2023-10-05T14:53:51.398 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T14:53:51.398 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969 --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} --owner scheduled_vshankar@teuthology --verbose -- /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/orig.config.yaml 2023-10-05T14:53:51.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T14:53:51.533 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969 branch: wip-61009-wo-1 description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} email: vshankar@redhat.com first_in_suite: false job_id: '7411969' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-61009-wo-1 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_client_delegate_inos_pct: 50 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-61009-wo-1 sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2223 sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f sleep_before_teardown: 0 subset: 328/1024 suite: fs:workload suite_branch: wip-61009-wo-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_14:37:31 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-05T14:53:51.534 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa; will attempt to use it 2023-10-05T14:53:51.534 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks 2023-10-05T14:53:51.534 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-05T14:53:51.536 INFO:teuthology.task.internal:Checking packages... 2023-10-05T14:53:51.559 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f' 2023-10-05T14:53:51.559 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-05T14:53:51.559 INFO:teuthology.packaging:ref: None 2023-10-05T14:53:51.559 INFO:teuthology.packaging:tag: None 2023-10-05T14:53:51.559 INFO:teuthology.packaging:branch: wip-61009-wo-1 2023-10-05T14:53:51.559 INFO:teuthology.packaging:sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T14:53:51.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-61009-wo-1 2023-10-05T14:53:51.700 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6578.g689b3d5a 2023-10-05T14:53:51.700 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-05T14:53:51.707 INFO:teuthology.task.internal:no buildpackages task found 2023-10-05T14:53:51.707 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-05T14:53:51.730 INFO:teuthology.task.internal:Saving configuration 2023-10-05T14:53:51.751 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-05T14:53:51.758 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T14:53:51.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:48:44.149463', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T14:53:51.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:48:44.146424', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T14:53:51.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:48:44.148153', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T14:53:51.827 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-05T14:53:51.833 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-05T14:53:51.833 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-05T14:53:51.833 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-05T14:53:51.833 INFO:teuthology.run_tasks:Running task console_log... 2023-10-05T14:53:51.924 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdea04baaf0>, signals=[15]) 2023-10-05T14:53:51.925 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-05T14:53:51.931 INFO:teuthology.task.internal:Opening connections... 2023-10-05T14:53:51.931 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T14:53:51.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T14:53:52.001 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-10-05T14:53:52.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T14:53:52.068 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-10-05T14:53:52.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T14:53:52.134 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-05T14:53:52.141 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-10-05T14:53:52.164 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-10-05T14:53:52.164 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-10-05T14:53:52.223 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T14:53:52.223 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-10-05T14:53:52.223 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-10-05T14:53:52.223 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-10-05T14:53:52.223 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T14:53:52.224 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-05T14:53:52.225 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-10-05T14:53:52.263 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-05T14:53:52.283 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-05T14:53:52.283 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-05T14:53:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T14:53:52.344 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-05T14:53:52.344 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-05T14:53:52.379 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-10-05T14:53:52.399 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-10-05T14:53:52.399 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-05T14:53:52.459 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T14:53:52.460 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-05T14:53:52.461 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-05T14:53:52.487 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-05T14:53:52.497 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-05T14:53:52.506 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-05T14:53:52.506 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-10-05T14:53:52.508 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-10-05T14:53:52.511 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-10-05T14:53:52.529 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-05T14:53:52.535 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-05T14:53:52.535 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-10-05T14:53:52.568 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-10-05T14:53:52.570 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-10-05T14:53:52.611 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-05T14:53:52.687 INFO:teuthology.run_tasks:Running task kernel... 2023-10-05T14:53:52.701 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-05T14:53:52.701 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-05T14:53:52.702 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-05T14:53:52.702 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T14:53:52.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T14:53:52.721 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-05T14:53:52.782 INFO:teuthology.orchestra.run.smithi060.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-05T14:53:52.782 INFO:teuthology.task.kernel:Running kernel on smithi060: 4.18.0-372.9.1.el8.x86_64 2023-10-05T14:53:52.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2023-10-05T14:53:54.076 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T14:53:54.077 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-05T14:53:55.582 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-05T14:53:56.316 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-05T14:54:00.000 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-10-05T14:54:00.761 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-05T14:54:00.808 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-05T14:54:00.810 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-05T14:54:00.810 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-05T14:54:00.924 DEBUG:teuthology.orchestra.run.smithi060:> echo no | sudo yum reinstall kernel || true 2023-10-05T14:54:01.273 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T14:54:01.274 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-05T14:54:01.547 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:02 ago on Thu 05 Oct 2023 02:53:59 PM UTC. 2023-10-05T14:54:01.590 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-05T14:54:01.633 INFO:teuthology.orchestra.run.smithi060.stderr:Error: No packages marked for reinstall. 2023-10-05T14:54:01.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum reinstall -y kernel || true 2023-10-05T14:54:02.032 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T14:54:02.032 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-05T14:54:02.298 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:03 ago on Thu 05 Oct 2023 02:53:59 PM UTC. 2023-10-05T14:54:02.343 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-05T14:54:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:Error: No packages marked for reinstall. 2023-10-05T14:54:02.424 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T14:54:02.506 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-05T14:54:02.507 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-05T14:54:02.507 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-05T14:54:02.508 DEBUG:teuthology.parallel:result is None 2023-10-05T14:54:02.508 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-05T14:54:02.516 INFO:teuthology.task.internal:Creating test directory... 2023-10-05T14:54:02.516 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T14:54:02.518 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T14:54:02.521 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T14:54:02.543 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-05T14:54:02.550 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-05T14:54:02.558 INFO:teuthology.task.internal:Creating archive directory... 2023-10-05T14:54:02.558 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T14:54:02.575 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T14:54:02.582 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T14:54:02.622 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-05T14:54:02.629 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-05T14:54:02.629 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T14:54:02.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T14:54:02.674 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T14:54:02.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T14:54:02.692 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T14:54:02.694 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T14:54:02.717 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T14:54:02.729 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T14:54:02.740 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T14:54:02.752 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T14:54:02.773 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T14:54:02.787 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T14:54:02.804 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T14:54:02.805 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-05T14:54:02.813 INFO:teuthology.task.internal:Configuring sudo... 2023-10-05T14:54:02.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T14:54:02.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T14:54:02.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T14:54:02.848 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-05T14:54:02.856 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-05T14:54:02.857 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T14:54:02.884 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T14:54:02.890 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T14:54:02.907 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T14:54:02.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T14:54:03.033 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T14:54:03.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T14:54:03.159 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T14:54:03.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T14:54:03.228 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T14:54:03.275 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T14:54:03.331 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T14:54:03.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T14:54:03.461 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T14:54:03.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T14:54:03.532 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T14:54:03.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T14:54:03.634 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T14:54:03.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T14:54:03.770 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T14:54:03.770 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T14:54:03.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-10-05T14:54:03.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-10-05T14:54:03.846 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-10-05T14:54:03.899 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T14:54:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T14:54:03.939 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T14:54:04.345 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-05T14:54:04.353 INFO:teuthology.task.internal:Starting timer... 2023-10-05T14:54:04.354 INFO:teuthology.run_tasks:Running task pcp... 2023-10-05T14:54:04.363 INFO:teuthology.run_tasks:Running task selinux... 2023-10-05T14:54:04.371 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-05T14:54:04.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2023-10-05T14:54:04.428 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2023-10-05T14:54:04.430 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-10-05T14:54:04.502 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-10-05T14:54:04.504 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-10-05T14:54:04.563 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2023-10-05T14:54:04.565 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-05T14:54:04.565 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2023-10-05T14:54:04.590 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2023-10-05T14:54:04.590 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-10-05T14:54:04.616 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-10-05T14:54:04.616 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-10-05T14:54:04.636 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-10-05T14:54:04.636 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-10-05T14:54:04.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T14:54:04.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T14:54:04.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T14:54:04.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T14:54:04.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T14:54:04.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T14:54:04.721 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-05T14:54:04.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2023-10-05T14:54:04.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-10-05T14:54:04.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-10-05T14:54:04.818 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-05T14:54:04.827 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-05T14:54:04.832 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-05T14:54:04.955 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-05T14:54:04.967 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-05T14:54:04.968 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi092.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-05T15:03:25.947 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-10-05T15:03:25.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-05T15:03:25.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:03:26.018 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-05T15:03:26.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-05T15:03:26.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-05T15:03:26.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:03:26.162 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-05T15:03:26.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-05T15:03:26.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-05T15:03:26.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:03:26.298 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-05T15:03:26.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-05T15:03:26.373 INFO:teuthology.run_tasks:Running task clock... 2023-10-05T15:03:26.383 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-05T15:03:26.383 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T15:03:26.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T15:03:26.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:03:26.392 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T15:03:26.392 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:03:26.419 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T15:03:26.422 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T15:03:26.435 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T15:03:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T15:03:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T15:03:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T15:03:26.511 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2023-10-05T15:03:26.524 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2023-10-05T15:03:26.540 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T15:03:26.542 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-10-05T15:03:26.554 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T15:03:26.555 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-10-05T15:03:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T15:03:26.584 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T15:03:26.630 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-05T15:03:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:03:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-05T15:03:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.634 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.634 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.634 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.665 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-10-05T15:03:26.668 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:03:26.668 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-10-05T15:03:26.668 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.668 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.668 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.668 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.692 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-10-05T15:03:26.704 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-10-05T15:03:26.718 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T15:03:26.732 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T15:03:26.808 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-05T15:03:26.811 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:03:26.811 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-05T15:03:26.811 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.812 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.812 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.812 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:03:26.813 INFO:teuthology.run_tasks:Running task pexec... 2023-10-05T15:03:26.823 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-05T15:03:26.823 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:03:26.823 DEBUG:teuthology.orchestra.run.smithi060:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-05T15:03:26.824 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi092.front.sepia.ceph.com 2023-10-05T15:03:26.824 DEBUG:teuthology.orchestra.run.smithi092:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-05T15:03:26.824 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi135.front.sepia.ceph.com 2023-10-05T15:03:26.824 DEBUG:teuthology.orchestra.run.smithi135:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-05T15:03:27.196 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:27.218 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:27.223 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:28.005 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:48 ago on Thu 05 Oct 2023 03:01:39 PM UTC. 2023-10-05T15:03:28.054 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:52 ago on Thu 05 Oct 2023 03:01:35 PM UTC. 2023-10-05T15:03:28.080 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:32 ago on Thu 05 Oct 2023 03:01:55 PM UTC. 2023-10-05T15:03:29.748 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-05T15:03:29.749 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout:Resetting modules: 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-10-05T15:03:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:29.927 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-05T15:03:29.928 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-05T15:03:29.928 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-10-05T15:03:29.928 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-05T15:03:29.929 INFO:teuthology.orchestra.run.smithi092.stdout:Resetting modules: 2023-10-05T15:03:29.929 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools 2023-10-05T15:03:29.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:29.929 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-05T15:03:29.929 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-05T15:03:29.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:30.087 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout:Resetting modules: 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-05T15:03:30.088 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-05T15:03:30.089 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:30.734 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:51 ago on Thu 05 Oct 2023 03:01:39 PM UTC. 2023-10-05T15:03:30.874 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:55 ago on Thu 05 Oct 2023 03:01:35 PM UTC. 2023-10-05T15:03:31.081 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:35 ago on Thu 05 Oct 2023 03:01:55 PM UTC. 2023-10-05T15:03:33.677 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-05T15:03:33.834 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-05T15:03:34.156 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:34.159 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-05T15:03:34.303 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:34.643 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:34.973 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:55 ago on Thu 05 Oct 2023 03:01:39 PM UTC. 2023-10-05T15:03:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:59 ago on Thu 05 Oct 2023 03:01:35 PM UTC. 2023-10-05T15:03:35.536 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:40 ago on Thu 05 Oct 2023 03:01:55 PM UTC. 2023-10-05T15:03:36.689 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-05T15:03:36.780 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout:Installing group/module packages: 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-05T15:03:36.781 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout:Installing module profiles: 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools/common 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools rhel8 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-10-05T15:03:36.782 INFO:teuthology.orchestra.run.smithi135.stdout:Install 10 Packages 2023-10-05T15:03:36.783 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:36.783 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 18 M 2023-10-05T15:03:36.783 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 65 M 2023-10-05T15:03:36.783 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-10-05T15:03:36.841 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-05T15:03:36.907 INFO:teuthology.orchestra.run.smithi135.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 756 kB/s | 94 kB 00:00 2023-10-05T15:03:36.933 INFO:teuthology.orchestra.run.smithi135.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 166 kB/s | 25 kB 00:00 2023-10-05T15:03:36.933 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-05T15:03:36.933 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-05T15:03:36.933 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-05T15:03:36.933 INFO:teuthology.orchestra.run.smithi092.stdout:Installing group/module packages: 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-05T15:03:36.934 INFO:teuthology.orchestra.run.smithi092.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:Installing module profiles: 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools/common 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools rhel8 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:Install 10 Packages 2023-10-05T15:03:36.935 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 18 M 2023-10-05T15:03:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 65 M 2023-10-05T15:03:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-05T15:03:36.958 INFO:teuthology.orchestra.run.smithi135.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 233 kB/s | 41 kB 00:00 2023-10-05T15:03:36.983 INFO:teuthology.orchestra.run.smithi135.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 651 kB/s | 49 kB 00:00 2023-10-05T15:03:37.034 INFO:teuthology.orchestra.run.smithi135.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.1 MB/s | 524 kB 00:00 2023-10-05T15:03:37.034 INFO:teuthology.orchestra.run.smithi092.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 961 kB/s | 94 kB 00:00 2023-10-05T15:03:37.059 INFO:teuthology.orchestra.run.smithi092.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 202 kB/s | 25 kB 00:00 2023-10-05T15:03:37.084 INFO:teuthology.orchestra.run.smithi092.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 275 kB/s | 41 kB 00:00 2023-10-05T15:03:37.100 INFO:teuthology.orchestra.run.smithi135.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-05T15:03:37.109 INFO:teuthology.orchestra.run.smithi092.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-10-05T15:03:37.126 INFO:teuthology.orchestra.run.smithi135.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.3 MB/s | 213 kB 00:00 2023-10-05T15:03:37.143 INFO:teuthology.orchestra.run.smithi092.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-05T15:03:37.168 INFO:teuthology.orchestra.run.smithi092.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-05T15:03:37.194 INFO:teuthology.orchestra.run.smithi092.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.2 MB/s | 213 kB 00:00 2023-10-05T15:03:37.267 INFO:teuthology.orchestra.run.smithi135.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 16 MB/s | 2.2 MB 00:00 2023-10-05T15:03:37.302 INFO:teuthology.orchestra.run.smithi092.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-10-05T15:03:37.360 INFO:teuthology.orchestra.run.smithi135.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 20 MB/s | 8.0 MB 00:00 2023-10-05T15:03:37.411 INFO:teuthology.orchestra.run.smithi092.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 29 MB/s | 7.0 MB 00:00 2023-10-05T15:03:37.448 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-05T15:03:37.452 INFO:teuthology.orchestra.run.smithi135.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 20 MB/s | 7.0 MB 00:00 2023-10-05T15:03:37.452 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:03:37.453 INFO:teuthology.orchestra.run.smithi135.stdout:Total 27 MB/s | 18 MB 00:00 2023-10-05T15:03:37.503 INFO:teuthology.orchestra.run.smithi092.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 19 MB/s | 8.0 MB 00:00 2023-10-05T15:03:37.503 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:03:37.503 INFO:teuthology.orchestra.run.smithi092.stdout:Total 32 MB/s | 18 MB 00:00 2023-10-05T15:03:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================================================ 2023-10-05T15:03:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-05T15:03:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================================================ 2023-10-05T15:03:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:Installing group/module packages: 2023-10-05T15:03:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-05T15:03:37.555 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout:Installing module profiles: 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools/common 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:37.556 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-10-05T15:03:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools rhel8 2023-10-05T15:03:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:37.557 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-05T15:03:37.557 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================================================ 2023-10-05T15:03:37.557 INFO:teuthology.orchestra.run.smithi060.stdout:Install 10 Packages 2023-10-05T15:03:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:37.558 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 18 M 2023-10-05T15:03:37.558 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 65 M 2023-10-05T15:03:37.558 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-05T15:03:37.640 INFO:teuthology.orchestra.run.smithi060.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.1 MB/s | 94 kB 00:00 2023-10-05T15:03:37.653 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-10-05T15:03:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 228 kB/s | 25 kB 00:00 2023-10-05T15:03:37.671 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-10-05T15:03:37.672 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-10-05T15:03:37.691 INFO:teuthology.orchestra.run.smithi060.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 304 kB/s | 41 kB 00:00 2023-10-05T15:03:37.702 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-05T15:03:37.716 INFO:teuthology.orchestra.run.smithi060.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-10-05T15:03:37.721 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-05T15:03:37.721 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-05T15:03:37.750 INFO:teuthology.orchestra.run.smithi060.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-05T15:03:37.775 INFO:teuthology.orchestra.run.smithi060.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-05T15:03:37.800 INFO:teuthology.orchestra.run.smithi060.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-05T15:03:37.853 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-10-05T15:03:37.857 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-10-05T15:03:37.902 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-05T15:03:37.906 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-05T15:03:38.043 INFO:teuthology.orchestra.run.smithi060.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 9.1 MB/s | 2.2 MB 00:00 2023-10-05T15:03:38.167 INFO:teuthology.orchestra.run.smithi060.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 18 MB/s | 7.0 MB 00:00 2023-10-05T15:03:38.259 INFO:teuthology.orchestra.run.smithi060.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 14 MB/s | 8.0 MB 00:00 2023-10-05T15:03:38.260 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:03:38.260 INFO:teuthology.orchestra.run.smithi060.stdout:Total 26 MB/s | 18 MB 00:00 2023-10-05T15:03:38.384 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-10-05T15:03:38.447 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-05T15:03:38.469 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-05T15:03:38.489 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-05T15:03:38.489 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-05T15:03:38.604 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-05T15:03:38.627 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-05T15:03:38.685 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-05T15:03:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-05T15:03:38.759 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:03:38.785 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:03:38.986 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-05T15:03:38.987 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-05T15:03:39.174 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-05T15:03:39.198 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-05T15:03:39.329 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-05T15:03:39.514 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-05T15:03:39.535 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-05T15:03:39.571 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-05T15:03:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:03:39.927 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-05T15:03:40.268 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-05T15:03:40.274 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-05T15:03:40.358 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-05T15:03:40.620 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-05T15:03:41.150 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-05T15:03:41.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-05T15:03:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-05T15:03:41.465 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-05T15:03:41.515 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-05T15:03:41.525 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-05T15:03:41.692 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-05T15:03:41.694 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:03:41.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:03:41.965 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:03:41.965 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-05T15:03:41.965 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:03:41.965 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-05T15:03:41.965 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-05T15:03:41.965 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-05T15:03:41.966 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-05T15:03:41.966 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-05T15:03:41.966 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-05T15:03:41.966 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-05T15:03:42.159 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-05T15:03:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-05T15:03:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-05T15:03:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-05T15:03:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-05T15:03:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:03:43.076 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-05T15:03:43.076 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:07 ago on Thu 05 Oct 2023 03:01:35 PM UTC. 2023-10-05T15:03:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:03:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-05T15:03:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-05T15:03:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-05T15:03:43.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-05T15:03:43.353 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:03 ago on Thu 05 Oct 2023 03:01:39 PM UTC. 2023-10-05T15:03:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-05T15:03:44.425 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:48 ago on Thu 05 Oct 2023 03:01:55 PM UTC. 2023-10-05T15:03:47.774 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-05T15:03:47.974 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:47.974 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-05T15:03:47.974 INFO:teuthology.orchestra.run.smithi092.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:47.974 INFO:teuthology.orchestra.run.smithi092.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:03:47.975 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-05T15:03:48.095 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-10-05T15:03:48.107 DEBUG:teuthology.parallel:result is None 2023-10-05T15:03:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:48.291 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-05T15:03:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:03:48.293 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-05T15:03:48.452 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-05T15:03:48.471 DEBUG:teuthology.parallel:result is None 2023-10-05T15:03:48.664 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:48.664 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:03:48.665 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-05T15:03:48.817 DEBUG:teuthology.parallel:result is None 2023-10-05T15:03:48.817 INFO:teuthology.run_tasks:Running task install... 2023-10-05T15:03:48.826 DEBUG:teuthology.task.install:project ceph 2023-10-05T15:03:48.827 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f'}} 2023-10-05T15:03:48.827 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f'} 2023-10-05T15:03:48.827 INFO:teuthology.task.install:Using flavor: default 2023-10-05T15:03:48.833 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-05T15:03:48.833 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-05T15:03:48.834 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'tag': None, 'wait_for_package': False} 2023-10-05T15:03:48.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:03:48.836 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'tag': None, 'wait_for_package': False} 2023-10-05T15:03:48.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:03:48.837 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'tag': None, 'wait_for_package': False} 2023-10-05T15:03:48.838 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:03:49.084 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/ 2023-10-05T15:03:49.084 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6578.g689b3d5a 2023-10-05T15:03:49.089 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/ 2023-10-05T15:03:49.089 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6578.g689b3d5a 2023-10-05T15:03:49.097 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/ 2023-10-05T15:03:49.097 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6578.g689b3d5a 2023-10-05T15:03:49.393 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T15:03:49.394 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:03:49.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T15:03:49.425 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-05T15:03:49.426 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T15:03:49.464 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T15:03:49.464 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:03:49.465 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T15:03:49.470 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T15:03:49.471 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:03:49.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T15:03:49.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T15:03:49.498 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-05T15:03:49.498 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T15:03:49.503 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-05T15:03:49.503 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T15:03:49.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T15:03:49.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T15:03:49.580 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T15:03:49.649 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2023-10-05T15:03:49.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2023-10-05T15:03:49.652 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T15:03:49.653 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T15:03:49.720 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-10-05T15:03:49.721 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-10-05T15:03:49.722 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-10-05T15:03:49.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-10-05T15:03:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:50.095 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:50.097 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:50.866 INFO:teuthology.orchestra.run.smithi060.stdout:44 files removed 2023-10-05T15:03:50.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-05T15:03:50.930 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-10-05T15:03:50.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-05T15:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout:44 files removed 2023-10-05T15:03:51.179 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-05T15:03:51.268 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:51.309 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:51.511 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:53.146 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 92 kB/s | 81 kB 00:00 2023-10-05T15:03:53.428 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 100 kB/s | 81 kB 00:00 2023-10-05T15:03:53.513 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 91 kB/s | 81 kB 00:00 2023-10-05T15:03:53.788 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-10-05T15:03:54.112 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-10-05T15:03:54.172 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-10-05T15:03:54.472 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-10-05T15:03:54.622 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-05T15:03:54.788 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-10-05T15:03:54.947 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-05T15:03:54.974 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 1.9 kB/s | 1.5 kB 00:00 2023-10-05T15:03:55.158 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-05T15:03:56.400 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-05T15:03:57.442 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 16 MB 00:02 2023-10-05T15:03:57.707 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 16 MB 00:03 2023-10-05T15:03:59.980 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 284 kB/s | 24 kB 00:00 2023-10-05T15:04:00.968 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 445 kB/s | 24 kB 00:00 2023-10-05T15:04:01.157 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-10-05T15:04:01.424 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 435 kB/s | 24 kB 00:00 2023-10-05T15:04:02.145 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-10-05T15:04:02.684 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 53 MB 00:01 2023-10-05T15:04:09.274 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-10-05T15:04:10.763 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 MB/s | 47 MB 00:01 2023-10-05T15:04:11.643 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 MB/s | 47 MB 00:01 2023-10-05T15:04:20.386 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:04:20.387 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:04:20.401 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-05T15:04:20.402 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-05T15:04:20.403 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-05T15:04:20.404 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-05T15:04:20.406 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-05T15:04:20.410 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-05T15:04:20.411 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-05T15:04:20.541 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-05T15:04:20.553 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-05T15:04:20.553 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-05T15:04:20.553 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.4 k 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 5.4 M 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 918 k 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 167 k 2023-10-05T15:04:20.554 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 1.6 M 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 132 k 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 1.8 M 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 7.4 M 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 47 k 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 14 M 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 49 M 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 261 k 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 184 k 2023-10-05T15:04:20.555 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 261 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 18 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 31 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 840 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 139 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-05T15:04:20.556 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 197 k 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 371 k 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 364 k 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 106 k 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 94 k 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.6 M 2023-10-05T15:04:20.557 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 180 k 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 23 M 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 23 k 2023-10-05T15:04:20.558 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 2.3 M 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 242 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 4.6 M 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 18 M 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 15 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 24 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-05T15:04:20.559 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 184 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 518 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.9 M 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-05T15:04:20.560 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-05T15:04:20.561 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-05T15:04:20.562 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-05T15:04:20.562 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T15:04:20.562 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-05T15:04:20.562 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T15:04:20.562 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 45 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 125 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T15:04:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-05T15:04:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:04:20.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T15:04:20.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql 10 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-05T15:04:20.567 INFO:teuthology.orchestra.run.smithi092.stdout:Install 128 Packages 2023-10-05T15:04:20.568 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 3 Packages 2023-10-05T15:04:20.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:04:20.568 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 209 M 2023-10-05T15:04:20.568 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-05T15:04:20.857 INFO:teuthology.orchestra.run.smithi092.stdout:(1/131): ceph-18.0.0-6578.g689b3d5a.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-10-05T15:04:21.099 INFO:teuthology.orchestra.run.smithi092.stdout:(2/131): ceph-fuse-18.0.0-6578.g689b3d5a.el8.x8 3.7 MB/s | 918 kB 00:00 2023-10-05T15:04:21.166 INFO:teuthology.orchestra.run.smithi092.stdout:(3/131): ceph-immutable-object-cache-18.0.0-657 2.5 MB/s | 167 kB 00:00 2023-10-05T15:04:21.233 INFO:teuthology.orchestra.run.smithi092.stdout:(4/131): ceph-base-18.0.0-6578.g689b3d5a.el8.x8 11 MB/s | 5.4 MB 00:00 2023-10-05T15:04:21.383 INFO:teuthology.orchestra.run.smithi092.stdout:(5/131): ceph-mds-18.0.0-6578.g689b3d5a.el8.x86 11 MB/s | 2.3 MB 00:00 2023-10-05T15:04:21.416 INFO:teuthology.orchestra.run.smithi092.stdout:(6/131): ceph-mgr-18.0.0-6578.g689b3d5a.el8.x86 8.9 MB/s | 1.6 MB 00:00 2023-10-05T15:04:21.675 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:04:21.676 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:04:21.690 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-05T15:04:21.691 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-05T15:04:21.692 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-05T15:04:21.693 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-05T15:04:21.695 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-05T15:04:21.698 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-05T15:04:21.699 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-05T15:04:21.831 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-05T15:04:21.842 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-10-05T15:04:21.842 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-10-05T15:04:21.842 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.4 k 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 5.4 M 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 918 k 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 167 k 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 1.6 M 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 132 k 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 1.8 M 2023-10-05T15:04:21.843 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 7.4 M 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 47 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 14 M 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 49 M 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 261 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 184 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 261 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 18 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-05T15:04:21.844 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 31 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 840 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 139 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 197 k 2023-10-05T15:04:21.845 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 371 k 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 364 k 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 106 k 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 94 k 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.6 M 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 180 k 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-05T15:04:21.846 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 23 M 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 23 k 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 2.3 M 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 242 k 2023-10-05T15:04:21.847 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 4.6 M 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 18 M 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 15 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 24 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 184 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-05T15:04:21.848 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 518 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.9 M 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-05T15:04:21.849 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 45 k 2023-10-05T15:04:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 125 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-05T15:04:21.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-05T15:04:21.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T15:04:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T15:04:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-10-05T15:04:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql 10 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout:Install 128 Packages 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 3 Packages 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:04:21.856 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 209 M 2023-10-05T15:04:21.857 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-10-05T15:04:22.050 INFO:teuthology.orchestra.run.smithi092.stdout:(7/131): ceph-mon-18.0.0-6578.g689b3d5a.el8.x86 6.9 MB/s | 4.6 MB 00:00 2023-10-05T15:04:22.290 INFO:teuthology.orchestra.run.smithi135.stdout:(1/131): ceph-18.0.0-6578.g689b3d5a.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-10-05T15:04:23.140 INFO:teuthology.orchestra.run.smithi135.stdout:(2/131): ceph-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.1 MB/s | 918 kB 00:00 2023-10-05T15:04:23.209 INFO:teuthology.orchestra.run.smithi092.stdout:(8/131): ceph-osd-18.0.0-6578.g689b3d5a.el8.x86 10 MB/s | 18 MB 00:01 2023-10-05T15:04:23.224 INFO:teuthology.orchestra.run.smithi135.stdout:(3/131): ceph-immutable-object-cache-18.0.0-657 2.0 MB/s | 167 kB 00:00 2023-10-05T15:04:23.317 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:04:23.318 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:04:23.334 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-05T15:04:23.335 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-05T15:04:23.336 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-05T15:04:23.337 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-05T15:04:23.339 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-05T15:04:23.343 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-05T15:04:23.344 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-05T15:04:23.359 INFO:teuthology.orchestra.run.smithi092.stdout:(9/131): ceph-radosgw-18.0.0-6578.g689b3d5a.el8 11 MB/s | 14 MB 00:01 2023-10-05T15:04:23.384 INFO:teuthology.orchestra.run.smithi092.stdout:(10/131): ceph-selinux-18.0.0-6578.g689b3d5a.el 139 kB/s | 24 kB 00:00 2023-10-05T15:04:23.460 INFO:teuthology.orchestra.run.smithi092.stdout:(11/131): cephfs-mirror-18.0.0-6578.g689b3d5a.e 3.4 MB/s | 261 kB 00:00 2023-10-05T15:04:23.491 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-05T15:04:23.504 INFO:teuthology.orchestra.run.smithi060.stdout:=========================================================================================================================== 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout:=========================================================================================================================== 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.4 k 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 5.4 M 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 918 k 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 167 k 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 1.6 M 2023-10-05T15:04:23.505 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 132 k 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 1.8 M 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 7.4 M 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 47 k 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 14 M 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 49 M 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 261 k 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 184 k 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 261 k 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 18 k 2023-10-05T15:04:23.506 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 31 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 840 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 139 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-05T15:04:23.507 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 197 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 371 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 364 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 106 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 94 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.6 M 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 180 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-05T15:04:23.508 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 23 M 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 23 k 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 2.3 M 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 242 k 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 4.6 M 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 18 M 2023-10-05T15:04:23.509 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 15 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 24 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 184 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T15:04:23.510 INFO:teuthology.orchestra.run.smithi060.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 518 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.9 M 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T15:04:23.511 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T15:04:23.512 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 45 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 125 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T15:04:23.513 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-05T15:04:23.514 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-05T15:04:23.515 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T15:04:23.515 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T15:04:23.515 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-05T15:04:23.515 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-05T15:04:23.515 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-05T15:04:23.515 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T15:04:23.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T15:04:23.517 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql 10 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout:=========================================================================================================================== 2023-10-05T15:04:23.518 INFO:teuthology.orchestra.run.smithi060.stdout:Install 128 Packages 2023-10-05T15:04:23.519 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 3 Packages 2023-10-05T15:04:23.519 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:04:23.519 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 209 M 2023-10-05T15:04:23.520 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-05T15:04:23.534 INFO:teuthology.orchestra.run.smithi092.stdout:(12/131): libcephfs-devel-18.0.0-6578.g689b3d5a 413 kB/s | 31 kB 00:00 2023-10-05T15:04:23.643 INFO:teuthology.orchestra.run.smithi092.stdout:(13/131): libcephfs2-18.0.0-6578.g689b3d5a.el8. 7.6 MB/s | 840 kB 00:00 2023-10-05T15:04:23.719 INFO:teuthology.orchestra.run.smithi092.stdout:(14/131): libcephsqlite-18.0.0-6578.g689b3d5a.e 2.4 MB/s | 184 kB 00:00 2023-10-05T15:04:23.799 INFO:teuthology.orchestra.run.smithi135.stdout:(4/131): ceph-mds-18.0.0-6578.g689b3d5a.el8.x86 4.0 MB/s | 2.3 MB 00:00 2023-10-05T15:04:23.802 INFO:teuthology.orchestra.run.smithi092.stdout:(15/131): librados-devel-18.0.0-6578.g689b3d5a. 1.6 MB/s | 139 kB 00:00 2023-10-05T15:04:23.894 INFO:teuthology.orchestra.run.smithi092.stdout:(16/131): libradosstriper1-18.0.0-6578.g689b3d5 5.5 MB/s | 518 kB 00:00 2023-10-05T15:04:23.961 INFO:teuthology.orchestra.run.smithi060.stdout:(1/131): ceph-18.0.0-6578.g689b3d5a.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-10-05T15:04:24.374 INFO:teuthology.orchestra.run.smithi135.stdout:(5/131): ceph-mgr-18.0.0-6578.g689b3d5a.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-10-05T15:04:24.769 INFO:teuthology.orchestra.run.smithi092.stdout:(17/131): librgw2-18.0.0-6578.g689b3d5a.el8.x86 7.9 MB/s | 6.9 MB 00:00 2023-10-05T15:04:24.845 INFO:teuthology.orchestra.run.smithi092.stdout:(18/131): python3-ceph-argparse-18.0.0-6578.g68 597 kB/s | 45 kB 00:00 2023-10-05T15:04:24.894 INFO:teuthology.orchestra.run.smithi060.stdout:(2/131): ceph-fuse-18.0.0-6578.g689b3d5a.el8.x8 984 kB/s | 918 kB 00:00 2023-10-05T15:04:24.928 INFO:teuthology.orchestra.run.smithi092.stdout:(19/131): python3-ceph-common-18.0.0-6578.g689b 1.5 MB/s | 125 kB 00:00 2023-10-05T15:04:25.028 INFO:teuthology.orchestra.run.smithi092.stdout:(20/131): python3-cephfs-18.0.0-6578.g689b3d5a. 1.9 MB/s | 197 kB 00:00 2023-10-05T15:04:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:(3/131): ceph-immutable-object-cache-18.0.0-657 1.0 MB/s | 167 kB 00:00 2023-10-05T15:04:25.137 INFO:teuthology.orchestra.run.smithi092.stdout:(21/131): python3-rados-18.0.0-6578.g689b3d5a.e 3.3 MB/s | 371 kB 00:00 2023-10-05T15:04:25.246 INFO:teuthology.orchestra.run.smithi092.stdout:(22/131): python3-rbd-18.0.0-6578.g689b3d5a.el8 3.3 MB/s | 364 kB 00:00 2023-10-05T15:04:25.346 INFO:teuthology.orchestra.run.smithi092.stdout:(23/131): python3-rgw-18.0.0-6578.g689b3d5a.el8 1.0 MB/s | 106 kB 00:00 2023-10-05T15:04:25.505 INFO:teuthology.orchestra.run.smithi092.stdout:(24/131): rbd-fuse-18.0.0-6578.g689b3d5a.el8.x8 591 kB/s | 94 kB 00:00 2023-10-05T15:04:25.917 INFO:teuthology.orchestra.run.smithi135.stdout:(6/131): ceph-mon-18.0.0-6578.g689b3d5a.el8.x86 3.0 MB/s | 4.6 MB 00:01 2023-10-05T15:04:26.065 INFO:teuthology.orchestra.run.smithi135.stdout:(7/131): ceph-base-18.0.0-6578.g689b3d5a.el8.x8 1.3 MB/s | 5.4 MB 00:04 2023-10-05T15:04:26.131 INFO:teuthology.orchestra.run.smithi092.stdout:(25/131): rbd-mirror-18.0.0-6578.g689b3d5a.el8. 5.7 MB/s | 3.6 MB 00:00 2023-10-05T15:04:26.137 INFO:teuthology.orchestra.run.smithi060.stdout:(4/131): ceph-mds-18.0.0-6578.g689b3d5a.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-05T15:04:26.223 INFO:teuthology.orchestra.run.smithi092.stdout:(26/131): rbd-nbd-18.0.0-6578.g689b3d5a.el8.x86 1.9 MB/s | 180 kB 00:00 2023-10-05T15:04:26.339 INFO:teuthology.orchestra.run.smithi092.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6578.g 198 kB/s | 23 kB 00:00 2023-10-05T15:04:26.457 INFO:teuthology.orchestra.run.smithi092.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6578.g689b3d5 1.1 MB/s | 132 kB 00:00 2023-10-05T15:04:26.820 INFO:teuthology.orchestra.run.smithi060.stdout:(5/131): ceph-mgr-18.0.0-6578.g689b3d5a.el8.x86 2.4 MB/s | 1.6 MB 00:00 2023-10-05T15:04:26.840 INFO:teuthology.orchestra.run.smithi092.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6578.g689b3 4.6 MB/s | 1.8 MB 00:00 2023-10-05T15:04:26.925 INFO:teuthology.orchestra.run.smithi135.stdout:(8/131): ceph-common-18.0.0-6578.g689b3d5a.el8. 4.6 MB/s | 23 MB 00:04 2023-10-05T15:04:27.034 INFO:teuthology.orchestra.run.smithi135.stdout:(9/131): ceph-selinux-18.0.0-6578.g689b3d5a.el8 225 kB/s | 24 kB 00:00 2023-10-05T15:04:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:(6/131): ceph-mon-18.0.0-6578.g689b3d5a.el8.x86 3.2 MB/s | 4.6 MB 00:01 2023-10-05T15:04:28.665 INFO:teuthology.orchestra.run.smithi092.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 4.1 MB/s | 7.4 MB 00:01 2023-10-05T15:04:28.790 INFO:teuthology.orchestra.run.smithi092.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6578.g68 1.9 MB/s | 242 kB 00:00 2023-10-05T15:04:28.899 INFO:teuthology.orchestra.run.smithi092.stdout:(32/131): ceph-mgr-rook-18.0.0-6578.g689b3d5a.e 438 kB/s | 47 kB 00:00 2023-10-05T15:04:29.007 INFO:teuthology.orchestra.run.smithi092.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6578.g6 134 kB/s | 15 kB 00:00 2023-10-05T15:04:29.141 INFO:teuthology.orchestra.run.smithi092.stdout:(34/131): ceph-volume-18.0.0-6578.g689b3d5a.el8 1.9 MB/s | 261 kB 00:00 2023-10-05T15:04:29.283 INFO:teuthology.orchestra.run.smithi092.stdout:(35/131): cephadm-18.0.0-6578.g689b3d5a.el8.noa 1.3 MB/s | 184 kB 00:00 2023-10-05T15:04:29.375 INFO:teuthology.orchestra.run.smithi092.stdout:(36/131): cephfs-top-18.0.0-6578.g689b3d5a.el8. 198 kB/s | 18 kB 00:00 2023-10-05T15:04:29.933 INFO:teuthology.orchestra.run.smithi092.stdout:(37/131): ceph-test-18.0.0-6578.g689b3d5a.el8.x 7.4 MB/s | 49 MB 00:06 2023-10-05T15:04:30.054 INFO:teuthology.orchestra.run.smithi060.stdout:(7/131): ceph-base-18.0.0-6578.g689b3d5a.el8.x8 869 kB/s | 5.4 MB 00:06 2023-10-05T15:04:30.125 INFO:teuthology.orchestra.run.smithi092.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 408 kB/s | 306 kB 00:00 2023-10-05T15:04:30.259 INFO:teuthology.orchestra.run.smithi092.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 563 kB/s | 75 kB 00:00 2023-10-05T15:04:30.292 INFO:teuthology.orchestra.run.smithi135.stdout:(10/131): ceph-osd-18.0.0-6578.g689b3d5a.el8.x8 4.1 MB/s | 18 MB 00:04 2023-10-05T15:04:30.309 INFO:teuthology.orchestra.run.smithi092.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 157 kB/s | 59 kB 00:00 2023-10-05T15:04:30.409 INFO:teuthology.orchestra.run.smithi135.stdout:(11/131): cephfs-mirror-18.0.0-6578.g689b3d5a.e 2.2 MB/s | 261 kB 00:00 2023-10-05T15:04:30.434 INFO:teuthology.orchestra.run.smithi092.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 349 kB/s | 44 kB 00:00 2023-10-05T15:04:30.468 INFO:teuthology.orchestra.run.smithi135.stdout:(12/131): libcephfs-devel-18.0.0-6578.g689b3d5a 532 kB/s | 31 kB 00:00 2023-10-05T15:04:30.568 INFO:teuthology.orchestra.run.smithi092.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-10-05T15:04:30.685 INFO:teuthology.orchestra.run.smithi135.stdout:(13/131): libcephfs2-18.0.0-6578.g689b3d5a.el8. 3.8 MB/s | 840 kB 00:00 2023-10-05T15:04:30.719 INFO:teuthology.orchestra.run.smithi092.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 652 kB/s | 185 kB 00:00 2023-10-05T15:04:30.752 INFO:teuthology.orchestra.run.smithi135.stdout:(14/131): libcephsqlite-18.0.0-6578.g689b3d5a.e 2.7 MB/s | 184 kB 00:00 2023-10-05T15:04:30.760 INFO:teuthology.orchestra.run.smithi092.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 177 kB/s | 33 kB 00:00 2023-10-05T15:04:30.819 INFO:teuthology.orchestra.run.smithi135.stdout:(15/131): librados-devel-18.0.0-6578.g689b3d5a. 2.0 MB/s | 139 kB 00:00 2023-10-05T15:04:30.836 INFO:teuthology.orchestra.run.smithi092.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2023-10-05T15:04:30.878 INFO:teuthology.orchestra.run.smithi092.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-05T15:04:30.953 INFO:teuthology.orchestra.run.smithi135.stdout:(16/131): libradosstriper1-18.0.0-6578.g689b3d5 3.8 MB/s | 518 kB 00:00 2023-10-05T15:04:31.003 INFO:teuthology.orchestra.run.smithi092.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 650 kB/s | 81 kB 00:00 2023-10-05T15:04:31.062 INFO:teuthology.orchestra.run.smithi092.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-10-05T15:04:31.112 INFO:teuthology.orchestra.run.smithi092.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-10-05T15:04:31.179 INFO:teuthology.orchestra.run.smithi092.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-10-05T15:04:31.304 INFO:teuthology.orchestra.run.smithi092.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-10-05T15:04:31.363 INFO:teuthology.orchestra.run.smithi092.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 4.7 MB/s | 1.2 MB 00:00 2023-10-05T15:04:31.413 INFO:teuthology.orchestra.run.smithi092.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2023-10-05T15:04:31.489 INFO:teuthology.orchestra.run.smithi092.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2023-10-05T15:04:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-05T15:04:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-05T15:04:31.698 INFO:teuthology.orchestra.run.smithi092.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 224 kB/s | 34 kB 00:00 2023-10-05T15:04:31.723 INFO:teuthology.orchestra.run.smithi092.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-05T15:04:31.815 INFO:teuthology.orchestra.run.smithi092.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 549 kB/s | 64 kB 00:00 2023-10-05T15:04:32.015 INFO:teuthology.orchestra.run.smithi092.stdout:(60/131): ceph-common-18.0.0-6578.g689b3d5a.el8 2.0 MB/s | 23 MB 00:11 2023-10-05T15:04:32.057 INFO:teuthology.orchestra.run.smithi092.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 56 kB/s | 19 kB 00:00 2023-10-05T15:04:32.074 INFO:teuthology.orchestra.run.smithi092.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 92 kB/s | 24 kB 00:00 2023-10-05T15:04:32.199 INFO:teuthology.orchestra.run.smithi092.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 220 kB/s | 27 kB 00:00 2023-10-05T15:04:32.225 INFO:teuthology.orchestra.run.smithi092.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-10-05T15:04:32.270 INFO:teuthology.orchestra.run.smithi135.stdout:(17/131): librgw2-18.0.0-6578.g689b3d5a.el8.x86 5.3 MB/s | 6.9 MB 00:01 2023-10-05T15:04:32.291 INFO:teuthology.orchestra.run.smithi092.stdout:(65/131): python3-tempora-1.14.1-5.el8.noarch.r 106 kB/s | 29 kB 00:00 2023-10-05T15:04:32.329 INFO:teuthology.orchestra.run.smithi135.stdout:(18/131): python3-ceph-argparse-18.0.0-6578.g68 767 kB/s | 45 kB 00:00 2023-10-05T15:04:32.333 INFO:teuthology.orchestra.run.smithi092.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.8 MB/s | 251 kB 00:00 2023-10-05T15:04:32.350 INFO:teuthology.orchestra.run.smithi092.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 488 kB/s | 61 kB 00:00 2023-10-05T15:04:32.388 INFO:teuthology.orchestra.run.smithi135.stdout:(19/131): python3-ceph-common-18.0.0-6578.g689b 2.1 MB/s | 125 kB 00:00 2023-10-05T15:04:32.404 INFO:teuthology.orchestra.run.smithi060.stdout:(8/131): ceph-osd-18.0.0-6578.g689b3d5a.el8.x86 4.3 MB/s | 18 MB 00:04 2023-10-05T15:04:32.442 INFO:teuthology.orchestra.run.smithi092.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-10-05T15:04:32.446 INFO:teuthology.orchestra.run.smithi135.stdout:(20/131): python3-cephfs-18.0.0-6578.g689b3d5a. 3.3 MB/s | 197 kB 00:00 2023-10-05T15:04:32.463 INFO:teuthology.orchestra.run.smithi060.stdout:(9/131): ceph-selinux-18.0.0-6578.g689b3d5a.el8 418 kB/s | 24 kB 00:00 2023-10-05T15:04:32.484 INFO:teuthology.orchestra.run.smithi092.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-10-05T15:04:32.509 INFO:teuthology.orchestra.run.smithi092.stdout:(70/131): python3-webtest-2.0.33-1.el8.noarch.r 392 kB/s | 85 kB 00:00 2023-10-05T15:04:32.686 INFO:teuthology.orchestra.run.smithi092.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 629 kB/s | 110 kB 00:00 2023-10-05T15:04:32.735 INFO:teuthology.orchestra.run.smithi092.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2023-10-05T15:04:32.819 INFO:teuthology.orchestra.run.smithi092.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 406 kB/s | 54 kB 00:00 2023-10-05T15:04:32.922 INFO:teuthology.orchestra.run.smithi135.stdout:(21/131): ceph-test-18.0.0-6578.g689b3d5a.el8.x 8.3 MB/s | 49 MB 00:05 2023-10-05T15:04:32.944 INFO:teuthology.orchestra.run.smithi092.stdout:(74/131): python3-scipy-1.0.0-21.module+el8.5.0 30 MB/s | 14 MB 00:00 2023-10-05T15:04:32.955 INFO:teuthology.orchestra.run.smithi135.stdout:(22/131): python3-rados-18.0.0-6578.g689b3d5a.e 730 kB/s | 371 kB 00:00 2023-10-05T15:04:32.970 INFO:teuthology.orchestra.run.smithi092.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-10-05T15:04:33.002 INFO:teuthology.orchestra.run.smithi092.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.7 MB/s | 323 kB 00:00 2023-10-05T15:04:33.089 INFO:teuthology.orchestra.run.smithi135.stdout:(23/131): ceph-radosgw-18.0.0-6578.g689b3d5a.el 2.0 MB/s | 14 MB 00:07 2023-10-05T15:04:33.103 INFO:teuthology.orchestra.run.smithi092.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 245 kB/s | 39 kB 00:00 2023-10-05T15:04:33.114 INFO:teuthology.orchestra.run.smithi135.stdout:(24/131): python3-rgw-18.0.0-6578.g689b3d5a.el8 671 kB/s | 106 kB 00:00 2023-10-05T15:04:33.140 INFO:teuthology.orchestra.run.smithi135.stdout:(25/131): python3-rbd-18.0.0-6578.g689b3d5a.el8 1.6 MB/s | 364 kB 00:00 2023-10-05T15:04:33.145 INFO:teuthology.orchestra.run.smithi092.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2023-10-05T15:04:33.179 INFO:teuthology.orchestra.run.smithi092.stdout:(79/131): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2023-10-05T15:04:33.181 INFO:teuthology.orchestra.run.smithi135.stdout:(26/131): rbd-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.0 MB/s | 94 kB 00:00 2023-10-05T15:04:33.204 INFO:teuthology.orchestra.run.smithi092.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-10-05T15:04:33.207 INFO:teuthology.orchestra.run.smithi135.stdout:(27/131): rbd-nbd-18.0.0-6578.g689b3d5a.el8.x86 2.6 MB/s | 180 kB 00:00 2023-10-05T15:04:33.240 INFO:teuthology.orchestra.run.smithi135.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6578.g 393 kB/s | 23 kB 00:00 2023-10-05T15:04:33.287 INFO:teuthology.orchestra.run.smithi092.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-05T15:04:33.299 INFO:teuthology.orchestra.run.smithi135.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6578.g689b3d5 1.4 MB/s | 132 kB 00:00 2023-10-05T15:04:33.371 INFO:teuthology.orchestra.run.smithi092.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 3.6 MB/s | 713 kB 00:00 2023-10-05T15:04:33.396 INFO:teuthology.orchestra.run.smithi092.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 244 kB/s | 27 kB 00:00 2023-10-05T15:04:33.488 INFO:teuthology.orchestra.run.smithi092.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-10-05T15:04:33.514 INFO:teuthology.orchestra.run.smithi092.stdout:(85/131): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-10-05T15:04:33.539 INFO:teuthology.orchestra.run.smithi092.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 309 kB/s | 44 kB 00:00 2023-10-05T15:04:33.647 INFO:teuthology.orchestra.run.smithi092.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-10-05T15:04:33.673 INFO:teuthology.orchestra.run.smithi092.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-10-05T15:04:33.725 INFO:teuthology.orchestra.run.smithi135.stdout:(30/131): rbd-mirror-18.0.0-6578.g689b3d5a.el8. 5.9 MB/s | 3.6 MB 00:00 2023-10-05T15:04:33.741 INFO:teuthology.orchestra.run.smithi092.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-05T15:04:33.773 INFO:teuthology.orchestra.run.smithi092.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 509 kB/s | 64 kB 00:00 2023-10-05T15:04:33.798 INFO:teuthology.orchestra.run.smithi092.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-05T15:04:33.800 INFO:teuthology.orchestra.run.smithi135.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6578.g68 3.2 MB/s | 242 kB 00:00 2023-10-05T15:04:33.832 INFO:teuthology.orchestra.run.smithi092.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 217 kB/s | 20 kB 00:00 2023-10-05T15:04:33.874 INFO:teuthology.orchestra.run.smithi092.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-10-05T15:04:33.875 INFO:teuthology.orchestra.run.smithi135.stdout:(32/131): ceph-mgr-dashboard-18.0.0-6578.g689b3 2.8 MB/s | 1.8 MB 00:00 2023-10-05T15:04:33.909 INFO:teuthology.orchestra.run.smithi135.stdout:(33/131): ceph-mgr-rook-18.0.0-6578.g689b3d5a.e 435 kB/s | 47 kB 00:00 2023-10-05T15:04:33.951 INFO:teuthology.orchestra.run.smithi135.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6578.g6 192 kB/s | 15 kB 00:00 2023-10-05T15:04:33.958 INFO:teuthology.orchestra.run.smithi092.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-05T15:04:33.976 INFO:teuthology.orchestra.run.smithi135.stdout:(35/131): ceph-volume-18.0.0-6578.g689b3d5a.el8 3.8 MB/s | 261 kB 00:00 2023-10-05T15:04:33.983 INFO:teuthology.orchestra.run.smithi092.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-10-05T15:04:34.035 INFO:teuthology.orchestra.run.smithi135.stdout:(36/131): cephadm-18.0.0-6578.g689b3d5a.el8.noa 2.2 MB/s | 184 kB 00:00 2023-10-05T15:04:34.061 INFO:teuthology.orchestra.run.smithi135.stdout:(37/131): cephfs-top-18.0.0-6578.g689b3d5a.el8. 216 kB/s | 18 kB 00:00 2023-10-05T15:04:34.083 INFO:teuthology.orchestra.run.smithi092.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-10-05T15:04:34.108 INFO:teuthology.orchestra.run.smithi092.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-10-05T15:04:34.161 INFO:teuthology.orchestra.run.smithi135.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 8.6 MB/s | 7.4 MB 00:00 2023-10-05T15:04:34.192 INFO:teuthology.orchestra.run.smithi092.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-10-05T15:04:34.267 INFO:teuthology.orchestra.run.smithi092.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-10-05T15:04:34.322 INFO:teuthology.orchestra.run.smithi060.stdout:(10/131): ceph-radosgw-18.0.0-6578.g689b3d5a.el 3.3 MB/s | 14 MB 00:04 2023-10-05T15:04:34.376 INFO:teuthology.orchestra.run.smithi092.stdout:(100/131): postgresql-server-10.21-2.module+el8 19 MB/s | 5.1 MB 00:00 2023-10-05T15:04:34.407 INFO:teuthology.orchestra.run.smithi060.stdout:(11/131): cephfs-mirror-18.0.0-6578.g689b3d5a.e 3.0 MB/s | 261 kB 00:00 2023-10-05T15:04:34.409 INFO:teuthology.orchestra.run.smithi092.stdout:(101/131): postgresql-contrib-10.21-2.module+el 3.6 MB/s | 808 kB 00:00 2023-10-05T15:04:34.451 INFO:teuthology.orchestra.run.smithi092.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 8.2 MB/s | 1.5 MB 00:00 2023-10-05T15:04:34.455 INFO:teuthology.orchestra.run.smithi060.stdout:(12/131): libcephfs-devel-18.0.0-6578.g689b3d5a 647 kB/s | 31 kB 00:00 2023-10-05T15:04:34.485 INFO:teuthology.orchestra.run.smithi092.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 431 kB/s | 47 kB 00:00 2023-10-05T15:04:34.543 INFO:teuthology.orchestra.run.smithi092.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-10-05T15:04:34.569 INFO:teuthology.orchestra.run.smithi092.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 363 kB/s | 43 kB 00:00 2023-10-05T15:04:34.595 INFO:teuthology.orchestra.run.smithi135.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 110 kB/s | 59 kB 00:00 2023-10-05T15:04:34.614 INFO:teuthology.orchestra.run.smithi060.stdout:(13/131): libcephfs2-18.0.0-6578.g689b3d5a.el8. 5.2 MB/s | 840 kB 00:00 2023-10-05T15:04:34.627 INFO:teuthology.orchestra.run.smithi092.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-05T15:04:34.661 INFO:teuthology.orchestra.run.smithi092.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 410 kB/s | 48 kB 00:00 2023-10-05T15:04:34.681 INFO:teuthology.orchestra.run.smithi060.stdout:(14/131): libcephsqlite-18.0.0-6578.g689b3d5a.e 2.7 MB/s | 184 kB 00:00 2023-10-05T15:04:34.704 INFO:teuthology.orchestra.run.smithi092.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 649 kB/s | 87 kB 00:00 2023-10-05T15:04:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 136 kB/s | 75 kB 00:00 2023-10-05T15:04:34.735 INFO:teuthology.orchestra.run.smithi060.stdout:(15/131): librados-devel-18.0.0-6578.g689b3d5a. 2.7 MB/s | 139 kB 00:00 2023-10-05T15:04:34.762 INFO:teuthology.orchestra.run.smithi092.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 318 kB/s | 43 kB 00:00 2023-10-05T15:04:34.795 INFO:teuthology.orchestra.run.smithi092.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 814 kB/s | 109 kB 00:00 2023-10-05T15:04:34.812 INFO:teuthology.orchestra.run.smithi135.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 394 kB/s | 306 kB 00:00 2023-10-05T15:04:34.821 INFO:teuthology.orchestra.run.smithi092.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-10-05T15:04:34.871 INFO:teuthology.orchestra.run.smithi135.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 290 kB/s | 44 kB 00:00 2023-10-05T15:04:34.877 INFO:teuthology.orchestra.run.smithi060.stdout:(16/131): libradosstriper1-18.0.0-6578.g689b3d5 3.5 MB/s | 518 kB 00:00 2023-10-05T15:04:34.921 INFO:teuthology.orchestra.run.smithi092.stdout:(112/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.5 MB/s | 155 kB 00:00 2023-10-05T15:04:34.963 INFO:teuthology.orchestra.run.smithi092.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.7 MB/s | 560 kB 00:00 2023-10-05T15:04:34.979 INFO:teuthology.orchestra.run.smithi135.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-10-05T15:04:34.988 INFO:teuthology.orchestra.run.smithi092.stdout:(114/131): libaio-devel-0.3.112-1.el8.x86_64.rp 97 kB/s | 19 kB 00:00 2023-10-05T15:04:35.013 INFO:teuthology.orchestra.run.smithi135.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 232 kB/s | 33 kB 00:00 2023-10-05T15:04:35.039 INFO:teuthology.orchestra.run.smithi135.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2023-10-05T15:04:35.071 INFO:teuthology.orchestra.run.smithi092.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-10-05T15:04:35.097 INFO:teuthology.orchestra.run.smithi092.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 134 kB/s | 18 kB 00:00 2023-10-05T15:04:35.105 INFO:teuthology.orchestra.run.smithi135.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-05T15:04:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-10-05T15:04:35.206 INFO:teuthology.orchestra.run.smithi092.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-10-05T15:04:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.0 MB/s | 384 kB 00:00 2023-10-05T15:04:35.248 INFO:teuthology.orchestra.run.smithi135.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 572 kB/s | 81 kB 00:00 2023-10-05T15:04:35.256 INFO:teuthology.orchestra.run.smithi092.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2023-10-05T15:04:35.273 INFO:teuthology.orchestra.run.smithi135.stdout:(49/131): python3-cheroot-8.5.2-1.el8.noarch.rp 664 kB/s | 173 kB 00:00 2023-10-05T15:04:35.290 INFO:teuthology.orchestra.run.smithi092.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 455 kB/s | 72 kB 00:00 2023-10-05T15:04:35.348 INFO:teuthology.orchestra.run.smithi135.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 88 kB/s | 11 kB 00:00 2023-10-05T15:04:35.357 INFO:teuthology.orchestra.run.smithi092.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 549 kB/s | 83 kB 00:00 2023-10-05T15:04:35.366 INFO:teuthology.orchestra.run.smithi135.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 149 kB/s | 18 kB 00:00 2023-10-05T15:04:35.432 INFO:teuthology.orchestra.run.smithi092.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 341 kB/s | 60 kB 00:00 2023-10-05T15:04:35.457 INFO:teuthology.orchestra.run.smithi092.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 587 kB/s | 98 kB 00:00 2023-10-05T15:04:35.474 INFO:teuthology.orchestra.run.smithi135.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 389 kB/s | 49 kB 00:00 2023-10-05T15:04:35.482 INFO:teuthology.orchestra.run.smithi060.stdout:(17/131): ceph-common-18.0.0-6578.g689b3d5a.el8 1.9 MB/s | 23 MB 00:11 2023-10-05T15:04:35.491 INFO:teuthology.orchestra.run.smithi135.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 468 kB/s | 59 kB 00:00 2023-10-05T15:04:35.516 INFO:teuthology.orchestra.run.smithi092.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 363 kB/s | 58 kB 00:00 2023-10-05T15:04:35.541 INFO:teuthology.orchestra.run.smithi060.stdout:(18/131): python3-ceph-argparse-18.0.0-6578.g68 772 kB/s | 45 kB 00:00 2023-10-05T15:04:35.591 INFO:teuthology.orchestra.run.smithi092.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 243 kB/s | 39 kB 00:00 2023-10-05T15:04:35.600 INFO:teuthology.orchestra.run.smithi135.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 480 kB/s | 60 kB 00:00 2023-10-05T15:04:35.616 INFO:teuthology.orchestra.run.smithi092.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.0 MB/s | 644 kB 00:00 2023-10-05T15:04:35.641 INFO:teuthology.orchestra.run.smithi060.stdout:(19/131): python3-ceph-common-18.0.0-6578.g689b 1.2 MB/s | 125 kB 00:00 2023-10-05T15:04:35.666 INFO:teuthology.orchestra.run.smithi092.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.1 MB/s | 171 kB 00:00 2023-10-05T15:04:35.667 INFO:teuthology.orchestra.run.smithi135.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2023-10-05T15:04:35.693 INFO:teuthology.orchestra.run.smithi135.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-10-05T15:04:35.734 INFO:teuthology.orchestra.run.smithi092.stdout:(128/131): NetworkManager-initscripts-updown-1. 968 kB/s | 138 kB 00:00 2023-10-05T15:04:35.749 INFO:teuthology.orchestra.run.smithi060.stdout:(20/131): python3-cephfs-18.0.0-6578.g689b3d5a. 1.8 MB/s | 197 kB 00:00 2023-10-05T15:04:35.762 INFO:teuthology.orchestra.run.smithi135.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 97 kB/s | 16 kB 00:00 2023-10-05T15:04:35.793 INFO:teuthology.orchestra.run.smithi135.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 267 kB/s | 34 kB 00:00 2023-10-05T15:04:35.852 INFO:teuthology.orchestra.run.smithi135.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2023-10-05T15:04:35.886 INFO:teuthology.orchestra.run.smithi135.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 518 kB/s | 64 kB 00:00 2023-10-05T15:04:35.911 INFO:teuthology.orchestra.run.smithi135.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 159 kB/s | 19 kB 00:00 2023-10-05T15:04:35.967 INFO:teuthology.orchestra.run.smithi092.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.3 MB/s | 798 kB 00:00 2023-10-05T15:04:35.978 INFO:teuthology.orchestra.run.smithi135.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 190 kB/s | 24 kB 00:00 2023-10-05T15:04:35.983 INFO:teuthology.orchestra.run.smithi060.stdout:(21/131): python3-rados-18.0.0-6578.g689b3d5a.e 1.6 MB/s | 371 kB 00:00 2023-10-05T15:04:36.012 INFO:teuthology.orchestra.run.smithi135.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-10-05T15:04:36.037 INFO:teuthology.orchestra.run.smithi135.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2023-10-05T15:04:36.125 INFO:teuthology.orchestra.run.smithi060.stdout:(22/131): python3-rbd-18.0.0-6578.g689b3d5a.el8 2.5 MB/s | 364 kB 00:00 2023-10-05T15:04:36.179 INFO:teuthology.orchestra.run.smithi135.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-10-05T15:04:36.204 INFO:teuthology.orchestra.run.smithi135.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 366 kB/s | 61 kB 00:00 2023-10-05T15:04:36.208 INFO:teuthology.orchestra.run.smithi060.stdout:(23/131): librgw2-18.0.0-6578.g689b3d5a.el8.x86 5.2 MB/s | 6.9 MB 00:01 2023-10-05T15:04:36.209 INFO:teuthology.orchestra.run.smithi092.stdout:(130/131): librados2-18.0.0-6578.g689b3d5a.el8. 6.3 MB/s | 3.7 MB 00:00 2023-10-05T15:04:36.226 INFO:teuthology.orchestra.run.smithi060.stdout:(24/131): python3-rgw-18.0.0-6578.g689b3d5a.el8 1.0 MB/s | 106 kB 00:00 2023-10-05T15:04:36.230 INFO:teuthology.orchestra.run.smithi135.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.1 MB/s | 251 kB 00:00 2023-10-05T15:04:36.259 INFO:teuthology.orchestra.run.smithi060.stdout:(25/131): rbd-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-05T15:04:36.322 INFO:teuthology.orchestra.run.smithi135.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 600 kB/s | 85 kB 00:00 2023-10-05T15:04:36.328 INFO:teuthology.orchestra.run.smithi060.stdout:(26/131): rbd-nbd-18.0.0-6578.g689b3d5a.el8.x86 2.6 MB/s | 180 kB 00:00 2023-10-05T15:04:36.347 INFO:teuthology.orchestra.run.smithi135.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 161 kB/s | 23 kB 00:00 2023-10-05T15:04:36.367 INFO:teuthology.orchestra.run.smithi092.stdout:(131/131): librbd1-18.0.0-6578.g689b3d5a.el8.x8 5.3 MB/s | 3.7 MB 00:00 2023-10-05T15:04:36.370 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:04:36.370 INFO:teuthology.orchestra.run.smithi092.stdout:Total 13 MB/s | 209 MB 00:15 2023-10-05T15:04:36.372 INFO:teuthology.orchestra.run.smithi135.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-05T15:04:36.385 INFO:teuthology.orchestra.run.smithi060.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6578.g 407 kB/s | 23 kB 00:00 2023-10-05T15:04:36.452 INFO:teuthology.orchestra.run.smithi060.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6578.g689b3d5 1.9 MB/s | 132 kB 00:00 2023-10-05T15:04:36.582 INFO:teuthology.orchestra.run.smithi135.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 981 kB/s | 200 kB 00:00 2023-10-05T15:04:36.615 INFO:teuthology.orchestra.run.smithi135.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 175 kB/s | 47 kB 00:00 2023-10-05T15:04:36.649 INFO:teuthology.orchestra.run.smithi135.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 4.1 MB/s | 1.7 MB 00:00 2023-10-05T15:04:36.691 INFO:teuthology.orchestra.run.smithi135.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 394 kB/s | 43 kB 00:00 2023-10-05T15:04:36.719 INFO:teuthology.orchestra.run.smithi060.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6578.g689b3 6.6 MB/s | 1.8 MB 00:00 2023-10-05T15:04:36.733 INFO:teuthology.orchestra.run.smithi135.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-05T15:04:36.758 INFO:teuthology.orchestra.run.smithi135.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-10-05T15:04:36.783 INFO:teuthology.orchestra.run.smithi135.stdout:(77/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 358 kB/s | 48 kB 00:00 2023-10-05T15:04:36.859 INFO:teuthology.orchestra.run.smithi135.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 339 kB/s | 43 kB 00:00 2023-10-05T15:04:36.884 INFO:teuthology.orchestra.run.smithi135.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 865 kB/s | 109 kB 00:00 2023-10-05T15:04:37.022 INFO:teuthology.orchestra.run.smithi135.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 960 kB/s | 229 kB 00:00 2023-10-05T15:04:37.043 INFO:teuthology.orchestra.run.smithi135.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 118 kB/s | 19 kB 00:00 2023-10-05T15:04:37.077 INFO:teuthology.orchestra.run.smithi135.stdout:(82/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.5 MB/s | 560 kB 00:00 2023-10-05T15:04:37.120 INFO:teuthology.orchestra.run.smithi135.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-10-05T15:04:37.161 INFO:teuthology.orchestra.run.smithi135.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 214 kB/s | 18 kB 00:00 2023-10-05T15:04:37.195 INFO:teuthology.orchestra.run.smithi135.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2023-10-05T15:04:37.205 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-05T15:04:37.270 INFO:teuthology.orchestra.run.smithi135.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-10-05T15:04:37.295 INFO:teuthology.orchestra.run.smithi135.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-10-05T15:04:37.326 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-05T15:04:37.326 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-05T15:04:37.362 INFO:teuthology.orchestra.run.smithi135.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 14 MB/s | 2.3 MB 00:00 2023-10-05T15:04:37.455 INFO:teuthology.orchestra.run.smithi135.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2023-10-05T15:04:37.481 INFO:teuthology.orchestra.run.smithi135.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 511 kB/s | 60 kB 00:00 2023-10-05T15:04:37.505 INFO:teuthology.orchestra.run.smithi135.stdout:(91/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 308 kB/s | 72 kB 00:00 2023-10-05T15:04:37.536 INFO:teuthology.orchestra.run.smithi060.stdout:(30/131): ceph-test-18.0.0-6578.g689b3d5a.el8.x 9.6 MB/s | 49 MB 00:05 2023-10-05T15:04:37.572 INFO:teuthology.orchestra.run.smithi135.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 837 kB/s | 98 kB 00:00 2023-10-05T15:04:37.597 INFO:teuthology.orchestra.run.smithi135.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 491 kB/s | 58 kB 00:00 2023-10-05T15:04:37.614 INFO:teuthology.orchestra.run.smithi060.stdout:(31/131): rbd-mirror-18.0.0-6578.g689b3d5a.el8. 2.6 MB/s | 3.6 MB 00:01 2023-10-05T15:04:37.637 INFO:teuthology.orchestra.run.smithi060.stdout:(32/131): ceph-mgr-modules-core-18.0.0-6578.g68 2.4 MB/s | 242 kB 00:00 2023-10-05T15:04:37.665 INFO:teuthology.orchestra.run.smithi135.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 243 kB/s | 39 kB 00:00 2023-10-05T15:04:37.678 INFO:teuthology.orchestra.run.smithi060.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6578.g6 350 kB/s | 15 kB 00:00 2023-10-05T15:04:37.704 INFO:teuthology.orchestra.run.smithi060.stdout:(34/131): ceph-mgr-rook-18.0.0-6578.g689b3d5a.e 516 kB/s | 47 kB 00:00 2023-10-05T15:04:37.715 INFO:teuthology.orchestra.run.smithi135.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.4 MB/s | 644 kB 00:00 2023-10-05T15:04:37.729 INFO:teuthology.orchestra.run.smithi060.stdout:(35/131): ceph-volume-18.0.0-6578.g689b3d5a.el8 5.1 MB/s | 261 kB 00:00 2023-10-05T15:04:37.749 INFO:teuthology.orchestra.run.smithi135.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.1 MB/s | 171 kB 00:00 2023-10-05T15:04:37.771 INFO:teuthology.orchestra.run.smithi060.stdout:(36/131): cephfs-top-18.0.0-6578.g689b3d5a.el8. 438 kB/s | 18 kB 00:00 2023-10-05T15:04:37.807 INFO:teuthology.orchestra.run.smithi135.stdout:(97/131): NetworkManager-initscripts-updown-1.3 966 kB/s | 138 kB 00:00 2023-10-05T15:04:37.863 INFO:teuthology.orchestra.run.smithi060.stdout:(37/131): cephadm-18.0.0-6578.g689b3d5a.el8.noa 1.1 MB/s | 184 kB 00:00 2023-10-05T15:04:37.866 INFO:teuthology.orchestra.run.smithi135.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 941 kB/s | 110 kB 00:00 2023-10-05T15:04:37.933 INFO:teuthology.orchestra.run.smithi135.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 432 kB/s | 54 kB 00:00 2023-10-05T15:04:37.947 INFO:teuthology.orchestra.run.smithi060.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 6.0 MB/s | 7.4 MB 00:01 2023-10-05T15:04:38.008 INFO:teuthology.orchestra.run.smithi135.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-10-05T15:04:38.047 INFO:teuthology.orchestra.run.smithi060.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-10-05T15:04:38.081 INFO:teuthology.orchestra.run.smithi060.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 271 kB/s | 59 kB 00:00 2023-10-05T15:04:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 487 kB/s | 75 kB 00:00 2023-10-05T15:04:38.140 INFO:teuthology.orchestra.run.smithi060.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 746 kB/s | 44 kB 00:00 2023-10-05T15:04:38.159 INFO:teuthology.orchestra.run.smithi135.stdout:(101/131): python3-scipy-1.0.0-21.module+el8.5. 31 MB/s | 14 MB 00:00 2023-10-05T15:04:38.165 INFO:teuthology.orchestra.run.smithi060.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.0 MB/s | 476 kB 00:00 2023-10-05T15:04:38.184 INFO:teuthology.orchestra.run.smithi135.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 221 kB/s | 39 kB 00:00 2023-10-05T15:04:38.190 INFO:teuthology.orchestra.run.smithi060.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 660 kB/s | 33 kB 00:00 2023-10-05T15:04:38.209 INFO:teuthology.orchestra.run.smithi135.stdout:(103/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2023-10-05T15:04:38.215 INFO:teuthology.orchestra.run.smithi060.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-10-05T15:04:38.241 INFO:teuthology.orchestra.run.smithi060.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-05T15:04:38.310 INFO:teuthology.orchestra.run.smithi135.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 4.2 MB/s | 538 kB 00:00 2023-10-05T15:04:38.316 INFO:teuthology.orchestra.run.smithi060.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-10-05T15:04:38.335 INFO:teuthology.orchestra.run.smithi135.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-05T15:04:38.341 INFO:teuthology.orchestra.run.smithi060.stdout:(48/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-05T15:04:38.361 INFO:teuthology.orchestra.run.smithi135.stdout:(106/131): bison-3.0.4-10.el8.x86_64.rpm 3.3 MB/s | 688 kB 00:00 2023-10-05T15:04:38.366 INFO:teuthology.orchestra.run.smithi060.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 648 kB/s | 81 kB 00:00 2023-10-05T15:04:38.384 INFO:teuthology.orchestra.run.smithi060.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 165 kB/s | 11 kB 00:00 2023-10-05T15:04:38.400 INFO:teuthology.orchestra.run.smithi060.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2023-10-05T15:04:38.419 INFO:teuthology.orchestra.run.smithi135.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-10-05T15:04:38.442 INFO:teuthology.orchestra.run.smithi060.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 832 kB/s | 49 kB 00:00 2023-10-05T15:04:38.459 INFO:teuthology.orchestra.run.smithi060.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-05T15:04:38.460 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-05T15:04:38.464 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-05T15:04:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 4.6 MB/s | 713 kB 00:00 2023-10-05T15:04:38.503 INFO:teuthology.orchestra.run.smithi060.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-10-05T15:04:38.544 INFO:teuthology.orchestra.run.smithi060.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2023-10-05T15:04:38.569 INFO:teuthology.orchestra.run.smithi060.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 232 kB/s | 16 kB 00:00 2023-10-05T15:04:38.570 INFO:teuthology.orchestra.run.smithi135.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-10-05T15:04:38.594 INFO:teuthology.orchestra.run.smithi060.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-05T15:04:38.595 INFO:teuthology.orchestra.run.smithi135.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 151 kB/s | 27 kB 00:00 2023-10-05T15:04:38.619 INFO:teuthology.orchestra.run.smithi060.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 445 kB/s | 34 kB 00:00 2023-10-05T15:04:38.620 INFO:teuthology.orchestra.run.smithi135.stdout:(111/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-10-05T15:04:38.637 INFO:teuthology.orchestra.run.smithi060.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-05T15:04:38.662 INFO:teuthology.orchestra.run.smithi060.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 955 kB/s | 64 kB 00:00 2023-10-05T15:04:38.687 INFO:teuthology.orchestra.run.smithi060.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-10-05T15:04:38.712 INFO:teuthology.orchestra.run.smithi060.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-10-05T15:04:38.729 INFO:teuthology.orchestra.run.smithi135.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 276 kB/s | 44 kB 00:00 2023-10-05T15:04:38.771 INFO:teuthology.orchestra.run.smithi060.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2023-10-05T15:04:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:(64/131): python3-tempora-1.14.1-5.el8.noarch.r 218 kB/s | 29 kB 00:00 2023-10-05T15:04:38.813 INFO:teuthology.orchestra.run.smithi135.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-10-05T15:04:38.821 INFO:teuthology.orchestra.run.smithi060.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-05T15:04:38.847 INFO:teuthology.orchestra.run.smithi135.stdout:(114/131): python3-werkzeug-0.12.2-4.el8.noarch 2.0 MB/s | 457 kB 00:00 2023-10-05T15:04:38.855 INFO:teuthology.orchestra.run.smithi060.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-05T15:04:38.872 INFO:teuthology.orchestra.run.smithi135.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.6 MB/s | 225 kB 00:00 2023-10-05T15:04:38.914 INFO:teuthology.orchestra.run.smithi135.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 636 kB/s | 64 kB 00:00 2023-10-05T15:04:38.947 INFO:teuthology.orchestra.run.smithi060.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 407 kB/s | 61 kB 00:00 2023-10-05T15:04:38.972 INFO:teuthology.orchestra.run.smithi060.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-10-05T15:04:38.989 INFO:teuthology.orchestra.run.smithi060.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 510 kB/s | 85 kB 00:00 2023-10-05T15:04:38.998 INFO:teuthology.orchestra.run.smithi135.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 839 kB/s | 126 kB 00:00 2023-10-05T15:04:39.023 INFO:teuthology.orchestra.run.smithi135.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 951 kB/s | 103 kB 00:00 2023-10-05T15:04:39.024 INFO:teuthology.orchestra.run.smithi060.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-05T15:04:39.090 INFO:teuthology.orchestra.run.smithi135.stdout:(119/131): python3-jsonpointer-1.10-11.el8.noar 92 kB/s | 20 kB 00:00 2023-10-05T15:04:39.140 INFO:teuthology.orchestra.run.smithi060.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2023-10-05T15:04:39.165 INFO:teuthology.orchestra.run.smithi135.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2023-10-05T15:04:39.204 INFO:teuthology.orchestra.run.smithi060.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 6.8 MB/s | 1.7 MB 00:00 2023-10-05T15:04:39.216 INFO:teuthology.orchestra.run.smithi135.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2023-10-05T15:04:39.241 INFO:teuthology.orchestra.run.smithi060.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 958 kB/s | 200 kB 00:00 2023-10-05T15:04:39.274 INFO:teuthology.orchestra.run.smithi060.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 318 kB/s | 43 kB 00:00 2023-10-05T15:04:39.300 INFO:teuthology.orchestra.run.smithi135.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-10-05T15:04:39.481 INFO:teuthology.orchestra.run.smithi135.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-10-05T15:04:39.481 INFO:teuthology.orchestra.run.smithi135.stdout:(124/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-05T15:04:39.481 INFO:teuthology.orchestra.run.smithi135.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-10-05T15:04:39.481 INFO:teuthology.orchestra.run.smithi060.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-05T15:04:39.481 INFO:teuthology.orchestra.run.smithi060.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 360 kB/s | 48 kB 00:00 2023-10-05T15:04:39.481 INFO:teuthology.orchestra.run.smithi060.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 612 kB/s | 87 kB 00:00 2023-10-05T15:04:39.482 INFO:teuthology.orchestra.run.smithi060.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 392 kB/s | 43 kB 00:00 2023-10-05T15:04:39.559 INFO:teuthology.orchestra.run.smithi135.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-10-05T15:04:39.625 INFO:teuthology.orchestra.run.smithi060.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.1 MB/s | 229 kB 00:00 2023-10-05T15:04:39.626 INFO:teuthology.orchestra.run.smithi135.stdout:(127/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-10-05T15:04:39.677 INFO:teuthology.orchestra.run.smithi135.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 6.9 MB/s | 1.5 MB 00:00 2023-10-05T15:04:39.692 INFO:teuthology.orchestra.run.smithi060.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.4 MB/s | 560 kB 00:00 2023-10-05T15:04:39.718 INFO:teuthology.orchestra.run.smithi060.stdout:(81/131): python3-pycparser-2.14-14.el8.noarch. 326 kB/s | 109 kB 00:00 2023-10-05T15:04:39.751 INFO:teuthology.orchestra.run.smithi060.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-10-05T15:04:39.794 INFO:teuthology.orchestra.run.smithi135.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 6.7 MB/s | 798 kB 00:00 2023-10-05T15:04:39.827 INFO:teuthology.orchestra.run.smithi060.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-10-05T15:04:39.862 INFO:teuthology.orchestra.run.smithi060.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 3.8 MB/s | 559 kB 00:00 2023-10-05T15:04:39.877 INFO:teuthology.orchestra.run.smithi060.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 142 kB/s | 18 kB 00:00 2023-10-05T15:04:39.936 INFO:teuthology.orchestra.run.smithi060.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-10-05T15:04:39.987 INFO:teuthology.orchestra.run.smithi060.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.8 MB/s | 238 kB 00:00 2023-10-05T15:04:40.062 INFO:teuthology.orchestra.run.smithi060.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-10-05T15:04:40.087 INFO:teuthology.orchestra.run.smithi060.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 480 kB/s | 72 kB 00:00 2023-10-05T15:04:40.154 INFO:teuthology.orchestra.run.smithi060.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 495 kB/s | 83 kB 00:00 2023-10-05T15:04:40.171 INFO:teuthology.orchestra.run.smithi060.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 549 kB/s | 60 kB 00:00 2023-10-05T15:04:40.196 INFO:teuthology.orchestra.run.smithi060.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 903 kB/s | 98 kB 00:00 2023-10-05T15:04:40.255 INFO:teuthology.orchestra.run.smithi060.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 574 kB/s | 58 kB 00:00 2023-10-05T15:04:40.272 INFO:teuthology.orchestra.run.smithi060.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 384 kB/s | 39 kB 00:00 2023-10-05T15:04:40.330 INFO:teuthology.orchestra.run.smithi060.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.7 MB/s | 644 kB 00:00 2023-10-05T15:04:40.380 INFO:teuthology.orchestra.run.smithi060.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.3 MB/s | 171 kB 00:00 2023-10-05T15:04:40.414 INFO:teuthology.orchestra.run.smithi060.stdout:(97/131): NetworkManager-initscripts-updown-1.3 968 kB/s | 138 kB 00:00 2023-10-05T15:04:40.515 INFO:teuthology.orchestra.run.smithi060.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 823 kB/s | 110 kB 00:00 2023-10-05T15:04:40.540 INFO:teuthology.orchestra.run.smithi060.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 433 kB/s | 54 kB 00:00 2023-10-05T15:04:40.648 INFO:teuthology.orchestra.run.smithi060.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-10-05T15:04:40.682 INFO:teuthology.orchestra.run.smithi060.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-10-05T15:04:40.841 INFO:teuthology.orchestra.run.smithi060.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 27 MB/s | 14 MB 00:00 2023-10-05T15:04:40.866 INFO:teuthology.orchestra.run.smithi060.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 179 kB/s | 39 kB 00:00 2023-10-05T15:04:40.900 INFO:teuthology.orchestra.run.smithi060.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-10-05T15:04:40.966 INFO:teuthology.orchestra.run.smithi060.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-10-05T15:04:41.000 INFO:teuthology.orchestra.run.smithi060.stdout:(106/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.3 MB/s | 538 kB 00:00 2023-10-05T15:04:41.059 INFO:teuthology.orchestra.run.smithi060.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-05T15:04:41.092 INFO:teuthology.orchestra.run.smithi060.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 5.6 MB/s | 713 kB 00:00 2023-10-05T15:04:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2023-10-05T15:04:41.218 INFO:teuthology.orchestra.run.smithi060.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 167 kB/s | 27 kB 00:00 2023-10-05T15:04:41.251 INFO:teuthology.orchestra.run.smithi060.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 751 kB/s | 44 kB 00:00 2023-10-05T15:04:41.335 INFO:teuthology.orchestra.run.smithi060.stdout:(112/131): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-10-05T15:04:41.444 INFO:teuthology.orchestra.run.smithi060.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-10-05T15:04:41.502 INFO:teuthology.orchestra.run.smithi060.stdout:(114/131): python3-werkzeug-0.12.2-4.el8.noarch 1.8 MB/s | 457 kB 00:00 2023-10-05T15:04:41.536 INFO:teuthology.orchestra.run.smithi060.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.1 MB/s | 225 kB 00:00 2023-10-05T15:04:41.578 INFO:teuthology.orchestra.run.smithi060.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 479 kB/s | 64 kB 00:00 2023-10-05T15:04:41.620 INFO:teuthology.orchestra.run.smithi060.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.0 MB/s | 126 kB 00:00 2023-10-05T15:04:41.662 INFO:teuthology.orchestra.run.smithi060.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 159 kB/s | 20 kB 00:00 2023-10-05T15:04:41.706 INFO:teuthology.orchestra.run.smithi060.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 823 kB/s | 103 kB 00:00 2023-10-05T15:04:41.771 INFO:teuthology.orchestra.run.smithi060.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-10-05T15:04:41.821 INFO:teuthology.orchestra.run.smithi060.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-10-05T15:04:41.980 INFO:teuthology.orchestra.run.smithi060.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 15 MB/s | 4.9 MB 00:00 2023-10-05T15:04:42.013 INFO:teuthology.orchestra.run.smithi060.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-10-05T15:04:42.114 INFO:teuthology.orchestra.run.smithi060.stdout:(124/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-10-05T15:04:42.147 INFO:teuthology.orchestra.run.smithi060.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-10-05T15:04:42.273 INFO:teuthology.orchestra.run.smithi060.stdout:(126/131): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2023-10-05T15:04:42.323 INFO:teuthology.orchestra.run.smithi060.stdout:(127/131): postgresql-contrib-10.21-2.module+el 3.8 MB/s | 808 kB 00:00 2023-10-05T15:04:42.465 INFO:teuthology.orchestra.run.smithi060.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 4.7 MB/s | 1.5 MB 00:00 2023-10-05T15:04:42.632 INFO:teuthology.orchestra.run.smithi060.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.7 MB/s | 798 kB 00:00 2023-10-05T15:04:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-05T15:04:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-05T15:04:43.910 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-05T15:04:44.123 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-05T15:04:44.292 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:04:44.382 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:04:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:04:45.037 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:04:45.225 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:04:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:04:45.824 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:04:45.954 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:04:46.166 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:04:46.263 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:04:46.441 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:04:46.660 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-05T15:04:46.852 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-05T15:04:47.498 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-05T15:04:47.723 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-05T15:04:47.874 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:04:47.980 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:04:48.132 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:04:48.215 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:04:48.348 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:04:48.492 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:04:48.690 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:04:49.307 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:04:49.474 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:04:50.055 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:04:50.265 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:04:50.971 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:04:51.216 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-05T15:04:51.456 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-05T15:04:51.668 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-05T15:04:51.854 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-05T15:04:52.062 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-05T15:04:52.308 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-05T15:04:52.471 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 26/134 2023-10-05T15:04:52.659 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 27/134 2023-10-05T15:04:53.542 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 28/134 2023-10-05T15:04:53.845 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-05T15:04:54.092 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-05T15:04:54.363 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-05T15:04:54.564 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:04:56.323 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:04:56.657 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-05T15:04:56.850 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-05T15:04:57.048 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-05T15:04:57.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 36/134 2023-10-05T15:04:57.409 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 37/134 2023-10-05T15:04:57.579 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-05T15:04:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-05T15:04:58.291 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-05T15:04:58.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-05T15:04:58.662 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-05T15:04:58.868 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-05T15:04:59.254 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-05T15:04:59.533 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-05T15:04:59.723 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-05T15:04:59.924 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-05T15:05:00.151 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-05T15:05:00.470 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-05T15:05:00.662 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-05T15:05:00.830 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-05T15:05:01.033 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-05T15:05:01.185 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-05T15:05:01.348 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-05T15:05:01.669 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-05T15:05:01.892 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-05T15:05:02.112 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-05T15:05:02.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-05T15:05:02.503 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-05T15:05:02.652 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-05T15:05:02.837 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:05:02.905 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:05:03.133 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-05T15:05:03.323 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-05T15:05:03.470 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:05:03.533 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:05:03.774 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-05T15:05:03.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-05T15:05:04.128 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-05T15:05:04.289 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-05T15:05:04.513 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-05T15:05:04.727 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-05T15:05:04.857 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-05T15:05:05.005 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-05T15:05:05.176 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-05T15:05:05.388 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-05T15:05:05.554 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-05T15:05:05.706 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-05T15:05:05.850 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-05T15:05:06.086 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-05T15:05:06.306 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-05T15:05:06.475 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-05T15:05:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-05T15:05:06.943 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-05T15:05:07.108 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-05T15:05:07.331 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-05T15:05:08.405 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-05T15:05:08.714 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-05T15:05:08.944 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-05T15:05:09.235 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-05T15:05:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-05T15:05:09.729 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-05T15:05:10.534 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-05T15:05:10.693 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:05:10.696 INFO:teuthology.orchestra.run.smithi060.stdout:(130/131): librados2-18.0.0-6578.g689b3d5a.el8. 135 kB/s | 3.7 MB 00:28 2023-10-05T15:05:10.769 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:05:10.838 INFO:teuthology.orchestra.run.smithi060.stdout:(131/131): librbd1-18.0.0-6578.g689b3d5a.el8.x8 133 kB/s | 3.7 MB 00:28 2023-10-05T15:05:10.842 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:05:10.843 INFO:teuthology.orchestra.run.smithi060.stdout:Total 4.4 MB/s | 209 MB 00:47 2023-10-05T15:05:10.874 INFO:teuthology.orchestra.run.smithi135.stdout:(130/131): librados2-18.0.0-6578.g689b3d5a.el8. 122 kB/s | 3.7 MB 00:31 2023-10-05T15:05:10.911 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 93/134 2023-10-05T15:05:11.307 INFO:teuthology.orchestra.run.smithi135.stdout:(131/131): librbd1-18.0.0-6578.g689b3d5a.el8.x8 120 kB/s | 3.7 MB 00:31 2023-10-05T15:05:11.310 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:05:11.310 INFO:teuthology.orchestra.run.smithi135.stdout:Total 4.2 MB/s | 209 MB 00:49 2023-10-05T15:05:11.703 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-05T15:05:11.835 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-05T15:05:11.835 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-05T15:05:12.098 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-10-05T15:05:12.218 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-10-05T15:05:12.219 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-10-05T15:05:13.028 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-05T15:05:13.033 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-05T15:05:13.335 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-10-05T15:05:13.341 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-10-05T15:05:14.625 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:14.860 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:15.460 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:15.738 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:05:15.802 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:05:15.927 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:05:18.130 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-05T15:05:18.331 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-10-05T15:05:18.351 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-05T15:05:18.514 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-05T15:05:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-05T15:05:18.711 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-05T15:05:18.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-05T15:05:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-05T15:05:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-05T15:05:19.064 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-05T15:05:19.069 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-05T15:05:19.273 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-05T15:05:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-05T15:05:19.679 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-05T15:05:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 5/134 2023-10-05T15:05:19.907 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 5/134 2023-10-05T15:05:20.176 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 5/134 2023-10-05T15:05:20.315 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 5/134 2023-10-05T15:05:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:05:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:05:20.612 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:05:20.614 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:05:20.703 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:05:20.786 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:05:20.831 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:05:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:05:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:05:21.256 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-05T15:05:21.315 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-05T15:05:21.482 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-05T15:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-05T15:05:21.717 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-05T15:05:21.793 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-05T15:05:22.135 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-05T15:05:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-05T15:05:22.386 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-05T15:05:22.471 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:05:22.735 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:05:22.827 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:05:22.881 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:05:22.985 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:05:23.027 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:05:23.199 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-05T15:05:23.252 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-05T15:05:23.364 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-05T15:05:23.443 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-05T15:05:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-05T15:05:23.654 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-05T15:05:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-05T15:05:23.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-05T15:05:23.851 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-05T15:05:23.921 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-05T15:05:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-05T15:05:24.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-05T15:05:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-05T15:05:24.706 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-05T15:05:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-05T15:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-05T15:05:25.504 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-05T15:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-05T15:05:25.718 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-05T15:05:25.747 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-05T15:05:26.450 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-05T15:05:26.506 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-05T15:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-05T15:05:26.783 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-05T15:05:26.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-05T15:05:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-05T15:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-05T15:05:27.242 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-05T15:05:27.362 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 26/134 2023-10-05T15:05:27.417 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 26/134 2023-10-05T15:05:27.483 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 27/134 2023-10-05T15:05:27.556 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 27/134 2023-10-05T15:05:27.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 28/134 2023-10-05T15:05:27.808 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 28/134 2023-10-05T15:05:27.955 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-05T15:05:28.002 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-05T15:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-05T15:05:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-05T15:05:30.800 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-05T15:05:30.946 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-05T15:05:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-05T15:05:31.443 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-05T15:05:31.453 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-05T15:05:31.692 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-05T15:05:31.725 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-05T15:05:31.960 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-05T15:05:31.988 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-05T15:05:32.157 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-05T15:05:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-05T15:05:32.364 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 36/134 2023-10-05T15:05:32.414 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-05T15:05:32.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 37/134 2023-10-05T15:05:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 36/134 2023-10-05T15:05:32.687 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-05T15:05:32.775 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 37/134 2023-10-05T15:05:32.839 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-05T15:05:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-05T15:05:33.004 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-05T15:05:33.099 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-05T15:05:33.103 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-05T15:05:33.309 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-05T15:05:33.335 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-05T15:05:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-05T15:05:33.591 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-05T15:05:33.612 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-05T15:05:33.754 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-05T15:05:33.814 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-05T15:05:33.836 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-05T15:05:33.967 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-05T15:05:34.050 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-05T15:05:34.075 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-05T15:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-05T15:05:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-05T15:05:34.429 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-05T15:05:34.455 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-05T15:05:34.644 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-05T15:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-05T15:05:34.812 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-10-05T15:05:34.969 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-10-05T15:05:34.970 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-10-05T15:05:34.970 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-10-05T15:05:34.970 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-05T15:05:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:05:34.979 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-05T15:05:35.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-05T15:05:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-05T15:05:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-05T15:05:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:05:35.395 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-05T15:05:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-05T15:05:35.678 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-05T15:05:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-05T15:05:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-05T15:05:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-05T15:05:36.354 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-05T15:05:36.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-05T15:05:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-05T15:05:36.674 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-05T15:05:36.802 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-05T15:05:36.927 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-05T15:05:37.086 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-05T15:05:37.087 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:05:37.094 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:05:37.143 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-05T15:05:37.311 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:05:37.386 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-05T15:05:37.468 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-05T15:05:37.480 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:05:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-05T15:05:37.737 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-05T15:05:37.805 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-05T15:05:37.913 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-05T15:05:37.934 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:05:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-05T15:05:38.080 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:05:38.097 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:05:38.202 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-05T15:05:38.231 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-05T15:05:38.383 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-05T15:05:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-05T15:05:38.582 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-05T15:05:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-05T15:05:38.904 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-05T15:05:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-05T15:05:39.198 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-05T15:05:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-05T15:05:39.460 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-05T15:05:39.469 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-05T15:05:39.617 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-05T15:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-05T15:05:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:05:39.822 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-05T15:05:39.870 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-05T15:05:40.001 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:05:40.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-05T15:05:40.060 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-05T15:05:40.135 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 102/134 2023-10-05T15:05:40.291 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-05T15:05:40.323 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-05T15:05:40.337 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 103/134 2023-10-05T15:05:40.438 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-05T15:05:40.537 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:05:40.544 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-05T15:05:40.572 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-05T15:05:40.725 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-05T15:05:40.759 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:05:40.781 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-05T15:05:40.872 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-05T15:05:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-05T15:05:41.057 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:05:41.195 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-05T15:05:41.195 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-05T15:05:41.314 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-05T15:05:41.362 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-05T15:05:41.507 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-05T15:05:41.538 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-05T15:05:41.714 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-05T15:05:41.757 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-05T15:05:41.892 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-05T15:05:42.014 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:05:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-05T15:05:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-05T15:05:42.179 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:05:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-05T15:05:42.270 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:05:42.381 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-05T15:05:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-05T15:05:42.550 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-05T15:05:42.615 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 107/134 2023-10-05T15:05:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-05T15:05:42.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-05T15:05:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-05T15:05:42.846 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:05:42.882 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:05:43.019 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-05T15:05:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-05T15:05:43.062 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:05:43.073 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:05:43.218 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-05T15:05:43.433 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-05T15:05:44.239 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-05T15:05:44.397 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 110/134 2023-10-05T15:05:44.531 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-05T15:05:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-05T15:05:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:05:44.753 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:05:44.768 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-05T15:05:44.795 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:05:44.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-05T15:05:44.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:05:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-05T15:05:45.178 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-05T15:05:45.306 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:05:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-05T15:05:45.462 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:05:45.545 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-05T15:05:45.635 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-05T15:05:45.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-05T15:05:46.096 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-05T15:05:46.507 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-05T15:05:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:05:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:05:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-05T15:05:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 93/134 2023-10-05T15:05:47.044 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:05:47.115 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:05:47.319 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 93/134 2023-10-05T15:05:50.096 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:05:50.398 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 115/134 2023-10-05T15:05:50.535 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:05:50.736 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:05:50.900 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:51.063 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:51.302 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:51.594 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-05T15:05:51.774 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:51.896 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-05T15:05:51.916 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:05:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:05:52.104 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 119/134 2023-10-05T15:05:52.221 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:05:52.297 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:05:52.345 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:05:52.464 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 121/134 2023-10-05T15:05:52.478 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:05:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:05:52.619 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:05:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:05:54.771 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:05:55.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:05:55.052 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:05:55.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 124/134 2023-10-05T15:05:55.508 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 125/134 2023-10-05T15:05:55.817 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 126/134 2023-10-05T15:05:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-05T15:05:56.284 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:05:56.292 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:05:56.475 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-05T15:05:56.642 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:05:56.727 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:05:56.925 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:05:56.938 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:05:56.938 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:05:57.153 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:05:57.153 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:05:57.372 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:05:57.582 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:05:58.104 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:05:58.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 1/134 2023-10-05T15:05:58.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2/134 2023-10-05T15:05:58.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 3/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 4/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 5/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 10/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 11/134 2023-10-05T15:05:58.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 12/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 13/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 14/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 15/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 16/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 17/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 18/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 19/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 20/134 2023-10-05T15:05:58.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 21/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 22/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 23/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 24/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 25/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 26/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 27/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 28/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 29/134 2023-10-05T15:05:58.107 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 30/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 31/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 32/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 33/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 34/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 35/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 36/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 37/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 38/134 2023-10-05T15:05:58.108 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-05T15:05:58.109 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-05T15:05:58.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-05T15:05:58.111 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-05T15:05:58.112 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-05T15:05:58.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-05T15:05:58.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-05T15:05:58.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-05T15:05:58.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 129/134 2023-10-05T15:05:58.117 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-05T15:05:58.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 131/134 2023-10-05T15:05:58.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:05:58.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-05T15:06:00.510 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:00.511 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:52 ago on Thu 05 Oct 2023 03:04:08 PM UTC. 2023-10-05T15:06:06.508 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-05T15:06:06.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-10-05T15:06:06.719 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.720 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-05T15:06:06.721 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-3.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:06:06.722 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libpq-13.5-1.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T15:06:06.723 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:06.724 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T15:06:06.725 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-05T15:06:06.726 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T15:06:06.727 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T15:06:06.728 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T15:06:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-05T15:06:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-05T15:06:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T15:06:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-05T15:06:06.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-05T15:06:06.730 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-05T15:06:06.893 DEBUG:teuthology.parallel:result is None 2023-10-05T15:06:11.616 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:06:11.616 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-10-05T15:06:11.616 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-10-05T15:06:11.616 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-10-05T15:06:11.617 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2023-10-05T15:06:11.617 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-10-05T15:06:11.617 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-10-05T15:06:11.617 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-10-05T15:06:11.617 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-10-05T15:06:11.617 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-10-05T15:06:11.618 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:06:12.016 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:06:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:06:12.380 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2023-10-05T15:06:12.380 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2023-10-05T15:06:12.380 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-05T15:06:12.380 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /run 2023-10-05T15:06:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2023-10-05T15:06:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2023-10-05T15:06:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2023-10-05T15:06:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2023-10-05T15:06:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-05T15:06:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:06:12.754 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:06:13.620 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:06:13.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:06:14.021 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:06:14.232 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:06:14.455 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:06:14.647 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:06:14.686 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:06:14.840 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:06:14.857 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:06:14.880 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:06:15.088 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:06:15.571 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:06:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:06:15.747 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:06:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:06:16.853 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:06:17.004 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 102/134 2023-10-05T15:06:17.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 103/134 2023-10-05T15:06:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:06:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:06:17.658 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:06:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:06:17.877 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 102/134 2023-10-05T15:06:17.917 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:06:18.074 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 103/134 2023-10-05T15:06:18.245 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:06:18.473 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:06:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:06:18.878 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:06:19.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:06:19.177 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:06:19.583 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 107/134 2023-10-05T15:06:19.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:06:19.821 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:06:19.830 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:06:19.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:06:20.000 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:06:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:06:20.110 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:06:20.491 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 107/134 2023-10-05T15:06:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:06:20.758 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:06:20.928 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:06:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:06:21.317 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 110/134 2023-10-05T15:06:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:06:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:06:21.723 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:06:21.764 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:06:21.939 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:06:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:06:22.374 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 110/134 2023-10-05T15:06:22.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:06:22.599 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:06:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:06:22.787 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:06:22.830 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:06:23.011 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:06:23.394 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:06:23.553 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:06:27.094 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:06:28.052 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 115/134 2023-10-05T15:06:28.424 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-05T15:06:28.501 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:06:28.649 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 117/134 2023-10-05T15:06:28.892 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-05T15:06:29.088 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-05T15:06:29.292 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-05T15:06:29.416 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 115/134 2023-10-05T15:06:29.559 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-05T15:06:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 121/134 2023-10-05T15:06:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-05T15:06:29.939 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:06:30.147 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 117/134 2023-10-05T15:06:30.403 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-05T15:06:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-05T15:06:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-05T15:06:30.990 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-05T15:06:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 121/134 2023-10-05T15:06:31.353 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:06:32.196 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:06:32.488 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:06:32.505 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:06:32.749 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 124/134 2023-10-05T15:06:32.986 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 125/134 2023-10-05T15:06:33.324 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 126/134 2023-10-05T15:06:33.674 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-05T15:06:33.724 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:06:33.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-05T15:06:33.960 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-05T15:06:33.979 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:06:33.997 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:06:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-05T15:06:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-05T15:06:34.186 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 124/134 2023-10-05T15:06:34.345 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-05T15:06:34.353 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-05T15:06:34.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-05T15:06:34.481 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:06:34.510 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 125/134 2023-10-05T15:06:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:06:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:06:34.844 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 126/134 2023-10-05T15:06:34.951 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:06:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-05T15:06:35.202 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-05T15:06:35.506 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-05T15:06:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-05T15:06:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-05T15:06:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 1/134 2023-10-05T15:06:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2/134 2023-10-05T15:06:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 3/134 2023-10-05T15:06:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 4/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 5/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 10/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 11/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 12/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 13/134 2023-10-05T15:06:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 14/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 15/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 16/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 17/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 18/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 19/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 20/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 21/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 22/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 23/134 2023-10-05T15:06:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 24/134 2023-10-05T15:06:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 25/134 2023-10-05T15:06:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 26/134 2023-10-05T15:06:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 27/134 2023-10-05T15:06:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 28/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 29/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 30/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 31/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 32/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 33/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 34/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 35/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 36/134 2023-10-05T15:06:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 37/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 38/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-05T15:06:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-05T15:06:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-05T15:06:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-05T15:06:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-05T15:06:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-05T15:06:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-05T15:06:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-05T15:06:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-05T15:06:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 129/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 131/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:06:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-05T15:06:35.893 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-05T15:06:35.902 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-05T15:06:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-05T15:06:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:06:36.213 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:06:36.213 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:06:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:06:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:37.215 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 1/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 3/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 4/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 5/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 10/134 2023-10-05T15:06:37.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 11/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 12/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 13/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 14/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 15/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 16/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 17/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 18/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 19/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 20/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 21/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 22/134 2023-10-05T15:06:37.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 23/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 24/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 25/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 26/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 27/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 28/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 29/134 2023-10-05T15:06:37.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 30/134 2023-10-05T15:06:37.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 31/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 32/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 33/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 34/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 35/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 36/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 37/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 38/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-05T15:06:37.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-05T15:06:37.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-05T15:06:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-05T15:06:37.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-05T15:06:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-05T15:06:37.232 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-05T15:06:37.233 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-05T15:06:37.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 129/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 131/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:06:37.235 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-05T15:06:38.235 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:38.235 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:29 ago on Thu 05 Oct 2023 03:04:09 PM UTC. 2023-10-05T15:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:29 ago on Thu 05 Oct 2023 03:04:10 PM UTC. 2023-10-05T15:06:46.999 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-10-05T15:06:47.210 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:06:47.210 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-10-05T15:06:47.210 INFO:teuthology.orchestra.run.smithi135.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-05T15:06:47.210 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.210 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.210 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-7.el8.noarch 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.212 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-3.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-05T15:06:47.213 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libpq-13.5-1.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.214 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-05T15:06:47.215 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T15:06:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T15:06:47.217 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T15:06:47.218 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.219 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T15:06:47.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-05T15:06:47.221 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T15:06:47.222 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-05T15:06:47.222 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:06:47.222 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-05T15:06:49.285 DEBUG:teuthology.parallel:result is None 2023-10-05T15:06:49.692 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-05T15:06:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.1-7.el8.noarch 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.0.4-10.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.1-9.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: jq-1.6-3.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-05T15:06:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-05T15:06:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-05T15:06:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: libpq-13.5-1.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T15:06:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T15:06:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T15:06:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-05T15:06:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T15:06:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T15:06:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T15:06:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-05T15:06:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:06:49.937 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-05T15:06:50.103 DEBUG:teuthology.parallel:result is None 2023-10-05T15:06:50.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:06:50.341 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T15:06:50.365 INFO:teuthology.orchestra.run.smithi060.stdout:18.0.0-6578.g689b3d5a.el8 2023-10-05T15:06:50.366 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6578.g689b3d5a.el8 2023-10-05T15:06:50.366 INFO:teuthology.task.install:The correct ceph version 18.0.0-6578.g689b3d5a is installed. 2023-10-05T15:06:50.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:06:50.586 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T15:06:50.614 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-6578.g689b3d5a.el8 2023-10-05T15:06:50.615 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6578.g689b3d5a.el8 2023-10-05T15:06:50.615 INFO:teuthology.task.install:The correct ceph version 18.0.0-6578.g689b3d5a is installed. 2023-10-05T15:06:50.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:06:50.756 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T15:06:50.783 INFO:teuthology.orchestra.run.smithi135.stdout:18.0.0-6578.g689b3d5a.el8 2023-10-05T15:06:50.784 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6578.g689b3d5a.el8 2023-10-05T15:06:50.784 INFO:teuthology.task.install:The correct ceph version 18.0.0-6578.g689b3d5a is installed. 2023-10-05T15:06:50.784 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-05T15:06:50.784 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:06:50.784 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T15:06:50.831 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:06:50.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T15:06:50.880 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:06:50.880 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T15:06:50.927 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-05T15:06:50.928 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:06:50.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T15:06:50.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T15:06:51.025 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:06:51.026 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T15:06:51.056 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T15:06:51.125 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:06:51.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T15:06:51.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T15:06:51.228 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-05T15:06:51.229 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:06:51.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T15:06:51.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T15:06:51.326 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:06:51.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T15:06:51.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T15:06:51.426 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:06:51.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T15:06:51.457 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T15:06:51.530 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-05T15:06:51.530 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:06:51.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T15:06:51.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T15:06:51.632 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:06:51.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T15:06:51.663 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T15:06:51.732 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:06:51.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T15:06:51.764 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T15:06:51.835 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-05T15:06:51.919 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_client_delegate_inos_pct': 50, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-05T15:06:51.919 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:06:51.920 INFO:tasks.cephadm:Cluster fsid is d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:06:51.920 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-05T15:06:51.920 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.60', 'mon.b': '172.21.15.92', 'mon.c': '172.21.15.135'} 2023-10-05T15:06:51.920 INFO:tasks.cephadm:First mon is mon.a on smithi060 2023-10-05T15:06:51.920 INFO:tasks.cephadm:First mgr is x 2023-10-05T15:06:51.920 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-05T15:06:51.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2023-10-05T15:06:51.956 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2023-10-05T15:06:51.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2023-10-05T15:06:52.020 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-05T15:06:52.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:06:52.242 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73000/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6578-g689b3d5a', 'node_name': '172.21.4.64+confusa02', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6578.g689b3d5a'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-05 14:15:16.970244', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-61009-wo-1', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}] 2023-10-05T15:06:52.385 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-61009-wo-1, sha1 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:06:52.386 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm 2023-10-05T15:06:52.386 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:53.002 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-rw-r--. 1 ubuntu ubuntu 753815 Oct 5 15:06 /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:53.003 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:53.430 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-rw-r--. 1 ubuntu ubuntu 753815 Oct 5 15:06 /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:53.430 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:54.068 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-rw-r--. 1 ubuntu ubuntu 753815 Oct 5 15:06 /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:54.069 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:54.091 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:54.113 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-05T15:06:54.151 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f on all hosts... 2023-10-05T15:06:54.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f pull 2023-10-05T15:06:54.154 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f pull 2023-10-05T15:06:54.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f pull 2023-10-05T15:06:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:06:58.037 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:06:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:07:33.102 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-05T15:07:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:07:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe", 2023-10-05T15:07:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2023-10-05T15:07:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3300db03fa5ba77da04282ea1191ae44872b62ffe3a77045637a1f1020109887" 2023-10-05T15:07:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-05T15:07:33.103 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-05T15:07:35.029 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:07:35.029 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:07:35.029 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe", 2023-10-05T15:07:35.029 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2023-10-05T15:07:35.029 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3300db03fa5ba77da04282ea1191ae44872b62ffe3a77045637a1f1020109887" 2023-10-05T15:07:35.030 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:07:35.030 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:07:35.808 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-10-05T15:07:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:07:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe", 2023-10-05T15:07:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2023-10-05T15:07:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3300db03fa5ba77da04282ea1191ae44872b62ffe3a77045637a1f1020109887" 2023-10-05T15:07:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2023-10-05T15:07:35.809 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-10-05T15:07:35.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2023-10-05T15:07:35.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2023-10-05T15:07:35.903 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2023-10-05T15:07:35.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2023-10-05T15:07:35.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2023-10-05T15:07:35.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2023-10-05T15:07:36.024 INFO:tasks.cephadm:Writing seed config... 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-05T15:07:36.025 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] mds_client_delegate_inos_pct = 50 2023-10-05T15:07:36.026 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-05T15:07:36.027 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-05T15:07:36.028 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-05T15:07:36.029 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:07:36.029 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-05T15:07:36.049 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d07a9b62-6390-11ee-8db5-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_client_delegate_inos_pct = 50 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-05T15:07:36.050 DEBUG:teuthology.orchestra.run.smithi060:mon.a> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-05T15:07:36.092 DEBUG:teuthology.orchestra.run.smithi060:mgr.x> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-05T15:07:36.124 INFO:journalctl@ceph.mon.a.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:07:36.125 INFO:tasks.cephadm:Bootstrapping... 2023-10-05T15:07:36.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f -v bootstrap --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.60 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:07:36.154 INFO:journalctl@ceph.mgr.x.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:07:36.302 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:07:36.302 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', '-v', 'bootstrap', '--fsid', 'd07a9b62-6390-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.60', '--skip-admin-label'] 2023-10-05T15:07:36.450 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 4.1.1 2023-10-05T15:07:36.450 INFO:teuthology.orchestra.run.smithi060.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-05T15:07:36.450 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying podman|docker is present... 2023-10-05T15:07:36.597 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 4.1.1 2023-10-05T15:07:36.597 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying lvm2 is present... 2023-10-05T15:07:36.597 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying time synchronization is in place... 2023-10-05T15:07:36.604 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-05T15:07:36.604 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-05T15:07:36.610 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-05T15:07:36.610 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2023-10-05T15:07:36.617 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2023-10-05T15:07:36.623 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2023-10-05T15:07:36.623 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2023-10-05T15:07:36.623 INFO:teuthology.orchestra.run.smithi060.stdout:Repeating the final host check... 2023-10-05T15:07:36.769 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 4.1.1 2023-10-05T15:07:36.769 INFO:teuthology.orchestra.run.smithi060.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-05T15:07:36.769 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl is present 2023-10-05T15:07:36.769 INFO:teuthology.orchestra.run.smithi060.stdout:lvcreate is present 2023-10-05T15:07:36.775 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-05T15:07:36.775 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-05T15:07:36.781 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-05T15:07:36.781 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2023-10-05T15:07:36.787 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2023-10-05T15:07:36.793 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2023-10-05T15:07:36.794 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2023-10-05T15:07:36.794 INFO:teuthology.orchestra.run.smithi060.stdout:Host looks OK 2023-10-05T15:07:36.794 INFO:teuthology.orchestra.run.smithi060.stdout:Cluster fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:36.794 INFO:teuthology.orchestra.run.smithi060.stdout:Acquiring lock 139817298356712 on /run/cephadm/d07a9b62-6390-11ee-8db5-212e2dc638e7.lock 2023-10-05T15:07:36.794 INFO:teuthology.orchestra.run.smithi060.stdout:Lock 139817298356712 acquired on /run/cephadm/d07a9b62-6390-11ee-8db5-212e2dc638e7.lock 2023-10-05T15:07:36.795 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 3300 ... 2023-10-05T15:07:36.795 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 6789 ... 2023-10-05T15:07:36.795 INFO:teuthology.orchestra.run.smithi060.stdout:Base mon IP(s) is [172.21.15.60:3300, 172.21.15.60:6789], mon addrv is [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2023-10-05T15:07:36.799 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-05T15:07:36.799 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.60 metric 100 2023-10-05T15:07:36.802 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-05T15:07:36.802 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-05T15:07:36.802 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1781sec hoplimit 64 pref medium 2023-10-05T15:07:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-05T15:07:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-05T15:07:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-05T15:07:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-05T15:07:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-05T15:07:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-05T15:07:36.806 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2023-10-05T15:07:36.806 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2023-10-05T15:07:36.806 INFO:teuthology.orchestra.run.smithi060.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-05T15:07:36.806 INFO:teuthology.orchestra.run.smithi060.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-05T15:07:36.808 INFO:teuthology.orchestra.run.smithi060.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Getting image source signatures 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:bbaffcd584794b4c36d1bbf695604ab523bf72bb8494f3e7d90e19daa4269491 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying config sha256:83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-05T15:07:37.251 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Storing signatures 2023-10-05T15:07:38.099 INFO:teuthology.orchestra.run.smithi060.stdout:ceph: stdout ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:07:38.099 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph version: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:07:38.099 INFO:teuthology.orchestra.run.smithi060.stdout:Extracting ceph user uid/gid from container image... 2023-10-05T15:07:38.855 INFO:teuthology.orchestra.run.smithi060.stdout:stat: stdout 167 167 2023-10-05T15:07:38.855 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial keys... 2023-10-05T15:07:39.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQA70R5lytOfDRAArQ21SKaTovySSP4IyM6jNg== 2023-10-05T15:07:40.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQA70R5lTLoHORAA00IXOq8G/DZUfD/dVv8/CQ== 2023-10-05T15:07:41.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQA80R5l1lD3KRAA7hRmFytmW6YcKFBICyV9rw== 2023-10-05T15:07:41.111 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial monmap... 2023-10-05T15:07:41.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-05T15:07:41.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-05T15:07:41.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:41.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-05T15:07:41.861 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool for a [v2:172.21.15.60:3300,v1:172.21.15.60:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-05T15:07:41.861 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = pacific 2023-10-05T15:07:41.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: set fsid to d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:41.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-05T15:07:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:07:41.861 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mon... 2023-10-05T15:07:44.312 INFO:teuthology.orchestra.run.smithi060.stdout:create mon.a on 2023-10-05T15:07:44.662 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-05T15:07:44.755 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-05T15:07:45.092 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7.target. 2023-10-05T15:07:45.092 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7.target. 2023-10-05T15:07:45.455 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a 2023-10-05T15:07:45.455 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-05T15:07:45.549 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7.target.wants/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@.service. 2023-10-05T15:07:45.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:45 smithi060 systemd[1]: Starting Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:07:46.055 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:07:46.056 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2023-10-05T15:07:46.064 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:07:46.065 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2023-10-05T15:07:46.065 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2023-10-05T15:07:46.065 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2023-10-05T15:07:46.065 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon to start... 2023-10-05T15:07:46.065 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon... 2023-10-05T15:07:46.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:45 smithi060 podman[98675]: 2023-10-05T15:07:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:46 smithi060 bash[98675]: 57fe741ec192f635a73d20e17c0d27fb0108d2457b786d12f2cce71d98c19771 2023-10-05T15:07:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:46 smithi060 systemd[1]: Started Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:07:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:46 smithi060 ceph-mon[98715]: mkfs d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:46 smithi060 ceph-mon[98715]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-05T15:07:47.016 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout cluster: 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout id: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout services: 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.618477s) 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout data: 2023-10-05T15:07:47.017 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-05T15:07:47.018 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-05T15:07:47.018 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pgs: 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.537+0000 7f120cf11700 1 Processor -- start 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.537+0000 7f120cf11700 1 -- start start 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.538+0000 7f120cf11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.538+0000 7f120cf11700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12081060d0 con 0x7f12081056e0 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.538+0000 7f120659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.538+0000 7f120659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34510/0 (socket says 172.21.15.60:34510) 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.538+0000 7f120659c700 1 -- 172.21.15.60:0/2160667163 learned_addr learned my addr 172.21.15.60:0/2160667163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:47.019 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.538+0000 7f120659c700 1 -- 172.21.15.60:0/2160667163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12081068e0 con 0x7f12081056e0 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120659c700 1 --2- 172.21.15.60:0/2160667163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208105b00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11f000bb40 tx=0x7f11f000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31e45be2473176e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120559a700 1 -- 172.21.15.60:0/2160667163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11f000dbe0 con 0x7f12081056e0 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120559a700 1 -- 172.21.15.60:0/2160667163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f000dd40 con 0x7f12081056e0 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120559a700 1 -- 172.21.15.60:0/2160667163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11f0004030 con 0x7f12081056e0 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120cf11700 1 -- 172.21.15.60:0/2160667163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 msgr2=0x7f1208105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120cf11700 1 --2- 172.21.15.60:0/2160667163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208105b00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11f000bb40 tx=0x7f11f000be50 comp rx=0 tx=0).stop 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120cf11700 1 -- 172.21.15.60:0/2160667163 shutdown_connections 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120cf11700 1 --2- 172.21.15.60:0/2160667163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208105b00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:47.020 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.539+0000 7f120cf11700 1 -- 172.21.15.60:0/2160667163 >> 172.21.15.60:0/2160667163 conn(0x7f1208100ca0 msgr2=0x7f12081030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.540+0000 7f120cf11700 1 -- 172.21.15.60:0/2160667163 shutdown_connections 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.540+0000 7f120cf11700 1 -- 172.21.15.60:0/2160667163 wait complete. 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.540+0000 7f120cf11700 1 Processor -- start 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.540+0000 7f120cf11700 1 -- start start 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.540+0000 7f120cf11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120cf11700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208197f80 con 0x7f12081056e0 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34512/0 (socket says 172.21.15.60:34512) 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120659c700 1 -- 172.21.15.60:0/2837279969 learned_addr learned my addr 172.21.15.60:0/2837279969 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120659c700 1 -- 172.21.15.60:0/2837279969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f000b7f0 con 0x7f12081056e0 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120659c700 1 --2- 172.21.15.60:0/2837279969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208197a40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f11f000b340 tx=0x7f11f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:47.021 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11f0020070 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f0003d40 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11f0010470 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1208198180 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.541+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12081985a0 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.542+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f11f00108d0 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.542+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11f002e9e0 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.542+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12081912d0 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.545+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f11f0029070 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.678+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f1208106b90 con 0x7f12081056e0 2023-10-05T15:07:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.678+0000 7f11ff7fe700 1 -- 172.21.15.60:0/2837279969 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f11f0010db0 con 0x7f12081056e0 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 msgr2=0x7f1208197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 --2- 172.21.15.60:0/2837279969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208197a40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f11f000b340 tx=0x7f11f0004750 comp rx=0 tx=0).stop 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 shutdown_connections 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 --2- 172.21.15.60:0/2837279969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12081056e0 0x7f1208197a40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 >> 172.21.15.60:0/2837279969 conn(0x7f1208100ca0 msgr2=0x7f1208102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 shutdown_connections 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:46.679+0000 7f120cf11700 1 -- 172.21.15.60:0/2837279969 wait complete. 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:mon is available 2023-10-05T15:07:47.023 INFO:teuthology.orchestra.run.smithi060.stdout:Assimilating anything we can from ceph.conf... 2023-10-05T15:07:47.280 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:47 smithi060 ceph-mon[98715]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-05T15:07:47.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:47 smithi060 ceph-mon[98715]: monmap e1: 1 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} 2023-10-05T15:07:47.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:47 smithi060 ceph-mon[98715]: fsmap 2023-10-05T15:07:47.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:47 smithi060 ceph-mon[98715]: osdmap e1: 0 total, 0 up, 0 in 2023-10-05T15:07:47.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:47 smithi060 ceph-mon[98715]: mgrmap e1: no daemons active 2023-10-05T15:07:47.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:47 smithi060 ceph-mon[98715]: from='client.? 172.21.15.60:0/2837279969' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:48.065 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.482+0000 7fcf56262700 1 Processor -- start 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.482+0000 7fcf56262700 1 -- start start 2023-10-05T15:07:48.066 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.482+0000 7fcf56262700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf501054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.482+0000 7fcf56262700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50079e50 con 0x7fcf501050b0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf501054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf501054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34514/0 (socket says 172.21.15.60:34514) 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4f7fe700 1 -- 172.21.15.60:0/3497502865 learned_addr learned my addr 172.21.15.60:0/3497502865 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4f7fe700 1 -- 172.21.15.60:0/3497502865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50105a10 con 0x7fcf501050b0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4f7fe700 1 --2- 172.21.15.60:0/3497502865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf501054d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcf440098a0 tx=0x7fcf44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c976c06180c8dfd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4e7fc700 1 -- 172.21.15.60:0/3497502865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf44004160 con 0x7fcf501050b0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4e7fc700 1 -- 172.21.15.60:0/3497502865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf440042c0 con 0x7fcf501050b0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.483+0000 7fcf4e7fc700 1 -- 172.21.15.60:0/3497502865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf440045a0 con 0x7fcf501050b0 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 -- 172.21.15.60:0/3497502865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 msgr2=0x7fcf501054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 --2- 172.21.15.60:0/3497502865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf501054d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcf440098a0 tx=0x7fcf44009bb0 comp rx=0 tx=0).stop 2023-10-05T15:07:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 -- 172.21.15.60:0/3497502865 shutdown_connections 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 --2- 172.21.15.60:0/3497502865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf501054d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 -- 172.21.15.60:0/3497502865 >> 172.21.15.60:0/3497502865 conn(0x7fcf50100c90 msgr2=0x7fcf501030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 -- 172.21.15.60:0/3497502865 shutdown_connections 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.484+0000 7fcf56262700 1 -- 172.21.15.60:0/3497502865 wait complete. 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf56262700 1 Processor -- start 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf56262700 1 -- start start 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf56262700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf5019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf56262700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5019c340 con 0x7fcf501050b0 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf5019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf5019be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34516/0 (socket says 172.21.15.60:34516) 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf4f7fe700 1 -- 172.21.15.60:0/1974741859 learned_addr learned my addr 172.21.15.60:0/1974741859 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:48.068 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf4f7fe700 1 -- 172.21.15.60:0/1974741859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44009550 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.485+0000 7fcf4f7fe700 1 --2- 172.21.15.60:0/1974741859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf5019be00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcf50079290 tx=0x7fcf44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf44011630 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44011790 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5019c540 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf44011a30 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5019c960 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf44022070 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.486+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcf4401c450 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.487+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50195b40 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.489+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcf4401b450 con 0x7fcf501050b0 2023-10-05T15:07:48.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.615+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fcf50105fb0 con 0x7fcf501050b0 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.618+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fcf4401b5f0 con 0x7fcf501050b0 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.619+0000 7fcf4cff9700 1 -- 172.21.15.60:0/1974741859 <== mon.0 v2:172.21.15.60:3300/0 8 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf4401b790 con 0x7fcf501050b0 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 msgr2=0x7fcf5019be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 --2- 172.21.15.60:0/1974741859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf5019be00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcf50079290 tx=0x7fcf44004750 comp rx=0 tx=0).stop 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 shutdown_connections 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 --2- 172.21.15.60:0/1974741859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf501050b0 0x7fcf5019be00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 >> 172.21.15.60:0/1974741859 conn(0x7fcf50100c90 msgr2=0x7fcf50192c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 shutdown_connections 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:47.620+0000 7fcf56262700 1 -- 172.21.15.60:0/1974741859 wait complete. 2023-10-05T15:07:48.070 INFO:teuthology.orchestra.run.smithi060.stdout:Generating new minimal ceph.conf... 2023-10-05T15:07:48.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:48 smithi060 ceph-mon[98715]: from='client.? 172.21.15.60:0/1974741859' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-05T15:07:48.337 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:48 smithi060 ceph-mon[98715]: from='client.? 172.21.15.60:0/1974741859' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d7d09700 1 Processor -- start 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d7d09700 1 -- start start 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d7d09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d0105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d7d09700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01060d0 con 0x7fb5d01056e0 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d5aa5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d0105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d5aa5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d0105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34518/0 (socket says 172.21.15.60:34518) 2023-10-05T15:07:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.569+0000 7fb5d5aa5700 1 -- 172.21.15.60:0/2980821833 learned_addr learned my addr 172.21.15.60:0/2980821833 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.570+0000 7fb5d5aa5700 1 -- 172.21.15.60:0/2980821833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d01068e0 con 0x7fb5d01056e0 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.570+0000 7fb5d5aa5700 1 --2- 172.21.15.60:0/2980821833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d0105b00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00098a0 tx=0x7fb5c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc6474351db9f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.570+0000 7fb5d4aa3700 1 -- 172.21.15.60:0/2980821833 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0004160 con 0x7fb5d01056e0 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.570+0000 7fb5d4aa3700 1 -- 172.21.15.60:0/2980821833 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5c00042c0 con 0x7fb5d01056e0 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.570+0000 7fb5d4aa3700 1 -- 172.21.15.60:0/2980821833 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0011a00 con 0x7fb5d01056e0 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 -- 172.21.15.60:0/2980821833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 msgr2=0x7fb5d0105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 --2- 172.21.15.60:0/2980821833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d0105b00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00098a0 tx=0x7fb5c0009bb0 comp rx=0 tx=0).stop 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 -- 172.21.15.60:0/2980821833 shutdown_connections 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 --2- 172.21.15.60:0/2980821833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d0105b00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 -- 172.21.15.60:0/2980821833 >> 172.21.15.60:0/2980821833 conn(0x7fb5d0100ca0 msgr2=0x7fb5d01030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:49.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 -- 172.21.15.60:0/2980821833 shutdown_connections 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 -- 172.21.15.60:0/2980821833 wait complete. 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.571+0000 7fb5d7d09700 1 Processor -- start 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d7d09700 1 -- start start 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d7d09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d7d09700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d019a9d0 con 0x7fb5d01056e0 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d5aa5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d5aa5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34520/0 (socket says 172.21.15.60:34520) 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d5aa5700 1 -- 172.21.15.60:0/565085772 learned_addr learned my addr 172.21.15.60:0/565085772 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d5aa5700 1 -- 172.21.15.60:0/565085772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c0009550 con 0x7fb5d01056e0 2023-10-05T15:07:49.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d5aa5700 1 --2- 172.21.15.60:0/565085772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d019a490 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0006af0 tx=0x7fb5c0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0003a40 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5c0003ba0 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d019abd0 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c001a700 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.572+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d019aff0 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.573+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb5c001ac30 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.573+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb5c0019700 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.574+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d00624e0 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.576+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb5c002de40 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.702+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb5d0109b10 con 0x7fb5d01056e0 2023-10-05T15:07:49.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.702+0000 7fb5c6ffd700 1 -- 172.21.15.60:0/565085772 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fb5c0024ad0 con 0x7fb5d01056e0 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.703+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 msgr2=0x7fb5d019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.703+0000 7fb5d7d09700 1 --2- 172.21.15.60:0/565085772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d019a490 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0006af0 tx=0x7fb5c0011ad0 comp rx=0 tx=0).stop 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.703+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 shutdown_connections 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.703+0000 7fb5d7d09700 1 --2- 172.21.15.60:0/565085772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d01056e0 0x7fb5d019a490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.703+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 >> 172.21.15.60:0/565085772 conn(0x7fb5d0100ca0 msgr2=0x7fb5d0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.703+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 shutdown_connections 2023-10-05T15:07:49.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:48.704+0000 7fb5d7d09700 1 -- 172.21.15.60:0/565085772 wait complete. 2023-10-05T15:07:49.114 INFO:teuthology.orchestra.run.smithi060.stdout:Restarting the monitor... 2023-10-05T15:07:49.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:49 smithi060 ceph-mon[98715]: from='client.? 172.21.15.60:0/565085772' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:07:49.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:49 smithi060 systemd[1]: Stopping Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:07:49.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[98691]: 2023-10-05T15:07:49.448+0000 7fb9d70f1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:07:49.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[98691]: 2023-10-05T15:07:49.448+0000 7fb9d70f1700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-05T15:07:50.080 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:49 smithi060 bash[99057]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a 2023-10-05T15:07:50.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-05T15:07:50.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 systemd[1]: Stopped Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:07:50.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 systemd[1]: Starting Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:07:50.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 podman[99190]: 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: set uid:gid to 167:167 (ceph:ceph) 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev), process ceph-mon, pid 7 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: pidfile_write: ignore empty --pid-file 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: load: jerasure load: lrc 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: RocksDB version: 7.9.2 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Git sha 0 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Compile date 2023-10-05 12:06:36 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: DB SUMMARY 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: DB Session ID: LXLEF9L6KLDSXBHFSBQO 2023-10-05T15:07:50.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: CURRENT file: CURRENT 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: IDENTITY file: IDENTITY 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99259 ; 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.error_if_exists: 0 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.create_if_missing: 0 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.paranoid_checks: 1 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.env: 0x555cc674fda0 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.fs: PosixFileSystem 2023-10-05T15:07:50.795 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.info_log: 0x555cc71875c0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_file_opening_threads: 16 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.statistics: (nil) 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.use_fsync: 0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_log_file_size: 0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.keep_log_file_num: 1000 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.recycle_log_file_num: 0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.allow_fallocate: 1 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.allow_mmap_reads: 0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.allow_mmap_writes: 0 2023-10-05T15:07:50.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.use_direct_reads: 0 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.create_missing_column_families: 0 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.db_log_dir: 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.wal_dir: 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.advise_random_on_open: 1 2023-10-05T15:07:50.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.db_write_buffer_size: 0 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.write_buffer_manager: 0x555cc713f360 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.rate_limiter: (nil) 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.wal_recovery_mode: 2 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.enable_thread_tracking: 0 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.enable_pipelined_write: 0 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.unordered_write: 0 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-05T15:07:50.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.row_cache: None 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.wal_filter: None 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.allow_ingest_behind: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.two_write_queues: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.manual_wal_flush: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.wal_compression: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.atomic_flush: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-05T15:07:50.799 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.log_readahead_size: 0 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.best_efforts_recovery: 0 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.allow_data_in_errors: 0 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.db_host_id: __hostname__ 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_background_jobs: 2 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_background_compactions: -1 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_subcompactions: 1 2023-10-05T15:07:50.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_total_wal_size: 0 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_open_files: -1 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bytes_per_sync: 0 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-05T15:07:50.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_readahead_size: 0 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_background_flushes: -1 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Compression algorithms supported: 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kZSTD supported: 0 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kXpressCompression supported: 0 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kLZ4HCCompression supported: 1 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kZlibCompression supported: 1 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kSnappyCompression supported: 1 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kLZ4Compression supported: 1 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: kBZip2Compression supported: 0 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-05T15:07:50.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.merge_operator: 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_filter: None 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_filter_factory: None 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.sst_partitioner_factory: None 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555cc71876c0) 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout: cache_index_and_filter_blocks: 1 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-05T15:07:50.803 INFO:journalctl@ceph.mon.a.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: pin_top_level_index_and_filter: 1 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_type: 0 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: data_block_index_type: 0 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_shortening: 1 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: checksum: 4 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: no_block_cache: 0 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache: 0x555cc71dd1f0 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_name: BinnedLRUCache 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_options: 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: capacity : 536870912 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: num_shard_bits : 4 2023-10-05T15:07:50.804 INFO:journalctl@ceph.mon.a.smithi060.stdout: strict_capacity_limit : 0 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: high_pri_pool_ratio: 0.000 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_compressed: (nil) 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: persistent_cache: (nil) 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_size: 4096 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_size_deviation: 10 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_restart_interval: 16 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_block_restart_interval: 1 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: metadata_block_size: 4096 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: partition_filters: 0 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: use_delta_encoding: 1 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: filter_policy: bloomfilter 2023-10-05T15:07:50.805 INFO:journalctl@ceph.mon.a.smithi060.stdout: whole_key_filtering: 1 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: verify_compression: 0 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: read_amp_bytes_per_bit: 0 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: format_version: 5 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: enable_index_compression: 1 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_align: 0 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: max_auto_readahead_size: 262144 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: prepopulate_block_cache: 0 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: initial_auto_readahead_size: 8192 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.write_buffer_size: 33554432 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_write_buffer_number: 2 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression: NoCompression 2023-10-05T15:07:50.806 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression: Disabled 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.prefix_extractor: nullptr 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.num_levels: 7 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:07:50.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.level: 32767 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.strategy: 0 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.enabled: false 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:07:50.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.target_file_size_base: 67108864 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-05T15:07:50.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.arena_block_size: 1048576 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.disable_auto_compactions: 0 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-05T15:07:50.810 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.table_properties_collectors: 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.inplace_update_support: 0 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-05T15:07:50.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.bloom_locality: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.max_successive_merges: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.paranoid_file_checks: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.force_consistency_checks: 1 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.report_bg_io_stats: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.ttl: 2592000 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.enable_blob_files: false 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.min_blob_size: 0 2023-10-05T15:07:50.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.blob_file_size: 268435456 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.blob_file_starting_level: 0 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 65544b19-cffc-4c75-92b9-883307d060e9 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696518470720178, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-05T15:07:50.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696518470721166, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94471, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92469, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13777, "raw_average_key_size": 50, "raw_value_size": 84943, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696518470, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "65544b19-cffc-4c75-92b9-883307d060e9", "db_session_id": "LXLEF9L6KLDSXBHFSBQO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696518470721238, "job": 1, "event": "recovery_finished"} 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555cc727a000 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: DB pointer 0x555cc7266000 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** DB Stats ** 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-05T15:07:50.814 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** Compaction Stats [default] ** 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: L0 2/0 94.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Sum 2/0 94.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2023-10-05T15:07:50.815 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** Compaction Stats [default] ** 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-05T15:07:50.816 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative compaction: 0.00 GB write, 29.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval compaction: 0.00 GB write, 29.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: Block cache BinnedLRUCache@0x555cc71dd1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: starting mon.a rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???) e1 preinit fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).mds e1 new map 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).mds e1 print_map 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: e1 2023-10-05T15:07:50.817 INFO:journalctl@ceph.mon.a.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout: legacy client fscid: -1 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout: No filesystems configured 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 bash[99190]: 8c174464088845a742ddee0596d17c074ff9f23e3002ff56d9c267ac0662d4f4 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-05T15:07:50.818 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: monmap e1: 1 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} 2023-10-05T15:07:50.819 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: fsmap 2023-10-05T15:07:50.819 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: osdmap e1: 0 total, 0 up, 0 in 2023-10-05T15:07:50.819 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 ceph-mon[99238]: mgrmap e1: no daemons active 2023-10-05T15:07:50.819 INFO:teuthology.orchestra.run.smithi060.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-05T15:07:51.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:50 smithi060 systemd[1]: Started Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:07:51.852 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.298+0000 7fe33cb3b700 1 Processor -- start 2023-10-05T15:07:51.856 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.298+0000 7fe33cb3b700 1 -- start start 2023-10-05T15:07:51.856 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.298+0000 7fe33cb3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338109720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:51.856 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.298+0000 7fe33cb3b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338079dd0 con 0x7fe338107330 2023-10-05T15:07:51.856 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338109720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:51.856 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338109720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34522/0 (socket says 172.21.15.60:34522) 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33659c700 1 -- 172.21.15.60:0/6179865 learned_addr learned my addr 172.21.15.60:0/6179865 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33659c700 1 -- 172.21.15.60:0/6179865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338079f10 con 0x7fe338107330 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33659c700 1 --2- 172.21.15.60:0/6179865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338109720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0098a0 tx=0x7fe32c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6723048e3b75ad15 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33559a700 1 -- 172.21.15.60:0/6179865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c004160 con 0x7fe338107330 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33559a700 1 -- 172.21.15.60:0/6179865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe32c0042c0 con 0x7fe338107330 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.299+0000 7fe33559a700 1 -- 172.21.15.60:0/6179865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c011a00 con 0x7fe338107330 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 -- 172.21.15.60:0/6179865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 msgr2=0x7fe338109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 --2- 172.21.15.60:0/6179865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338109720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0098a0 tx=0x7fe32c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 -- 172.21.15.60:0/6179865 shutdown_connections 2023-10-05T15:07:51.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 --2- 172.21.15.60:0/6179865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338109720 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 -- 172.21.15.60:0/6179865 >> 172.21.15.60:0/6179865 conn(0x7fe338100ca0 msgr2=0x7fe3381030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 -- 172.21.15.60:0/6179865 shutdown_connections 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.300+0000 7fe33cb3b700 1 -- 172.21.15.60:0/6179865 wait complete. 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33cb3b700 1 Processor -- start 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33cb3b700 1 -- start start 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33cb3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33cb3b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3381071d0 con 0x7fe338107330 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34524/0 (socket says 172.21.15.60:34524) 2023-10-05T15:07:51.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33659c700 1 -- 172.21.15.60:0/2424168639 learned_addr learned my addr 172.21.15.60:0/2424168639 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.301+0000 7fe33659c700 1 -- 172.21.15.60:0/2424168639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c009550 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe33659c700 1 --2- 172.21.15.60:0/2424168639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338106c90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009fb0 tx=0x7fe32c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c003930 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe32c003a90 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3381052e0 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe338105700 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c019610 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe32c019c00 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.302+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe32c0243f0 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.303+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe318005320 con 0x7fe338107330 2023-10-05T15:07:51.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.305+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe32c003c00 con 0x7fe338107330 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.431+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe3180058a0 con 0x7fe338107330 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.432+0000 7fe3277fe700 1 -- 172.21.15.60:0/2424168639 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe32c005a20 con 0x7fe338107330 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.433+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 msgr2=0x7fe338106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.433+0000 7fe33cb3b700 1 --2- 172.21.15.60:0/2424168639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338106c90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009fb0 tx=0x7fe32c011ad0 comp rx=0 tx=0).stop 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.433+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 shutdown_connections 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.433+0000 7fe33cb3b700 1 --2- 172.21.15.60:0/2424168639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe338107330 0x7fe338106c90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.433+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 >> 172.21.15.60:0/2424168639 conn(0x7fe338100ca0 msgr2=0x7fe3381019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.434+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 shutdown_connections 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:51.434+0000 7fe33cb3b700 1 -- 172.21.15.60:0/2424168639 wait complete. 2023-10-05T15:07:51.860 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-05T15:07:51.882 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:07:51.883 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mgr... 2023-10-05T15:07:51.883 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-05T15:07:51.883 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-05T15:07:52.094 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x 2023-10-05T15:07:52.094 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-05T15:07:52.188 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7.target.wants/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@.service. 2023-10-05T15:07:52.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:52 smithi060 systemd[1]: Starting Ceph mgr.x for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:07:52.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:52 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2424168639' entity='client.admin' 2023-10-05T15:07:52.782 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:52 smithi060 podman[99468]: 2023-10-05T15:07:52.798 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:07:52.798 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2023-10-05T15:07:52.806 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:07:52.806 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2023-10-05T15:07:52.806 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2023-10-05T15:07:52.806 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2023-10-05T15:07:52.814 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:07:52.814 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2023-10-05T15:07:52.823 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:07:52.823 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2023-10-05T15:07:52.823 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2023-10-05T15:07:52.823 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-05T15:07:52.823 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr to start... 2023-10-05T15:07:52.824 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr... 2023-10-05T15:07:53.084 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:52 smithi060 bash[99468]: ac8f200dcec8cbc5f74022063b2090b22df3700e47e0f1df502b2e9db72cc8aa 2023-10-05T15:07:53.084 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:52 smithi060 systemd[1]: Started Ceph mgr.x for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:07:53.084 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:52 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:52.923+0000 7fe5b664a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:07:53.084 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:53.020+0000 7fe5b664a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:07:53.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:53.135+0000 7fe5b664a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:07:53.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:53.249+0000 7fe5b664a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:07:53.882 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:53.882 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:53.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:07:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:07:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-05T15:07:53.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:07:46.062432+0000", 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:07:53.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.370+0000 7f97cd02d700 1 Processor -- start 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.370+0000 7f97cd02d700 1 -- start start 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.370+0000 7f97cd02d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c8106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.370+0000 7f97cd02d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c81071f0 con 0x7f97c8106800 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c8106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c8106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34530/0 (socket says 172.21.15.60:34530) 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c6d9d700 1 -- 172.21.15.60:0/1677966633 learned_addr learned my addr 172.21.15.60:0/1677966633 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c6d9d700 1 -- 172.21.15.60:0/1677966633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c8107a00 con 0x7f97c8106800 2023-10-05T15:07:53.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c6d9d700 1 --2- 172.21.15.60:0/1677966633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c8106c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f97b80098a0 tx=0x7f97b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b132a8f7a51e40fe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c5d9b700 1 -- 172.21.15.60:0/1677966633 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97b8004160 con 0x7f97c8106800 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c5d9b700 1 -- 172.21.15.60:0/1677966633 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97b80042c0 con 0x7f97c8106800 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.371+0000 7f97c5d9b700 1 -- 172.21.15.60:0/1677966633 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97b8011a00 con 0x7f97c8106800 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.372+0000 7f97cd02d700 1 -- 172.21.15.60:0/1677966633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 msgr2=0x7f97c8106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.372+0000 7f97cd02d700 1 --2- 172.21.15.60:0/1677966633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c8106c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f97b80098a0 tx=0x7f97b8009bb0 comp rx=0 tx=0).stop 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.372+0000 7f97cd02d700 1 -- 172.21.15.60:0/1677966633 shutdown_connections 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.372+0000 7f97cd02d700 1 --2- 172.21.15.60:0/1677966633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c8106c20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.372+0000 7f97cd02d700 1 -- 172.21.15.60:0/1677966633 >> 172.21.15.60:0/1677966633 conn(0x7f97c8101da0 msgr2=0x7f97c81041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.372+0000 7f97cd02d700 1 -- 172.21.15.60:0/1677966633 shutdown_connections 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.373+0000 7f97cd02d700 1 -- 172.21.15.60:0/1677966633 wait complete. 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.373+0000 7f97cd02d700 1 Processor -- start 2023-10-05T15:07:53.889 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.373+0000 7f97cd02d700 1 -- start start 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97cd02d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c807bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97cd02d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c807c190 con 0x7f97c8106800 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97c6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c807bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97c6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c807bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34532/0 (socket says 172.21.15.60:34532) 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97c6d9d700 1 -- 172.21.15.60:0/2307402244 learned_addr learned my addr 172.21.15.60:0/2307402244 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97c6d9d700 1 -- 172.21.15.60:0/2307402244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8009550 con 0x7f97c8106800 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97c6d9d700 1 --2- 172.21.15.60:0/2307402244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c807bc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009fb0 tx=0x7f97b8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.374+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97b8003930 con 0x7f97c8106800 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.375+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97b8003a90 con 0x7f97c8106800 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.375+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c807a2a0 con 0x7f97c8106800 2023-10-05T15:07:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.375+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97b80195e0 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.375+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c807a6c0 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.375+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f97b8019ba0 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.375+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f97b80243f0 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.376+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c80624e0 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.378+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f97b8003c00 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.512+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f97c810ac30 con 0x7f97c8106800 2023-10-05T15:07:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.512+0000 7f97affff700 1 -- 172.21.15.60:0/2307402244 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f97b801a9d0 con 0x7f97c8106800 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.513+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 msgr2=0x7f97c807bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.513+0000 7f97cd02d700 1 --2- 172.21.15.60:0/2307402244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c807bc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009fb0 tx=0x7f97b8011ad0 comp rx=0 tx=0).stop 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.513+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 shutdown_connections 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.513+0000 7f97cd02d700 1 --2- 172.21.15.60:0/2307402244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c8106800 0x7f97c807bc50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.513+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 >> 172.21.15.60:0/2307402244 conn(0x7f97c8101da0 msgr2=0x7f97c8103410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.513+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 shutdown_connections 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:53.514+0000 7f97cd02d700 1 -- 172.21.15.60:0/2307402244 wait complete. 2023-10-05T15:07:53.892 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (1/15)... 2023-10-05T15:07:53.907 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2307402244' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:07:53.908 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:53.461+0000 7fe5b664a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:07:54.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:53.949+0000 7fe5b664a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:07:54.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:54 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:54.102+0000 7fe5b664a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:07:54.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:54 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:54.210+0000 7fe5b664a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:07:54.665 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:54 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:54.325+0000 7fe5b664a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:07:55.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:54 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:54.837+0000 7fe5b664a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:07:55.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:55 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:55.632+0000 7fe5b664a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:07:55.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:55 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:55.730+0000 7fe5b664a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:07:56.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:56 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/224387556' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:07:56.840 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:56 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:56.726+0000 7fe5b664a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:07:56.922 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:07:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:07:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:07:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:07:56.925 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:07:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:07:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:07:56.928 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:07:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:07:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:07:56.936 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:07:56.938 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:07:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:07:46.062432+0000", 2023-10-05T15:07:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f26684700 1 Processor -- start 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f26684700 1 -- start start 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f26684700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f201054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f26684700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20079e30 con 0x7f5f201050c0 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f201054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f201054e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34534/0 (socket says 172.21.15.60:34534) 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f1ffff700 1 -- 172.21.15.60:0/2357034423 learned_addr learned my addr 172.21.15.60:0/2357034423 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.406+0000 7f5f1ffff700 1 -- 172.21.15.60:0/2357034423 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20105a20 con 0x7f5f201050c0 2023-10-05T15:07:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.407+0000 7f5f1ffff700 1 --2- 172.21.15.60:0/2357034423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f201054e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f100098a0 tx=0x7f5f10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56685b0560bf7f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.407+0000 7f5f1effd700 1 -- 172.21.15.60:0/2357034423 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f10004160 con 0x7f5f201050c0 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.407+0000 7f5f1effd700 1 -- 172.21.15.60:0/2357034423 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f100042c0 con 0x7f5f201050c0 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.407+0000 7f5f1effd700 1 -- 172.21.15.60:0/2357034423 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f10011a00 con 0x7f5f201050c0 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 -- 172.21.15.60:0/2357034423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 msgr2=0x7f5f201054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 --2- 172.21.15.60:0/2357034423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f201054e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f100098a0 tx=0x7f5f10009bb0 comp rx=0 tx=0).stop 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 -- 172.21.15.60:0/2357034423 shutdown_connections 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 --2- 172.21.15.60:0/2357034423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f201054e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 -- 172.21.15.60:0/2357034423 >> 172.21.15.60:0/2357034423 conn(0x7f5f20100ca0 msgr2=0x7f5f201030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 -- 172.21.15.60:0/2357034423 shutdown_connections 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.408+0000 7f5f26684700 1 -- 172.21.15.60:0/2357034423 wait complete. 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f26684700 1 Processor -- start 2023-10-05T15:07:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f26684700 1 -- start start 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f26684700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f2019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f26684700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2019cb30 con 0x7f5f201050c0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f2019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f2019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34536/0 (socket says 172.21.15.60:34536) 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.409+0000 7f5f1ffff700 1 -- 172.21.15.60:0/224387556 learned_addr learned my addr 172.21.15.60:0/224387556 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1ffff700 1 -- 172.21.15.60:0/224387556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f10009550 con 0x7f5f201050c0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1ffff700 1 --2- 172.21.15.60:0/224387556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f2019c5f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5f10006af0 tx=0x7f5f10011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f10003a40 con 0x7f5f201050c0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f10003ba0 con 0x7f5f201050c0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f26684700 1 -- 172.21.15.60:0/224387556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2019cd30 con 0x7f5f201050c0 2023-10-05T15:07:56.942 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f1001a6e0 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f26684700 1 -- 172.21.15.60:0/224387556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2019d150 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5f1001ac50 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.410+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5f10019700 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.411+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f000052f0 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.416+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5f10024a60 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.551+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5f00005870 con 0x7f5f201050c0 2023-10-05T15:07:56.943 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.551+0000 7f5f1d7fa700 1 -- 172.21.15.60:0/224387556 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5f10024c00 con 0x7f5f201050c0 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 msgr2=0x7f5f2019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 --2- 172.21.15.60:0/224387556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f2019c5f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5f10006af0 tx=0x7f5f10011ad0 comp rx=0 tx=0).stop 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 shutdown_connections 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 --2- 172.21.15.60:0/224387556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f201050c0 0x7f5f2019c5f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 >> 172.21.15.60:0/224387556 conn(0x7f5f20100ca0 msgr2=0x7f5f20190c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 shutdown_connections 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:56.552+0000 7f5f06ffd700 1 -- 172.21.15.60:0/224387556 wait complete. 2023-10-05T15:07:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (2/15)... 2023-10-05T15:07:57.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:56 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:56.838+0000 7fe5b664a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:07:57.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:57 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:57.061+0000 7fe5b664a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:07:57.697 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:57 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:57.416+0000 7fe5b664a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:07:57.697 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:57 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:57.695+0000 7fe5b664a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:07:58.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:57 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:57.879+0000 7fe5b664a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:07:58.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:58 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:58.211+0000 7fe5b664a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:07:59.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:59.043+0000 7fe5b664a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:07:59.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:59.208+0000 7fe5b664a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:07:59.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:07:59 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3539907184' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:07:59.741 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:59.472+0000 7fe5b664a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:07:59.741 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:59.616+0000 7fe5b664a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:07:59.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:07:59.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:07:59.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:07:59.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:59.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:07:59.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:07:59.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:07:59.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.993 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:07:59.994 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:07:46.062432+0000", 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.444+0000 7ff661ccd700 1 Processor -- start 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.444+0000 7ff661ccd700 1 -- start start 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.444+0000 7ff661ccd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c109680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.444+0000 7ff661ccd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c079e70 con 0x7ff65c107290 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34538/0 (socket says 172.21.15.60:34538) 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65b7fe700 1 -- 172.21.15.60:0/143979874 learned_addr learned my addr 172.21.15.60:0/143979874 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:59.995 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65b7fe700 1 -- 172.21.15.60:0/143979874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c109bc0 con 0x7ff65c107290 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65b7fe700 1 --2- 172.21.15.60:0/143979874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c109680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff6500098a0 tx=0x7ff650009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7b5beb0fb49318 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65a7fc700 1 -- 172.21.15.60:0/143979874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff650004160 con 0x7ff65c107290 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65a7fc700 1 -- 172.21.15.60:0/143979874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff6500042c0 con 0x7ff65c107290 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.445+0000 7ff65a7fc700 1 -- 172.21.15.60:0/143979874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff650011a00 con 0x7ff65c107290 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 -- 172.21.15.60:0/143979874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 msgr2=0x7ff65c109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 --2- 172.21.15.60:0/143979874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c109680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff6500098a0 tx=0x7ff650009bb0 comp rx=0 tx=0).stop 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 -- 172.21.15.60:0/143979874 shutdown_connections 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 --2- 172.21.15.60:0/143979874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c109680 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 -- 172.21.15.60:0/143979874 >> 172.21.15.60:0/143979874 conn(0x7ff65c100ca0 msgr2=0x7ff65c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 -- 172.21.15.60:0/143979874 shutdown_connections 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.446+0000 7ff661ccd700 1 -- 172.21.15.60:0/143979874 wait complete. 2023-10-05T15:07:59.996 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.447+0000 7ff661ccd700 1 Processor -- start 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.447+0000 7ff661ccd700 1 -- start start 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.447+0000 7ff661ccd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.447+0000 7ff661ccd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c19a970 con 0x7ff65c107290 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff65b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff65b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34540/0 (socket says 172.21.15.60:34540) 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff65b7fe700 1 -- 172.21.15.60:0/3539907184 learned_addr learned my addr 172.21.15.60:0/3539907184 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff65b7fe700 1 -- 172.21.15.60:0/3539907184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009550 con 0x7ff65c107290 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff65b7fe700 1 --2- 172.21.15.60:0/3539907184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c19a430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff650006af0 tx=0x7ff650011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff650003a40 con 0x7ff65c107290 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff650003ba0 con 0x7ff65c107290 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c19ab70 con 0x7ff65c107290 2023-10-05T15:07:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff65001a6e0 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.448+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c19af90 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.449+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff65001ac50 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.449+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff650019700 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.449+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0624e0 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.452+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff65002de30 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.584+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff65c10a960 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.585+0000 7ff658ff9700 1 -- 172.21.15.60:0/3539907184 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ff650024a60 con 0x7ff65c107290 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 msgr2=0x7ff65c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 --2- 172.21.15.60:0/3539907184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c19a430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff650006af0 tx=0x7ff650011ad0 comp rx=0 tx=0).stop 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 shutdown_connections 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 --2- 172.21.15.60:0/3539907184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65c107290 0x7ff65c19a430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:07:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 >> 172.21.15.60:0/3539907184 conn(0x7ff65c100ca0 msgr2=0x7ff65c101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:07:59.999 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 shutdown_connections 2023-10-05T15:07:59.999 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:07:59.586+0000 7ff661ccd700 1 -- 172.21.15.60:0/3539907184 wait complete. 2023-10-05T15:07:59.999 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (3/15)... 2023-10-05T15:08:00.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:07:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:07:59.896+0000 7fe5b664a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:08:01.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:00.955+0000 7fe5b664a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:08:02.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: Activating manager daemon x 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: mgrmap e2: x(active, starting, since 0.00316137s) 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: Manager daemon x is now available 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' 2023-10-05T15:08:02.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' 2023-10-05T15:08:02.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:01 smithi060 ceph-mon[99238]: from='mgr.14100 172.21.15.60:0/114247795' entity='mgr.x' 2023-10-05T15:08:03.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:02 smithi060 ceph-mon[99238]: mgrmap e3: x(active, since 1.00797s) 2023-10-05T15:08:05.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:04 smithi060 ceph-mon[99238]: mgrmap e4: x(active, since 3s) 2023-10-05T15:08:06.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1520362717' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:08:08.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:08:08.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:08:08.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:08:08.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:08:08.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:08:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:08:08.153 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:08:08.153 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:08:08.153 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:08:08.153 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.153 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:08:08.153 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:08:08.154 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.155 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:07:46.062432+0000", 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d3e6b1700 1 Processor -- start 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d3e6b1700 1 -- start start 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d3e6b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d3e6b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d381060d0 con 0x7f7d381056e0 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:08.156 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34566/0 (socket says 172.21.15.60:34566) 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d37fff700 1 -- 172.21.15.60:0/467676391 learned_addr learned my addr 172.21.15.60:0/467676391 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d37fff700 1 -- 172.21.15.60:0/467676391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d381068e0 con 0x7f7d381056e0 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.021+0000 7f7d37fff700 1 --2- 172.21.15.60:0/467676391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38105b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7d280098a0 tx=0x7f7d28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2b3fb5c41e5413 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d36ffd700 1 -- 172.21.15.60:0/467676391 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d28004160 con 0x7f7d381056e0 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d36ffd700 1 -- 172.21.15.60:0/467676391 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d280042c0 con 0x7f7d381056e0 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d36ffd700 1 -- 172.21.15.60:0/467676391 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d28011a00 con 0x7f7d381056e0 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/467676391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 msgr2=0x7f7d38105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 --2- 172.21.15.60:0/467676391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38105b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7d280098a0 tx=0x7f7d28009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/467676391 shutdown_connections 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 --2- 172.21.15.60:0/467676391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38105b00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/467676391 >> 172.21.15.60:0/467676391 conn(0x7f7d38100ca0 msgr2=0x7f7d381030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:08.157 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/467676391 shutdown_connections 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.022+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/467676391 wait complete. 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.023+0000 7f7d3e6b1700 1 Processor -- start 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.023+0000 7f7d3e6b1700 1 -- start start 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.023+0000 7f7d3e6b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38079b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.023+0000 7f7d3e6b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3819d160 con 0x7f7d381056e0 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.023+0000 7f7d37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38079b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38079b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34568/0 (socket says 172.21.15.60:34568) 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d37fff700 1 -- 172.21.15.60:0/1520362717 learned_addr learned my addr 172.21.15.60:0/1520362717 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d37fff700 1 -- 172.21.15.60:0/1520362717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009550 con 0x7f7d381056e0 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d37fff700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38079b30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009fb0 tx=0x7f7d28011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d28003930 con 0x7f7d381056e0 2023-10-05T15:08:08.158 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d28003a90 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3819d2a0 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d280195e0 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.024+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3819d6c0 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.025+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f7d28019850 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.025+0000 7f7d357fa700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f7d200387d0 0x7f7d2003ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.025+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380624e0 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.025+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7d2804c570 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.025+0000 7f7d377fe700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f7d200387d0 0x7f7d2003ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.026+0000 7f7d377fe700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f7d200387d0 0x7f7d2003ac90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c006fd0 tx=0x7f7d2c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.031+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d28019b00 con 0x7f7d381056e0 2023-10-05T15:08:08.159 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.555+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7d38109b10 con 0x7f7d381056e0 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.556+0000 7f7d357fa700 1 -- 172.21.15.60:0/1520362717 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f7d28018350 con 0x7f7d381056e0 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f7d200387d0 msgr2=0x7f7d2003ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f7d200387d0 0x7f7d2003ac90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c006fd0 tx=0x7f7d2c006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 msgr2=0x7f7d38079b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38079b30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009fb0 tx=0x7f7d28011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 shutdown_connections 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f7d200387d0 0x7f7d2003ac90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 --2- 172.21.15.60:0/1520362717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d381056e0 0x7f7d38079b30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 >> 172.21.15.60:0/1520362717 conn(0x7f7d38100ca0 msgr2=0x7f7d38102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 shutdown_connections 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:05.558+0000 7f7d3e6b1700 1 -- 172.21.15.60:0/1520362717 wait complete. 2023-10-05T15:08:08.160 INFO:teuthology.orchestra.run.smithi060.stdout:mgr is available 2023-10-05T15:08:09.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:09 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4083132960' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-05T15:08:09.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:08:09.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2023-10-05T15:08:09.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-05T15:08:09.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0de0d23700 1 Processor -- start 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0de0d23700 1 -- start start 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0de0d23700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc1054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0de0d23700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc079e50 con 0x7f0ddc1050a0 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0dda59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc1054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0dda59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc1054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34572/0 (socket says 172.21.15.60:34572) 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.679+0000 7f0dda59c700 1 -- 172.21.15.60:0/4098929048 learned_addr learned my addr 172.21.15.60:0/4098929048 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:09.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.680+0000 7f0dda59c700 1 -- 172.21.15.60:0/4098929048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc105a00 con 0x7f0ddc1050a0 2023-10-05T15:08:09.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.680+0000 7f0dda59c700 1 --2- 172.21.15.60:0/4098929048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc1054c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098a0 tx=0x7f0dcc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bade050da0ea53c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:09.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.680+0000 7f0dd959a700 1 -- 172.21.15.60:0/4098929048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc004160 con 0x7f0ddc1050a0 2023-10-05T15:08:09.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.680+0000 7f0dd959a700 1 -- 172.21.15.60:0/4098929048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0dcc0042c0 con 0x7f0ddc1050a0 2023-10-05T15:08:09.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.680+0000 7f0dd959a700 1 -- 172.21.15.60:0/4098929048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc011a00 con 0x7f0ddc1050a0 2023-10-05T15:08:09.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 -- 172.21.15.60:0/4098929048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 msgr2=0x7f0ddc1054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:09.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 --2- 172.21.15.60:0/4098929048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc1054c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098a0 tx=0x7f0dcc009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 -- 172.21.15.60:0/4098929048 shutdown_connections 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 --2- 172.21.15.60:0/4098929048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc1054c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 -- 172.21.15.60:0/4098929048 >> 172.21.15.60:0/4098929048 conn(0x7f0ddc100ca0 msgr2=0x7f0ddc1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 -- 172.21.15.60:0/4098929048 shutdown_connections 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.681+0000 7f0de0d23700 1 -- 172.21.15.60:0/4098929048 wait complete. 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0de0d23700 1 Processor -- start 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0de0d23700 1 -- start start 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0de0d23700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0de0d23700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc19cb80 con 0x7f0ddc1050a0 2023-10-05T15:08:09.508 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0dda59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0dda59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc19c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34574/0 (socket says 172.21.15.60:34574) 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0dda59c700 1 -- 172.21.15.60:0/4083132960 learned_addr learned my addr 172.21.15.60:0/4083132960 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0dda59c700 1 -- 172.21.15.60:0/4083132960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc009550 con 0x7f0ddc1050a0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.682+0000 7f0dda59c700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc19c640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009fb0 tx=0x7f0dcc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.683+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc003930 con 0x7f0ddc1050a0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.683+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc19cd80 con 0x7f0ddc1050a0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.683+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0dcc003a90 con 0x7f0ddc1050a0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.683+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc019610 con 0x7f0ddc1050a0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.683+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc19d1a0 con 0x7f0ddc1050a0 2023-10-05T15:08:09.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.684+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f0dcc0198d0 con 0x7f0ddc1050a0 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.684+0000 7f0dcb7fe700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f0dc4038780 0x7f0dc403ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.684+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0dcc04c5a0 con 0x7f0ddc1050a0 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.684+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc195ef0 con 0x7f0ddc1050a0 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.684+0000 7f0dd9d9b700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f0dc4038780 0x7f0dc403ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.684+0000 7f0dd9d9b700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f0dc4038780 0x7f0dc403ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0006fd0 tx=0x7f0dd0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:08.689+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0dcc019b80 con 0x7f0ddc1050a0 2023-10-05T15:08:09.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.048+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0ddc0624e0 con 0x7f0ddc1050a0 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.049+0000 7f0dcb7fe700 1 -- 172.21.15.60:0/4083132960 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f0dcc018350 con 0x7f0ddc1050a0 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f0dc4038780 msgr2=0x7f0dc403ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f0dc4038780 0x7f0dc403ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0006fd0 tx=0x7f0dd0006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 msgr2=0x7f0ddc19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc19c640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009fb0 tx=0x7f0dcc011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 shutdown_connections 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f0dc4038780 0x7f0dc403ac40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 --2- 172.21.15.60:0/4083132960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ddc1050a0 0x7f0ddc19c640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 >> 172.21.15.60:0/4083132960 conn(0x7f0ddc100ca0 msgr2=0x7f0ddc190c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 shutdown_connections 2023-10-05T15:08:09.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:09.051+0000 7f0de0d23700 1 -- 172.21.15.60:0/4083132960 wait complete. 2023-10-05T15:08:09.512 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling cephadm module... 2023-10-05T15:08:10.843 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:10 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3627500082' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-05T15:08:10.843 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: ignoring --setuser ceph since I am not root 2023-10-05T15:08:10.843 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: ignoring --setgroup ceph since I am not root 2023-10-05T15:08:10.843 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:10.744+0000 7f465f20a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.013+0000 7f05417e4700 1 Processor -- start 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f05417e4700 1 -- start start 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f05417e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f05417e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c1054d0 con 0x7f053c104ae0 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f053affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f053affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34578/0 (socket says 172.21.15.60:34578) 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f053affd700 1 -- 172.21.15.60:0/132414012 learned_addr learned my addr 172.21.15.60:0/132414012 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f053affd700 1 -- 172.21.15.60:0/132414012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c107a70 con 0x7f053c104ae0 2023-10-05T15:08:10.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.014+0000 7f053affd700 1 --2- 172.21.15.60:0/132414012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c104f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098a0 tx=0x7f052c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7814ce535bd7adb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f0539ffb700 1 -- 172.21.15.60:0/132414012 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c004160 con 0x7f053c104ae0 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f0539ffb700 1 -- 172.21.15.60:0/132414012 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f052c0042c0 con 0x7f053c104ae0 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f0539ffb700 1 -- 172.21.15.60:0/132414012 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c011a00 con 0x7f053c104ae0 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 -- 172.21.15.60:0/132414012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 msgr2=0x7f053c104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 --2- 172.21.15.60:0/132414012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c104f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098a0 tx=0x7f052c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 -- 172.21.15.60:0/132414012 shutdown_connections 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 --2- 172.21.15.60:0/132414012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c104f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:10.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 -- 172.21.15.60:0/132414012 >> 172.21.15.60:0/132414012 conn(0x7f053c100450 msgr2=0x7f053c102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 -- 172.21.15.60:0/132414012 shutdown_connections 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.015+0000 7f05417e4700 1 -- 172.21.15.60:0/132414012 wait complete. 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f05417e4700 1 Processor -- start 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f05417e4700 1 -- start start 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f05417e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f05417e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c19a9e0 con 0x7f053c104ae0 2023-10-05T15:08:10.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f053affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f053affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34580/0 (socket says 172.21.15.60:34580) 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.016+0000 7f053affd700 1 -- 172.21.15.60:0/3627500082 learned_addr learned my addr 172.21.15.60:0/3627500082 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f053affd700 1 -- 172.21.15.60:0/3627500082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009550 con 0x7f053c104ae0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f053affd700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c19a4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f052c009130 tx=0x7f052c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c003ab0 con 0x7f053c104ae0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f052c003c10 con 0x7f053c104ae0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c19abe0 con 0x7f053c104ae0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c0247d0 con 0x7f053c104ae0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.017+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c19b000 con 0x7f053c104ae0 2023-10-05T15:08:10.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.018+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f052c01abb0 con 0x7f053c104ae0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.018+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c0624e0 con 0x7f053c104ae0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.018+0000 7f0523fff700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f05240387d0 0x7f052403ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.018+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f052c04c5a0 con 0x7f053c104ae0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.018+0000 7f053a7fc700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f05240387d0 0x7f052403ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.019+0000 7f053a7fc700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f05240387d0 0x7f052403ac90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0530006fd0 tx=0x7f0530006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.023+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f052c018920 con 0x7f053c104ae0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.501+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f053c10adb0 con 0x7f053c104ae0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.552+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f052c018350 con 0x7f053c104ae0 2023-10-05T15:08:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.554+0000 7f0523fff700 1 -- 172.21.15.60:0/3627500082 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f052c02d770 con 0x7f053c104ae0 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f05240387d0 msgr2=0x7f052403ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f05240387d0 0x7f052403ac90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0530006fd0 tx=0x7f0530006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 msgr2=0x7f053c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c19a4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f052c009130 tx=0x7f052c011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 shutdown_connections 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f05240387d0 0x7f052403ac90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 --2- 172.21.15.60:0/3627500082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c104ae0 0x7f053c19a4a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 >> 172.21.15.60:0/3627500082 conn(0x7f053c100450 msgr2=0x7f053c101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 shutdown_connections 2023-10-05T15:08:10.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:10.555+0000 7f05417e4700 1 -- 172.21.15.60:0/3627500082 wait complete. 2023-10-05T15:08:11.161 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:10.841+0000 7f465f20a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:08:11.161 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:10.951+0000 7f465f20a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:08:11.162 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:11.068+0000 7f465f20a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:08:11.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:11.284+0000 7f465f20a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:08:11.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:11.764+0000 7f465f20a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:08:11.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:11 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3627500082' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-05T15:08:11.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:11 smithi060 ceph-mon[99238]: mgrmap e5: x(active, since 9s) 2023-10-05T15:08:12.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:08:12.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.451+0000 7f2f3595c700 1 Processor -- start 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f3595c700 1 -- start start 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f3595c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f30106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f3595c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301071f0 con 0x7f2f30106800 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f30106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f30106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34594/0 (socket says 172.21.15.60:34594) 2023-10-05T15:08:12.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f2effd700 1 -- 172.21.15.60:0/2223486267 learned_addr learned my addr 172.21.15.60:0/2223486267 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f2effd700 1 -- 172.21.15.60:0/2223486267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30107a00 con 0x7f2f30106800 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.452+0000 7f2f2effd700 1 --2- 172.21.15.60:0/2223486267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f30106c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f200098a0 tx=0x7f2f20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6248e43c35de5a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f2dffb700 1 -- 172.21.15.60:0/2223486267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f20004160 con 0x7f2f30106800 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f2dffb700 1 -- 172.21.15.60:0/2223486267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f200042c0 con 0x7f2f30106800 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f2dffb700 1 -- 172.21.15.60:0/2223486267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f20011a00 con 0x7f2f30106800 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f3595c700 1 -- 172.21.15.60:0/2223486267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 msgr2=0x7f2f30106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f3595c700 1 --2- 172.21.15.60:0/2223486267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f30106c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f200098a0 tx=0x7f2f20009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f3595c700 1 -- 172.21.15.60:0/2223486267 shutdown_connections 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f3595c700 1 --2- 172.21.15.60:0/2223486267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f30106c20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.453+0000 7f2f3595c700 1 -- 172.21.15.60:0/2223486267 >> 172.21.15.60:0/2223486267 conn(0x7f2f30101da0 msgr2=0x7f2f301041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.454+0000 7f2f3595c700 1 -- 172.21.15.60:0/2223486267 shutdown_connections 2023-10-05T15:08:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.454+0000 7f2f3595c700 1 -- 172.21.15.60:0/2223486267 wait complete. 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.454+0000 7f2f3595c700 1 Processor -- start 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.454+0000 7f2f3595c700 1 -- start start 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3595c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f3019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3595c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3019a9f0 con 0x7f2f30106800 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f3019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f3019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34596/0 (socket says 172.21.15.60:34596) 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f2effd700 1 -- 172.21.15.60:0/1215077401 learned_addr learned my addr 172.21.15.60:0/1215077401 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f2effd700 1 -- 172.21.15.60:0/1215077401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009550 con 0x7f2f30106800 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f2effd700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f3019a4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009fb0 tx=0x7f2f20011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f20003930 con 0x7f2f30106800 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3019abf0 con 0x7f2f30106800 2023-10-05T15:08:12.400 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f20003a90 con 0x7f2f30106800 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f200195e0 con 0x7f2f30106800 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.455+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3019b010 con 0x7f2f30106800 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.456+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f2f200198a0 con 0x7f2f30106800 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.456+0000 7f2f3495a700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 0x7f2f1803ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.457+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f2004c600 con 0x7f2f30106800 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.457+0000 7f2f2e7fc700 1 -- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 msgr2=0x7f2f1803ac90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:12.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.457+0000 7f2f2e7fc700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 0x7f2f1803ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.457+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f300624e0 con 0x7f2f30106800 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.462+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f20019ba0 con 0x7f2f30106800 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.658+0000 7f2f2e7fc700 1 -- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 msgr2=0x7f2f1803ac90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.658+0000 7f2f2e7fc700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 0x7f2f1803ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.939+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2f3010ac30 con 0x7f2f30106800 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.939+0000 7f2f3495a700 1 -- 172.21.15.60:0/1215077401 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f2f200172b0 con 0x7f2f30106800 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 msgr2=0x7f2f1803ac90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 0x7f2f1803ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:12.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 msgr2=0x7f2f3019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f3019a4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009fb0 tx=0x7f2f20011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 shutdown_connections 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2f180387d0 0x7f2f1803ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 --2- 172.21.15.60:0/1215077401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f30106800 0x7f2f3019a4b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.941+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 >> 172.21.15.60:0/1215077401 conn(0x7f2f30101da0 msgr2=0x7f2f30103410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.942+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 shutdown_connections 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:11.942+0000 7f2f3595c700 1 -- 172.21.15.60:0/1215077401 wait complete. 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2023-10-05T15:08:12.403 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 5... 2023-10-05T15:08:12.403 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:11.924+0000 7f465f20a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:08:12.404 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:12.045+0000 7f465f20a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:08:12.404 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:12.162+0000 7f465f20a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:08:12.657 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:12 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1215077401' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-05T15:08:12.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:12.691+0000 7f465f20a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:08:13.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:13.479+0000 7f465f20a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:08:13.915 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:13.578+0000 7f465f20a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:08:14.885 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:14.552+0000 7f465f20a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:08:14.886 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:14.663+0000 7f465f20a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:08:15.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:14.884+0000 7f465f20a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:08:15.489 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:15.234+0000 7f465f20a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:08:15.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:15.487+0000 7f465f20a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:08:15.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:15.671+0000 7f465f20a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:08:16.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:16.001+0000 7f465f20a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:08:17.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:16.826+0000 7f465f20a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:08:17.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:16.985+0000 7f465f20a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:08:17.643 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:17.232+0000 7f465f20a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:08:17.644 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:17.370+0000 7f465f20a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:08:17.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:17.641+0000 7f465f20a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:08:19.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:18.702+0000 7f465f20a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:08:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: Active manager daemon x restarted 2023-10-05T15:08:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: Activating manager daemon x 2023-10-05T15:08:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: osdmap e2: 0 total, 0 up, 0 in 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: mgrmap e6: x(active, starting, since 0.00343047s) 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: Manager daemon x is now available 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:19.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:18 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:20.077 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:19 smithi060 ceph-mon[99238]: Found migration_current of "None". Setting to last migration. 2023-10-05T15:08:20.077 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:19 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:20.077 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:19 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:08:20.077 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:19 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:08:20.077 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:19 smithi060 ceph-mon[99238]: mgrmap e7: x(active, since 1.00554s) 2023-10-05T15:08:20.167 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f20515e1700 1 Processor -- start 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f20515e1700 1 -- start start 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f20515e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c109640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f20515e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c079eb0 con 0x7f204c107250 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f204affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f204affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34604/0 (socket says 172.21.15.60:34604) 2023-10-05T15:08:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.883+0000 7f204affd700 1 -- 172.21.15.60:0/679155202 learned_addr learned my addr 172.21.15.60:0/679155202 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.884+0000 7f204affd700 1 -- 172.21.15.60:0/679155202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c109b80 con 0x7f204c107250 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.884+0000 7f204affd700 1 --2- 172.21.15.60:0/679155202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c109640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098a0 tx=0x7f203c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7abc6ab9e548d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.884+0000 7f2049ffb700 1 -- 172.21.15.60:0/679155202 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203c004160 con 0x7f204c107250 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.884+0000 7f2049ffb700 1 -- 172.21.15.60:0/679155202 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f203c0042c0 con 0x7f204c107250 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.884+0000 7f2049ffb700 1 -- 172.21.15.60:0/679155202 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203c011a00 con 0x7f204c107250 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 -- 172.21.15.60:0/679155202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 msgr2=0x7f204c109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 --2- 172.21.15.60:0/679155202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c109640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098a0 tx=0x7f203c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 -- 172.21.15.60:0/679155202 shutdown_connections 2023-10-05T15:08:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 --2- 172.21.15.60:0/679155202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c109640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.170 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 -- 172.21.15.60:0/679155202 >> 172.21.15.60:0/679155202 conn(0x7f204c100ca0 msgr2=0x7f204c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:20.170 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 -- 172.21.15.60:0/679155202 shutdown_connections 2023-10-05T15:08:20.170 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 -- 172.21.15.60:0/679155202 wait complete. 2023-10-05T15:08:20.170 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.885+0000 7f20515e1700 1 Processor -- start 2023-10-05T15:08:20.170 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f20515e1700 1 -- start start 2023-10-05T15:08:20.170 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f20515e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f20515e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c19a980 con 0x7f204c107250 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f204affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f204affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34606/0 (socket says 172.21.15.60:34606) 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f204affd700 1 -- 172.21.15.60:0/965543584 learned_addr learned my addr 172.21.15.60:0/965543584 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f204affd700 1 -- 172.21.15.60:0/965543584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c009550 con 0x7f204c107250 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f204affd700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c19a440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f203c006af0 tx=0x7f203c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.886+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203c003a40 con 0x7f204c107250 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.887+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c19ab80 con 0x7f204c107250 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.887+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f203c003ba0 con 0x7f204c107250 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.887+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203c01a6e0 con 0x7f204c107250 2023-10-05T15:08:20.171 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.887+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c19afa0 con 0x7f204c107250 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.887+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f203c01a950 con 0x7f204c107250 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.888+0000 7f2033fff700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.888+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 --> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f203403b3f0 con 0x7f2034038820 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.888+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f203c04c850 con 0x7f204c107250 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.888+0000 7f204a7fc700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 msgr2=0x7f203403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:12.888+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:13.089+0000 7f204a7fc700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 msgr2=0x7f203403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:13.089+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:13.490+0000 7f204a7fc700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 msgr2=0x7f203403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:13.490+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-05T15:08:20.172 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:14.291+0000 7f204a7fc700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 msgr2=0x7f203403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:14.291+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:15.892+0000 7f204a7fc700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 msgr2=0x7f203403ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4045235795 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:15.892+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:18.718+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mgrmap(e 6) v1 ==== 45346+0+0 (secure 0 0 0) 0x7f203c02d960 con 0x7f204c107250 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:18.718+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 msgr2=0x7f203403ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:18.718+0000 7f2033fff700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.719+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f203c04dd70 con 0x7f204c107250 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.719+0000 7f2033fff700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f203403bff0 0x7f203403e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.719+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f203403b3f0 con 0x7f203403bff0 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.720+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f203403bff0 0x7f203403e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.720+0000 7f204a7fc700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f203403bff0 0x7f203403e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2040003a10 tx=0x7f2040009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:20.173 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.721+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f203403b3f0 con 0x7f203403bff0 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f204c19b780 con 0x7f203403bff0 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f2033fff700 1 -- 172.21.15.60:0/965543584 <== mgr.14120 v2:172.21.15.60:6800/2843655042 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f204c19b780 con 0x7f203403bff0 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f203403bff0 msgr2=0x7f203403e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f203403bff0 0x7f203403e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2040003a10 tx=0x7f2040009290 comp rx=0 tx=0).stop 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 msgr2=0x7f204c19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c19a440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f203c006af0 tx=0x7f203c011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 shutdown_connections 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f203403bff0 0x7f203403e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204c107250 0x7f204c19a440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 --2- 172.21.15.60:0/965543584 >> [v2:172.21.15.60:6800/4045235795,v1:172.21.15.60:6801/4045235795] conn(0x7f2034038820 0x7f203403ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:20.174 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.732+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 >> 172.21.15.60:0/965543584 conn(0x7f204c100ca0 msgr2=0x7f204c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:20.175 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.733+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 shutdown_connections 2023-10-05T15:08:20.175 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:19.733+0000 7f20515e1700 1 -- 172.21.15.60:0/965543584 wait complete. 2023-10-05T15:08:20.175 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 5 is available 2023-10-05T15:08:20.175 INFO:teuthology.orchestra.run.smithi060.stdout:Setting orchestrator backend to cephadm... 2023-10-05T15:08:21.106 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:20 smithi060 ceph-mon[99238]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-05T15:08:21.106 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:20 smithi060 ceph-mon[99238]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-05T15:08:21.106 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:20 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:21.106 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:20 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:21.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.666+0000 7f5930df3700 1 Processor -- start 2023-10-05T15:08:21.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.666+0000 7f5930df3700 1 -- start start 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f5930df3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c07a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f5930df3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c07a8f0 con 0x7f592c07bec0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f592a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c07a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f592a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c07a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34650/0 (socket says 172.21.15.60:34650) 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f592a59c700 1 -- 172.21.15.60:0/2072036959 learned_addr learned my addr 172.21.15.60:0/2072036959 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f592a59c700 1 -- 172.21.15.60:0/2072036959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c07aa30 con 0x7f592c07bec0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.667+0000 7f592a59c700 1 --2- 172.21.15.60:0/2072036959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c07a320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f591c0098a0 tx=0x7f591c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d16011b2b2464 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f592959a700 1 -- 172.21.15.60:0/2072036959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f591c004160 con 0x7f592c07bec0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f592959a700 1 -- 172.21.15.60:0/2072036959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f591c0042c0 con 0x7f592c07bec0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f592959a700 1 -- 172.21.15.60:0/2072036959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f591c011a00 con 0x7f592c07bec0 2023-10-05T15:08:21.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 -- 172.21.15.60:0/2072036959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 msgr2=0x7f592c07a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 --2- 172.21.15.60:0/2072036959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c07a320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f591c0098a0 tx=0x7f591c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 -- 172.21.15.60:0/2072036959 shutdown_connections 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 --2- 172.21.15.60:0/2072036959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c07a320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 -- 172.21.15.60:0/2072036959 >> 172.21.15.60:0/2072036959 conn(0x7f592c101da0 msgr2=0x7f592c1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 -- 172.21.15.60:0/2072036959 shutdown_connections 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.668+0000 7f5930df3700 1 -- 172.21.15.60:0/2072036959 wait complete. 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.669+0000 7f5930df3700 1 Processor -- start 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.669+0000 7f5930df3700 1 -- start start 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.669+0000 7f5930df3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.669+0000 7f5930df3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c19cbb0 con 0x7f592c07bec0 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f592a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f592a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34652/0 (socket says 172.21.15.60:34652) 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f592a59c700 1 -- 172.21.15.60:0/1441245053 learned_addr learned my addr 172.21.15.60:0/1441245053 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f592a59c700 1 -- 172.21.15.60:0/1441245053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c009550 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f592a59c700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c19c670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f591c006af0 tx=0x7f591c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f591c003a40 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f591c003ba0 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c19cdb0 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f591c01a700 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.670+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c19d1d0 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.671+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f591c01a930 con 0x7f592c07bec0 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.671+0000 7f591b7fe700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f5914038740 0x7f591403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.671+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f591c04c620 con 0x7f592c07bec0 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.672+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c0624e0 con 0x7f592c07bec0 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.672+0000 7f5929d9b700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f5914038740 0x7f591403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.672+0000 7f5929d9b700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f5914038740 0x7f591403ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5920006fd0 tx=0x7f5920006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.677+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f591c048080 con 0x7f592c07bec0 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:20.775+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f591c02d910 con 0x7f592c07bec0 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.069+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f592c103270 con 0x7f5914038740 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.075+0000 7f591b7fe700 1 -- 172.21.15.60:0/1441245053 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f592c103270 con 0x7f5914038740 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f5914038740 msgr2=0x7f591403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:21.515 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f5914038740 0x7f591403ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5920006fd0 tx=0x7f5920006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 msgr2=0x7f592c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c19c670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f591c006af0 tx=0x7f591c011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 shutdown_connections 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f5914038740 0x7f591403ac00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 --2- 172.21.15.60:0/1441245053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f592c07bec0 0x7f592c19c670 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 >> 172.21.15.60:0/1441245053 conn(0x7f592c101da0 msgr2=0x7f592c102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 shutdown_connections 2023-10-05T15:08:21.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:21.078+0000 7f5930df3700 1 -- 172.21.15.60:0/1441245053 wait complete. 2023-10-05T15:08:22.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: mgrmap e8: x(active, since 2s) 2023-10-05T15:08:22.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:21] ENGINE Bus STARTING 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:21] ENGINE Serving on http://172.21.15.60:8765 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:21] ENGINE Serving on https://172.21.15.60:7150 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:21] ENGINE Bus STARTED 2023-10-05T15:08:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:21 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:22.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-05T15:08:22.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f607144e700 1 Processor -- start 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f607144e700 1 -- start start 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f607144e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c1054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f607144e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c079e30 con 0x7f606c1050d0 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f606affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c1054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f606affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c1054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34664/0 (socket says 172.21.15.60:34664) 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f606affd700 1 -- 172.21.15.60:0/3999626076 learned_addr learned my addr 172.21.15.60:0/3999626076 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.004+0000 7f606affd700 1 -- 172.21.15.60:0/3999626076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c105a30 con 0x7f606c1050d0 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.005+0000 7f606affd700 1 --2- 172.21.15.60:0/3999626076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c1054f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60600098a0 tx=0x7f6060009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d44d6b34fed624 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.005+0000 7f6069ffb700 1 -- 172.21.15.60:0/3999626076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6060004160 con 0x7f606c1050d0 2023-10-05T15:08:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.005+0000 7f6069ffb700 1 -- 172.21.15.60:0/3999626076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60600042c0 con 0x7f606c1050d0 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.005+0000 7f6069ffb700 1 -- 172.21.15.60:0/3999626076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6060011a00 con 0x7f606c1050d0 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.005+0000 7f607144e700 1 -- 172.21.15.60:0/3999626076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 msgr2=0x7f606c1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.005+0000 7f607144e700 1 --2- 172.21.15.60:0/3999626076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c1054f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60600098a0 tx=0x7f6060009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 -- 172.21.15.60:0/3999626076 shutdown_connections 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 --2- 172.21.15.60:0/3999626076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c1054f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 -- 172.21.15.60:0/3999626076 >> 172.21.15.60:0/3999626076 conn(0x7f606c100c90 msgr2=0x7f606c1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 -- 172.21.15.60:0/3999626076 shutdown_connections 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 -- 172.21.15.60:0/3999626076 wait complete. 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 Processor -- start 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.006+0000 7f607144e700 1 -- start start 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f607144e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:22.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f607144e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c19cbe0 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f606affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f606affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34666/0 (socket says 172.21.15.60:34666) 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f606affd700 1 -- 172.21.15.60:0/2859922442 learned_addr learned my addr 172.21.15.60:0/2859922442 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f606affd700 1 -- 172.21.15.60:0/2859922442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009550 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f606affd700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c19c6a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6060009130 tx=0x7f6060011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6060003b70 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6060003cd0 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60600197d0 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c19cde0 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.007+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c19d200 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.008+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f60600199c0 con 0x7f606c1050d0 2023-10-05T15:08:22.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.008+0000 7f6053fff700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f6054038870 0x7f605403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.008+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f606004cbc0 con 0x7f606c1050d0 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.009+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c195f10 con 0x7f606c1050d0 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.009+0000 7f606a7fc700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f6054038870 0x7f605403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.009+0000 7f606a7fc700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f6054038870 0x7f605403ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f605c006fd0 tx=0x7f605c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.014+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6060018530 con 0x7f606c1050d0 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.379+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f606c02d080 con 0x7f6054038870 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.380+0000 7f6053fff700 1 -- 172.21.15.60:0/2859922442 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f606c02d080 con 0x7f6054038870 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f6054038870 msgr2=0x7f605403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f6054038870 0x7f605403ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f605c006fd0 tx=0x7f605c006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 msgr2=0x7f606c19c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:22.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c19c6a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6060009130 tx=0x7f6060011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 shutdown_connections 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f6054038870 0x7f605403ad30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 --2- 172.21.15.60:0/2859922442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f606c1050d0 0x7f606c19c6a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.382+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 >> 172.21.15.60:0/2859922442 conn(0x7f606c100c90 msgr2=0x7f606c190c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.383+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 shutdown_connections 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:22.383+0000 7f607144e700 1 -- 172.21.15.60:0/2859922442 wait complete. 2023-10-05T15:08:22.761 INFO:teuthology.orchestra.run.smithi060.stdout:Generating ssh key... 2023-10-05T15:08:23.034 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:22 smithi060 ceph-mon[99238]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:24.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.280+0000 7f0e23523700 1 Processor -- start 2023-10-05T15:08:24.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.280+0000 7f0e23523700 1 -- start start 2023-10-05T15:08:24.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.280+0000 7f0e23523700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c1054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.280+0000 7f0e23523700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c079e30 con 0x7f0e1c1050c0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e212bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c1054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e212bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c1054e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34670/0 (socket says 172.21.15.60:34670) 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e212bf700 1 -- 172.21.15.60:0/2106699988 learned_addr learned my addr 172.21.15.60:0/2106699988 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e212bf700 1 -- 172.21.15.60:0/2106699988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c105a20 con 0x7f0e1c1050c0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e212bf700 1 --2- 172.21.15.60:0/2106699988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c1054e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e180098a0 tx=0x7f0e18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18c0d6a1d5c75a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e0ffff700 1 -- 172.21.15.60:0/2106699988 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e18004160 con 0x7f0e1c1050c0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e0ffff700 1 -- 172.21.15.60:0/2106699988 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e180042c0 con 0x7f0e1c1050c0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.281+0000 7f0e0ffff700 1 -- 172.21.15.60:0/2106699988 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e18011a00 con 0x7f0e1c1050c0 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 -- 172.21.15.60:0/2106699988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 msgr2=0x7f0e1c1054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:24.104 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 --2- 172.21.15.60:0/2106699988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c1054e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e180098a0 tx=0x7f0e18009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 -- 172.21.15.60:0/2106699988 shutdown_connections 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 --2- 172.21.15.60:0/2106699988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c1054e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 -- 172.21.15.60:0/2106699988 >> 172.21.15.60:0/2106699988 conn(0x7f0e1c100ca0 msgr2=0x7f0e1c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 -- 172.21.15.60:0/2106699988 shutdown_connections 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.282+0000 7f0e23523700 1 -- 172.21.15.60:0/2106699988 wait complete. 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e23523700 1 Processor -- start 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e23523700 1 -- start start 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e23523700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e23523700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c19cb30 con 0x7f0e1c1050c0 2023-10-05T15:08:24.105 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e212bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e212bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34672/0 (socket says 172.21.15.60:34672) 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e212bf700 1 -- 172.21.15.60:0/956504930 learned_addr learned my addr 172.21.15.60:0/956504930 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.283+0000 7f0e212bf700 1 -- 172.21.15.60:0/956504930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18009550 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.284+0000 7f0e212bf700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c19c5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e18006af0 tx=0x7f0e18011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.284+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e18003a40 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.284+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e18003ba0 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.284+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c19cd30 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.284+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e1801a6e0 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.284+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c19d150 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.285+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c195ef0 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.285+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f0e18024a60 con 0x7f0e1c1050c0 2023-10-05T15:08:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.286+0000 7f0e0e7fc700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f0e08038820 0x7f0e0803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.286+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0e1804c960 con 0x7f0e1c1050c0 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.286+0000 7f0e20abe700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f0e08038820 0x7f0e0803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.286+0000 7f0e20abe700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f0e08038820 0x7f0e0803ace0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e10006fd0 tx=0x7f0e10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.290+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e18024430 con 0x7f0e1c1050c0 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.655+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e1c02d160 con 0x7f0e08038820 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.731+0000 7f0e0e7fc700 1 -- 172.21.15.60:0/956504930 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0e1c02d160 con 0x7f0e08038820 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f0e08038820 msgr2=0x7f0e0803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f0e08038820 0x7f0e0803ace0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e10006fd0 tx=0x7f0e10006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 msgr2=0x7f0e1c19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c19c5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e18006af0 tx=0x7f0e18011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:24.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 shutdown_connections 2023-10-05T15:08:24.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f0e08038820 0x7f0e0803ace0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:24.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 --2- 172.21.15.60:0/956504930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e1c1050c0 0x7f0e1c19c5f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:24.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 >> 172.21.15.60:0/956504930 conn(0x7f0e1c100ca0 msgr2=0x7f0e1c190c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:24.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 shutdown_connections 2023-10-05T15:08:24.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:23.733+0000 7f0e23523700 1 -- 172.21.15.60:0/956504930 wait complete. 2023-10-05T15:08:24.118 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: Generating public/private rsa key pair. 2023-10-05T15:08:24.118 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: Your identification has been saved in /tmp/tmp7705vj6n/key. 2023-10-05T15:08:24.118 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: Your public key has been saved in /tmp/tmp7705vj6n/key.pub. 2023-10-05T15:08:24.118 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: The key fingerprint is: 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: SHA256:aO1AcABRt5cJ0y750RykpSe0JgFkv4NjiV91P3eOFLQ ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: The key's randomart image is: 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: +---[RSA 3072]----+ 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | o=Bo*...o . | 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | . = *.B. . . | 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | =o@oo. E | 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | . +oOo+o. . | 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | . = BoS. o o .| 2023-10-05T15:08:24.119 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | o + +. + + | 2023-10-05T15:08:24.120 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | . . . .| 2023-10-05T15:08:24.120 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | | 2023-10-05T15:08:24.120 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: | | 2023-10-05T15:08:24.120 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: +----[SHA256]-----+ 2023-10-05T15:08:24.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:24 smithi060 ceph-mon[99238]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:24.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:24 smithi060 ceph-mon[99238]: Generating ssh key... 2023-10-05T15:08:24.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:24 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:24.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:24 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.588+0000 7fb7d3f94700 1 Processor -- start 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.588+0000 7fb7d3f94700 1 -- start start 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.588+0000 7fb7d3f94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.588+0000 7fb7d3f94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc1060d0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d1d30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:25.348 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d1d30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34676/0 (socket says 172.21.15.60:34676) 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d1d30700 1 -- 172.21.15.60:0/3584689103 learned_addr learned my addr 172.21.15.60:0/3584689103 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d1d30700 1 -- 172.21.15.60:0/3584689103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc1068e0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d1d30700 1 --2- 172.21.15.60:0/3584689103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc105b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00098a0 tx=0x7fb7c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61275cf73a2fa9d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d0d2e700 1 -- 172.21.15.60:0/3584689103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c0004160 con 0x7fb7cc1056e0 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d0d2e700 1 -- 172.21.15.60:0/3584689103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7c00042c0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.589+0000 7fb7d0d2e700 1 -- 172.21.15.60:0/3584689103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c0011a00 con 0x7fb7cc1056e0 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 -- 172.21.15.60:0/3584689103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 msgr2=0x7fb7cc105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 --2- 172.21.15.60:0/3584689103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc105b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00098a0 tx=0x7fb7c0009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 -- 172.21.15.60:0/3584689103 shutdown_connections 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 --2- 172.21.15.60:0/3584689103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc105b00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 -- 172.21.15.60:0/3584689103 >> 172.21.15.60:0/3584689103 conn(0x7fb7cc100ca0 msgr2=0x7fb7cc1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 -- 172.21.15.60:0/3584689103 shutdown_connections 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.590+0000 7fb7d3f94700 1 -- 172.21.15.60:0/3584689103 wait complete. 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d3f94700 1 Processor -- start 2023-10-05T15:08:25.350 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d3f94700 1 -- start start 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d3f94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc079b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d3f94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc19d1b0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d1d30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc079b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d1d30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc079b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34678/0 (socket says 172.21.15.60:34678) 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.591+0000 7fb7d1d30700 1 -- 172.21.15.60:0/2274495608 learned_addr learned my addr 172.21.15.60:0/2274495608 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7d1d30700 1 -- 172.21.15.60:0/2274495608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0009550 con 0x7fb7cc1056e0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7d1d30700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc079b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0000c00 tx=0x7fb7c00039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00117f0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc19d2f0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7c0011df0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c001a430 con 0x7fb7cc1056e0 2023-10-05T15:08:25.351 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.592+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc19d710 con 0x7fb7cc1056e0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.593+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fb7c001a6b0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.593+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc0624e0 con 0x7fb7cc1056e0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.593+0000 7fb7beffd700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fb7b8038810 0x7fb7b803acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.593+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb7c004c680 con 0x7fb7cc1056e0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.593+0000 7fb7d152f700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fb7b8038810 0x7fb7b803acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.594+0000 7fb7d152f700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fb7b8038810 0x7fb7b803acd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8006fd0 tx=0x7fb7c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.598+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb7c0018b80 con 0x7fb7cc1056e0 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.964+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7cc102f60 con 0x7fb7b8038810 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.964+0000 7fb7beffd700 1 -- 172.21.15.60:0/2274495608 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb7cc102f60 con 0x7fb7b8038810 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fb7b8038810 msgr2=0x7fb7b803acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fb7b8038810 0x7fb7b803acd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8006fd0 tx=0x7fb7c8006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:25.352 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 msgr2=0x7fb7cc079b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc079b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0000c00 tx=0x7fb7c00039f0 comp rx=0 tx=0).stop 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 shutdown_connections 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fb7b8038810 0x7fb7b803acd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 --2- 172.21.15.60:0/2274495608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7cc1056e0 0x7fb7cc079b50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 >> 172.21.15.60:0/2274495608 conn(0x7fb7cc100ca0 msgr2=0x7fb7cc102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 shutdown_connections 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:24.967+0000 7fb7d3f94700 1 -- 172.21.15.60:0/2274495608 wait complete. 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:Adding key to root@localhost authorized_keys... 2023-10-05T15:08:25.353 INFO:teuthology.orchestra.run.smithi060.stdout:Adding host smithi060... 2023-10-05T15:08:26.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:25 smithi060 ceph-mon[99238]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:26.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:26 smithi060 ceph-mon[99238]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:28.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:27 smithi060 ceph-mon[99238]: Deploying cephadm binary to smithi060 2023-10-05T15:08:29.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Added host 'smithi060' with addr '172.21.15.60' 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.824+0000 7fc0354e4700 1 Processor -- start 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.824+0000 7fc0354e4700 1 -- start start 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.824+0000 7fc0354e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc0301096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.824+0000 7fc0354e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030079e50 con 0x7fc0301072c0 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc0301096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc0301096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34682/0 (socket says 172.21.15.60:34682) 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02effd700 1 -- 172.21.15.60:0/2187591400 learned_addr learned my addr 172.21.15.60:0/2187591400 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02effd700 1 -- 172.21.15.60:0/2187591400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030109bf0 con 0x7fc0301072c0 2023-10-05T15:08:29.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02effd700 1 --2- 172.21.15.60:0/2187591400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc0301096b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc0240098a0 tx=0x7fc024009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5091a573d5a050 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02dffb700 1 -- 172.21.15.60:0/2187591400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc024004160 con 0x7fc0301072c0 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02dffb700 1 -- 172.21.15.60:0/2187591400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc0240042c0 con 0x7fc0301072c0 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.825+0000 7fc02dffb700 1 -- 172.21.15.60:0/2187591400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc024011a00 con 0x7fc0301072c0 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 -- 172.21.15.60:0/2187591400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 msgr2=0x7fc0301096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 --2- 172.21.15.60:0/2187591400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc0301096b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc0240098a0 tx=0x7fc024009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 -- 172.21.15.60:0/2187591400 shutdown_connections 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 --2- 172.21.15.60:0/2187591400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc0301096b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 -- 172.21.15.60:0/2187591400 >> 172.21.15.60:0/2187591400 conn(0x7fc030100c90 msgr2=0x7fc0301030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 -- 172.21.15.60:0/2187591400 shutdown_connections 2023-10-05T15:08:29.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.826+0000 7fc0354e4700 1 -- 172.21.15.60:0/2187591400 wait complete. 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc0354e4700 1 Processor -- start 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc0354e4700 1 -- start start 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc0354e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc030106c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc0354e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030107160 con 0x7fc0301072c0 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc02effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc030106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc02effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc030106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34684/0 (socket says 172.21.15.60:34684) 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc02effd700 1 -- 172.21.15.60:0/2350317519 learned_addr learned my addr 172.21.15.60:0/2350317519 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:29.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.827+0000 7fc02effd700 1 -- 172.21.15.60:0/2350317519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009550 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.828+0000 7fc02effd700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc030106c20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc024009130 tx=0x7fc024011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.828+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc024003b70 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.828+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc024003cd0 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.828+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc030105270 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.828+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0240197d0 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.828+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc030105690 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.829+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fc02401abb0 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.829+0000 7fc017fff700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc0180388c0 0x7fc01803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.829+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03010a990 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.829+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc02404cb20 con 0x7fc0301072c0 2023-10-05T15:08:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.829+0000 7fc02e7fc700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc0180388c0 0x7fc01803ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.830+0000 7fc02e7fc700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc0180388c0 0x7fc01803ad80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc020006fd0 tx=0x7fc020006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:25.834+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc02401a430 con 0x7fc0301072c0 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:26.207+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}) v1 -- 0x7fc030105d80 con 0x7fc0180388c0 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.125+0000 7fc017fff700 1 -- 172.21.15.60:0/2350317519 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fc030105d80 con 0x7fc0180388c0 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc0180388c0 msgr2=0x7fc01803ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc0180388c0 0x7fc01803ad80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc020006fd0 tx=0x7fc020006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 msgr2=0x7fc030106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc030106c20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc024009130 tx=0x7fc024011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 shutdown_connections 2023-10-05T15:08:29.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc0180388c0 0x7fc01803ad80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:29.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 --2- 172.21.15.60:0/2350317519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0301072c0 0x7fc030106c20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:29.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 >> 172.21.15.60:0/2350317519 conn(0x7fc030100c90 msgr2=0x7fc030102310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:29.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 shutdown_connections 2023-10-05T15:08:29.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.128+0000 7fc0354e4700 1 -- 172.21.15.60:0/2350317519 wait complete. 2023-10-05T15:08:29.507 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying unmanaged mon service... 2023-10-05T15:08:30.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:30 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:30.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:30 smithi060 ceph-mon[99238]: Added host smithi060 2023-10-05T15:08:30.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:30 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:30.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-05T15:08:30.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b51836700 1 Processor -- start 2023-10-05T15:08:30.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b51836700 1 -- start start 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b51836700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b51836700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c1071f0 con 0x7f2b4c106800 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34718/0 (socket says 172.21.15.60:34718) 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.952+0000 7f2b4affd700 1 -- 172.21.15.60:0/4212576487 learned_addr learned my addr 172.21.15.60:0/4212576487 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.953+0000 7f2b4affd700 1 -- 172.21.15.60:0/4212576487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c107a00 con 0x7f2b4c106800 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.953+0000 7f2b4affd700 1 --2- 172.21.15.60:0/4212576487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c106c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0098a0 tx=0x7f2b3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af877f5b1359228b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.953+0000 7f2b49ffb700 1 -- 172.21.15.60:0/4212576487 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b3c004160 con 0x7f2b4c106800 2023-10-05T15:08:30.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.953+0000 7f2b49ffb700 1 -- 172.21.15.60:0/4212576487 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b3c0042c0 con 0x7f2b4c106800 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.953+0000 7f2b49ffb700 1 -- 172.21.15.60:0/4212576487 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b3c011a00 con 0x7f2b4c106800 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 -- 172.21.15.60:0/4212576487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 msgr2=0x7f2b4c106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 --2- 172.21.15.60:0/4212576487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c106c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0098a0 tx=0x7f2b3c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 -- 172.21.15.60:0/4212576487 shutdown_connections 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 --2- 172.21.15.60:0/4212576487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c106c20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 -- 172.21.15.60:0/4212576487 >> 172.21.15.60:0/4212576487 conn(0x7f2b4c101da0 msgr2=0x7f2b4c1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 -- 172.21.15.60:0/4212576487 shutdown_connections 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 -- 172.21.15.60:0/4212576487 wait complete. 2023-10-05T15:08:30.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.954+0000 7f2b51836700 1 Processor -- start 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b51836700 1 -- start start 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b51836700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b51836700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c19a9e0 con 0x7f2b4c106800 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34720/0 (socket says 172.21.15.60:34720) 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b4affd700 1 -- 172.21.15.60:0/3095853115 learned_addr learned my addr 172.21.15.60:0/3095853115 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b4affd700 1 -- 172.21.15.60:0/3095853115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c009550 con 0x7f2b4c106800 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.955+0000 7f2b4affd700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c19a4a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c006af0 tx=0x7f2b3c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:30.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.956+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b3c003a40 con 0x7f2b4c106800 2023-10-05T15:08:30.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.956+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b3c003ba0 con 0x7f2b4c106800 2023-10-05T15:08:30.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.956+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c19abe0 con 0x7f2b4c106800 2023-10-05T15:08:30.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.956+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b3c01a700 con 0x7f2b4c106800 2023-10-05T15:08:30.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.956+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c19b000 con 0x7f2b4c106800 2023-10-05T15:08:30.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.957+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f2b3c01a930 con 0x7f2b4c106800 2023-10-05T15:08:30.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.957+0000 7f2b50834700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f2b34038870 0x7f2b3403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:30.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.957+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2b3c04c8e0 con 0x7f2b4c106800 2023-10-05T15:08:30.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.957+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c0624e0 con 0x7f2b4c106800 2023-10-05T15:08:30.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.957+0000 7f2b4a7fc700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f2b34038870 0x7f2b3403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:30.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.957+0000 7f2b4a7fc700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f2b34038870 0x7f2b3403ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b40006fd0 tx=0x7f2b40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:30.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:29.962+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2b3c01abe0 con 0x7f2b4c106800 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.354+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2b4c1032a0 con 0x7f2b34038870 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.359+0000 7f2b50834700 1 -- 172.21.15.60:0/3095853115 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2b4c1032a0 con 0x7f2b34038870 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f2b34038870 msgr2=0x7f2b3403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f2b34038870 0x7f2b3403ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b40006fd0 tx=0x7f2b40006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 msgr2=0x7f2b4c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c19a4a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c006af0 tx=0x7f2b3c011ad0 comp rx=0 tx=0).stop 2023-10-05T15:08:30.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 shutdown_connections 2023-10-05T15:08:30.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f2b34038870 0x7f2b3403ad30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:30.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 --2- 172.21.15.60:0/3095853115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b4c106800 0x7f2b4c19a4a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:30.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 >> 172.21.15.60:0/3095853115 conn(0x7f2b4c101da0 msgr2=0x7f2b4c102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:30.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 shutdown_connections 2023-10-05T15:08:30.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:30.361+0000 7f2b51836700 1 -- 172.21.15.60:0/3095853115 wait complete. 2023-10-05T15:08:30.957 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying unmanaged mgr service... 2023-10-05T15:08:31.487 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:31 smithi060 ceph-mon[99238]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:31.487 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:31 smithi060 ceph-mon[99238]: Saving service mon spec with placement count:5 2023-10-05T15:08:31.487 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:31 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:32.527 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:32 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:32.527 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:32 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:32.528 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:32 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:32.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-05T15:08:32.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.741+0000 7fc2fd349700 1 Processor -- start 2023-10-05T15:08:32.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.741+0000 7fc2fd349700 1 -- start start 2023-10-05T15:08:32.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2fd349700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f8105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:32.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2fd349700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81060d0 con 0x7fc2f81056e0 2023-10-05T15:08:32.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f8105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f8105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34724/0 (socket says 172.21.15.60:34724) 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f6ffd700 1 -- 172.21.15.60:0/3572650900 learned_addr learned my addr 172.21.15.60:0/3572650900 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f6ffd700 1 -- 172.21.15.60:0/3572650900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f81068e0 con 0x7fc2f81056e0 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f6ffd700 1 --2- 172.21.15.60:0/3572650900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f8105b00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80098a0 tx=0x7fc2e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa00dbb434b0b241 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f5ffb700 1 -- 172.21.15.60:0/3572650900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e8004160 con 0x7fc2f81056e0 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f5ffb700 1 -- 172.21.15.60:0/3572650900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2e80042c0 con 0x7fc2f81056e0 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.742+0000 7fc2f5ffb700 1 -- 172.21.15.60:0/3572650900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e80119b0 con 0x7fc2f81056e0 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 -- 172.21.15.60:0/3572650900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 msgr2=0x7fc2f8105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 --2- 172.21.15.60:0/3572650900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f8105b00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80098a0 tx=0x7fc2e8009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 -- 172.21.15.60:0/3572650900 shutdown_connections 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 --2- 172.21.15.60:0/3572650900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f8105b00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 -- 172.21.15.60:0/3572650900 >> 172.21.15.60:0/3572650900 conn(0x7fc2f8100ca0 msgr2=0x7fc2f81030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 -- 172.21.15.60:0/3572650900 shutdown_connections 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.743+0000 7fc2fd349700 1 -- 172.21.15.60:0/3572650900 wait complete. 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2fd349700 1 Processor -- start 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2fd349700 1 -- start start 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2fd349700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2fd349700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f819a9a0 con 0x7fc2f81056e0 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2f6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2f6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34726/0 (socket says 172.21.15.60:34726) 2023-10-05T15:08:32.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.744+0000 7fc2f6ffd700 1 -- 172.21.15.60:0/2925848002 learned_addr learned my addr 172.21.15.60:0/2925848002 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2f6ffd700 1 -- 172.21.15.60:0/2925848002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009550 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2f6ffd700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f819a460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000c00 tx=0x7fc2e8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e80039f0 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2e8003b50 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2e801a780 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f819aba0 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.745+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f819afc0 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.746+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fc2e801a9f0 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.746+0000 7fc2dffff700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc2e0038870 0x7fc2e003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.746+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc2e804c860 con 0x7fc2f81056e0 2023-10-05T15:08:32.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.746+0000 7fc2f67fc700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc2e0038870 0x7fc2e003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.746+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f80624e0 con 0x7fc2f81056e0 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.747+0000 7fc2f67fc700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc2e0038870 0x7fc2e003ad30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec006fd0 tx=0x7fc2ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:31.751+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc2e801aca0 con 0x7fc2f81056e0 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.142+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc2f8102e10 con 0x7fc2e0038870 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.147+0000 7fc2dffff700 1 -- 172.21.15.60:0/2925848002 <== mgr.14120 v2:172.21.15.60:6800/2843655042 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc2f8102e10 con 0x7fc2e0038870 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc2e0038870 msgr2=0x7fc2e003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc2e0038870 0x7fc2e003ad30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec006fd0 tx=0x7fc2ec006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 msgr2=0x7fc2f819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f819a460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000c00 tx=0x7fc2e8011a30 comp rx=0 tx=0).stop 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 shutdown_connections 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc2e0038870 0x7fc2e003ad30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:32.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 --2- 172.21.15.60:0/2925848002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f81056e0 0x7fc2f819a460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:32.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 >> 172.21.15.60:0/2925848002 conn(0x7fc2f8100ca0 msgr2=0x7fc2f8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:32.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 shutdown_connections 2023-10-05T15:08:32.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:32.149+0000 7fc2fd349700 1 -- 172.21.15.60:0/2925848002 wait complete. 2023-10-05T15:08:33.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:33 smithi060 ceph-mon[99238]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:33.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:33 smithi060 ceph-mon[99238]: Saving service mgr spec with placement count:2 2023-10-05T15:08:33.947 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.127+0000 7f1c058d9700 1 Processor -- start 2023-10-05T15:08:33.947 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1c058d9700 1 -- start start 2023-10-05T15:08:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1c058d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c00109660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1c058d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00079e70 con 0x7f1c00107270 2023-10-05T15:08:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c00109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c00109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34730/0 (socket says 172.21.15.60:34730) 2023-10-05T15:08:33.949 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1bfeffd700 1 -- 172.21.15.60:0/725927395 learned_addr learned my addr 172.21.15.60:0/725927395 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:33.949 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1bfeffd700 1 -- 172.21.15.60:0/725927395 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00109ba0 con 0x7f1c00107270 2023-10-05T15:08:33.949 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.128+0000 7f1bfeffd700 1 --2- 172.21.15.60:0/725927395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c00109660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098a0 tx=0x7f1bf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fabb04722fc336 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:33.949 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1bfdffb700 1 -- 172.21.15.60:0/725927395 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bf0004160 con 0x7f1c00107270 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1bfdffb700 1 -- 172.21.15.60:0/725927395 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bf00042c0 con 0x7f1c00107270 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1bfdffb700 1 -- 172.21.15.60:0/725927395 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bf00119b0 con 0x7f1c00107270 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1c058d9700 1 -- 172.21.15.60:0/725927395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 msgr2=0x7f1c00109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1c058d9700 1 --2- 172.21.15.60:0/725927395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c00109660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098a0 tx=0x7f1bf0009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1c058d9700 1 -- 172.21.15.60:0/725927395 shutdown_connections 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1c058d9700 1 --2- 172.21.15.60:0/725927395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c00109660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.129+0000 7f1c058d9700 1 -- 172.21.15.60:0/725927395 >> 172.21.15.60:0/725927395 conn(0x7f1c00100c60 msgr2=0x7f1c001030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.130+0000 7f1c058d9700 1 -- 172.21.15.60:0/725927395 shutdown_connections 2023-10-05T15:08:33.950 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.130+0000 7f1c058d9700 1 -- 172.21.15.60:0/725927395 wait complete. 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.130+0000 7f1c058d9700 1 Processor -- start 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.130+0000 7f1c058d9700 1 -- start start 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c058d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c0019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c058d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0019aa10 con 0x7f1c00107270 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c0019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c0019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34732/0 (socket says 172.21.15.60:34732) 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1bfeffd700 1 -- 172.21.15.60:0/834787571 learned_addr learned my addr 172.21.15.60:0/834787571 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1bfeffd700 1 -- 172.21.15.60:0/834787571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0009550 con 0x7f1c00107270 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1bfeffd700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c0019a4d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0003f00 tx=0x7f1bf0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:33.951 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bf0003b20 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bf0003c80 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0019ac10 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bf0019770 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.131+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0019b030 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.133+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c000624e0 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.133+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f1bf001ab60 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.134+0000 7f1c048d7700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f1be8038870 0x7f1be803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.134+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1bf004ccb0 con 0x7f1c00107270 2023-10-05T15:08:33.952 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.134+0000 7f1bfe7fc700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f1be8038870 0x7f1be803ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.134+0000 7f1bfe7fc700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f1be8038870 0x7f1be803ad30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.138+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1bf001a430 con 0x7f1c00107270 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.506+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1c0010a980 con 0x7f1c00107270 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.509+0000 7f1c048d7700 1 -- 172.21.15.60:0/834787571 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1bf002a030 con 0x7f1c00107270 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f1be8038870 msgr2=0x7f1be803ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f1be8038870 0x7f1be803ad30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf4006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 msgr2=0x7f1c0019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c0019a4d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0003f00 tx=0x7f1bf0011a30 comp rx=0 tx=0).stop 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 shutdown_connections 2023-10-05T15:08:33.953 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f1be8038870 0x7f1be803ad30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:33.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 --2- 172.21.15.60:0/834787571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c00107270 0x7f1c0019a4d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:33.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.511+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 >> 172.21.15.60:0/834787571 conn(0x7f1c00100c60 msgr2=0x7f1c00102350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:33.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.512+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 shutdown_connections 2023-10-05T15:08:33.954 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:33.512+0000 7f1c058d9700 1 -- 172.21.15.60:0/834787571 wait complete. 2023-10-05T15:08:34.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:34 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/834787571' entity='client.admin' 2023-10-05T15:08:34.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:34 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.504+0000 7fc48e7fb700 1 Processor -- start 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.504+0000 7fc48e7fb700 1 -- start start 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.504+0000 7fc48e7fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488109700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.504+0000 7fc48e7fb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc488079df0 con 0x7fc488107310 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.505+0000 7fc487fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488109700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.505+0000 7fc487fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488109700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34736/0 (socket says 172.21.15.60:34736) 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.505+0000 7fc487fff700 1 -- 172.21.15.60:0/4180207084 learned_addr learned my addr 172.21.15.60:0/4180207084 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.505+0000 7fc487fff700 1 -- 172.21.15.60:0/4180207084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488079f30 con 0x7fc488107310 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.505+0000 7fc487fff700 1 --2- 172.21.15.60:0/4180207084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488109700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4780098a0 tx=0x7fc478009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f39bd00d27224d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:35.291 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.506+0000 7fc486ffd700 1 -- 172.21.15.60:0/4180207084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc478004160 con 0x7fc488107310 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.506+0000 7fc486ffd700 1 -- 172.21.15.60:0/4180207084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4780042c0 con 0x7fc488107310 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.506+0000 7fc486ffd700 1 -- 172.21.15.60:0/4180207084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4780119b0 con 0x7fc488107310 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.506+0000 7fc48e7fb700 1 -- 172.21.15.60:0/4180207084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 msgr2=0x7fc488109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.506+0000 7fc48e7fb700 1 --2- 172.21.15.60:0/4180207084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488109700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4780098a0 tx=0x7fc478009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.507+0000 7fc48e7fb700 1 -- 172.21.15.60:0/4180207084 shutdown_connections 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.507+0000 7fc48e7fb700 1 --2- 172.21.15.60:0/4180207084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488109700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.507+0000 7fc48e7fb700 1 -- 172.21.15.60:0/4180207084 >> 172.21.15.60:0/4180207084 conn(0x7fc488100ca0 msgr2=0x7fc4881030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.507+0000 7fc48e7fb700 1 -- 172.21.15.60:0/4180207084 shutdown_connections 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.507+0000 7fc48e7fb700 1 -- 172.21.15.60:0/4180207084 wait complete. 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.507+0000 7fc48e7fb700 1 Processor -- start 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.508+0000 7fc48e7fb700 1 -- start start 2023-10-05T15:08:35.292 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.508+0000 7fc48e7fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488106c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.508+0000 7fc48e7fb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4881071b0 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.508+0000 7fc487fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488106c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.508+0000 7fc487fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488106c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34738/0 (socket says 172.21.15.60:34738) 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.508+0000 7fc487fff700 1 -- 172.21.15.60:0/3179384897 learned_addr learned my addr 172.21.15.60:0/3179384897 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.509+0000 7fc487fff700 1 -- 172.21.15.60:0/3179384897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478009550 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.509+0000 7fc487fff700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488106c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc478011980 tx=0x7fc478011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.511+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc478003a60 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.511+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc478003bc0 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.511+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4881052c0 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.511+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc47801a670 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.511+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4881056e0 con 0x7fc488107310 2023-10-05T15:08:35.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.512+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48810a9b0 con 0x7fc488107310 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.512+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fc47801a8e0 con 0x7fc488107310 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.513+0000 7fc4857fa700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc470038870 0x7fc47003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.513+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc47804c8f0 con 0x7fc488107310 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.513+0000 7fc4877fe700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc470038870 0x7fc47003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.513+0000 7fc4877fe700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc470038870 0x7fc47003ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc47c006fd0 tx=0x7fc47c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.522+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc47801ab90 con 0x7fc488107310 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.886+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc48810ac20 con 0x7fc488107310 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.888+0000 7fc4857fa700 1 -- 172.21.15.60:0/3179384897 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc478018350 con 0x7fc488107310 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc470038870 msgr2=0x7fc47003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc470038870 0x7fc47003ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc47c006fd0 tx=0x7fc47c006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 msgr2=0x7fc488106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:35.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488106c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc478011980 tx=0x7fc478011a60 comp rx=0 tx=0).stop 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 shutdown_connections 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7fc470038870 0x7fc47003ad30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 --2- 172.21.15.60:0/3179384897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc488107310 0x7fc488106c70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 >> 172.21.15.60:0/3179384897 conn(0x7fc488100ca0 msgr2=0x7fc4881019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 shutdown_connections 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:34.891+0000 7fc48e7fb700 1 -- 172.21.15.60:0/3179384897 wait complete. 2023-10-05T15:08:35.295 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling the dashboard module... 2023-10-05T15:08:36.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:35 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3179384897' entity='client.admin' 2023-10-05T15:08:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:35 smithi060 ceph-mon[99238]: from='mgr.14120 172.21.15.60:0/145393081' entity='mgr.x' 2023-10-05T15:08:37.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:36 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2674408299' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-05T15:08:37.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: ignoring --setuser ceph since I am not root 2023-10-05T15:08:37.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: ignoring --setgroup ceph since I am not root 2023-10-05T15:08:37.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:37.101+0000 7fcee9139200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:08:37.340 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72febe0700 1 Processor -- start 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72febe0700 1 -- start start 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72febe0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f8104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72febe0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81054c0 con 0x7f72f8104ad0 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72fc97c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f8104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72fc97c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f8104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34742/0 (socket says 172.21.15.60:34742) 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.827+0000 7f72fc97c700 1 -- 172.21.15.60:0/1647790606 learned_addr learned my addr 172.21.15.60:0/1647790606 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.828+0000 7f72fc97c700 1 -- 172.21.15.60:0/1647790606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8107a60 con 0x7f72f8104ad0 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.828+0000 7f72fc97c700 1 --2- 172.21.15.60:0/1647790606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f8104ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098a0 tx=0x7f72ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a52c3d4f6352c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.828+0000 7f72f77fe700 1 -- 172.21.15.60:0/1647790606 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72ec004160 con 0x7f72f8104ad0 2023-10-05T15:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.828+0000 7f72f77fe700 1 -- 172.21.15.60:0/1647790606 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72ec0042c0 con 0x7f72f8104ad0 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.828+0000 7f72f77fe700 1 -- 172.21.15.60:0/1647790606 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72ec0119b0 con 0x7f72f8104ad0 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 -- 172.21.15.60:0/1647790606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 msgr2=0x7f72f8104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 --2- 172.21.15.60:0/1647790606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f8104ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098a0 tx=0x7f72ec009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 -- 172.21.15.60:0/1647790606 shutdown_connections 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 --2- 172.21.15.60:0/1647790606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f8104ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 -- 172.21.15.60:0/1647790606 >> 172.21.15.60:0/1647790606 conn(0x7f72f8100420 msgr2=0x7f72f8102840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 -- 172.21.15.60:0/1647790606 shutdown_connections 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 -- 172.21.15.60:0/1647790606 wait complete. 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.829+0000 7f72febe0700 1 Processor -- start 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.831+0000 7f72febe0700 1 -- start start 2023-10-05T15:08:37.342 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72febe0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f81073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72febe0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8107900 con 0x7f72f8104ad0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72fc97c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f81073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72fc97c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f81073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34744/0 (socket says 172.21.15.60:34744) 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72fc97c700 1 -- 172.21.15.60:0/2674408299 learned_addr learned my addr 172.21.15.60:0/2674408299 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72fc97c700 1 -- 172.21.15.60:0/2674408299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec009550 con 0x7f72f8104ad0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72fc97c700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f81073c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72ec003e60 tx=0x7f72ec011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72ec003a60 con 0x7f72f8104ad0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.832+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f8105a10 con 0x7f72f8104ad0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.833+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72ec003bc0 con 0x7f72f8104ad0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.833+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72ec0196c0 con 0x7f72f8104ad0 2023-10-05T15:08:37.343 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.833+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f8105e30 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.834+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f72ec019980 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.834+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f8062550 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.834+0000 7f72f5ffb700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f72e8038800 0x7f72e803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.834+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f72ec04caa0 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.834+0000 7f72f7fff700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f72e8038800 0x7f72e803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.835+0000 7f72f7fff700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f72e8038800 0x7f72e803acc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006fd0 tx=0x7f72e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:35.839+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f72f8062550 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.330+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f72f8062550 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.892+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f72f8062550 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.894+0000 7f72f5ffb700 1 -- 172.21.15.60:0/2674408299 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f72ec00ed40 con 0x7f72f8104ad0 2023-10-05T15:08:37.344 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.895+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f72e8038800 msgr2=0x7f72e803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.895+0000 7f72febe0700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f72e8038800 0x7f72e803acc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006fd0 tx=0x7f72e4006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.895+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 msgr2=0x7f72f81073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.895+0000 7f72febe0700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f81073c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72ec003e60 tx=0x7f72ec011a30 comp rx=0 tx=0).stop 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.895+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 shutdown_connections 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.896+0000 7f72febe0700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f72e8038800 0x7f72e803acc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.896+0000 7f72febe0700 1 --2- 172.21.15.60:0/2674408299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72f8104ad0 0x7f72f81073c0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72ec003e60 tx=0x7f72ec011a30 comp rx=0 tx=0).stop 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.896+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 >> 172.21.15.60:0/2674408299 conn(0x7f72f8100420 msgr2=0x7f72f81011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.896+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 shutdown_connections 2023-10-05T15:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:36.896+0000 7f72febe0700 1 -- 172.21.15.60:0/2674408299 wait complete. 2023-10-05T15:08:37.517 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:37.198+0000 7fcee9139200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:08:37.518 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:37.308+0000 7fcee9139200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:08:37.518 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:37.429+0000 7fcee9139200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:08:37.894 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:37.648+0000 7fcee9139200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:08:38.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:38.139+0000 7fcee9139200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:08:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2674408299' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-05T15:08:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:37 smithi060 ceph-mon[99238]: mgrmap e9: x(active, since 18s) 2023-10-05T15:08:38.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:38.292+0000 7fcee9139200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:08:38.665 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:38.404+0000 7fcee9139200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:08:38.665 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:38.524+0000 7fcee9139200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:08:38.783 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.849+0000 7f80fb443700 1 Processor -- start 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.849+0000 7f80fb443700 1 -- start start 2023-10-05T15:08:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.849+0000 7f80fb443700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f4105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.849+0000 7f80fb443700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41060d0 con 0x7f80f41056e0 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80f91df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f4105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80f91df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f4105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34758/0 (socket says 172.21.15.60:34758) 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80f91df700 1 -- 172.21.15.60:0/472491031 learned_addr learned my addr 172.21.15.60:0/472491031 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80f91df700 1 -- 172.21.15.60:0/472491031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f41068e0 con 0x7f80f41056e0 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80f91df700 1 --2- 172.21.15.60:0/472491031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f4105b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80f000bb40 tx=0x7f80f000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7780721b4586d146 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80ebfff700 1 -- 172.21.15.60:0/472491031 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80f000dbe0 con 0x7f80f41056e0 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80ebfff700 1 -- 172.21.15.60:0/472491031 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80f00044f0 con 0x7f80f41056e0 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.850+0000 7f80ebfff700 1 -- 172.21.15.60:0/472491031 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80f0003e60 con 0x7f80f41056e0 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 -- 172.21.15.60:0/472491031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 msgr2=0x7f80f4105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 --2- 172.21.15.60:0/472491031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f4105b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80f000bb40 tx=0x7f80f000be50 comp rx=0 tx=0).stop 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 -- 172.21.15.60:0/472491031 shutdown_connections 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 --2- 172.21.15.60:0/472491031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f4105b00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 -- 172.21.15.60:0/472491031 >> 172.21.15.60:0/472491031 conn(0x7f80f4100ca0 msgr2=0x7f80f41030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 -- 172.21.15.60:0/472491031 shutdown_connections 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.851+0000 7f80fb443700 1 -- 172.21.15.60:0/472491031 wait complete. 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80fb443700 1 Processor -- start 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80fb443700 1 -- start start 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80fb443700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80fb443700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f419cbe0 con 0x7f80f41056e0 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80f91df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80f91df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f419c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34760/0 (socket says 172.21.15.60:34760) 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.852+0000 7f80f91df700 1 -- 172.21.15.60:0/4107213958 learned_addr learned my addr 172.21.15.60:0/4107213958 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80f91df700 1 -- 172.21.15.60:0/4107213958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f000b7f0 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80f91df700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f419c6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80f00046e0 tx=0x7f80f0004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80f0010760 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80f0010d80 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80f0019d70 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f419cde0 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.853+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f419d1a0 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.854+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f80f002a450 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.854+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4191f70 con 0x7f80f41056e0 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.854+0000 7f80ea7fc700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 0x7f80e003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:38.794 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.854+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f80f004cdf0 con 0x7f80f41056e0 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.854+0000 7f80f89de700 1 -- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 msgr2=0x7f80e003ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.854+0000 7f80f89de700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 0x7f80e003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:37.859+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80f000fd20 con 0x7f80f41056e0 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.055+0000 7f80f89de700 1 -- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 msgr2=0x7f80e003ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.055+0000 7f80f89de700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 0x7f80e003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.337+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f80f402d070 con 0x7f80f41056e0 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.338+0000 7f80ea7fc700 1 -- 172.21.15.60:0/4107213958 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f80f0028350 con 0x7f80f41056e0 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 msgr2=0x7f80e003ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 0x7f80e003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:38.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 msgr2=0x7f80f419c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f419c6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80f00046e0 tx=0x7f80f0004020 comp rx=0 tx=0).stop 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 shutdown_connections 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f80e0038870 0x7f80e003ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 --2- 172.21.15.60:0/4107213958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80f41056e0 0x7f80f419c6a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 >> 172.21.15.60:0/4107213958 conn(0x7f80f4100ca0 msgr2=0x7f80f418f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 shutdown_connections 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:38.340+0000 7f80fb443700 1 -- 172.21.15.60:0/4107213958 wait complete. 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2023-10-05T15:08:38.796 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 9... 2023-10-05T15:08:38.999 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:38 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4107213958' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-05T15:08:39.253 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:39.051+0000 7fcee9139200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:08:40.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:39.844+0000 7fcee9139200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:08:40.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:39.943+0000 7fcee9139200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:08:41.254 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:40.918+0000 7fcee9139200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:08:41.254 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:41.030+0000 7fcee9139200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:08:41.860 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:41.252+0000 7fcee9139200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:08:41.861 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:41.606+0000 7fcee9139200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:08:42.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:41.859+0000 7fcee9139200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:08:42.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:42.043+0000 7fcee9139200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:08:42.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:42.375+0000 7fcee9139200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:08:43.610 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:43.200+0000 7fcee9139200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:08:43.610 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:43.359+0000 7fcee9139200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:08:43.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:43.607+0000 7fcee9139200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:08:43.915 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:43.744+0000 7fcee9139200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:08:44.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:44.018+0000 7fcee9139200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:08:45.417 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:08:45.064+0000 7fcee9139200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:08:45.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: Active manager daemon x restarted 2023-10-05T15:08:45.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: Activating manager daemon x 2023-10-05T15:08:45.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: osdmap e3: 0 total, 0 up, 0 in 2023-10-05T15:08:45.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: mgrmap e10: x(active, starting, since 0.00302219s) 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: Manager daemon x is now available 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:45.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:46.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:08:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:08:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:46 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:45] ENGINE Bus STARTING 2023-10-05T15:08:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:46 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:45] ENGINE Serving on https://172.21.15.60:7150 2023-10-05T15:08:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:46 smithi060 ceph-mon[99238]: mgrmap e11: x(active, since 1.00618s) 2023-10-05T15:08:46.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:08:46.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-05T15:08:46.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-05T15:08:46.955 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.460+0000 7f4a34fb6700 1 Processor -- start 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a34fb6700 1 -- start start 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a34fb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a30106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a34fb6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301071f0 con 0x7f4a30106800 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a30106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a30106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34768/0 (socket says 172.21.15.60:34768) 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a2e59c700 1 -- 172.21.15.60:0/3296390 learned_addr learned my addr 172.21.15.60:0/3296390 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.461+0000 7f4a2e59c700 1 -- 172.21.15.60:0/3296390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30107a00 con 0x7f4a30106800 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.462+0000 7f4a2e59c700 1 --2- 172.21.15.60:0/3296390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a30106c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098a0 tx=0x7f4a20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268dad2fa4940913 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.462+0000 7f4a2d59a700 1 -- 172.21.15.60:0/3296390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a20004160 con 0x7f4a30106800 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.462+0000 7f4a2d59a700 1 -- 172.21.15.60:0/3296390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a200042c0 con 0x7f4a30106800 2023-10-05T15:08:46.956 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.462+0000 7f4a2d59a700 1 -- 172.21.15.60:0/3296390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a200119b0 con 0x7f4a30106800 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.462+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3296390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 msgr2=0x7f4a30106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.462+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3296390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a30106c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098a0 tx=0x7f4a20009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3296390 shutdown_connections 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3296390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a30106c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3296390 >> 172.21.15.60:0/3296390 conn(0x7f4a30101da0 msgr2=0x7f4a301041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3296390 shutdown_connections 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3296390 wait complete. 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 Processor -- start 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.463+0000 7f4a34fb6700 1 -- start start 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a34fb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a3019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a34fb6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3019a9f0 con 0x7f4a30106800 2023-10-05T15:08:46.957 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a3019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a3019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34770/0 (socket says 172.21.15.60:34770) 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a2e59c700 1 -- 172.21.15.60:0/3000313146 learned_addr learned my addr 172.21.15.60:0/3000313146 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a2e59c700 1 -- 172.21.15.60:0/3000313146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20009550 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a2e59c700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a3019a4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a20003e60 tx=0x7f4a20011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a20003970 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3019abf0 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a20003ad0 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.464+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3019b010 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.465+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a200195e0 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.465+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f4a200198d0 con 0x7f4a30106800 2023-10-05T15:08:46.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.466+0000 7f4a1f7fe700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.466+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 --> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a1803b440 con 0x7f4a18038870 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.466+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4a2004d980 con 0x7f4a30106800 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.466+0000 7f4a2dd9b700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 msgr2=0x7f4a1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.466+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.667+0000 7f4a2dd9b700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 msgr2=0x7f4a1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:39.667+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:40.068+0000 7f4a2dd9b700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 msgr2=0x7f4a1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:40.068+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:40.869+0000 7f4a2dd9b700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 msgr2=0x7f4a1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:40.869+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:42.470+0000 7f4a2dd9b700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 msgr2=0x7f4a1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2843655042 2023-10-05T15:08:46.959 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:42.470+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:45.080+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mgrmap(e 10) v1 ==== 45359+0+0 (secure 0 0 0) 0x7f4a2002d9b0 con 0x7f4a30106800 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:45.080+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 msgr2=0x7f4a1803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:45.080+0000 7f4a1f7fe700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.082+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7f4a2004e530 con 0x7f4a30106800 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.082+0000 7f4a1f7fe700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a1803c1b0 0x7f4a1803e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.082+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a1803b440 con 0x7f4a1803c1b0 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.082+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a1803c1b0 0x7f4a1803e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.083+0000 7f4a2dd9b700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a1803c1b0 0x7f4a1803e5a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4a24003a10 tx=0x7f4a24009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.083+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f4a1803b440 con 0x7f4a1803c1b0 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.094+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f4a3019b7f0 con 0x7f4a1803c1b0 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.094+0000 7f4a1f7fe700 1 -- 172.21.15.60:0/3000313146 <== mgr.14152 v2:172.21.15.60:6800/3043189857 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f4a3019b7f0 con 0x7f4a1803c1b0 2023-10-05T15:08:46.960 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a1803c1b0 msgr2=0x7f4a1803e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a1803c1b0 0x7f4a1803e5a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4a24003a10 tx=0x7f4a24009270 comp rx=0 tx=0).stop 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 msgr2=0x7f4a3019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a3019a4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a20003e60 tx=0x7f4a20011aa0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 shutdown_connections 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a1803c1b0 0x7f4a1803e5a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a30106800 0x7f4a3019a4b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 --2- 172.21.15.60:0/3000313146 >> [v2:172.21.15.60:6800/2843655042,v1:172.21.15.60:6801/2843655042] conn(0x7f4a18038870 0x7f4a1803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 >> 172.21.15.60:0/3000313146 conn(0x7f4a30101da0 msgr2=0x7f4a30103450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 shutdown_connections 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:46.095+0000 7f4a34fb6700 1 -- 172.21.15.60:0/3000313146 wait complete. 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 9 is available 2023-10-05T15:08:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:Generating a dashboard self-signed certificate... 2023-10-05T15:08:47.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:47 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:46] ENGINE Serving on http://172.21.15.60:8765 2023-10-05T15:08:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:47 smithi060 ceph-mon[99238]: [05/Oct/2023:15:08:46] ENGINE Bus STARTED 2023-10-05T15:08:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:47 smithi060 ceph-mon[99238]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-05T15:08:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:47 smithi060 ceph-mon[99238]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-05T15:08:48.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-05T15:08:48.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.575+0000 7f2f0b500700 1 Processor -- start 2023-10-05T15:08:48.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.575+0000 7f2f0b500700 1 -- start start 2023-10-05T15:08:48.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.575+0000 7f2f0b500700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f04106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:48.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.575+0000 7f2f0b500700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041071f0 con 0x7f2f04106800 2023-10-05T15:08:48.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2f0929c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f04106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2f0929c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f04106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34824/0 (socket says 172.21.15.60:34824) 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2f0929c700 1 -- 172.21.15.60:0/3326371181 learned_addr learned my addr 172.21.15.60:0/3326371181 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2f0929c700 1 -- 172.21.15.60:0/3326371181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04107a00 con 0x7f2f04106800 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2f0929c700 1 --2- 172.21.15.60:0/3326371181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f04106c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f000098a0 tx=0x7f2f00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0a683ba45c4684 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2efbfff700 1 -- 172.21.15.60:0/3326371181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f00004160 con 0x7f2f04106800 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2efbfff700 1 -- 172.21.15.60:0/3326371181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f000042c0 con 0x7f2f04106800 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.576+0000 7f2efbfff700 1 -- 172.21.15.60:0/3326371181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f000119b0 con 0x7f2f04106800 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 -- 172.21.15.60:0/3326371181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 msgr2=0x7f2f04106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 --2- 172.21.15.60:0/3326371181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f04106c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f000098a0 tx=0x7f2f00009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 -- 172.21.15.60:0/3326371181 shutdown_connections 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 --2- 172.21.15.60:0/3326371181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f04106c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 -- 172.21.15.60:0/3326371181 >> 172.21.15.60:0/3326371181 conn(0x7f2f04101da0 msgr2=0x7f2f041041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 -- 172.21.15.60:0/3326371181 shutdown_connections 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.577+0000 7f2f0b500700 1 -- 172.21.15.60:0/3326371181 wait complete. 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0b500700 1 Processor -- start 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0b500700 1 -- start start 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0b500700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f0419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0b500700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0419cc00 con 0x7f2f04106800 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0929c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f0419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0929c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f0419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34826/0 (socket says 172.21.15.60:34826) 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0929c700 1 -- 172.21.15.60:0/1488125053 learned_addr learned my addr 172.21.15.60:0/1488125053 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:48.402 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0929c700 1 -- 172.21.15.60:0/1488125053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00009550 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0929c700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f0419c6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f00003e60 tx=0x7f2f00011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f00003970 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f00003ad0 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0419ce00 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.578+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f000195e0 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.579+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0419d220 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.579+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f2f000198a0 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.580+0000 7f2efa7fc700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ef0038820 0x7f2ef003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.580+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f040624e0 con 0x7f2f04106800 2023-10-05T15:08:48.403 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.580+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2f0004ccc0 con 0x7f2f04106800 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.580+0000 7f2f08a9b700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ef0038820 0x7f2ef003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.580+0000 7f2f08a9b700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ef0038820 0x7f2ef003ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4006fd0 tx=0x7f2ef4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.585+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f0002b340 con 0x7f2f04106800 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:47.960+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f04104070 con 0x7f2ef0038820 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.050+0000 7f2efa7fc700 1 -- 172.21.15.60:0/1488125053 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f2f04104070 con 0x7f2ef0038820 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ef0038820 msgr2=0x7f2ef003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ef0038820 0x7f2ef003ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4006fd0 tx=0x7f2ef4006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 msgr2=0x7f2f0419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f0419c6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f00003e60 tx=0x7f2f00011aa0 comp rx=0 tx=0).stop 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 shutdown_connections 2023-10-05T15:08:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ef0038820 0x7f2ef003ace0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:48.405 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 --2- 172.21.15.60:0/1488125053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f04106800 0x7f2f0419c6c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:48.405 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 >> 172.21.15.60:0/1488125053 conn(0x7f2f04101da0 msgr2=0x7f2f04103410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:48.405 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 shutdown_connections 2023-10-05T15:08:48.405 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.053+0000 7f2f0b500700 1 -- 172.21.15.60:0/1488125053 wait complete. 2023-10-05T15:08:48.405 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial admin user... 2023-10-05T15:08:48.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:48 smithi060 ceph-mon[99238]: mgrmap e12: x(active, since 2s) 2023-10-05T15:08:48.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:48.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:48.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:49.533 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:49 smithi060 ceph-mon[99238]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:49.654 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:49 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:50.046 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$BPiCMxCcDfBogEv35wZX3.f2fvCAwMsoUW.97IkLjXaywajGTsX5e", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696518529, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f2382b700 1 Processor -- start 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f2382b700 1 -- start start 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f2382b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f2382b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c1060d0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f215c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f215c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34830/0 (socket says 172.21.15.60:34830) 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.910+0000 7f4f215c7700 1 -- 172.21.15.60:0/3989078762 learned_addr learned my addr 172.21.15.60:0/3989078762 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.911+0000 7f4f215c7700 1 -- 172.21.15.60:0/3989078762 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c1068e0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.911+0000 7f4f215c7700 1 --2- 172.21.15.60:0/3989078762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c105b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0098a0 tx=0x7f4f0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb47ec3a70b633e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.911+0000 7f4f13fff700 1 -- 172.21.15.60:0/3989078762 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c004160 con 0x7f4f1c1056e0 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.911+0000 7f4f13fff700 1 -- 172.21.15.60:0/3989078762 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f0c0042c0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.911+0000 7f4f13fff700 1 -- 172.21.15.60:0/3989078762 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0119b0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 -- 172.21.15.60:0/3989078762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 msgr2=0x7f4f1c105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 --2- 172.21.15.60:0/3989078762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c105b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0098a0 tx=0x7f4f0c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 -- 172.21.15.60:0/3989078762 shutdown_connections 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 --2- 172.21.15.60:0/3989078762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c105b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 -- 172.21.15.60:0/3989078762 >> 172.21.15.60:0/3989078762 conn(0x7f4f1c100ca0 msgr2=0x7f4f1c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 -- 172.21.15.60:0/3989078762 shutdown_connections 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 -- 172.21.15.60:0/3989078762 wait complete. 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 Processor -- start 2023-10-05T15:08:50.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.912+0000 7f4f2382b700 1 -- start start 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f2382b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c190930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f2382b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c190e70 con 0x7f4f1c1056e0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f215c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c190930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f215c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c190930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34832/0 (socket says 172.21.15.60:34832) 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f215c7700 1 -- 172.21.15.60:0/4055081436 learned_addr learned my addr 172.21.15.60:0/4055081436 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f215c7700 1 -- 172.21.15.60:0/4055081436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009550 con 0x7f4f1c1056e0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f215c7700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c190930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c003e60 tx=0x7f4f0c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c003970 con 0x7f4f1c1056e0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c18ef80 con 0x7f4f1c1056e0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f0c003ad0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0195e0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.913+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c18f3a0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.914+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f4f0c0198a0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.914+0000 7f4f127fc700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f08038820 0x7f4f0803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.915+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4f0c04cb10 con 0x7f4f1c1056e0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.915+0000 7f4f20dc6700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f08038820 0x7f4f0803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.915+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c109b10 con 0x7f4f1c1056e0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.915+0000 7f4f20dc6700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f08038820 0x7f4f0803ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f18006fd0 tx=0x7f4f18006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:48.920+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4f0c019bf0 con 0x7f4f1c1056e0 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.322+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4f1c062300 con 0x7f4f08038820 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.570+0000 7f4f127fc700 1 -- 172.21.15.60:0/4055081436 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4f1c062300 con 0x7f4f08038820 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f08038820 msgr2=0x7f4f0803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:50.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f08038820 0x7f4f0803ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f18006fd0 tx=0x7f4f18006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 msgr2=0x7f4f1c190930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c190930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c003e60 tx=0x7f4f0c011aa0 comp rx=0 tx=0).stop 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 shutdown_connections 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f08038820 0x7f4f0803ace0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 --2- 172.21.15.60:0/4055081436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f1c1056e0 0x7f4f1c190930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 >> 172.21.15.60:0/4055081436 conn(0x7f4f1c100ca0 msgr2=0x7f4f1c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 shutdown_connections 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:49.572+0000 7f4f2382b700 1 -- 172.21.15.60:0/4055081436 wait complete. 2023-10-05T15:08:50.051 INFO:teuthology.orchestra.run.smithi060.stdout:Fetching dashboard port number... 2023-10-05T15:08:50.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:50 smithi060 ceph-mon[99238]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:08:50.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:51.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 8443 2023-10-05T15:08:51.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effda1cc700 1 Processor -- start 2023-10-05T15:08:51.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effda1cc700 1 -- start start 2023-10-05T15:08:51.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effda1cc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd41054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:51.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effda1cc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4079e30 con 0x7effd41050a0 2023-10-05T15:08:51.293 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effd37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd41054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effd37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd41054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34840/0 (socket says 172.21.15.60:34840) 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.527+0000 7effd37fe700 1 -- 172.21.15.60:0/2579135212 learned_addr learned my addr 172.21.15.60:0/2579135212 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.528+0000 7effd37fe700 1 -- 172.21.15.60:0/2579135212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4105a00 con 0x7effd41050a0 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.528+0000 7effd37fe700 1 --2- 172.21.15.60:0/2579135212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd41054c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7effc40098a0 tx=0x7effc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc56e3ff67cd7b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.528+0000 7effd27fc700 1 -- 172.21.15.60:0/2579135212 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc4004160 con 0x7effd41050a0 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.528+0000 7effd27fc700 1 -- 172.21.15.60:0/2579135212 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effc40042c0 con 0x7effd41050a0 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.528+0000 7effd27fc700 1 -- 172.21.15.60:0/2579135212 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc40119b0 con 0x7effd41050a0 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 -- 172.21.15.60:0/2579135212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 msgr2=0x7effd41054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 --2- 172.21.15.60:0/2579135212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd41054c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7effc40098a0 tx=0x7effc4009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 -- 172.21.15.60:0/2579135212 shutdown_connections 2023-10-05T15:08:51.294 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 --2- 172.21.15.60:0/2579135212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd41054c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 -- 172.21.15.60:0/2579135212 >> 172.21.15.60:0/2579135212 conn(0x7effd4100c60 msgr2=0x7effd41030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 -- 172.21.15.60:0/2579135212 shutdown_connections 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 -- 172.21.15.60:0/2579135212 wait complete. 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.529+0000 7effda1cc700 1 Processor -- start 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effda1cc700 1 -- start start 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effda1cc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effda1cc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd419cbe0 con 0x7effd41050a0 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effd37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effd37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd419c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34842/0 (socket says 172.21.15.60:34842) 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effd37fe700 1 -- 172.21.15.60:0/2038498400 learned_addr learned my addr 172.21.15.60:0/2038498400 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effd37fe700 1 -- 172.21.15.60:0/2038498400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4009550 con 0x7effd41050a0 2023-10-05T15:08:51.295 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.530+0000 7effd37fe700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd419c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effc4003f00 tx=0x7effc4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.531+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc4003b20 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.531+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effc4003c80 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.531+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd419cde0 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.531+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc4019770 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.531+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd419d200 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.531+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7effc40199e0 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.532+0000 7effd0ff9700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7effbc0388c0 0x7effbc03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.532+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7effc404cc40 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.532+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd4195f50 con 0x7effd41050a0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.532+0000 7effd2ffd700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7effbc0388c0 0x7effbc03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:51.296 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.532+0000 7effd2ffd700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7effbc0388c0 0x7effbc03ad80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7effc8006fd0 tx=0x7effc8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.537+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7effc4018b80 con 0x7effd41050a0 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.901+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7effd40624e0 con 0x7effd41050a0 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.902+0000 7effd0ff9700 1 -- 172.21.15.60:0/2038498400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7effc4023e60 con 0x7effd41050a0 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7effbc0388c0 msgr2=0x7effbc03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7effbc0388c0 0x7effbc03ad80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7effc8006fd0 tx=0x7effc8006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 msgr2=0x7effd419c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd419c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effc4003f00 tx=0x7effc4011a30 comp rx=0 tx=0).stop 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 shutdown_connections 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7effbc0388c0 0x7effbc03ad80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 --2- 172.21.15.60:0/2038498400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd41050a0 0x7effd419c6a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 >> 172.21.15.60:0/2038498400 conn(0x7effd4100c60 msgr2=0x7effd4190c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.904+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 shutdown_connections 2023-10-05T15:08:51.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:50.905+0000 7effda1cc700 1 -- 172.21.15.60:0/2038498400 wait complete. 2023-10-05T15:08:51.301 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:08:51.301 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2023-10-05T15:08:51.309 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:08:51.310 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2023-10-05T15:08:51.310 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2023-10-05T15:08:51.310 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-05T15:08:51.311 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph Dashboard is now available at: 2023-10-05T15:08:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: URL: https://smithi060:8443/ 2023-10-05T15:08:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: User: admin 2023-10-05T15:08:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: Password: lwgbuzwr01 2023-10-05T15:08:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:51.312 INFO:teuthology.orchestra.run.smithi060.stdout:Saving cluster configuration to /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config directory 2023-10-05T15:08:51.312 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling autotune for osd_memory_target 2023-10-05T15:08:51.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:51 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2038498400' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-05T15:08:52.562 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa34eae700 1 Processor -- start 2023-10-05T15:08:52.562 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa34eae700 1 -- start start 2023-10-05T15:08:52.562 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa34eae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:52.562 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa34eae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301060d0 con 0x7ffa301056e0 2023-10-05T15:08:52.562 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:52.562 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34846/0 (socket says 172.21.15.60:34846) 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa2e59c700 1 -- 172.21.15.60:0/1136736510 learned_addr learned my addr 172.21.15.60:0/1136736510 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.774+0000 7ffa2e59c700 1 -- 172.21.15.60:0/1136736510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa301068e0 con 0x7ffa301056e0 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa2e59c700 1 --2- 172.21.15.60:0/1136736510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30105b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000bb40 tx=0x7ffa2000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedc69b735d2eaa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa2d59a700 1 -- 172.21.15.60:0/1136736510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa2000dbe0 con 0x7ffa301056e0 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa2d59a700 1 -- 172.21.15.60:0/1136736510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa200044f0 con 0x7ffa301056e0 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa2d59a700 1 -- 172.21.15.60:0/1136736510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa20003e60 con 0x7ffa301056e0 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa34eae700 1 -- 172.21.15.60:0/1136736510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 msgr2=0x7ffa30105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa34eae700 1 --2- 172.21.15.60:0/1136736510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30105b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000bb40 tx=0x7ffa2000be50 comp rx=0 tx=0).stop 2023-10-05T15:08:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa34eae700 1 -- 172.21.15.60:0/1136736510 shutdown_connections 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa34eae700 1 --2- 172.21.15.60:0/1136736510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30105b00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa34eae700 1 -- 172.21.15.60:0/1136736510 >> 172.21.15.60:0/1136736510 conn(0x7ffa30100ca0 msgr2=0x7ffa301030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.775+0000 7ffa34eae700 1 -- 172.21.15.60:0/1136736510 shutdown_connections 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.776+0000 7ffa34eae700 1 -- 172.21.15.60:0/1136736510 wait complete. 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.776+0000 7ffa34eae700 1 Processor -- start 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.776+0000 7ffa34eae700 1 -- start start 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa34eae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa34eae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30198790 con 0x7ffa301056e0 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa2e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34848/0 (socket says 172.21.15.60:34848) 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa2e59c700 1 -- 172.21.15.60:0/715873098 learned_addr learned my addr 172.21.15.60:0/715873098 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa2e59c700 1 -- 172.21.15.60:0/715873098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2000b7f0 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa2e59c700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30198250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa200046e0 tx=0x7ffa20004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa2001e070 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa20010c20 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa20022b60 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa30198990 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.777+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30198db0 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.778+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ffa2002c440 con 0x7ffa301056e0 2023-10-05T15:08:52.565 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.778+0000 7ffa277fe700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffa1c0388c0 0x7ffa1c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.778+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ffa2004f540 con 0x7ffa301056e0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.779+0000 7ffa2dd9b700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffa1c0388c0 0x7ffa1c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.779+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30191f70 con 0x7ffa301056e0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.779+0000 7ffa2dd9b700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffa1c0388c0 0x7ffa1c03ad80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa18006fd0 tx=0x7ffa18006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:51.784+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffa20027030 con 0x7ffa301056e0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.144+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ffa3002cfe0 con 0x7ffa301056e0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.144+0000 7ffa277fe700 1 -- 172.21.15.60:0/715873098 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ffa2002a540 con 0x7ffa301056e0 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.146+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffa1c0388c0 msgr2=0x7ffa1c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:52.566 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.146+0000 7ffa34eae700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffa1c0388c0 0x7ffa1c03ad80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa18006fd0 tx=0x7ffa18006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.146+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 msgr2=0x7ffa30198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.146+0000 7ffa34eae700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30198250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa200046e0 tx=0x7ffa20004020 comp rx=0 tx=0).stop 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.147+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 shutdown_connections 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.147+0000 7ffa34eae700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffa1c0388c0 0x7ffa1c03ad80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.147+0000 7ffa34eae700 1 --2- 172.21.15.60:0/715873098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa301056e0 0x7ffa30198250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.147+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 >> 172.21.15.60:0/715873098 conn(0x7ffa30100ca0 msgr2=0x7ffa3018f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.147+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 shutdown_connections 2023-10-05T15:08:52.567 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:52.147+0000 7ffa34eae700 1 -- 172.21.15.60:0/715873098 wait complete. 2023-10-05T15:08:52.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:52 smithi060 ceph-mon[99238]: mgrmap e13: x(active, since 6s) 2023-10-05T15:08:54.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.071+0000 7f9a06d1d700 1 Processor -- start 2023-10-05T15:08:54.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.071+0000 7f9a06d1d700 1 -- start start 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.071+0000 7f9a06d1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a00109640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.071+0000 7f9a06d1d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00079eb0 con 0x7f9a00107250 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f9a04ab9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a00109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f9a04ab9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a00109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34852/0 (socket says 172.21.15.60:34852) 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f9a04ab9700 1 -- 172.21.15.60:0/3034728420 learned_addr learned my addr 172.21.15.60:0/3034728420 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f9a04ab9700 1 -- 172.21.15.60:0/3034728420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00109b80 con 0x7f9a00107250 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f9a04ab9700 1 --2- 172.21.15.60:0/3034728420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a00109640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99f40098a0 tx=0x7f99f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab0a7df3cfcaea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f99ff7fe700 1 -- 172.21.15.60:0/3034728420 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99f4004160 con 0x7f9a00107250 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f99ff7fe700 1 -- 172.21.15.60:0/3034728420 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99f40042c0 con 0x7f9a00107250 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.072+0000 7f99ff7fe700 1 -- 172.21.15.60:0/3034728420 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99f40119b0 con 0x7f9a00107250 2023-10-05T15:08:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 -- 172.21.15.60:0/3034728420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 msgr2=0x7f9a00109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 --2- 172.21.15.60:0/3034728420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a00109640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99f40098a0 tx=0x7f99f4009bb0 comp rx=0 tx=0).stop 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 -- 172.21.15.60:0/3034728420 shutdown_connections 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 --2- 172.21.15.60:0/3034728420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a00109640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 -- 172.21.15.60:0/3034728420 >> 172.21.15.60:0/3034728420 conn(0x7f9a00100ca0 msgr2=0x7f9a001030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 -- 172.21.15.60:0/3034728420 shutdown_connections 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.073+0000 7f9a06d1d700 1 -- 172.21.15.60:0/3034728420 wait complete. 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a06d1d700 1 Processor -- start 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a06d1d700 1 -- start start 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a06d1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a0019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a06d1d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0019a970 con 0x7f9a00107250 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a04ab9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a0019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a04ab9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a0019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34854/0 (socket says 172.21.15.60:34854) 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a04ab9700 1 -- 172.21.15.60:0/551614621 learned_addr learned my addr 172.21.15.60:0/551614621 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a04ab9700 1 -- 172.21.15.60:0/551614621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4009550 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f9a04ab9700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a0019a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99f4011980 tx=0x7f99f4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99f4003a60 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.074+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99f4003bc0 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.075+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0019ab70 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.075+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99f401a670 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.075+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0019af90 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.076+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f99f401a930 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.076+0000 7f99fdffb700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f99f0038910 0x7f99f003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.076+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f99f404cb10 con 0x7f9a00107250 2023-10-05T15:08:54.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.076+0000 7f99fffff700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f99f0038910 0x7f99f003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.076+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a000624e0 con 0x7f9a00107250 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.076+0000 7f99fffff700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f99f0038910 0x7f99f003add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f99ec006fd0 tx=0x7f99ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.081+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99f4018db0 con 0x7f9a00107250 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.660+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f9a0010a9c0 con 0x7f9a00107250 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.663+0000 7f99fdffb700 1 -- 172.21.15.60:0/551614621 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f99f4018350 con 0x7f9a00107250 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f99f0038910 msgr2=0x7f99f003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f99f0038910 0x7f99f003add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f99ec006fd0 tx=0x7f99ec006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 msgr2=0x7f9a0019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a0019a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99f4011980 tx=0x7f99f4011a60 comp rx=0 tx=0).stop 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 shutdown_connections 2023-10-05T15:08:54.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f99f0038910 0x7f99f003add0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 --2- 172.21.15.60:0/551614621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a00107250 0x7f9a0019a430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 >> 172.21.15.60:0/551614621 conn(0x7f9a00100ca0 msgr2=0x7f9a001019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 shutdown_connections 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2023-10-05T15:08:53.665+0000 7f9a06d1d700 1 -- 172.21.15.60:0/551614621 wait complete. 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout:Or, if you are only running a single cluster on this host: 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-05T15:08:54.012 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout: ceph telemetry on 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout:For more information see: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:08:54.013 INFO:teuthology.orchestra.run.smithi060.stdout:Bootstrap complete. 2023-10-05T15:08:54.045 INFO:tasks.cephadm:Fetching config... 2023-10-05T15:08:54.045 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:08:54.045 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-05T15:08:54.062 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-05T15:08:54.062 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:08:54.062 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-05T15:08:54.121 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-05T15:08:54.121 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:08:54.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-05T15:08:54.191 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-05T15:08:54.191 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:08:54.191 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-05T15:08:54.249 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-05T15:08:54.249 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-05T15:08:54.334 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:08:54.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-05T15:08:54.395 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:08:54.407 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-05T15:08:54.454 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC888Sq1984zhE8RYQ7f4LIDN4ZSFx19C9grq/fRQmdsIoPFkU77fTHtFbZQBg1KQBNH1VX6ufyIONqQ/+m2SxiS7LbDbL1xhUkgvOincPeZLoKoxUbRR1L35x8Tx45ktGwep31jNLBIl8mGJwIKjliEmMY4VjWTIw3aflBnJX0yamiZ01C2/snLWewrecTWqInnf8MxbpqrTiPRYnqvI0BnoEduwLxtnTqtUwDirwrS5ZFGEeFa7BDIdj3jhcAm+CW1maac0j+NdcyvB6tF6jVLpoA2MZmo1LdW1hHxdmUPFgwyObZsYcpag8pXRjGiimOA1ch8B+mIeflw1DbmpiWZC5xQkgi119emxqdRl80lOkDwGghjOMMIYajwTl9egPHxNYwHvqVvxN/+0mCadyeY22uJvX60MZ079BwkzhkttmDVEPc/nvaBQJqwtC+6SC0DD7XR1o+iFPm7MjPGJPthudhbWg73kxyOrJG27sstgYV1ZB60UgELIbvza7D4CM= ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:08:54.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-05T15:08:54.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:54 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/551614621' entity='client.admin' 2023-10-05T15:08:55.033 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.450+0000 7f80b48b8700 1 -- 172.21.15.60:0/3478649528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 msgr2=0x7f80b01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.450+0000 7f80b48b8700 1 --2- 172.21.15.60:0/3478649528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b01013e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80a800b0a0 tx=0x7f80a800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.450+0000 7f80b48b8700 1 -- 172.21.15.60:0/3478649528 shutdown_connections 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.450+0000 7f80b48b8700 1 --2- 172.21.15.60:0/3478649528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b01013e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.450+0000 7f80b48b8700 1 -- 172.21.15.60:0/3478649528 >> 172.21.15.60:0/3478649528 conn(0x7f80b00fae80 msgr2=0x7f80b00fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.451+0000 7f80b48b8700 1 -- 172.21.15.60:0/3478649528 shutdown_connections 2023-10-05T15:08:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.451+0000 7f80b48b8700 1 -- 172.21.15.60:0/3478649528 wait complete. 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.451+0000 7f80b48b8700 1 Processor -- start 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.451+0000 7f80b48b8700 1 -- start start 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80b48b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80b48b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0198900 con 0x7f80b0100fc0 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80ae59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80ae59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b0068c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34860/0 (socket says 172.21.15.60:34860) 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80ae59c700 1 -- 172.21.15.60:0/683662386 learned_addr learned my addr 172.21.15.60:0/683662386 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80ae59c700 1 -- 172.21.15.60:0/683662386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009d00 con 0x7f80b0100fc0 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80ae59c700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b0068c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80a80093e0 tx=0x7f80a800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80a800e040 con 0x7f80b0100fc0 2023-10-05T15:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80a8003d40 con 0x7f80b0100fc0 2023-10-05T15:08:56.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b0198a40 con 0x7f80b0100fc0 2023-10-05T15:08:56.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80a801d5e0 con 0x7f80b0100fc0 2023-10-05T15:08:56.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.452+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b0198ee0 con 0x7f80b0100fc0 2023-10-05T15:08:56.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.453+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f80a8019070 con 0x7f80b0100fc0 2023-10-05T15:08:56.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.453+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b018e4f0 con 0x7f80b0100fc0 2023-10-05T15:08:56.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.453+0000 7f80a77fe700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f809c038900 0x7f809c03adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:56.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.453+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f80a804ca60 con 0x7f80b0100fc0 2023-10-05T15:08:56.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.454+0000 7f80add9b700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f809c038900 0x7f809c03adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:56.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.454+0000 7f80add9b700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f809c038900 0x7f809c03adc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8098006fd0 tx=0x7f8098006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:56.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.458+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80a8026e20 con 0x7f80b0100fc0 2023-10-05T15:08:56.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.662+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f80b0062530 con 0x7f80b0100fc0 2023-10-05T15:08:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.664+0000 7f80a77fe700 1 -- 172.21.15.60:0/683662386 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f80a8017020 con 0x7f80b0100fc0 2023-10-05T15:08:56.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.667+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f809c038900 msgr2=0x7f809c03adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.667+0000 7f80b48b8700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f809c038900 0x7f809c03adc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8098006fd0 tx=0x7f8098006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.667+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 msgr2=0x7f80b0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.667+0000 7f80b48b8700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b0068c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80a80093e0 tx=0x7f80a800bd40 comp rx=0 tx=0).stop 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.668+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 shutdown_connections 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.668+0000 7f80b48b8700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f809c038900 0x7f809c03adc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.668+0000 7f80b48b8700 1 --2- 172.21.15.60:0/683662386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b0100fc0 0x7f80b0068c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.668+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 >> 172.21.15.60:0/683662386 conn(0x7f80b00fae80 msgr2=0x7f80b00fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.668+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 shutdown_connections 2023-10-05T15:08:56.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:56.668+0000 7f80b48b8700 1 -- 172.21.15.60:0/683662386 wait complete. 2023-10-05T15:08:57.076 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-05T15:08:57.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-05T15:08:57.555 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:08:57.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:57 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/683662386' entity='client.admin' 2023-10-05T15:08:59.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.066+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/1703365746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 msgr2=0x7fbc441013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:59.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.066+0000 7fbc4a9cf700 1 --2- 172.21.15.60:0/1703365746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc441013e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009910 tx=0x7fbc34009c20 comp rx=0 tx=0).stop 2023-10-05T15:08:59.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.066+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/1703365746 shutdown_connections 2023-10-05T15:08:59.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.066+0000 7fbc4a9cf700 1 --2- 172.21.15.60:0/1703365746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc441013e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:59.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.066+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/1703365746 >> 172.21.15.60:0/1703365746 conn(0x7fbc440fae80 msgr2=0x7fbc440fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:59.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.067+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/1703365746 shutdown_connections 2023-10-05T15:08:59.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.067+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/1703365746 wait complete. 2023-10-05T15:08:59.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.067+0000 7fbc4a9cf700 1 Processor -- start 2023-10-05T15:08:59.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.067+0000 7fbc4a9cf700 1 -- start start 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc4a9cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc44195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc4a9cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44196110 con 0x7fbc44100fc0 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc43fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc44195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc43fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc44195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34866/0 (socket says 172.21.15.60:34866) 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc43fff700 1 -- 172.21.15.60:0/4022160967 learned_addr learned my addr 172.21.15.60:0/4022160967 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc43fff700 1 -- 172.21.15.60:0/4022160967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340095f0 con 0x7fbc44100fc0 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc43fff700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc44195bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006010 tx=0x7fbc340057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:59.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.068+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc3401d070 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.069+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc340044e0 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.069+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44196310 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.069+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc340039b0 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.069+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44196750 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.069+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fbc34003c20 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.069+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4418f500 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.070+0000 7fbc417fa700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbc2c038910 0x7fbc2c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.070+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbc3404cb20 con 0x7fbc44100fc0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.070+0000 7fbc437fe700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbc2c038910 0x7fbc2c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:08:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.070+0000 7fbc437fe700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbc2c038910 0x7fbc2c03add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbc38006fd0 tx=0x7fbc38006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:08:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.074+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbc3402a950 con 0x7fbc44100fc0 2023-10-05T15:08:59.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:08:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:08:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:08:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:08:59.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.280+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc4402d080 con 0x7fbc2c038910 2023-10-05T15:08:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.283+0000 7fbc417fa700 1 -- 172.21.15.60:0/4022160967 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbc4402d080 con 0x7fbc2c038910 2023-10-05T15:08:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.285+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbc2c038910 msgr2=0x7fbc2c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbc2c038910 0x7fbc2c03add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbc38006fd0 tx=0x7fbc38006e40 comp rx=0 tx=0).stop 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 msgr2=0x7fbc44195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc44195bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006010 tx=0x7fbc340057c0 comp rx=0 tx=0).stop 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 shutdown_connections 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbc2c038910 0x7fbc2c03add0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 --2- 172.21.15.60:0/4022160967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc44100fc0 0x7fbc44195bd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 >> 172.21.15.60:0/4022160967 conn(0x7fbc440fae80 msgr2=0x7fbc44068950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 shutdown_connections 2023-10-05T15:08:59.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:08:59.286+0000 7fbc4a9cf700 1 -- 172.21.15.60:0/4022160967 wait complete. 2023-10-05T15:08:59.708 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi092 2023-10-05T15:08:59.709 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:08:59.709 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.conf 2023-10-05T15:08:59.730 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:08:59.730 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:08:59.790 INFO:tasks.cephadm:Adding host smithi092 to orchestrator... 2023-10-05T15:08:59.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi092 2023-10-05T15:09:00.364 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:00.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:00.539 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:00 smithi060 ceph-mon[99238]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 -- 172.21.15.60:0/561942992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 msgr2=0x7fc57c105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 --2- 172.21.15.60:0/561942992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c105c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009910 tx=0x7fc56c009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 -- 172.21.15.60:0/561942992 shutdown_connections 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 --2- 172.21.15.60:0/561942992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c105c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 -- 172.21.15.60:0/561942992 >> 172.21.15.60:0/561942992 conn(0x7fc57c075370 msgr2=0x7fc57c075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 -- 172.21.15.60:0/561942992 shutdown_connections 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.637+0000 7fc5838e5700 1 -- 172.21.15.60:0/561942992 wait complete. 2023-10-05T15:09:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc5838e5700 1 Processor -- start 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc5838e5700 1 -- start start 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc5838e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c0fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc5838e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0feec0 con 0x7fc57c105860 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc581681700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c0fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc581681700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c0fcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34872/0 (socket says 172.21.15.60:34872) 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc581681700 1 -- 172.21.15.60:0/1647404553 learned_addr learned my addr 172.21.15.60:0/1647404553 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc581681700 1 -- 172.21.15.60:0/1647404553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0095f0 con 0x7fc57c105860 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.638+0000 7fc581681700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c0fcf40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc56c004f40 tx=0x7fc56c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.639+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c01d070 con 0x7fc57c105860 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.639+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc56c004370 con 0x7fc57c105860 2023-10-05T15:09:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.639+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0fd480 con 0x7fc57c105860 2023-10-05T15:09:01.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.639+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c0039b0 con 0x7fc57c105860 2023-10-05T15:09:01.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.639+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c0fd900 con 0x7fc57c105860 2023-10-05T15:09:01.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.640+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0624e0 con 0x7fc57c105860 2023-10-05T15:09:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.640+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fc56c003c70 con 0x7fc57c105860 2023-10-05T15:09:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.640+0000 7fc5727fc700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5680388c0 0x7fc56803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.640+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc56c04c710 con 0x7fc57c105860 2023-10-05T15:09:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.640+0000 7fc580e80700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5680388c0 0x7fc56803ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.640+0000 7fc580e80700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5680388c0 0x7fc56803ad80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc578006fd0 tx=0x7fc578006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.645+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc56c029360 con 0x7fc57c105860 2023-10-05T15:09:01.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:01 smithi060 ceph-mon[99238]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:01.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:01.847+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}) v1 -- 0x7fc57c0fdd40 con 0x7fc5680388c0 2023-10-05T15:09:02.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:02 smithi060 ceph-mon[99238]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:03.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:03 smithi060 ceph-mon[99238]: Deploying cephadm binary to smithi092 2023-10-05T15:09:04.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.850+0000 7fc5727fc700 1 -- 172.21.15.60:0/1647404553 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fc57c0fdd40 con 0x7fc5680388c0 2023-10-05T15:09:04.853 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi092' with addr '172.21.15.92' 2023-10-05T15:09:04.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5680388c0 msgr2=0x7fc56803ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5680388c0 0x7fc56803ad80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc578006fd0 tx=0x7fc578006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 msgr2=0x7fc57c0fcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c0fcf40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc56c004f40 tx=0x7fc56c005020 comp rx=0 tx=0).stop 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 shutdown_connections 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5680388c0 0x7fc56803ad80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 --2- 172.21.15.60:0/1647404553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc57c105860 0x7fc57c0fcf40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 >> 172.21.15.60:0/1647404553 conn(0x7fc57c075370 msgr2=0x7fc57c103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 shutdown_connections 2023-10-05T15:09:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:04.853+0000 7fc5838e5700 1 -- 172.21.15.60:0/1647404553 wait complete. 2023-10-05T15:09:05.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-05T15:09:05.797 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:06.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:06.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:05 smithi060 ceph-mon[99238]: Added host smithi092 2023-10-05T15:09:06.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:06.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 -- 172.21.15.60:0/3735329608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 msgr2=0x7f5008101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 --2- 172.21.15.60:0/3735329608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008101ef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009910 tx=0x7f4ff0009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 -- 172.21.15.60:0/3735329608 shutdown_connections 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 --2- 172.21.15.60:0/3735329608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008101ef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 -- 172.21.15.60:0/3735329608 >> 172.21.15.60:0/3735329608 conn(0x7f50080fb360 msgr2=0x7f50080fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 -- 172.21.15.60:0/3735329608 shutdown_connections 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.990+0000 7f500d762700 1 -- 172.21.15.60:0/3735329608 wait complete. 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f500d762700 1 Processor -- start 2023-10-05T15:09:06.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f500d762700 1 -- start start 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f500d762700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f500d762700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50081963c0 con 0x7f5008101b10 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f5006ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f5006ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34898/0 (socket says 172.21.15.60:34898) 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.991+0000 7f5006ffd700 1 -- 172.21.15.60:0/2448207348 learned_addr learned my addr 172.21.15.60:0/2448207348 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f5006ffd700 1 -- 172.21.15.60:0/2448207348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00095f0 con 0x7f5008101b10 2023-10-05T15:09:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f5006ffd700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008195e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005850 tx=0x7f4ff0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff001d070 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50081965c0 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ff0004370 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff0003ab0 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.992+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50081969e0 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.993+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f4ff000f460 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.993+0000 7f4ffffff700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4ff40388c0 0x7f4ff403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.993+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4ff004c820 con 0x7f5008101b10 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.993+0000 7f50067fc700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4ff40388c0 0x7f4ff403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.993+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080624e0 con 0x7f5008101b10 2023-10-05T15:09:06.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.994+0000 7f50067fc700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4ff40388c0 0x7f4ff403ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8006fd0 tx=0x7f4ff8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:06.998+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ff0026070 con 0x7f5008101b10 2023-10-05T15:09:07.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:06 smithi060 ceph-mon[99238]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:07.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:07.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.208+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f500810ad20 con 0x7f4ff40388c0 2023-10-05T15:09:07.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.209+0000 7f4ffffff700 1 -- 172.21.15.60:0/2448207348 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f500810ad20 con 0x7f4ff40388c0 2023-10-05T15:09:07.211 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:09:07.211 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}] 2023-10-05T15:09:07.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4ff40388c0 msgr2=0x7f4ff403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:07.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4ff40388c0 0x7f4ff403ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8006fd0 tx=0x7f4ff8006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:07.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 msgr2=0x7f5008195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:07.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008195e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005850 tx=0x7f4ff0004ff0 comp rx=0 tx=0).stop 2023-10-05T15:09:07.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 shutdown_connections 2023-10-05T15:09:07.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4ff40388c0 0x7f4ff403ad80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:07.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 --2- 172.21.15.60:0/2448207348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5008101b10 0x7f5008195e80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:07.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 >> 172.21.15.60:0/2448207348 conn(0x7f50080fb360 msgr2=0x7f5008105160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:07.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 shutdown_connections 2023-10-05T15:09:07.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:07.211+0000 7f500d762700 1 -- 172.21.15.60:0/2448207348 wait complete. 2023-10-05T15:09:07.657 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2023-10-05T15:09:07.657 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:09:07.657 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2023-10-05T15:09:07.678 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:09:07.678 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:07.737 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2023-10-05T15:09:07.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi135 2023-10-05T15:09:08.303 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:08.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:08 smithi060 ceph-mon[99238]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:08.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:08 smithi060 ceph-mon[99238]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:09:08.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:08 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:09.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 -- 172.21.15.60:0/4126381187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 msgr2=0x7f5d8c105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 --2- 172.21.15.60:0/4126381187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c105c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009910 tx=0x7f5d80009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 -- 172.21.15.60:0/4126381187 shutdown_connections 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 --2- 172.21.15.60:0/4126381187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c105c30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 -- 172.21.15.60:0/4126381187 >> 172.21.15.60:0/4126381187 conn(0x7f5d8c0fb360 msgr2=0x7f5d8c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 -- 172.21.15.60:0/4126381187 shutdown_connections 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.603+0000 7f5d93224700 1 -- 172.21.15.60:0/4126381187 wait complete. 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d93224700 1 Processor -- start 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d93224700 1 -- start start 2023-10-05T15:09:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d93224700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d93224700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c196380 con 0x7f5d8c105850 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d90fc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d90fc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34904/0 (socket says 172.21.15.60:34904) 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.604+0000 7f5d90fc0700 1 -- 172.21.15.60:0/2652990115 learned_addr learned my addr 172.21.15.60:0/2652990115 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d90fc0700 1 -- 172.21.15.60:0/2652990115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800095f0 con 0x7f5d8c105850 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d90fc0700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c195e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004f40 tx=0x7f5d80005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d8001d070 con 0x7f5d8c105850 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c1965e0 con 0x7f5d8c105850 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d80004370 con 0x7f5d8c105850 2023-10-05T15:09:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d80003970 con 0x7f5d8c105850 2023-10-05T15:09:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.605+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c196a60 con 0x7f5d8c105850 2023-10-05T15:09:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.606+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f5d80003c30 con 0x7f5d8c105850 2023-10-05T15:09:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.606+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c0624e0 con 0x7f5d8c105850 2023-10-05T15:09:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.606+0000 7f5d89ffb700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5d7c0388c0 0x7f5d7c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.606+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5d8004c840 con 0x7f5d8c105850 2023-10-05T15:09:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.606+0000 7f5d8bfff700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5d7c0388c0 0x7f5d7c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.607+0000 7f5d8bfff700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5d7c0388c0 0x7f5d7c03ad80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d78006fd0 tx=0x7f5d78006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.611+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d80029950 con 0x7f5d8c105850 2023-10-05T15:09:09.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:09.815+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d8c0008d0 con 0x7f5d7c0388c0 2023-10-05T15:09:10.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:10 smithi060 ceph-mon[99238]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:10 smithi060 ceph-mon[99238]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:11.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: Deploying cephadm binary to smithi135 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:09:11.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:11.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:11 smithi060 ceph-mon[99238]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.781+0000 7f5d89ffb700 1 -- 172.21.15.60:0/2652990115 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5d8c0008d0 con 0x7f5d7c0388c0 2023-10-05T15:09:12.783 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi135' with addr '172.21.15.135' 2023-10-05T15:09:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5d7c0388c0 msgr2=0x7f5d7c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5d7c0388c0 0x7f5d7c03ad80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d78006fd0 tx=0x7f5d78006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 msgr2=0x7f5d8c195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c195e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004f40 tx=0x7f5d80005020 comp rx=0 tx=0).stop 2023-10-05T15:09:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 shutdown_connections 2023-10-05T15:09:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5d7c0388c0 0x7f5d7c03ad80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 --2- 172.21.15.60:0/2652990115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8c105850 0x7f5d8c195e40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 >> 172.21.15.60:0/2652990115 conn(0x7f5d8c0fb360 msgr2=0x7f5d8c068970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 shutdown_connections 2023-10-05T15:09:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:12.783+0000 7f5d93224700 1 -- 172.21.15.60:0/2652990115 wait complete. 2023-10-05T15:09:13.075 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:12 smithi060 ceph-mon[99238]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:13.075 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:13.076 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:13.076 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:13.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-05T15:09:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:14.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:13 smithi060 ceph-mon[99238]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:14.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:13 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:14.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:13 smithi060 ceph-mon[99238]: Added host smithi135 2023-10-05T15:09:14.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:13 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:14.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:13 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:14.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 -- 172.21.15.60:0/3924165338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 msgr2=0x7f8914105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:14.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 --2- 172.21.15.60:0/3924165338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914105c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8910009910 tx=0x7f8910009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:14.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 -- 172.21.15.60:0/3924165338 shutdown_connections 2023-10-05T15:09:14.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 --2- 172.21.15.60:0/3924165338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914105c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 -- 172.21.15.60:0/3924165338 >> 172.21.15.60:0/3924165338 conn(0x7f8914075370 msgr2=0x7f8914075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 -- 172.21.15.60:0/3924165338 shutdown_connections 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.897+0000 7f891bfaa700 1 -- 172.21.15.60:0/3924165338 wait complete. 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.898+0000 7f891bfaa700 1 Processor -- start 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.898+0000 7f891bfaa700 1 -- start start 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.898+0000 7f891bfaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.898+0000 7f891bfaa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89141971c0 con 0x7f8914105860 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8919d46700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8919d46700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34930/0 (socket says 172.21.15.60:34930) 2023-10-05T15:09:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8919d46700 1 -- 172.21.15.60:0/3398886777 learned_addr learned my addr 172.21.15.60:0/3398886777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8919d46700 1 -- 172.21.15.60:0/3398886777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89100095f0 con 0x7f8914105860 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8919d46700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914196c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8910004f40 tx=0x7f8910005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f891001d070 con 0x7f8914105860 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8914197420 con 0x7f8914105860 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8910004370 con 0x7f8914105860 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8910003970 con 0x7f8914105860 2023-10-05T15:09:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.899+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89141978a0 con 0x7f8914105860 2023-10-05T15:09:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.900+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f8910003be0 con 0x7f8914105860 2023-10-05T15:09:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.900+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914104b10 con 0x7f8914105860 2023-10-05T15:09:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.900+0000 7f8906ffd700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8900038910 0x7f890003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.900+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f891004c620 con 0x7f8914105860 2023-10-05T15:09:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.900+0000 7f8919545700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8900038910 0x7f890003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.901+0000 7f8919545700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8900038910 0x7f890003add0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8908006fd0 tx=0x7f8908006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:14.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:14.905+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f891002a730 con 0x7f8914105860 2023-10-05T15:09:15.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.110+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89140687e0 con 0x7f8900038910 2023-10-05T15:09:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.112+0000 7f8906ffd700 1 -- 172.21.15.60:0/3398886777 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7f89140687e0 con 0x7f8900038910 2023-10-05T15:09:15.113 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:09:15.113 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2023-10-05T15:09:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8900038910 msgr2=0x7f890003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8900038910 0x7f890003add0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8908006fd0 tx=0x7f8908006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 msgr2=0x7f8914196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914196c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8910004f40 tx=0x7f8910005020 comp rx=0 tx=0).stop 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 shutdown_connections 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8900038910 0x7f890003add0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 --2- 172.21.15.60:0/3398886777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8914105860 0x7f8914196c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 >> 172.21.15.60:0/3398886777 conn(0x7f8914075370 msgr2=0x7f89140fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 shutdown_connections 2023-10-05T15:09:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:15.114+0000 7f891bfaa700 1 -- 172.21.15.60:0/3398886777 wait complete. 2023-10-05T15:09:15.136 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:14 smithi060 ceph-mon[99238]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:15.136 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:14 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:15.479 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-05T15:09:15.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-05T15:09:16.042 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:16.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:16 smithi060 ceph-mon[99238]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:16.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:16 smithi060 ceph-mon[99238]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:09:16.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:17.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.227+0000 7f4931f4e700 1 -- 172.21.15.60:0/1119554547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 msgr2=0x7f492c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.227+0000 7f4931f4e700 1 --2- 172.21.15.60:0/1119554547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c106d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f491c009910 tx=0x7f491c009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 -- 172.21.15.60:0/1119554547 shutdown_connections 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 --2- 172.21.15.60:0/1119554547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c106d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 -- 172.21.15.60:0/1119554547 >> 172.21.15.60:0/1119554547 conn(0x7f492c0fc4b0 msgr2=0x7f492c0fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 -- 172.21.15.60:0/1119554547 shutdown_connections 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 -- 172.21.15.60:0/1119554547 wait complete. 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 Processor -- start 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.228+0000 7f4931f4e700 1 -- start start 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f4931f4e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f4931f4e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c196340 con 0x7f492c106960 2023-10-05T15:09:17.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f492b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f492b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34936/0 (socket says 172.21.15.60:34936) 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f492b7fe700 1 -- 172.21.15.60:0/2005821690 learned_addr learned my addr 172.21.15.60:0/2005821690 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f492b7fe700 1 -- 172.21.15.60:0/2005821690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0095f0 con 0x7f492c106960 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f492b7fe700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c195e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f491c006010 tx=0x7f491c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f491c01d070 con 0x7f492c106960 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f491c00bbb0 con 0x7f492c106960 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.229+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f491c003930 con 0x7f492c106960 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.230+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c1965a0 con 0x7f492c106960 2023-10-05T15:09:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.230+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c196a20 con 0x7f492c106960 2023-10-05T15:09:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.230+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f491c003b70 con 0x7f492c106960 2023-10-05T15:09:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.231+0000 7f4928ff9700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49140388c0 0x7f491403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.231+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f491c04c630 con 0x7f492c106960 2023-10-05T15:09:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.231+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c0624e0 con 0x7f492c106960 2023-10-05T15:09:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.231+0000 7f492affd700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49140388c0 0x7f491403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.231+0000 7f492affd700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49140388c0 0x7f491403ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4920006fd0 tx=0x7f4920006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.236+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f491c026020 con 0x7f492c106960 2023-10-05T15:09:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:17.443+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f492c197250 con 0x7f492c106960 2023-10-05T15:09:18.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.154+0000 7f4928ff9700 1 -- 172.21.15.60:0/2005821690 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f491c00b6f0 con 0x7f492c106960 2023-10-05T15:09:18.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49140388c0 msgr2=0x7f491403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:18.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49140388c0 0x7f491403ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4920006fd0 tx=0x7f4920006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 msgr2=0x7f492c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c195e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f491c006010 tx=0x7f491c004ff0 comp rx=0 tx=0).stop 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 shutdown_connections 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49140388c0 0x7f491403ad80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 --2- 172.21.15.60:0/2005821690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f492c106960 0x7f492c195e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.158+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 >> 172.21.15.60:0/2005821690 conn(0x7f492c0fc4b0 msgr2=0x7f492c108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.159+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 shutdown_connections 2023-10-05T15:09:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:18.159+0000 7f4931f4e700 1 -- 172.21.15.60:0/2005821690 wait complete. 2023-10-05T15:09:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2023-10-05T15:09:18.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2005821690' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-05T15:09:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:09:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:18.596 INFO:tasks.cephadm:Adding mon.a on smithi060 2023-10-05T15:09:18.596 INFO:tasks.cephadm:Adding mon.b on smithi092 2023-10-05T15:09:18.596 INFO:tasks.cephadm:Adding mon.c on smithi135 2023-10-05T15:09:18.596 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c' 2023-10-05T15:09:19.212 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:19.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2005821690' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:19.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:20.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:20 smithi060 ceph-mon[99238]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 -- 172.21.15.135:0/2450448661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 msgr2=0x7fde38105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 --2- 172.21.15.135:0/2450448661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38105c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009910 tx=0x7fde2c009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 -- 172.21.15.135:0/2450448661 shutdown_connections 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 --2- 172.21.15.135:0/2450448661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38105c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 -- 172.21.15.135:0/2450448661 >> 172.21.15.135:0/2450448661 conn(0x7fde38075370 msgr2=0x7fde38075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 -- 172.21.15.135:0/2450448661 shutdown_connections 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 -- 172.21.15.135:0/2450448661 wait complete. 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 Processor -- start 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.482+0000 7fde3de92700 1 -- start start 2023-10-05T15:09:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.483+0000 7fde3de92700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:20.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.483+0000 7fde3de92700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde38196360 con 0x7fde38105860 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.483+0000 7fde377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.483+0000 7fde377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.135:34568/0 (socket says 172.21.15.135:34568) 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.483+0000 7fde377fe700 1 -- 172.21.15.135:0/3710970936 learned_addr learned my addr 172.21.15.135:0/3710970936 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.483+0000 7fde377fe700 1 -- 172.21.15.135:0/3710970936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0095f0 con 0x7fde38105860 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.484+0000 7fde377fe700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38195e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde2c006010 tx=0x7fde2c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.484+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde2c01d070 con 0x7fde38105860 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.484+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde2c00bbb0 con 0x7fde38105860 2023-10-05T15:09:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.484+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde381965c0 con 0x7fde38105860 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.484+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde2c003930 con 0x7fde38105860 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.484+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde38196a40 con 0x7fde38105860 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.485+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fde2c003b70 con 0x7fde38105860 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.485+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde380624e0 con 0x7fde38105860 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.485+0000 7fde34ff9700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fde200388c0 0x7fde2003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.485+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde2c04c6b0 con 0x7fde38105860 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.485+0000 7fde36ffd700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fde200388c0 0x7fde2003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.486+0000 7fde36ffd700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fde200388c0 0x7fde2003ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde28006fd0 tx=0x7fde28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.490+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fde2c029540 con 0x7fde38105860 2023-10-05T15:09:20.693 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.691+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fde38000990 con 0x7fde200388c0 2023-10-05T15:09:20.701 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.699+0000 7fde34ff9700 1 -- 172.21.15.135:0/3710970936 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fde38000990 con 0x7fde200388c0 2023-10-05T15:09:20.701 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.700+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fde200388c0 msgr2=0x7fde2003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.700+0000 7fde3de92700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fde200388c0 0x7fde2003ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde28006fd0 tx=0x7fde28006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.700+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 msgr2=0x7fde38195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.700+0000 7fde3de92700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38195e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde2c006010 tx=0x7fde2c004ff0 comp rx=0 tx=0).stop 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.701+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 shutdown_connections 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.701+0000 7fde3de92700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fde200388c0 0x7fde2003ad80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:20.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.701+0000 7fde3de92700 1 --2- 172.21.15.135:0/3710970936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde38105860 0x7fde38195e20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:20.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.701+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 >> 172.21.15.135:0/3710970936 conn(0x7fde38075370 msgr2=0x7fde38103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:20.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.701+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 shutdown_connections 2023-10-05T15:09:20.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:20.701+0000 7fde3de92700 1 -- 172.21.15.135:0/3710970936 wait complete. 2023-10-05T15:09:21.190 DEBUG:teuthology.orchestra.run.smithi092:mon.b> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-05T15:09:21.193 DEBUG:teuthology.orchestra.run.smithi135:mon.c> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-05T15:09:21.195 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-05T15:09:21.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-05T15:09:21.225 INFO:journalctl@ceph.mon.c.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:09:21.229 INFO:journalctl@ceph.mon.b.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:09:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c;count:3 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:22.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:22.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:21 smithi060 ceph-mon[99238]: Deploying daemon mon.c on smithi135 2023-10-05T15:09:23.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:22 smithi060 ceph-mon[99238]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.973+0000 7f9c19b6d700 1 -- 172.21.15.135:0/4090256544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 msgr2=0x7f9c14105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.973+0000 7f9c19b6d700 1 --2- 172.21.15.135:0/4090256544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14105c30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009910 tx=0x7f9c08009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.973+0000 7f9c19b6d700 1 -- 172.21.15.135:0/4090256544 shutdown_connections 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.973+0000 7f9c19b6d700 1 --2- 172.21.15.135:0/4090256544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14105c30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.973+0000 7f9c19b6d700 1 -- 172.21.15.135:0/4090256544 >> 172.21.15.135:0/4090256544 conn(0x7f9c140fb360 msgr2=0x7f9c140fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.974+0000 7f9c19b6d700 1 -- 172.21.15.135:0/4090256544 shutdown_connections 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.974+0000 7f9c19b6d700 1 -- 172.21.15.135:0/4090256544 wait complete. 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.974+0000 7f9c19b6d700 1 Processor -- start 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.974+0000 7f9c19b6d700 1 -- start start 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.974+0000 7f9c19b6d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.974+0000 7f9c19b6d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14069870 con 0x7f9c14105850 2023-10-05T15:09:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.975+0000 7f9c137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.975+0000 7f9c137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14194a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.135:34574/0 (socket says 172.21.15.135:34574) 2023-10-05T15:09:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.975+0000 7f9c137fe700 1 -- 172.21.15.135:0/1647209752 learned_addr learned my addr 172.21.15.135:0/1647209752 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:09:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.975+0000 7f9c137fe700 1 -- 172.21.15.135:0/1647209752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080095f0 con 0x7f9c14105850 2023-10-05T15:09:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.975+0000 7f9c137fe700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14194a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c08004f40 tx=0x7f9c08005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:23.982 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.976+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c0801d070 con 0x7f9c14105850 2023-10-05T15:09:23.982 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.976+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c08004370 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.976+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c14194fc0 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.976+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c080039b0 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.976+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c14195440 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.977+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c14103b00 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.977+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f9c08003c70 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.977+0000 7f9c10ff9700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9bfc0388c0 0x7f9bfc03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.977+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c0804c680 con 0x7f9c14105850 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.977+0000 7f9c12ffd700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9bfc0388c0 0x7f9bfc03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.978+0000 7f9c12ffd700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9bfc0388c0 0x7f9bfc03ad80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c04006fd0 tx=0x7f9c04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:23.984 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:23.982+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c08029360 con 0x7f9c14105850 2023-10-05T15:09:24.269 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.267+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c140624e0 con 0x7f9c14105850 2023-10-05T15:09:24.269 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.267+0000 7f9c10ff9700 1 -- 172.21.15.135:0/1647209752 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f9c08026030 con 0x7f9c14105850 2023-10-05T15:09:24.270 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:09:24.270 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","modified":"2023-10-05T15:07:41.502205Z","created":"2023-10-05T15:07:41.502205Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-05T15:09:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9bfc0388c0 msgr2=0x7f9bfc03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9bfc0388c0 0x7f9bfc03ad80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c04006fd0 tx=0x7f9c04006e40 comp rx=0 tx=0).stop 2023-10-05T15:09:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 msgr2=0x7f9c14194a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14194a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c08004f40 tx=0x7f9c08005020 comp rx=0 tx=0).stop 2023-10-05T15:09:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 shutdown_connections 2023-10-05T15:09:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9bfc0388c0 0x7f9bfc03ad80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 --2- 172.21.15.135:0/1647209752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14105850 0x7f9c14194a80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 >> 172.21.15.135:0/1647209752 conn(0x7f9c140fb360 msgr2=0x7f9c14107d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 shutdown_connections 2023-10-05T15:09:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:24.270+0000 7f9c19b6d700 1 -- 172.21.15.135:0/1647209752 wait complete. 2023-10-05T15:09:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2023-10-05T15:09:24.434 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-05T15:09:24.434 INFO:journalctl@ceph.mon.c.smithi135.stdout: e1 2023-10-05T15:09:24.434 INFO:journalctl@ceph.mon.c.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:09:24.434 INFO:journalctl@ceph.mon.c.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:09:24.435 INFO:journalctl@ceph.mon.c.smithi135.stdout: legacy client fscid: -1 2023-10-05T15:09:24.435 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-10-05T15:09:24.435 INFO:journalctl@ceph.mon.c.smithi135.stdout: No filesystems configured 2023-10-05T15:09:24.435 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-05T15:09:24.435 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-05T15:09:24.783 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-05T15:09:24.783 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-05T15:09:24.783 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-05T15:09:24.783 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-05T15:09:24.783 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Added host smithi092 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:09:24.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Deploying cephadm binary to smithi135 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:24.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Added host smithi135 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2005821690' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:09:24.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2005821690' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-05T15:09:24.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:24.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:24.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:24.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:24.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:24.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c;count:3 2023-10-05T15:09:24.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:24.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:24.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:24.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:24.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:24.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:24.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: Deploying daemon mon.c on smithi135 2023-10-05T15:09:24.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:24.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-05T15:09:24.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-05T15:09:24.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expand map: {default=false} 2023-10-05T15:09:24.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta from 'false' to 'false' 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expanded map: {default=false} 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expand map: {default=info} 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta from 'info' to 'info' 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expanded map: {default=info} 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expand map: {default=daemon} 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expanded map: {default=daemon} 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expand map: {default=debug} 2023-10-05T15:09:24.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta from 'debug' to 'debug' 2023-10-05T15:09:24.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 ceph-mon[103360]: expand_channel_meta expanded map: {default=debug} 2023-10-05T15:09:24.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:24 smithi135 systemd[1]: Started Ceph mon.c for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:09:25.842 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-05T15:09:25.843 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-05T15:09:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:09:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:09:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: mon.a calling monitor election 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: mon.c calling monitor election 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: monmap e2: 2 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: fsmap 2023-10-05T15:09:29.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: mgrmap e13: x(active, since 44s) 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: overall HEALTH_OK 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:29.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:29 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: mon.a calling monitor election 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: mon.c calling monitor election 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: monmap e2: 2 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: fsmap 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: mgrmap e13: x(active, since 44s) 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: overall HEALTH_OK 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:29.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:29.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:29.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:29.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:29 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:30.612 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.609+0000 7f27a47a5700 1 -- 172.21.15.135:0/3121331014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 msgr2=0x7f2788005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:30.612 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.610+0000 7f27a47a5700 1 --2- 172.21.15.135:0/3121331014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f2788005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f279c077150 tx=0x7f279800feb0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.612 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.610+0000 7f27a47a5700 1 -- 172.21.15.135:0/3121331014 shutdown_connections 2023-10-05T15:09:30.612 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.610+0000 7f27a47a5700 1 --2- 172.21.15.135:0/3121331014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f2788005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.613 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.610+0000 7f27a47a5700 1 -- 172.21.15.135:0/3121331014 >> 172.21.15.135:0/3121331014 conn(0x7f279c0fb050 msgr2=0x7f279c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:30.613 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.610+0000 7f27a47a5700 1 -- 172.21.15.135:0/3121331014 shutdown_connections 2023-10-05T15:09:30.613 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.610+0000 7f27a47a5700 1 -- 172.21.15.135:0/3121331014 wait complete. 2023-10-05T15:09:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a47a5700 1 Processor -- start 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a47a5700 1 -- start start 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a47a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f279c194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a47a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a47a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c195a20 con 0x7f27880035c0 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a47a5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c195b90 con 0x7f279c195490 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a1d40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a1d40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54758/0 (socket says 172.21.15.135:54758) 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a1d40700 1 -- 172.21.15.135:0/475844837 learned_addr learned my addr 172.21.15.135:0/475844837 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.611+0000 7f27a2541700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f279c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a1d40700 1 -- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 msgr2=0x7f279c199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-05T15:09:30.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a1d40700 1 -- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 msgr2=0x7f279c199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a1d40700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a1d40700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a2541700 1 -- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 msgr2=0x7f279c199900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a2541700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a2541700 1 -- 172.21.15.135:0/475844837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279800f900 con 0x7f27880035c0 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a2541700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f279c194f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2798010010 tx=0x7f27980047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2798013960 con 0x7f27880035c0 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c199ea0 con 0x7f27880035c0 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2798004030 con 0x7f27880035c0 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.612+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2798003a80 con 0x7f27880035c0 2023-10-05T15:09:30.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.613+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c19a3f0 con 0x7f27880035c0 2023-10-05T15:09:30.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.613+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f2798003d40 con 0x7f27880035c0 2023-10-05T15:09:30.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.614+0000 7f27937fe700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2780038700 0x7f278003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:30.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.614+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2798000e40 con 0x7f27880035c0 2023-10-05T15:09:30.618 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.614+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c0624e0 con 0x7f27880035c0 2023-10-05T15:09:30.618 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.614+0000 7f27a1d40700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2780038700 0x7f278003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:30.618 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.614+0000 7f27a1d40700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2780038700 0x7f278003abc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f278c009180 tx=0x7f278c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.619+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f279801a980 con 0x7f27880035c0 2023-10-05T15:09:30.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:30 smithi135 ceph-mon[103360]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:30.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:30 smithi135 ceph-mon[103360]: Deploying daemon mon.b on smithi092 2023-10-05T15:09:30.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.888+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f279c1963c0 con 0x7f27880035c0 2023-10-05T15:09:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.888+0000 7f27937fe700 1 -- 172.21.15.135:0/475844837 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f279803d090 con 0x7f27880035c0 2023-10-05T15:09:30.891 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:09:30.891 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","modified":"2023-10-05T15:09:24.440503Z","created":"2023-10-05T15:07:41.502205Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2780038700 msgr2=0x7f278003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2780038700 0x7f278003abc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f278c009180 tx=0x7f278c008040 comp rx=0 tx=0).stop 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 msgr2=0x7f279c194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f279c194f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2798010010 tx=0x7f27980047a0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 shutdown_connections 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2780038700 0x7f278003abc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27880035c0 0x7f279c194f50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 --2- 172.21.15.135:0/475844837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c195490 0x7f279c199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 >> 172.21.15.135:0/475844837 conn(0x7f279c0fb050 msgr2=0x7f279c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:30.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.890+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 shutdown_connections 2023-10-05T15:09:30.894 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:30.891+0000 7f27a47a5700 1 -- 172.21.15.135:0/475844837 wait complete. 2023-10-05T15:09:30.894 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2023-10-05T15:09:30.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:30 smithi060 ceph-mon[99238]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:30.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:30 smithi060 ceph-mon[99238]: Deploying daemon mon.b on smithi092 2023-10-05T15:09:30.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:31 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/475844837' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:09:32.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:31 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/475844837' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:09:32.276 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-05T15:09:32.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-05T15:09:32.343 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 systemd[1]: Starting Ceph mon.b for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:09:32.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 podman[102904]: 2023-10-05T15:09:32.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: set uid:gid to 167:167 (ceph:ceph) 2023-10-05T15:09:32.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev), process ceph-mon, pid 7 2023-10-05T15:09:32.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pidfile_write: ignore empty --pid-file 2023-10-05T15:09:32.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 bash[102904]: 79832c67e7b137615ad542a17d4b6da735cc78546b905f83dfa506c6782934fd 2023-10-05T15:09:32.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: load: jerasure load: lrc 2023-10-05T15:09:32.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: RocksDB version: 7.9.2 2023-10-05T15:09:32.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Git sha 0 2023-10-05T15:09:32.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Compile date 2023-10-05 12:06:36 2023-10-05T15:09:32.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: DB SUMMARY 2023-10-05T15:09:32.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: DB Session ID: F9WG1ACHR7QSA8L8RM9C 2023-10-05T15:09:32.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: CURRENT file: CURRENT 2023-10-05T15:09:32.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: IDENTITY file: IDENTITY 2023-10-05T15:09:32.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-05T15:09:32.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-05T15:09:32.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-05T15:09:32.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.error_if_exists: 0 2023-10-05T15:09:32.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.create_if_missing: 0 2023-10-05T15:09:32.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.paranoid_checks: 1 2023-10-05T15:09:32.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-05T15:09:32.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.env: 0x555d309f2da0 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.fs: PosixFileSystem 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.info_log: 0x555d31b835c0 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_file_opening_threads: 16 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.statistics: (nil) 2023-10-05T15:09:32.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.use_fsync: 0 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_log_file_size: 0 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.keep_log_file_num: 1000 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.recycle_log_file_num: 0 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.allow_fallocate: 1 2023-10-05T15:09:32.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.allow_mmap_reads: 0 2023-10-05T15:09:32.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.allow_mmap_writes: 0 2023-10-05T15:09:32.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.use_direct_reads: 0 2023-10-05T15:09:32.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-05T15:09:32.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.create_missing_column_families: 0 2023-10-05T15:09:32.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.db_log_dir: 2023-10-05T15:09:32.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.wal_dir: 2023-10-05T15:09:32.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-05T15:09:32.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-05T15:09:32.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-05T15:09:32.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-05T15:09:32.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-05T15:09:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-05T15:09:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.advise_random_on_open: 1 2023-10-05T15:09:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.db_write_buffer_size: 0 2023-10-05T15:09:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.write_buffer_manager: 0x555d31b3b360 2023-10-05T15:09:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-05T15:09:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-05T15:09:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-05T15:09:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.rate_limiter: (nil) 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.wal_recovery_mode: 2 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.enable_thread_tracking: 0 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.enable_pipelined_write: 0 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.unordered_write: 0 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-05T15:09:32.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.row_cache: None 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.wal_filter: None 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.allow_ingest_behind: 0 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.two_write_queues: 0 2023-10-05T15:09:32.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.manual_wal_flush: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.wal_compression: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.atomic_flush: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.log_readahead_size: 0 2023-10-05T15:09:32.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.best_efforts_recovery: 0 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.allow_data_in_errors: 0 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.db_host_id: __hostname__ 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_background_jobs: 2 2023-10-05T15:09:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_background_compactions: -1 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_subcompactions: 1 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_total_wal_size: 0 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-05T15:09:32.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_open_files: -1 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bytes_per_sync: 0 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_readahead_size: 0 2023-10-05T15:09:32.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_background_flushes: -1 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Compression algorithms supported: 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kZSTD supported: 0 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kXpressCompression supported: 0 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kLZ4HCCompression supported: 1 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kZlibCompression supported: 1 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kSnappyCompression supported: 1 2023-10-05T15:09:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kLZ4Compression supported: 1 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: kBZip2Compression supported: 0 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.merge_operator: 2023-10-05T15:09:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_filter: None 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_filter_factory: None 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.sst_partitioner_factory: None 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555d31b836c0) 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout: cache_index_and_filter_blocks: 1 2023-10-05T15:09:32.696 INFO:journalctl@ceph.mon.b.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-05T15:09:32.697 INFO:journalctl@ceph.mon.b.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-05T15:09:32.697 INFO:journalctl@ceph.mon.b.smithi092.stdout: pin_top_level_index_and_filter: 1 2023-10-05T15:09:32.697 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_type: 0 2023-10-05T15:09:32.697 INFO:journalctl@ceph.mon.b.smithi092.stdout: data_block_index_type: 0 2023-10-05T15:09:32.697 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_shortening: 1 2023-10-05T15:09:32.697 INFO:journalctl@ceph.mon.b.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: checksum: 4 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: no_block_cache: 0 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache: 0x555d31bd91f0 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_name: BinnedLRUCache 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_options: 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: capacity : 536870912 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: num_shard_bits : 4 2023-10-05T15:09:32.698 INFO:journalctl@ceph.mon.b.smithi092.stdout: strict_capacity_limit : 0 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: high_pri_pool_ratio: 0.000 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_compressed: (nil) 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: persistent_cache: (nil) 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_size: 4096 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_size_deviation: 10 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_restart_interval: 16 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_block_restart_interval: 1 2023-10-05T15:09:32.699 INFO:journalctl@ceph.mon.b.smithi092.stdout: metadata_block_size: 4096 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: partition_filters: 0 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: use_delta_encoding: 1 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: filter_policy: bloomfilter 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: whole_key_filtering: 1 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: verify_compression: 0 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: read_amp_bytes_per_bit: 0 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: format_version: 5 2023-10-05T15:09:32.700 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_index_compression: 1 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_align: 0 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout: max_auto_readahead_size: 262144 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout: prepopulate_block_cache: 0 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout: initial_auto_readahead_size: 8192 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.write_buffer_size: 33554432 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_write_buffer_number: 2 2023-10-05T15:09:32.701 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression: NoCompression 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression: Disabled 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.prefix_extractor: nullptr 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.num_levels: 7 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-05T15:09:32.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.level: 32767 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.strategy: 0 2023-10-05T15:09:32.703 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.enabled: false 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.target_file_size_base: 67108864 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-05T15:09:32.704 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-05T15:09:32.705 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.arena_block_size: 1048576 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.disable_auto_compactions: 0 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-05T15:09:32.706 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.table_properties_collectors: 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.inplace_update_support: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.bloom_locality: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.max_successive_merges: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.paranoid_file_checks: 0 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.force_consistency_checks: 1 2023-10-05T15:09:32.707 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.report_bg_io_stats: 0 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.ttl: 2592000 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.enable_blob_files: false 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.min_blob_size: 0 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.blob_file_size: 268435456 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-05T15:09:32.708 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.blob_file_starting_level: 0 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5965a299-5e44-44b1-9c8e-d766b5968496 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696518572548873, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696518572549272, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696518572, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5965a299-5e44-44b1-9c8e-d766b5968496", "db_session_id": "F9WG1ACHR7QSA8L8RM9C", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696518572549338, "job": 1, "event": "recovery_finished"} 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-05T15:09:32.709 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555d31c76000 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: DB pointer 0x555d31c62000 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** DB Stats ** 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:09:32.710 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** Compaction Stats [default] ** 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** Compaction Stats [default] ** 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-05T15:09:32.711 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Block cache BinnedLRUCache@0x555d31bd91f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-05T15:09:32.712 INFO:journalctl@ceph.mon.b.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: using public_addr v2:172.21.15.92:0/0 -> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: starting mon.b rank -1 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 systemd[1]: Started Ceph mon.b for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(???) e0 preinit fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).mds e1 new map 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout: e1 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:09:32.713 INFO:journalctl@ceph.mon.b.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout: legacy client fscid: -1 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout: No filesystems configured 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:09:32.714 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Added host smithi092 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.715 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Deploying cephadm binary to smithi135 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.716 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Added host smithi135 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:09:32.717 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2005821690' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2005821690' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-05T15:09:32.718 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c;count:3 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:32.719 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Deploying daemon mon.c on smithi135 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.a calling monitor election 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.720 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.c calling monitor election 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: monmap e2: 2 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: fsmap 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mgrmap e13: x(active, since 44s) 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: overall HEALTH_OK 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.721 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: Deploying daemon mon.b on smithi092 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/475844837' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expand map: {default=false} 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta from 'false' to 'false' 2023-10-05T15:09:32.722 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expanded map: {default=false} 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expand map: {default=info} 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta from 'info' to 'info' 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expanded map: {default=info} 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expand map: {default=daemon} 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expanded map: {default=daemon} 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expand map: {default=debug} 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta from 'debug' to 'debug' 2023-10-05T15:09:32.723 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:32 smithi092 ceph-mon[102944]: expand_channel_meta expanded map: {default=debug} 2023-10-05T15:09:32.843 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:09:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2686095063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc400057d0 msgr2=0x7fcc40007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2686095063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc400057d0 0x7fcc40007c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcc58077920 tx=0x7fcc4c014ec0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2686095063 shutdown_connections 2023-10-05T15:09:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2686095063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc400057d0 0x7fcc40007c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2686095063 >> 172.21.15.135:0/2686095063 conn(0x7fcc58076520 msgr2=0x7fcc58076930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2686095063 shutdown_connections 2023-10-05T15:09:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.615+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2686095063 wait complete. 2023-10-05T15:09:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 Processor -- start 2023-10-05T15:09:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 -- start start 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 0x7fcc58193e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc58198d40 0x7fcc581991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58194a80 con 0x7fcc58198d40 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581a0ab0 con 0x7fcc400057d0 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.617+0000 7fcc5dbf8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581a0bf0 con 0x7fcc58194390 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54782/0 (socket says 172.21.15.135:54782) 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 -- 172.21.15.135:0/2604778546 learned_addr learned my addr 172.21.15.135:0/2604778546 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc58198d40 0x7fcc581991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc577fe700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 0x7fcc58193e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 msgr2=0x7fcc58198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 msgr2=0x7fcc58198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc56ffd700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc577fe700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 msgr2=0x7fcc58193e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc577fe700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 msgr2=0x7fcc58193e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc577fe700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 0x7fcc58193e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-05T15:09:37.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc577fe700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 0x7fcc58193e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:09:37.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 msgr2=0x7fcc58198800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:09:37.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 msgr2=0x7fcc58193e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:09:37.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 0x7fcc58193e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 -- 172.21.15.135:0/2604778546 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c014910 con 0x7fcc58198d40 2023-10-05T15:09:37.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.618+0000 7fcc57fff700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc58198d40 0x7fcc581991f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000bd50 tx=0x7fcc5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:37.624 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.619+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000cd10 con 0x7fcc58198d40 2023-10-05T15:09:37.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.619+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc581a52e0 con 0x7fcc58198d40 2023-10-05T15:09:37.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.619+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc581a57e0 con 0x7fcc58198d40 2023-10-05T15:09:37.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.619+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc5000ce70 con 0x7fcc58198d40 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.619+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50012840 con 0x7fcc58198d40 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.620+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc40007ed0 con 0x7fcc58198d40 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.621+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fcc500129c0 con 0x7fcc58198d40 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.621+0000 7fcc54ff9700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcc44038d90 0x7fcc4403b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.621+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcc5004adf0 con 0x7fcc58198d40 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.621+0000 7fcc577fe700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcc44038d90 0x7fcc4403b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:37.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.622+0000 7fcc577fe700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcc44038d90 0x7fcc4403b250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c010010 tx=0x7fcc4c001e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:37.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.626+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcc50014440 con 0x7fcc58198d40 2023-10-05T15:09:37.909 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.907+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcc40001690 con 0x7fcc58198d40 2023-10-05T15:09:37.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.907+0000 7fcc54ff9700 1 -- 172.21.15.135:0/2604778546 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7fcc5001b6e0 con 0x7fcc58198d40 2023-10-05T15:09:37.910 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T15:09:37.910 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","modified":"2023-10-05T15:09:32.582168Z","created":"2023-10-05T15:07:41.502205Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-05T15:09:37.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcc44038d90 msgr2=0x7fcc4403b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:37.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcc44038d90 0x7fcc4403b250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c010010 tx=0x7fcc4c001e50 comp rx=0 tx=0).stop 2023-10-05T15:09:37.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc58198d40 msgr2=0x7fcc581991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:37.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc58198d40 0x7fcc581991f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000bd50 tx=0x7fcc5000be30 comp rx=0 tx=0).stop 2023-10-05T15:09:37.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 shutdown_connections 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcc44038d90 0x7fcc4403b250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc58198d40 0x7fcc581991f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc400057d0 0x7fcc58193e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 --2- 172.21.15.135:0/2604778546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58194390 0x7fcc58198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 >> 172.21.15.135:0/2604778546 conn(0x7fcc58076520 msgr2=0x7fcc5818cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 shutdown_connections 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:37.910+0000 7fcc5dbf8700 1 -- 172.21.15.135:0/2604778546 wait complete. 2023-10-05T15:09:37.913 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 3 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: mon.c calling monitor election 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: mon.a calling monitor election 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:37.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: monmap e3: 3 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: fsmap 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: mgrmap e13: x(active, since 52s) 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: mon.b (rank 2) addr [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] is down (out of quorum) 2023-10-05T15:09:37.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:37.937 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:37.937 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:37.937 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: mon.c calling monitor election 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: mon.a calling monitor election 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: monmap e3: 3 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: fsmap 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: mgrmap e13: x(active, since 52s) 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-05T15:09:38.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: mon.b (rank 2) addr [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] is down (out of quorum) 2023-10-05T15:09:38.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:38.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:38.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:38.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:38.298 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-05T15:09:38.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-05T15:09:38.878 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:38 smithi135 ceph-mon[103360]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:38 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/2604778546' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:09:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:38 smithi060 ceph-mon[99238]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:39.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:39.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:38 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/2604778546' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:09:39.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:09:39.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: mon.c calling monitor election 2023-10-05T15:09:39.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: mon.a calling monitor election 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: monmap e3: 3 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:39.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: fsmap 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: mgrmap e13: x(active, since 52s) 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: mon.b (rank 2) addr [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] is down (out of quorum) 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:39.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:39.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/2604778546' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:09:39.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 -- 172.21.15.60:0/4011075177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2318101b10 msgr2=0x7f2318101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 --2- 172.21.15.60:0/4011075177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2318101b10 0x7f2318101ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2314009910 tx=0x7f2314009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 -- 172.21.15.60:0/4011075177 shutdown_connections 2023-10-05T15:09:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 --2- 172.21.15.60:0/4011075177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2318101b10 0x7f2318101ef0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 -- 172.21.15.60:0/4011075177 >> 172.21.15.60:0/4011075177 conn(0x7f23180fb360 msgr2=0x7f23180fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 -- 172.21.15.60:0/4011075177 shutdown_connections 2023-10-05T15:09:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.168+0000 7f231f887700 1 -- 172.21.15.60:0/4011075177 wait complete. 2023-10-05T15:09:40.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 Processor -- start 2023-10-05T15:09:40.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 -- start start 2023-10-05T15:09:40.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318101b10 0x7f23180ff770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:40.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23180ffcb0 0x7f2318100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:40.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 0x7f23181a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181a4cc0 con 0x7f23181a2280 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181a4e30 con 0x7f2318101b10 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231f887700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181a4ff0 con 0x7f23180ffcb0 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.169+0000 7f231de24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 0x7f23181a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 0x7f23181a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34946/0 (socket says 172.21.15.60:34946) 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 -- 172.21.15.60:0/3099170323 learned_addr learned my addr 172.21.15.60:0/3099170323 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231d623700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318101b10 0x7f23180ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231ce22700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23180ffcb0 0x7f2318100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 -- 172.21.15.60:0/3099170323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23180ffcb0 msgr2=0x7f2318100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23180ffcb0 0x7f2318100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 -- 172.21.15.60:0/3099170323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318101b10 msgr2=0x7f23180ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318101b10 0x7f23180ff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 -- 172.21.15.60:0/3099170323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140095f0 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231de24700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 0x7f23181a4670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f231000ba50 tx=0x7f231000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000c930 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2310014440 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23181a52d0 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100075b0 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.170+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23181a57d0 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.171+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f2310007710 con 0x7f23181a2280 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.171+0000 7f230e7fc700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2304038d40 0x7f230403b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.171+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f231004aa80 con 0x7f23181a2280 2023-10-05T15:09:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.171+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318108380 con 0x7f23181a2280 2023-10-05T15:09:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.171+0000 7f231d623700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2304038d40 0x7f230403b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.172+0000 7f231d623700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2304038d40 0x7f230403b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2314006010 tx=0x7f231400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.176+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f231001b8b0 con 0x7f23181a2280 2023-10-05T15:09:40.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.379+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2318100ca0 con 0x7f23181a2280 2023-10-05T15:09:40.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.380+0000 7f230e7fc700 1 -- 172.21.15.60:0/3099170323 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f231001b2c0 con 0x7f23181a2280 2023-10-05T15:09:40.382 INFO:teuthology.orchestra.run.smithi060.stdout:# minimal ceph.conf for d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:09:40.382 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2023-10-05T15:09:40.382 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:09:40.382 INFO:teuthology.orchestra.run.smithi060.stdout: mon_host = [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2304038d40 msgr2=0x7f230403b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2304038d40 0x7f230403b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2314006010 tx=0x7f231400b540 comp rx=0 tx=0).stop 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 msgr2=0x7f23181a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 0x7f23181a4670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f231000ba50 tx=0x7f231000bd60 comp rx=0 tx=0).stop 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 shutdown_connections 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2304038d40 0x7f230403b200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23181a2280 0x7f23181a4670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318101b10 0x7f23180ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 --2- 172.21.15.60:0/3099170323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23180ffcb0 0x7f2318100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:40.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 >> 172.21.15.60:0/3099170323 conn(0x7f23180fb360 msgr2=0x7f23181054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:40.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 shutdown_connections 2023-10-05T15:09:40.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:40.382+0000 7f231f887700 1 -- 172.21.15.60:0/3099170323 wait complete. 2023-10-05T15:09:40.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: mon.b calling monitor election 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: mon.b calling monitor election 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: mon.c calling monitor election 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: mon.a calling monitor election 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: monmap e3: 3 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: fsmap 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: mgrmap e13: x(active, since 54s) 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Cluster is now healthy 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: overall HEALTH_OK 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:40 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3099170323' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: mon.b calling monitor election 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: mon.b calling monitor election 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: mon.c calling monitor election 2023-10-05T15:09:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: mon.a calling monitor election 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: monmap e3: 3 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: fsmap 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: mgrmap e13: x(active, since 54s) 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Cluster is now healthy 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: overall HEALTH_OK 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:40.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:40.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:40.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:40 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3099170323' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:40.753 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-05T15:09:40.754 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:09:40.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2023-10-05T15:09:40.783 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:09:40.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:40.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: mon.b calling monitor election 2023-10-05T15:09:40.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:40.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:09:40.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:09:40.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:09:40.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: mon.b calling monitor election 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: mon.c calling monitor election 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: mon.a calling monitor election 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: monmap e3: 3 mons at {a=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: fsmap 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: mgrmap e13: x(active, since 54s) 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-05T15:09:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Cluster is now healthy 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: overall HEALTH_OK 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:40.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:40 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3099170323' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:40.851 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:09:40.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2023-10-05T15:09:40.883 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:09:40.883 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:40.951 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:09:40.951 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2023-10-05T15:09:40.985 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:09:40.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:09:41.053 INFO:tasks.cephadm:Adding mgr.x on smithi060 2023-10-05T15:09:41.054 INFO:tasks.cephadm:Adding mgr.y on smithi092 2023-10-05T15:09:41.054 INFO:tasks.cephadm:Adding mgr.z on smithi135 2023-10-05T15:09:41.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi060=x;smithi092=y;smithi135=z' 2023-10-05T15:09:41.647 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:09:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:41 smithi092 ceph-mon[102944]: Reconfiguring mon.a (unknown last config time)... 2023-10-05T15:09:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:41 smithi092 ceph-mon[102944]: Reconfiguring daemon mon.a on smithi060 2023-10-05T15:09:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:41 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:41.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:41 smithi135 ceph-mon[103360]: Reconfiguring mon.a (unknown last config time)... 2023-10-05T15:09:41.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:41 smithi135 ceph-mon[103360]: Reconfiguring daemon mon.a on smithi060 2023-10-05T15:09:41.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:41 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:41.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:41 smithi060 ceph-mon[99238]: Reconfiguring mon.a (unknown last config time)... 2023-10-05T15:09:41.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:41 smithi060 ceph-mon[99238]: Reconfiguring daemon mon.a on smithi060 2023-10-05T15:09:41.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:41 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:09:42.669 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: Reconfiguring mon.b (monmap changed)... 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:42.670 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:42 smithi092 ceph-mon[102944]: Reconfiguring daemon mon.b on smithi092 2023-10-05T15:09:42.809 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:42.809 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:42.809 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:42.809 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: Reconfiguring mon.b (monmap changed)... 2023-10-05T15:09:42.809 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:42.810 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:42.810 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:42.810 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:42 smithi135 ceph-mon[103360]: Reconfiguring daemon mon.b on smithi092 2023-10-05T15:09:42.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: Reconfiguring mon.b (monmap changed)... 2023-10-05T15:09:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:42.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:42 smithi060 ceph-mon[99238]: Reconfiguring daemon mon.b on smithi092 2023-10-05T15:09:42.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.935+0000 7ff78aa40700 1 -- 172.21.15.135:0/3163109101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7840ffa00 msgr2=0x7ff7840ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:42.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.935+0000 7ff78aa40700 1 --2- 172.21.15.135:0/3163109101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7840ffa00 0x7ff7840ffe20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff774009910 tx=0x7ff774009c20 comp rx=0 tx=0).stop 2023-10-05T15:09:42.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 -- 172.21.15.135:0/3163109101 shutdown_connections 2023-10-05T15:09:42.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 --2- 172.21.15.135:0/3163109101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7840ffa00 0x7ff7840ffe20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:42.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 -- 172.21.15.135:0/3163109101 >> 172.21.15.135:0/3163109101 conn(0x7ff7840fafc0 msgr2=0x7ff7840fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:42.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 -- 172.21.15.135:0/3163109101 shutdown_connections 2023-10-05T15:09:42.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 -- 172.21.15.135:0/3163109101 wait complete. 2023-10-05T15:09:42.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 Processor -- start 2023-10-05T15:09:42.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.936+0000 7ff78aa40700 1 -- start start 2023-10-05T15:09:42.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff78aa40700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7840ffa00 0x7ff784195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff78aa40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff784196290 0x7ff78419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff78aa40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff784196710 0x7ff78419d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff78aa40700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78419e030 con 0x7ff784196290 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff78aa40700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78419e1a0 con 0x7ff7840ffa00 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff78aa40700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78419e360 con 0x7ff784196710 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff788fdd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff784196710 0x7ff78419d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:42.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff788fdd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff784196710 0x7ff78419d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54794/0 (socket says 172.21.15.135:54794) 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff788fdd700 1 -- 172.21.15.135:0/2966859447 learned_addr learned my addr 172.21.15.135:0/2966859447 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff783fff700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7840ffa00 0x7ff784195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff7837fe700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff784196290 0x7ff78419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff783fff700 1 -- 172.21.15.135:0/2966859447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff784196710 msgr2=0x7ff78419d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff783fff700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff784196710 0x7ff78419d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff783fff700 1 -- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff784196290 msgr2=0x7ff78419b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff783fff700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff784196290 0x7ff78419b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.937+0000 7ff783fff700 1 -- 172.21.15.135:0/2966859447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740095f0 con 0x7ff7840ffa00 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.938+0000 7ff783fff700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7840ffa00 0x7ff784195d50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff7740098e0 tx=0x7ff774004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.938+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77401d070 con 0x7ff7840ffa00 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.938+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff77400be20 con 0x7ff7840ffa00 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.938+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78419e5e0 con 0x7ff7840ffa00 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.938+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774022d80 con 0x7ff7840ffa00 2023-10-05T15:09:42.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.938+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78419eb20 con 0x7ff7840ffa00 2023-10-05T15:09:42.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.939+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff77400f460 con 0x7ff7840ffa00 2023-10-05T15:09:42.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.939+0000 7ff7817fa700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff76c038d90 0x7ff76c03b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:42.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.939+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff77404d6e0 con 0x7ff7840ffa00 2023-10-05T15:09:42.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.939+0000 7ff7837fe700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff76c038d90 0x7ff76c03b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:42.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.939+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78418f520 con 0x7ff7840ffa00 2023-10-05T15:09:42.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.940+0000 7ff7837fe700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff76c038d90 0x7ff76c03b250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff778009ad0 tx=0x7ff778009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:42.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:42.945+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff774027030 con 0x7ff7840ffa00 2023-10-05T15:09:43.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.159+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi092=y;smithi135=z", "target": ["mon-mgr", ""]}) v1 -- 0x7ff78402d080 con 0x7ff76c038d90 2023-10-05T15:09:43.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.166+0000 7ff7817fa700 1 -- 172.21.15.135:0/2966859447 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff78402d080 con 0x7ff76c038d90 2023-10-05T15:09:43.169 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mgr update... 2023-10-05T15:09:43.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff76c038d90 msgr2=0x7ff76c03b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:43.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff76c038d90 0x7ff76c03b250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff778009ad0 tx=0x7ff778009210 comp rx=0 tx=0).stop 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7840ffa00 msgr2=0x7ff784195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7840ffa00 0x7ff784195d50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff7740098e0 tx=0x7ff774004cb0 comp rx=0 tx=0).stop 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 shutdown_connections 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff784196710 0x7ff78419d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7840ffa00 0x7ff784195d50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff76c038d90 0x7ff76c03b250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 --2- 172.21.15.135:0/2966859447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff784196290 0x7ff78419b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:43.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 >> 172.21.15.135:0/2966859447 conn(0x7ff7840fafc0 msgr2=0x7ff784068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:43.172 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 shutdown_connections 2023-10-05T15:09:43.172 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:09:43.168+0000 7ff78aa40700 1 -- 172.21.15.135:0/2966859447 wait complete. 2023-10-05T15:09:43.602 DEBUG:teuthology.orchestra.run.smithi092:mgr.y> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-05T15:09:43.604 DEBUG:teuthology.orchestra.run.smithi135:mgr.z> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-05T15:09:43.607 INFO:tasks.cephadm:Deploying OSDs... 2023-10-05T15:09:43.607 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:09:43.607 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T15:09:43.629 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T15:09:43.629 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-10-05T15:09:43.635 INFO:journalctl@ceph.mgr.z.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:09:43.636 INFO:journalctl@ceph.mgr.y.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:09:43.690 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T15:09:43.690 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 385919 Links: 1 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-05 15:08:57.058192210 +0000 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-05 15:02:56.895834335 +0000 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-05 15:02:56.895834335 +0000 2023-10-05T15:09:43.691 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-05T15:09:43.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T15:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-05T15:09:43.763 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-05T15:09:43.763 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000126499 s, 4.0 MB/s 2023-10-05T15:09:43.764 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T15:09:43.825 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: Reconfiguring mon.c (monmap changed)... 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: Reconfiguring daemon mon.c on smithi135 2023-10-05T15:09:43.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T15:09:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 382849 Links: 1 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-05 15:08:57.106191768 +0000 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-05 15:02:57.418829563 +0000 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-05 15:02:57.418829563 +0000 2023-10-05T15:09:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-05T15:09:43.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T15:09:43.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:43.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:43.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: Reconfiguring mon.c (monmap changed)... 2023-10-05T15:09:43.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:43.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:43.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:43.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: Reconfiguring daemon mon.c on smithi135 2023-10-05T15:09:43.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:43.954 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-05T15:09:43.954 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-05T15:09:43.954 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000114901 s, 4.5 MB/s 2023-10-05T15:09:43.955 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T15:09:44.015 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-10-05T15:09:44.074 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T15:09:44.074 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 390918 Links: 1 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-05 15:08:57.150191364 +0000 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-05 15:02:57.954824674 +0000 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-05 15:02:57.954824674 +0000 2023-10-05T15:09:44.075 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-05T15:09:44.075 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T15:09:44.140 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: Reconfiguring mon.c (monmap changed)... 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: Reconfiguring daemon mon.c on smithi135 2023-10-05T15:09:44.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.143 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-05T15:09:44.143 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-05T15:09:44.143 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000115315 s, 4.4 MB/s 2023-10-05T15:09:44.144 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T15:09:44.203 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-10-05T15:09:44.261 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T15:09:44.261 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:44.261 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 382905 Links: 1 2023-10-05T15:09:44.261 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:44.261 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:44.262 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-05 15:08:57.194190959 +0000 2023-10-05T15:09:44.262 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-05 15:02:58.502819674 +0000 2023-10-05T15:09:44.262 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-05 15:02:58.502819674 +0000 2023-10-05T15:09:44.262 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-05T15:09:44.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T15:09:44.328 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-05T15:09:44.328 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-05T15:09:44.328 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000121397 s, 4.2 MB/s 2023-10-05T15:09:44.329 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T15:09:44.388 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-05T15:09:44.388 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T15:09:44.408 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T15:09:44.408 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 392273 Links: 1 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-05 15:09:32.021634740 +0000 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-05 15:02:35.345310758 +0000 2023-10-05T15:09:44.468 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-05 15:02:35.345310758 +0000 2023-10-05T15:09:44.469 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-05T15:09:44.469 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T15:09:44.537 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-05T15:09:44.537 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-05T15:09:44.537 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000316048 s, 1.6 MB/s 2023-10-05T15:09:44.538 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T15:09:44.598 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 386627 Links: 1 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-05 15:09:32.021634740 +0000 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-05 15:02:35.860305121 +0000 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-05 15:02:35.860305121 +0000 2023-10-05T15:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-05T15:09:44.658 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T15:09:44.725 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-05T15:09:44.725 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-05T15:09:44.725 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000261837 s, 2.0 MB/s 2023-10-05T15:09:44.726 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T15:09:44.785 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-10-05T15:09:44.845 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 388806 Links: 1 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-05 15:09:32.021634740 +0000 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-05 15:02:36.376299472 +0000 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-05 15:02:36.376299472 +0000 2023-10-05T15:09:44.846 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-05T15:09:44.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi092=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: Saving service mgr spec with placement smithi060=x;smithi092=y;smithi135=z;count:3 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:44.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:44.912 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.912 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:44.912 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:09:44.912 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:44.912 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:44.913 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-05T15:09:44.913 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-05T15:09:44.913 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000231657 s, 2.2 MB/s 2023-10-05T15:09:44.914 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T15:09:44.972 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-10-05T15:09:44.973 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:44.973 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi092=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:44.973 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: Saving service mgr spec with placement smithi060=x;smithi092=y;smithi135=z;count:3 2023-10-05T15:09:44.973 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:44.974 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:45.030 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T15:09:45.030 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:45.030 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 387928 Links: 1 2023-10-05T15:09:45.030 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:45.030 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:45.031 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-05 15:09:32.021634740 +0000 2023-10-05T15:09:45.031 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-05 15:02:36.916293560 +0000 2023-10-05T15:09:45.031 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-05 15:02:36.916293560 +0000 2023-10-05T15:09:45.031 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-05T15:09:45.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T15:09:45.095 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-05T15:09:45.096 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-05T15:09:45.096 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000252692 s, 2.0 MB/s 2023-10-05T15:09:45.097 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T15:09:45.155 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-05T15:09:45.155 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T15:09:45.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:45.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi092=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: Saving service mgr spec with placement smithi060=x;smithi092=y;smithi135=z;count:3 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:09:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:45.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:45.173 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T15:09:45.173 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 387615 Links: 1 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-05 15:09:23.705759032 +0000 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-05 15:02:38.693306196 +0000 2023-10-05T15:09:45.231 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-05 15:02:38.693306196 +0000 2023-10-05T15:09:45.232 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-05T15:09:45.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T15:09:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-05T15:09:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-05T15:09:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000248828 s, 2.1 MB/s 2023-10-05T15:09:45.300 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T15:09:45.358 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-10-05T15:09:45.416 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T15:09:45.416 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:45.416 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 394242 Links: 1 2023-10-05T15:09:45.416 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:45.416 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:45.417 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-05 15:09:23.705759032 +0000 2023-10-05T15:09:45.417 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-05 15:02:39.224294685 +0000 2023-10-05T15:09:45.417 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-05 15:02:39.224294685 +0000 2023-10-05T15:09:45.417 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-05T15:09:45.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T15:09:45.565 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-05T15:09:45.565 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-05T15:09:45.565 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000222756 s, 2.3 MB/s 2023-10-05T15:09:45.566 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T15:09:45.583 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 394315 Links: 1 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-05 15:09:45.516290343 +0000 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-05 15:02:39.766282936 +0000 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-05 15:02:39.766282936 +0000 2023-10-05T15:09:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-05T15:09:45.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T15:09:45.713 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-05T15:09:45.714 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-05T15:09:45.714 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000208878 s, 2.5 MB/s 2023-10-05T15:09:45.715 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T15:09:45.774 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-10-05T15:09:45.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:45 smithi135 ceph-mon[103360]: Deploying daemon mgr.z on smithi135 2023-10-05T15:09:45.831 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:45 smithi135 systemd[1]: Starting Ceph mgr.z for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:09:45.832 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T15:09:45.832 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:09:45.832 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 392862 Links: 1 2023-10-05T15:09:45.832 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:09:45.833 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:09:45.833 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-05 15:09:45.643287615 +0000 2023-10-05T15:09:45.833 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-05 15:02:40.271271989 +0000 2023-10-05T15:09:45.833 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-05 15:02:40.271271989 +0000 2023-10-05T15:09:45.833 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-05T15:09:45.833 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T15:09:45.899 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-05T15:09:45.899 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-05T15:09:45.899 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000280432 s, 1.8 MB/s 2023-10-05T15:09:45.900 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T15:09:45.957 INFO:tasks.cephadm:Deploying osd.0 on smithi060 with /dev/vg_nvme/lv_4... 2023-10-05T15:09:45.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-05T15:09:45.987 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:45 smithi060 ceph-mon[99238]: Deploying daemon mgr.z on smithi135 2023-10-05T15:09:46.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:45 smithi092 ceph-mon[102944]: Deploying daemon mgr.z on smithi135 2023-10-05T15:09:46.238 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:45 smithi135 podman[105424]: 2023-10-05T15:09:46.530 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 bash[105424]: 5315c8c3c62c7998d57fa05b1d0738658598531c78dc097e4449c0c64096570b 2023-10-05T15:09:46.531 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mgr[105507]: -- 172.21.15.135:0/1785689706 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55790621d1e0 con 0x5579061f3000 2023-10-05T15:09:46.531 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 systemd[1]: Started Ceph mgr.z for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:09:46.531 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:46.360+0000 7f6bde4a5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:09:46.531 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:46.440+0000 7f6bde4a5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:09:46.531 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:46.529+0000 7f6bde4a5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:09:46.537 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:46.792 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:46.621+0000 7f6bde4a5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:09:46.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:46.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:46.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:46.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:46.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:46.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:09:46.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:46.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:47.043 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:47.043 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:47.043 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:47.044 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:47.044 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:47.044 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:09:47.044 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:47.044 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:09:47.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:47.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:47.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:46.791+0000 7f6bde4a5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:09:47.473 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:47.153+0000 7f6bde4a5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:09:47.474 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:47.288+0000 7f6bde4a5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:09:47.474 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:47.377+0000 7f6bde4a5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:09:47.474 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:47.472+0000 7f6bde4a5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:09:47.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:47 smithi060 ceph-mon[99238]: Deploying daemon mgr.y on smithi092 2023-10-05T15:09:47.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:47 smithi092 ceph-mon[102944]: Deploying daemon mgr.y on smithi092 2023-10-05T15:09:47.927 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:47 smithi092 systemd[1]: Starting Ceph mgr.y for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:09:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-05T15:09:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-05T15:09:48.039 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-05T15:09:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-05T15:09:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00812259 s, 1.3 GB/s 2023-10-05T15:09:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-05T15:09:48.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:47 smithi135 ceph-mon[103360]: Deploying daemon mgr.y on smithi092 2023-10-05T15:09:48.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:47.894+0000 7f6bde4a5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:09:48.382 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 podman[104378]: 2023-10-05T15:09:48.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2023-10-05T15:09:48.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 bash[104378]: 2435ac7db78f130c06e77ec0b3a91a82a70823f5db284d20302a95a2e9d2f261 2023-10-05T15:09:48.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mgr[104418]: -- 172.21.15.92:0/3107408100 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ee510d11e0 con 0x55ee510a6c00 2023-10-05T15:09:48.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 systemd[1]: Started Ceph mgr.y for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:09:48.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:48.504+0000 7effe14f4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:09:48.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:48.583+0000 7effe14f4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:09:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-mon[103360]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:48.832 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:48.560+0000 7f6bde4a5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:09:48.832 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:48.642+0000 7f6bde4a5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:09:48.961 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:48.679+0000 7effe14f4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:09:48.961 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:48.777+0000 7effe14f4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:48.959+0000 7effe14f4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mon[102944]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:48.962 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:49.012 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:09:49.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:48 smithi060 ceph-mon[99238]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:49.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:49.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:49.674 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:49.345+0000 7effe14f4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:09:49.674 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:49.481+0000 7effe14f4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:09:49.674 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:49.574+0000 7effe14f4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:09:49.767 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:49.485+0000 7f6bde4a5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:09:49.767 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:49.587+0000 7f6bde4a5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:09:49.768 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:49.765+0000 7f6bde4a5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:09:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 -- 172.21.15.60:0/2043728243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 msgr2=0x7f10d8102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/2043728243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8102690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009990 tx=0x7f10cc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:09:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 -- 172.21.15.60:0/2043728243 shutdown_connections 2023-10-05T15:09:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/2043728243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10d8102bd0 0x7f10d8109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/2043728243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10d80ff250 0x7f10d80ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/2043728243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8102690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 -- 172.21.15.60:0/2043728243 >> 172.21.15.60:0/2043728243 conn(0x7f10d80fab70 msgr2=0x7f10d80fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:09:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 -- 172.21.15.60:0/2043728243 shutdown_connections 2023-10-05T15:09:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 -- 172.21.15.60:0/2043728243 wait complete. 2023-10-05T15:09:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.200+0000 7f10dd6b8700 1 Processor -- start 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 -- start start 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10d80ff250 0x7f10d8196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10d8102bd0 0x7f10d819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819e840 con 0x7f10d8102230 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819e980 con 0x7f10d80ff250 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10dd6b8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819eb40 con 0x7f10d8102bd0 2023-10-05T15:09:50.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34956/0 (socket says 172.21.15.60:34956) 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 -- 172.21.15.60:0/4241389597 learned_addr learned my addr 172.21.15.60:0/4241389597 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d6ffd700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10d80ff250 0x7f10d8196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d77fe700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10d8102bd0 0x7f10d819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 -- 172.21.15.60:0/4241389597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10d8102bd0 msgr2=0x7f10d819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10d8102bd0 0x7f10d819e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 -- 172.21.15.60:0/4241389597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10d80ff250 msgr2=0x7f10d8196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10d80ff250 0x7f10d8196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 -- 172.21.15.60:0/4241389597 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0095f0 con 0x7f10d8102230 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.201+0000 7f10d67fc700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8197230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0098e0 tx=0x7f10cc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.202+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc01d070 con 0x7f10d8102230 2023-10-05T15:09:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.202+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10cc022470 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.202+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d819edc0 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.202+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc017650 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.202+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d819f180 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.203+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f10cc0177b0 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.203+0000 7f10bffff700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f10c0038af0 0x7f10c003afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.203+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f10cc04c780 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.203+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d81086d0 con 0x7f10d8102230 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.203+0000 7f10d6ffd700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f10c0038af0 0x7f10c003afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:09:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.203+0000 7f10d6ffd700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f10c0038af0 0x7f10c003afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10d81981d0 tx=0x7f10c8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:09:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.208+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10cc027020 con 0x7f10d8102230 2023-10-05T15:09:50.330 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:50.064+0000 7f6bde4a5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:09:50.331 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:50.303+0000 7f6bde4a5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:09:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:50.421+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d802d2e0 con 0x7f10c0038af0 2023-10-05T15:09:50.426 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:49.672+0000 7effe14f4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:09:50.426 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:50.114+0000 7effe14f4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:09:50.720 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:50.451+0000 7f6bde4a5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:09:51.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:09:51.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:09:51.050 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.050 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:51.050 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:51.050 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:50.718+0000 7f6bde4a5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:50.794+0000 7effe14f4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:09:51.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:50.875+0000 7effe14f4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:09:51.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:51.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:51.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:51.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:09:51.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:09:51.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:09:51.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:09:51.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:51.758 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:51.445+0000 7f6bde4a5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:09:51.758 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:51.577+0000 7f6bde4a5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:09:51.904 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:51 smithi092 ceph-mon[102944]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:51.904 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:51 smithi092 ceph-mon[102944]: Reconfiguring mgr.x (unknown last config time)... 2023-10-05T15:09:51.904 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:51 smithi092 ceph-mon[102944]: Reconfiguring daemon mgr.x on smithi060 2023-10-05T15:09:51.904 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:51.638+0000 7effe14f4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:09:51.905 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:51.728+0000 7effe14f4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:09:52.050 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:51 smithi060 ceph-mon[99238]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:52.051 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:51 smithi060 ceph-mon[99238]: Reconfiguring mgr.x (unknown last config time)... 2023-10-05T15:09:52.051 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:51 smithi060 ceph-mon[99238]: Reconfiguring daemon mgr.x on smithi060 2023-10-05T15:09:52.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-mon[103360]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:09:52.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-mon[103360]: Reconfiguring mgr.x (unknown last config time)... 2023-10-05T15:09:52.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-mon[103360]: Reconfiguring daemon mgr.x on smithi060 2023-10-05T15:09:52.082 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:51.772+0000 7f6bde4a5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:09:52.082 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:51.886+0000 7f6bde4a5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:09:52.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:51.902+0000 7effe14f4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:09:52.553 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:52.182+0000 7effe14f4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:09:52.553 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:52.405+0000 7effe14f4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:09:52.581 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:52.108+0000 7f6bde4a5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:09:52.815 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:52.551+0000 7effe14f4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:52.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:09:52.968+0000 7f6bde4a5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:09:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:53.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:53.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:09:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:09:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:09:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:09:53.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:52.813+0000 7effe14f4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:09:53.780 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:53.508+0000 7effe14f4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:09:53.780 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:53.638+0000 7effe14f4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:09:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:53.784+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 14) v1 ==== 90791+0+0 (secure 0 0 0) 0x7f10cc0225e0 con 0x7f10d8102230 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: Standby manager daemon z started 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2958927456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "347f2ced-67e4-4e5a-9259-3bbb7716df2f"}]: dispatch 2023-10-05T15:09:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2958927456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "347f2ced-67e4-4e5a-9259-3bbb7716df2f"}]': finished 2023-10-05T15:09:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: osdmap e5: 1 total, 0 up, 1 in 2023-10-05T15:09:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:09:54.157 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:53.829+0000 7effe14f4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:09:54.158 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:53.941+0000 7effe14f4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:09:54.158 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: Standby manager daemon z started 2023-10-05T15:09:54.158 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:09:54.159 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:09:54.159 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:09:54.159 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:09:54.159 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2958927456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "347f2ced-67e4-4e5a-9259-3bbb7716df2f"}]: dispatch 2023-10-05T15:09:54.159 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2958927456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "347f2ced-67e4-4e5a-9259-3bbb7716df2f"}]': finished 2023-10-05T15:09:54.160 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: osdmap e5: 1 total, 0 up, 1 in 2023-10-05T15:09:54.160 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:09:54.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: Standby manager daemon z started 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/185609023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2958927456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "347f2ced-67e4-4e5a-9259-3bbb7716df2f"}]: dispatch 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2958927456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "347f2ced-67e4-4e5a-9259-3bbb7716df2f"}]': finished 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: osdmap e5: 1 total, 0 up, 1 in 2023-10-05T15:09:54.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:09:54.426 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:54 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:54.155+0000 7effe14f4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:09:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:54 smithi135 ceph-mon[103360]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:54 smithi135 ceph-mon[103360]: mgrmap e14: x(active, since 68s), standbys: z 2023-10-05T15:09:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:09:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:54 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3941224007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:09:55.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:54 smithi060 ceph-mon[99238]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:54 smithi060 ceph-mon[99238]: mgrmap e14: x(active, since 68s), standbys: z 2023-10-05T15:09:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:09:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:54 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3941224007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:09:55.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:09:55 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:09:55.014+0000 7effe14f4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:09:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:54 smithi092 ceph-mon[102944]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:54 smithi092 ceph-mon[102944]: mgrmap e14: x(active, since 68s), standbys: z 2023-10-05T15:09:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:09:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:54 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3941224007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:09:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:09:55.793+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f10cc020370 con 0x7f10d8102230 2023-10-05T15:09:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:55 smithi135 ceph-mon[103360]: Standby manager daemon y started 2023-10-05T15:09:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:55 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:09:56.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:55 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:09:56.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:55 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:09:56.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:55 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:09:56.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:55 smithi060 ceph-mon[99238]: Standby manager daemon y started 2023-10-05T15:09:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:55 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:09:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:55 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:09:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:55 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:09:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:55 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:09:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:55 smithi092 ceph-mon[102944]: Standby manager daemon y started 2023-10-05T15:09:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:55 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:09:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:55 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:09:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:55 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:09:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:55 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/2749417929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:09:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:56 smithi135 ceph-mon[103360]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:56 smithi135 ceph-mon[103360]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-10-05T15:09:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:09:57.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:56 smithi060 ceph-mon[99238]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:57.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:56 smithi060 ceph-mon[99238]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-10-05T15:09:57.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:09:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:56 smithi092 ceph-mon[102944]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:56 smithi092 ceph-mon[102944]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-10-05T15:09:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:09:59.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:09:58 smithi135 ceph-mon[103360]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:59.248 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:09:58 smithi092 ceph-mon[102944]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:09:59.407 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:09:58 smithi060 ceph-mon[99238]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:01.066 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:00 smithi060 ceph-mon[99238]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:01.066 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-05T15:10:01.066 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:01.066 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:00 smithi060 ceph-mon[99238]: Deploying daemon osd.0 on smithi060 2023-10-05T15:10:01.066 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:00 smithi060 ceph-mon[99238]: overall HEALTH_OK 2023-10-05T15:10:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:00 smithi135 ceph-mon[103360]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-05T15:10:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:00 smithi135 ceph-mon[103360]: Deploying daemon osd.0 on smithi060 2023-10-05T15:10:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:00 smithi135 ceph-mon[103360]: overall HEALTH_OK 2023-10-05T15:10:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:00 smithi092 ceph-mon[102944]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-05T15:10:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:00 smithi092 ceph-mon[102944]: Deploying daemon osd.0 on smithi060 2023-10-05T15:10:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:00 smithi092 ceph-mon[102944]: overall HEALTH_OK 2023-10-05T15:10:03.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:02 smithi135 ceph-mon[103360]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:02 smithi060 ceph-mon[99238]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:02 smithi092 ceph-mon[102944]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:04 smithi135 ceph-mon[103360]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:04 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:04 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:04 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:05.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:04 smithi060 ceph-mon[99238]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:05.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:04 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:04 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:04 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:04 smithi092 ceph-mon[102944]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:04 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:04 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:04 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:06.804 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:06 smithi060 ceph-mon[99238]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:06.804 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:06.804 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:06.805 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:07.057 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:07.058 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:06 smithi135 ceph-mon[103360]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:06 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:06 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:06 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:07.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:06 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:07.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:06 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:06 smithi092 ceph-mon[102944]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:06 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:06 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:06 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:07.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:06 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:07.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:06 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:07.278 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 0 on host 'smithi060' 2023-10-05T15:10:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.276+0000 7f10bffff700 1 -- 172.21.15.60:0/4241389597 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f10d802d2e0 con 0x7f10c0038af0 2023-10-05T15:10:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.278+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f10c0038af0 msgr2=0x7f10c003afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.278+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f10c0038af0 0x7f10c003afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10d81981d0 tx=0x7f10c8007400 comp rx=0 tx=0).stop 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 msgr2=0x7f10d8197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8197230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0098e0 tx=0x7f10cc00f690 comp rx=0 tx=0).stop 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 shutdown_connections 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10d8102bd0 0x7f10d819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10d80ff250 0x7f10d8196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f10c0038af0 0x7f10c003afb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 --2- 172.21.15.60:0/4241389597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d8102230 0x7f10d8197230 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 >> 172.21.15.60:0/4241389597 conn(0x7f10d80fab70 msgr2=0x7f10d8105810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:10:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 shutdown_connections 2023-10-05T15:10:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:07.279+0000 7f10dd6b8700 1 -- 172.21.15.60:0/4241389597 wait complete. 2023-10-05T15:10:07.723 DEBUG:teuthology.orchestra.run.smithi060:osd.0> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-05T15:10:07.725 INFO:tasks.cephadm:Deploying osd.1 on smithi092 with /dev/vg_nvme/lv_4... 2023-10-05T15:10:07.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-05T15:10:07.756 INFO:journalctl@ceph.osd.0.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:10:08.276 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:10:08.515 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:08 smithi092 ceph-mon[102944]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:08.515 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:08 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:08.516 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:08 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:08.516 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:08 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:08.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:08 smithi060 ceph-mon[99238]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:08.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:08 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:08.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:08 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:08.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:08 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:08.542 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:08 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0[117854]: 2023-10-05T15:10:08.398+0000 7f1eb179f640 -1 osd.0 0 log_to_monitors true 2023-10-05T15:10:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:08 smithi135 ceph-mon[103360]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:08 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:08 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:08 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:09 smithi135 ceph-mon[103360]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:10:09.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:09 smithi060 ceph-mon[99238]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:10:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:09 smithi092 ceph-mon[102944]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:10:09.790 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-05T15:10:09.790 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-05T15:10:09.790 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-05T15:10:09.790 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-05T15:10:09.790 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111415 s, 941 MB/s 2023-10-05T15:10:09.791 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-05T15:10:10.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2023-10-05T15:10:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:10 smithi135 ceph-mon[103360]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:10 smithi135 ceph-mon[103360]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-05T15:10:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:10 smithi135 ceph-mon[103360]: osdmap e6: 1 total, 0 up, 1 in 2023-10-05T15:10:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:10 smithi135 ceph-mon[103360]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:10:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:10 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:10.664 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0[117854]: 2023-10-05T15:10:10.271+0000 7f1ea6e16700 -1 osd.0 0 waiting for initial osdmap 2023-10-05T15:10:10.665 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0[117854]: 2023-10-05T15:10:10.274+0000 7f1ea1408700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:10:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-mon[99238]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-mon[99238]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-05T15:10:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-mon[99238]: osdmap e6: 1 total, 0 up, 1 in 2023-10-05T15:10:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-mon[99238]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:10:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:10 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:10 smithi092 ceph-mon[102944]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:10 smithi092 ceph-mon[102944]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-05T15:10:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:10 smithi092 ceph-mon[102944]: osdmap e6: 1 total, 0 up, 1 in 2023-10-05T15:10:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:10 smithi092 ceph-mon[102944]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:10:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:10 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:10.780 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: osdmap e7: 1 total, 0 up, 1 in 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi060 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi060 to 17173M 2023-10-05T15:10:11.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:11.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:11.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:11 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: osdmap e7: 1 total, 0 up, 1 in 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi060 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi060 to 17173M 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:11.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:11.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:11 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:10:11.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: osdmap e7: 1 total, 0 up, 1 in 2023-10-05T15:10:11.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:11.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi060 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi060 to 17173M 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:11.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:11 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:12.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.042+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/1718428982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc0ff5f0 msgr2=0x7fb2bc0ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:12.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.042+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/1718428982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc0ff5f0 0x7fb2bc0ffa10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0099c0 tx=0x7fb2ac009cd0 comp rx=0 tx=0).stop 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/1718428982 shutdown_connections 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/1718428982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 0x7fb2bc107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/1718428982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc0ff5f0 0x7fb2bc0ffa10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/1718428982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/1718428982 >> 172.21.15.92:0/1718428982 conn(0x7fb2bc0fab70 msgr2=0x7fb2bc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/1718428982 shutdown_connections 2023-10-05T15:10:12.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/1718428982 wait complete. 2023-10-05T15:10:12.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.043+0000 7fb2c1d8e700 1 Processor -- start 2023-10-05T15:10:12.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 -- start start 2023-10-05T15:10:12.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2bc0ff5f0 0x7fb2bc196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:12.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc1967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 0x7fb2bc19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc19d6f0 con 0x7fb2bc101190 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc19d860 con 0x7fb2bc1007f0 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2c1d8e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc19da20 con 0x7fb2bc0ff5f0 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc1967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc1967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38186/0 (socket says 172.21.15.92:38186) 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 -- 172.21.15.92:0/744268422 learned_addr learned my addr 172.21.15.92:0/744268422 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2bbfff700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 0x7fb2bc19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 -- 172.21.15.92:0/744268422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2bc0ff5f0 msgr2=0x7fb2bc196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2bb7fe700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2bc0ff5f0 0x7fb2bc196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2bc0ff5f0 0x7fb2bc196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:12.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 -- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 msgr2=0x7fb2bc19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 0x7fb2bc19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 -- 172.21.15.92:0/744268422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0095f0 con 0x7fb2bc1007f0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2bbfff700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 0x7fb2bc19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.044+0000 7fb2baffd700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc1967a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0007b50 tx=0x7fb2b0007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.045+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0011070 con 0x7fb2bc1007f0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.045+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2b000c2e0 con 0x7fb2bc1007f0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.045+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc194fa0 con 0x7fb2bc1007f0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.045+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000e5c0 con 0x7fb2bc1007f0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.045+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc1954f0 con 0x7fb2bc1007f0 2023-10-05T15:10:12.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.046+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc10ae50 con 0x7fb2bc1007f0 2023-10-05T15:10:12.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.047+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fb2b0004750 con 0x7fb2bc1007f0 2023-10-05T15:10:12.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.047+0000 7fb2b8ff9700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2a40a1520 0x7fb2a40a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:12.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.048+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7fb2b00ccb40 con 0x7fb2bc1007f0 2023-10-05T15:10:12.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.048+0000 7fb2bb7fe700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2a40a1520 0x7fb2a40a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:12.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.048+0000 7fb2bb7fe700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2a40a1520 0x7fb2a40a39e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac003720 tx=0x7fb2ac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:10:12.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.051+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2b0097c00 con 0x7fb2bc1007f0 2023-10-05T15:10:12.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:12.248+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2bc195c60 con 0x7fb2a40a1520 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] boot 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: osdmap e8: 1 total, 1 up, 1 in 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:12.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:12.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] boot 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: osdmap e8: 1 total, 1 up, 1 in 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: osd.0 [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] boot 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: osdmap e8: 1 total, 1 up, 1 in 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:13.369 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:13 smithi092 ceph-mon[102944]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:13.370 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:13 smithi092 ceph-mon[102944]: osdmap e9: 1 total, 1 up, 1 in 2023-10-05T15:10:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:13 smithi135 ceph-mon[103360]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:13 smithi135 ceph-mon[103360]: osdmap e9: 1 total, 1 up, 1 in 2023-10-05T15:10:13.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:13 smithi060 ceph-mon[99238]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:13.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:13 smithi060 ceph-mon[99238]: osdmap e9: 1 total, 1 up, 1 in 2023-10-05T15:10:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:14 smithi135 ceph-mon[103360]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:14.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:14 smithi060 ceph-mon[99238]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:14.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:14 smithi092 ceph-mon[102944]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:15 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/994790662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]: dispatch 2023-10-05T15:10:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:15 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]: dispatch 2023-10-05T15:10:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:15 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]': finished 2023-10-05T15:10:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:15 smithi135 ceph-mon[103360]: osdmap e10: 2 total, 1 up, 2 in 2023-10-05T15:10:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:15 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/3404030476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:15.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:15 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/994790662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]: dispatch 2023-10-05T15:10:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:15 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]: dispatch 2023-10-05T15:10:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:15 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]': finished 2023-10-05T15:10:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:15 smithi060 ceph-mon[99238]: osdmap e10: 2 total, 1 up, 2 in 2023-10-05T15:10:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:15 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/3404030476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:15 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/994790662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]: dispatch 2023-10-05T15:10:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:15 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]: dispatch 2023-10-05T15:10:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:15 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31b61e8d-4c45-43bd-ae04-807def1aa75e"}]': finished 2023-10-05T15:10:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:15 smithi092 ceph-mon[102944]: osdmap e10: 2 total, 1 up, 2 in 2023-10-05T15:10:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:15 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/3404030476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:17.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:16 smithi135 ceph-mon[103360]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:17.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:16 smithi060 ceph-mon[99238]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:16 smithi092 ceph-mon[102944]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:18.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:18 smithi092 ceph-mon[102944]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:19.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:18 smithi135 ceph-mon[103360]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:19.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:18 smithi060 ceph-mon[99238]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:21.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:20 smithi135 ceph-mon[103360]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:21.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:20 smithi060 ceph-mon[99238]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:21.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:20 smithi092 ceph-mon[102944]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:22.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:21 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-05T15:10:22.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:21 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:22.084 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:21 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-05T15:10:22.085 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:21 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:22.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-05T15:10:22.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:22 smithi135 ceph-mon[103360]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:22 smithi135 ceph-mon[103360]: Deploying daemon osd.1 on smithi092 2023-10-05T15:10:23.082 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:22 smithi092 ceph-mon[102944]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:23.082 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:22 smithi092 ceph-mon[102944]: Deploying daemon osd.1 on smithi092 2023-10-05T15:10:23.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:22 smithi060 ceph-mon[99238]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:23.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:22 smithi060 ceph-mon[99238]: Deploying daemon osd.1 on smithi092 2023-10-05T15:10:25.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:24 smithi135 ceph-mon[103360]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:25.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:24 smithi060 ceph-mon[99238]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:24 smithi092 ceph-mon[102944]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:26.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:26 smithi092 ceph-mon[102944]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:26.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:26 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:26.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:26 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:26.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:26 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:26 smithi135 ceph-mon[103360]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:26 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:26 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:26 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:27.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:26 smithi060 ceph-mon[99238]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:27.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:26 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:27.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:26 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:27.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:26 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:28.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.714+0000 7fb2b8ff9700 1 -- 172.21.15.92:0/744268422 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb2bc195c60 con 0x7fb2a40a1520 2023-10-05T15:10:28.717 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 1 on host 'smithi092' 2023-10-05T15:10:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2a40a1520 msgr2=0x7fb2a40a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2a40a1520 0x7fb2a40a39e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac003720 tx=0x7fb2ac005fb0 comp rx=0 tx=0).stop 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 msgr2=0x7fb2bc1967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc1967a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0007b50 tx=0x7fb2b0007f10 comp rx=0 tx=0).stop 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 shutdown_connections 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2a40a1520 0x7fb2a40a39e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2bc101190 0x7fb2bc19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2bc0ff5f0 0x7fb2bc196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 --2- 172.21.15.92:0/744268422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2bc1007f0 0x7fb2bc1967a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 >> 172.21.15.92:0/744268422 conn(0x7fb2bc0fab70 msgr2=0x7fb2bc0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 shutdown_connections 2023-10-05T15:10:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:10:28.717+0000 7fb2c1d8e700 1 -- 172.21.15.92:0/744268422 wait complete. 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.158 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.158 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:28 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:29.159 DEBUG:teuthology.orchestra.run.smithi092:osd.1> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-05T15:10:29.161 INFO:tasks.cephadm:Deploying osd.2 on smithi135 with /dev/vg_nvme/lv_4... 2023-10-05T15:10:29.161 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:28 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:29.190 INFO:journalctl@ceph.osd.1.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:10:29.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:29.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:29.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:29.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:29.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:28 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:29.725 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:10:29.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:29 smithi092 ceph-mon[102944]: from='osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:10:29.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:29 smithi092 ceph-mon[102944]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:10:29.927 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1[107988]: 2023-10-05T15:10:29.730+0000 7f829a07a640 -1 osd.1 0 log_to_monitors true 2023-10-05T15:10:30.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:29 smithi060 ceph-mon[99238]: from='osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:10:30.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:29 smithi060 ceph-mon[99238]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:10:30.232 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:29 smithi135 ceph-mon[103360]: from='osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:10:30.233 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:29 smithi135 ceph-mon[103360]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:10:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:30 smithi135 ceph-mon[103360]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:31.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:30 smithi135 ceph-mon[103360]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-05T15:10:31.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:30 smithi135 ceph-mon[103360]: osdmap e11: 2 total, 1 up, 2 in 2023-10-05T15:10:31.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:30 smithi135 ceph-mon[103360]: from='osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:10:31.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:31.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:30 smithi135 ceph-mon[103360]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:10:31.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:30 smithi060 ceph-mon[99238]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:30 smithi060 ceph-mon[99238]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-05T15:10:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:30 smithi060 ceph-mon[99238]: osdmap e11: 2 total, 1 up, 2 in 2023-10-05T15:10:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:30 smithi060 ceph-mon[99238]: from='osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:10:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:30 smithi060 ceph-mon[99238]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:10:31.176 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1[107988]: 2023-10-05T15:10:30.910+0000 7f828f6f1700 -1 osd.1 0 waiting for initial osdmap 2023-10-05T15:10:31.176 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1[107988]: 2023-10-05T15:10:30.913+0000 7f82894e2700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:10:31.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-mon[102944]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:31.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-mon[102944]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-05T15:10:31.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-mon[102944]: osdmap e11: 2 total, 1 up, 2 in 2023-10-05T15:10:31.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-mon[102944]: from='osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:10:31.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:31.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:30 smithi092 ceph-mon[102944]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:10:31.253 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-05T15:10:31.254 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-05T15:10:31.254 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-10-05T15:10:31.254 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-10-05T15:10:31.254 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115668 s, 907 MB/s 2023-10-05T15:10:31.254 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-10-05T15:10:31.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2023-10-05T15:10:32.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:31 smithi092 ceph-mon[102944]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:10:32.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:31 smithi092 ceph-mon[102944]: osdmap e12: 2 total, 1 up, 2 in 2023-10-05T15:10:32.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:31 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:32.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:31 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:10:32.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:31 smithi135 ceph-mon[103360]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:10:32.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:31 smithi135 ceph-mon[103360]: osdmap e12: 2 total, 1 up, 2 in 2023-10-05T15:10:32.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:31 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:32.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:31 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:32.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:31 smithi060 ceph-mon[99238]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:10:32.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:31 smithi060 ceph-mon[99238]: osdmap e12: 2 total, 1 up, 2 in 2023-10-05T15:10:32.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:31 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:32.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:31 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:33.064 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:10:33.064 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:10:33.064 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:33.064 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] boot 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: osdmap e13: 2 total, 2 up, 2 in 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi092 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:33.065 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:10:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:10:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] boot 2023-10-05T15:10:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: osdmap e13: 2 total, 2 up, 2 in 2023-10-05T15:10:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi092 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:33.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: osd.1 [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] boot 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: osdmap e13: 2 total, 2 up, 2 in 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi092 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:33.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-05T15:10:33.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:33.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:33.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 -- 172.21.15.135:0/2515806353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828102b40 msgr2=0x7fc8281093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 --2- 172.21.15.135:0/2515806353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828102b40 0x7fc8281093f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc82000b0a0 tx=0x7fc82000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 -- 172.21.15.135:0/2515806353 shutdown_connections 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 --2- 172.21.15.135:0/2515806353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828102b40 0x7fc8281093f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 --2- 172.21.15.135:0/2515806353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 0x7fc8281013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 --2- 172.21.15.135:0/2515806353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8281021a0 0x7fc828102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 -- 172.21.15.135:0/2515806353 >> 172.21.15.135:0/2515806353 conn(0x7fc8280fc540 msgr2=0x7fc8280fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 -- 172.21.15.135:0/2515806353 shutdown_connections 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.552+0000 7fc82e185700 1 -- 172.21.15.135:0/2515806353 wait complete. 2023-10-05T15:10:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 Processor -- start 2023-10-05T15:10:33.556 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 -- start start 2023-10-05T15:10:33.556 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 0x7fc828196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 0x7fc8281972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc828102b40 0x7fc82819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82819e940 con 0x7fc828102b40 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82819ea80 con 0x7fc828100fa0 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc82e185700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82819ec10 con 0x7fc8281021a0 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 0x7fc8281972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 0x7fc8281972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54822/0 (socket says 172.21.15.135:54822) 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 -- 172.21.15.135:0/2921441032 learned_addr learned my addr 172.21.15.135:0/2921441032 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc8277fe700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 0x7fc828196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 -- 172.21.15.135:0/2921441032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 msgr2=0x7fc828196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:33.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 0x7fc828196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc827fff700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc828102b40 0x7fc82819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 -- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc828102b40 msgr2=0x7fc82819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc828102b40 0x7fc82819e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc826ffd700 1 -- 172.21.15.135:0/2921441032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820009d00 con 0x7fc8281021a0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.553+0000 7fc8277fe700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 0x7fc828196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.554+0000 7fc826ffd700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 0x7fc8281972f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c9e0 tx=0x7fc81800cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.554+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818007ac0 con 0x7fc8281021a0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.554+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc818007c20 con 0x7fc8281021a0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.554+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818018660 con 0x7fc8281021a0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.554+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82819eef0 con 0x7fc8281021a0 2023-10-05T15:10:33.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.554+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82819f310 con 0x7fc8281021a0 2023-10-05T15:10:33.559 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.555+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc828108450 con 0x7fc8281021a0 2023-10-05T15:10:33.559 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.556+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fc81800f450 con 0x7fc8281021a0 2023-10-05T15:10:33.559 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.556+0000 7fc824ff9700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc8100a13f0 0x7fc8100a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:33.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.556+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fc8180cb450 con 0x7fc8281021a0 2023-10-05T15:10:33.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.556+0000 7fc8277fe700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc8100a13f0 0x7fc8100a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:33.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.557+0000 7fc8277fe700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc8100a13f0 0x7fc8100a38b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc828102000 tx=0x7fc81c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:10:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.561+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc818096300 con 0x7fc8281021a0 2023-10-05T15:10:33.758 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:33.756+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc82802d350 con 0x7fc8100a13f0 2023-10-05T15:10:34.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:33 smithi135 ceph-mon[103360]: osdmap e14: 2 total, 2 up, 2 in 2023-10-05T15:10:34.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:34.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:34.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:34.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:33 smithi060 ceph-mon[99238]: osdmap e14: 2 total, 2 up, 2 in 2023-10-05T15:10:34.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:34.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:34.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:34.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:33 smithi092 ceph-mon[102944]: osdmap e14: 2 total, 2 up, 2 in 2023-10-05T15:10:34.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:34.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:34.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:35.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:34 smithi135 ceph-mon[103360]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:35.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:34 smithi135 ceph-mon[103360]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:35.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:34 smithi060 ceph-mon[99238]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:35.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:34 smithi060 ceph-mon[99238]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:35.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:34 smithi092 ceph-mon[102944]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:35.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:34 smithi092 ceph-mon[102944]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:36 smithi135 ceph-mon[103360]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:36 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/4082799966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]: dispatch 2023-10-05T15:10:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:36 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]: dispatch 2023-10-05T15:10:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:36 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]': finished 2023-10-05T15:10:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:36 smithi135 ceph-mon[103360]: osdmap e15: 3 total, 2 up, 3 in 2023-10-05T15:10:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:37.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:36 smithi060 ceph-mon[99238]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:36 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/4082799966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]: dispatch 2023-10-05T15:10:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:36 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]: dispatch 2023-10-05T15:10:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:36 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]': finished 2023-10-05T15:10:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:36 smithi060 ceph-mon[99238]: osdmap e15: 3 total, 2 up, 3 in 2023-10-05T15:10:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:36 smithi092 ceph-mon[102944]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:36 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/4082799966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]: dispatch 2023-10-05T15:10:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:36 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]: dispatch 2023-10-05T15:10:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:36 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5814980-a6fb-4a86-86f0-d59539b4515a"}]': finished 2023-10-05T15:10:37.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:36 smithi092 ceph-mon[102944]: osdmap e15: 3 total, 2 up, 3 in 2023-10-05T15:10:37.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:38.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:37 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/2305764742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:38.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:37 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/2305764742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:37 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/2305764742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:38 smithi135 ceph-mon[103360]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:39.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:38 smithi060 ceph-mon[99238]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:38 smithi092 ceph-mon[102944]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:40 smithi135 ceph-mon[103360]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:41.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:40 smithi060 ceph-mon[99238]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:40 smithi092 ceph-mon[102944]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:43.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:42 smithi135 ceph-mon[103360]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:43.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:42 smithi060 ceph-mon[99238]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:42 smithi092 ceph-mon[102944]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:44.048 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-05T15:10:44.048 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:44.048 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:43 smithi135 ceph-mon[103360]: Deploying daemon osd.2 on smithi135 2023-10-05T15:10:44.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-05T15:10:44.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:44.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:43 smithi060 ceph-mon[99238]: Deploying daemon osd.2 on smithi135 2023-10-05T15:10:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-05T15:10:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:43 smithi092 ceph-mon[102944]: Deploying daemon osd.2 on smithi135 2023-10-05T15:10:45.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:44 smithi135 ceph-mon[103360]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:45.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:44 smithi060 ceph-mon[99238]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:45.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:44 smithi092 ceph-mon[102944]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:47.072 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:46 smithi135 ceph-mon[103360]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:47.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:46 smithi060 ceph-mon[99238]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:47.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:46 smithi092 ceph-mon[102944]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:48 smithi135 ceph-mon[103360]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:48.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:48 smithi060 ceph-mon[99238]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:48 smithi092 ceph-mon[102944]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:50.222 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 2 on host 'smithi135' 2023-10-05T15:10:50.223 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.220+0000 7fc824ff9700 1 -- 172.21.15.135:0/2921441032 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc82802d350 con 0x7fc8100a13f0 2023-10-05T15:10:50.224 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc8100a13f0 msgr2=0x7fc8100a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc8100a13f0 0x7fc8100a38b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc828102000 tx=0x7fc81c008040 comp rx=0 tx=0).stop 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 msgr2=0x7fc8281972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 0x7fc8281972f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c9e0 tx=0x7fc81800cda0 comp rx=0 tx=0).stop 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 shutdown_connections 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc8100a13f0 0x7fc8100a38b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc828102b40 0x7fc82819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828100fa0 0x7fc828196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 --2- 172.21.15.135:0/2921441032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8281021a0 0x7fc8281972f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:50.225 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 >> 172.21.15.135:0/2921441032 conn(0x7fc8280fc540 msgr2=0x7fc828105590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:10:50.226 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 shutdown_connections 2023-10-05T15:10:50.226 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:10:50.222+0000 7fc82e185700 1 -- 172.21.15.135:0/2921441032 wait complete. 2023-10-05T15:10:50.640 DEBUG:teuthology.orchestra.run.smithi135:osd.2> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-05T15:10:50.642 INFO:tasks.cephadm:Deploying osd.3 on smithi060 with /dev/vg_nvme/lv_3... 2023-10-05T15:10:50.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-05T15:10:50.674 INFO:journalctl@ceph.osd.2.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:10:50.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:50.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:50.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:50.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:10:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:51.205 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:10:51.506 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2[109190]: 2023-10-05T15:10:51.339+0000 7f93c443c640 -1 osd.2 0 log_to_monitors true 2023-10-05T15:10:51.955 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:51 smithi060 ceph-mon[99238]: from='osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:10:51.955 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:51 smithi060 ceph-mon[99238]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:10:52.061 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:51 smithi135 ceph-mon[103360]: from='osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:10:52.061 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:51 smithi135 ceph-mon[103360]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:10:52.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:51 smithi092 ceph-mon[102944]: from='osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:10:52.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:51 smithi092 ceph-mon[102944]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-05T15:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-05T15:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-05T15:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-05T15:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013446 s, 780 MB/s 2023-10-05T15:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-05T15:10:53.081 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2[109190]: 2023-10-05T15:10:52.775+0000 7f93b9ab3700 -1 osd.2 0 waiting for initial osdmap 2023-10-05T15:10:53.081 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2[109190]: 2023-10-05T15:10:52.779+0000 7f93b40a5700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:10:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-mon[103360]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-mon[103360]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-05T15:10:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-mon[103360]: osdmap e16: 3 total, 2 up, 3 in 2023-10-05T15:10:53.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-mon[103360]: from='osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:10:53.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:53.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:52 smithi135 ceph-mon[103360]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:10:53.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:52 smithi060 ceph-mon[99238]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:52 smithi060 ceph-mon[99238]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-05T15:10:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:52 smithi060 ceph-mon[99238]: osdmap e16: 3 total, 2 up, 3 in 2023-10-05T15:10:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:52 smithi060 ceph-mon[99238]: from='osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:10:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:53.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:52 smithi060 ceph-mon[99238]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:10:53.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2023-10-05T15:10:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:52 smithi092 ceph-mon[102944]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:52 smithi092 ceph-mon[102944]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-05T15:10:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:52 smithi092 ceph-mon[102944]: osdmap e16: 3 total, 2 up, 3 in 2023-10-05T15:10:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:52 smithi092 ceph-mon[102944]: from='osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:10:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:52 smithi092 ceph-mon[102944]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:10:53.737 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:10:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:10:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: osdmap e17: 3 total, 2 up, 3 in 2023-10-05T15:10:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:54.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:10:54.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: osdmap e17: 3 total, 2 up, 3 in 2023-10-05T15:10:54.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:54.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:54.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:10:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: osdmap e17: 3 total, 2 up, 3 in 2023-10-05T15:10:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:10:54.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:54.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:10:54.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/3799836414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 msgr2=0x7fdf481082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/3799836414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf481082b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000b0a0 tx=0x7fdf4000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:10:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/3799836414 shutdown_connections 2023-10-05T15:10:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/3799836414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf481082b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/3799836414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf480ffe70 0x7fdf48100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/3799836414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf48100fd0 0x7fdf48101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/3799836414 >> 172.21.15.60:0/3799836414 conn(0x7fdf480fb3f0 msgr2=0x7fdf480fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:10:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/3799836414 shutdown_connections 2023-10-05T15:10:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.986+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/3799836414 wait complete. 2023-10-05T15:10:54.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 Processor -- start 2023-10-05T15:10:54.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 -- start start 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf480ffe70 0x7fdf48195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf48100fd0 0x7fdf481960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf4819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4819d730 con 0x7fdf48101990 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4819d870 con 0x7fdf48100fd0 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4f6f4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4819da00 con 0x7fdf480ffe70 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4dc91700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf4819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4dc91700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf4819d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35028/0 (socket says 172.21.15.60:35028) 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.987+0000 7fdf4dc91700 1 -- 172.21.15.60:0/2862244481 learned_addr learned my addr 172.21.15.60:0/2862244481 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4d490700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf480ffe70 0x7fdf48195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:54.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4cc8f700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf48100fd0 0x7fdf481960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4dc91700 1 -- 172.21.15.60:0/2862244481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf480ffe70 msgr2=0x7fdf48195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4dc91700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf480ffe70 0x7fdf48195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4dc91700 1 -- 172.21.15.60:0/2862244481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf48100fd0 msgr2=0x7fdf481960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4dc91700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf48100fd0 0x7fdf481960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4dc91700 1 -- 172.21.15.60:0/2862244481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40009d00 con 0x7fdf48101990 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4dc91700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf4819d160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000d010 tx=0x7fdf40004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000e040 con 0x7fdf48101990 2023-10-05T15:10:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf4001ab90 con 0x7fdf48101990 2023-10-05T15:10:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf48069230 con 0x7fdf48101990 2023-10-05T15:10:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400057d0 con 0x7fdf48101990 2023-10-05T15:10:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.988+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf48069730 con 0x7fdf48101990 2023-10-05T15:10:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.989+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4806a120 con 0x7fdf48101990 2023-10-05T15:10:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.990+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fdf4001ad00 con 0x7fdf48101990 2023-10-05T15:10:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.991+0000 7fdf3a7fc700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf340a13f0 0x7fdf340a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:10:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.991+0000 7fdf4d490700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf340a13f0 0x7fdf340a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:10:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.991+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2851+0+0 (secure 0 0 0) 0x7fdf400cebc0 con 0x7fdf48101990 2023-10-05T15:10:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.991+0000 7fdf4d490700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf340a13f0 0x7fdf340a38b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c004630 tx=0x7fdf3c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:10:54.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:54.996+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf400998e0 con 0x7fdf48101990 2023-10-05T15:10:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:10:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:10:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi135 2023-10-05T15:10:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi135 to 17168M 2023-10-05T15:10:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] boot 2023-10-05T15:10:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: osdmap e18: 3 total, 3 up, 3 in 2023-10-05T15:10:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:55.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:10:55.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:10:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi135 2023-10-05T15:10:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi135 to 17168M 2023-10-05T15:10:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] boot 2023-10-05T15:10:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: osdmap e18: 3 total, 3 up, 3 in 2023-10-05T15:10:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi135 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi135 to 17168M 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: osd.2 [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] boot 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: osdmap e18: 3 total, 3 up, 3 in 2023-10-05T15:10:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:10:55.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:55.203+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf48106ec0 con 0x7fdf340a13f0 2023-10-05T15:10:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:55 smithi135 ceph-mon[103360]: osdmap e19: 3 total, 3 up, 3 in 2023-10-05T15:10:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:55 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:10:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:55 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:55 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:55 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:56.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:55 smithi060 ceph-mon[99238]: osdmap e19: 3 total, 3 up, 3 in 2023-10-05T15:10:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:55 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:10:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:55 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:55 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:55 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:55 smithi092 ceph-mon[102944]: osdmap e19: 3 total, 3 up, 3 in 2023-10-05T15:10:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:55 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:10:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:55 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:10:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:55 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:10:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:55 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:10:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:56 smithi135 ceph-mon[103360]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:10:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:56 smithi135 ceph-mon[103360]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-05T15:10:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:56 smithi135 ceph-mon[103360]: osdmap e20: 3 total, 3 up, 3 in 2023-10-05T15:10:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:10:57.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:56 smithi060 ceph-mon[99238]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:10:57.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:56 smithi060 ceph-mon[99238]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:57.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-05T15:10:57.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:56 smithi060 ceph-mon[99238]: osdmap e20: 3 total, 3 up, 3 in 2023-10-05T15:10:57.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:10:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:56 smithi092 ceph-mon[102944]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:10:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:56 smithi092 ceph-mon[102944]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:10:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-05T15:10:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:56 smithi092 ceph-mon[102944]: osdmap e20: 3 total, 3 up, 3 in 2023-10-05T15:10:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:10:57.414 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124219]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:10:57.414 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124219]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:57.415 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124219]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:57.415 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124219]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:10:57.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:10:57.813+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdf40005930 con 0x7fdf48101990 2023-10-05T15:10:58.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:10:58.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:57 smithi135 ceph-mon[103360]: osdmap e21: 3 total, 3 up, 3 in 2023-10-05T15:10:58.082 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:10:58.083 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:57 smithi092 ceph-mon[102944]: osdmap e21: 3 total, 3 up, 3 in 2023-10-05T15:10:58.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:10:58.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:57 smithi060 ceph-mon[99238]: osdmap e21: 3 total, 3 up, 3 in 2023-10-05T15:10:58.165 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124257]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:10:58.165 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124257]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:58.165 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124257]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:58.165 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:10:57 smithi060 sudo[124257]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:10:58.335 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113468]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:10:58.335 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:58.335 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113468]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:58.335 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113468]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:10:58.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113471]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:10:58.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113471]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:58.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113471]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:58.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:10:58 smithi092 sudo[113471]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:10:58.856 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113827]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:10:58.856 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113827]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:58.856 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113827]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:58.856 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113827]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: osdmap e22: 3 total, 3 up, 3 in 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/805093298' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5847cb91-24d6-43e4-ad16-e1410664b98f"}]: dispatch 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/805093298' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5847cb91-24d6-43e4-ad16-e1410664b98f"}]': finished 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: osdmap e23: 4 total, 3 up, 4 in 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:58.857 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:10:58 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/615733499' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:59.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:10:59.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: osdmap e22: 3 total, 3 up, 3 in 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/805093298' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5847cb91-24d6-43e4-ad16-e1410664b98f"}]: dispatch 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/805093298' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5847cb91-24d6-43e4-ad16-e1410664b98f"}]': finished 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: osdmap e23: 4 total, 3 up, 4 in 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:59.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:58 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/615733499' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:10:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: osdmap e22: 3 total, 3 up, 3 in 2023-10-05T15:10:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-05T15:10:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/805093298' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5847cb91-24d6-43e4-ad16-e1410664b98f"}]: dispatch 2023-10-05T15:10:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/805093298' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5847cb91-24d6-43e4-ad16-e1410664b98f"}]': finished 2023-10-05T15:10:59.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: osdmap e23: 4 total, 3 up, 4 in 2023-10-05T15:10:59.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:10:59.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:10:59.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:10:58 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/615733499' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:10:59.331 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113830]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:10:59.331 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:59.331 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113830]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:59.331 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:10:58 smithi135 sudo[113830]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:10:59.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124531]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:10:59.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:10:59.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124531]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:10:59.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124531]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:11:00.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124720]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:11:00.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124720]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:11:00.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124720]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:11:00.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:10:59 smithi060 sudo[124720]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:11:00.265 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113833]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:11:00.265 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:11:00.266 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113833]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:11:00.266 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113833]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:11:00.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113836]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:11:00.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113836]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:11:00.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113836]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:11:00.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 sudo[113836]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:11:00.759 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113474]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:11:00.759 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113474]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:11:00.759 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113474]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:11:00.759 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113474]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:11:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:01.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:01.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113477]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113477]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113477]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 sudo[113477]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:01.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.829 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:01.829 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.829 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:01.829 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.829 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.829 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:01 smithi135 ceph-mon[103360]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:01.961 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:01.962 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:01 smithi060 ceph-mon[99238]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:02.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:02.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:02.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:02.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:11:02.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:11:02.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:11:02.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:11:02.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:01 smithi092 ceph-mon[102944]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:11:03.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:02 smithi135 ceph-mon[103360]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:03.108 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:02 smithi060 ceph-mon[99238]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:02 smithi092 ceph-mon[102944]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:04.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:04 smithi135 ceph-mon[103360]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 KiB/s wr, 17 op/s 2023-10-05T15:11:04.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:04 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-05T15:11:04.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:04 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:05.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:04 smithi060 ceph-mon[99238]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 KiB/s wr, 17 op/s 2023-10-05T15:11:05.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:04 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-05T15:11:05.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:04 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:04 smithi092 ceph-mon[102944]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 KiB/s wr, 17 op/s 2023-10-05T15:11:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:04 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-05T15:11:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:04 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:05.981 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:05 smithi060 ceph-mon[99238]: Deploying daemon osd.3 on smithi060 2023-10-05T15:11:06.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:05 smithi135 ceph-mon[103360]: Deploying daemon osd.3 on smithi060 2023-10-05T15:11:06.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:05 smithi092 ceph-mon[102944]: Deploying daemon osd.3 on smithi060 2023-10-05T15:11:06.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:06 smithi060 ceph-mon[99238]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-05T15:11:07.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:06 smithi135 ceph-mon[103360]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-05T15:11:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:06 smithi092 ceph-mon[102944]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-05T15:11:08.828 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:08 smithi060 ceph-mon[99238]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-10-05T15:11:09.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:08 smithi135 ceph-mon[103360]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-10-05T15:11:09.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:08 smithi092 ceph-mon[102944]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-10-05T15:11:10.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:09 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:10.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:09 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:10.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:09 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:10.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:09 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:10.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:09 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:10.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:09 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:10.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:09 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:10.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:09 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:10.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:09 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:11.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:10 smithi060 ceph-mon[99238]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-10-05T15:11:11.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:10 smithi092 ceph-mon[102944]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-10-05T15:11:11.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:10 smithi135 ceph-mon[103360]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-10-05T15:11:11.563 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 3 on host 'smithi060' 2023-10-05T15:11:11.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.560+0000 7fdf3a7fc700 1 -- 172.21.15.60:0/2862244481 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdf48106ec0 con 0x7fdf340a13f0 2023-10-05T15:11:11.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.562+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf340a13f0 msgr2=0x7fdf340a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.562+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf340a13f0 0x7fdf340a38b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c004630 tx=0x7fdf3c00b3c0 comp rx=0 tx=0).stop 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.562+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 msgr2=0x7fdf4819d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.562+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf4819d160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000d010 tx=0x7fdf40004c80 comp rx=0 tx=0).stop 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 shutdown_connections 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf340a13f0 0x7fdf340a38b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf48101990 0x7fdf4819d160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf480ffe70 0x7fdf48195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 --2- 172.21.15.60:0/2862244481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf48100fd0 0x7fdf481960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 >> 172.21.15.60:0/2862244481 conn(0x7fdf480fb3f0 msgr2=0x7fdf481044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:11:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 shutdown_connections 2023-10-05T15:11:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:11.563+0000 7fdf4f6f4700 1 -- 172.21.15.60:0/2862244481 wait complete. 2023-10-05T15:11:12.024 DEBUG:teuthology.orchestra.run.smithi060:osd.3> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-05T15:11:12.026 INFO:tasks.cephadm:Deploying osd.4 on smithi092 with /dev/vg_nvme/lv_3... 2023-10-05T15:11:12.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-05T15:11:12.060 INFO:journalctl@ceph.osd.3.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-05T15:11:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:12.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:12.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:12.914 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:11:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:11:12.793+0000 7fec57b64640 -1 osd.3 0 log_to_monitors true 2023-10-05T15:11:13.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:13 smithi060 ceph-mon[99238]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-05T15:11:13.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:13 smithi092 ceph-mon[102944]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-05T15:11:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:13 smithi135 ceph-mon[103360]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-05T15:11:14.149 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-05T15:11:14.149 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-05T15:11:14.149 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-05T15:11:14.150 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-05T15:11:14.150 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111028 s, 944 MB/s 2023-10-05T15:11:14.150 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-05T15:11:14.543 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:14 smithi092 ceph-mon[102944]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-05T15:11:14.543 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:14 smithi092 ceph-mon[102944]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-05T15:11:14.544 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:14 smithi092 ceph-mon[102944]: osdmap e24: 4 total, 3 up, 4 in 2023-10-05T15:11:14.544 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:14 smithi092 ceph-mon[102944]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:11:14.544 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:14 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:14.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2023-10-05T15:11:14.574 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:11:14.249+0000 7fec4d1db700 -1 osd.3 0 waiting for initial osdmap 2023-10-05T15:11:14.574 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:11:14.255+0000 7fec44fc8700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:11:14.574 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-mon[99238]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-05T15:11:14.574 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-mon[99238]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-05T15:11:14.574 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-mon[99238]: osdmap e24: 4 total, 3 up, 4 in 2023-10-05T15:11:14.574 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-mon[99238]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:11:14.575 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:14 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:14 smithi135 ceph-mon[103360]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-05T15:11:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:14 smithi135 ceph-mon[103360]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-05T15:11:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:14 smithi135 ceph-mon[103360]: osdmap e24: 4 total, 3 up, 4 in 2023-10-05T15:11:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:14 smithi135 ceph-mon[103360]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:11:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:14 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.104 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:11:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:11:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: osdmap e25: 4 total, 3 up, 4 in 2023-10-05T15:11:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi060 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi060 to 8586M 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:15.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:15 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: osdmap e25: 4 total, 3 up, 4 in 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi060 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:15.607 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:15.607 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi060 to 8586M 2023-10-05T15:11:15.607 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.607 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:15.607 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:15.607 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:15 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: osdmap e25: 4 total, 3 up, 4 in 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi060 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:15.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:15.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi060 to 8586M 2023-10-05T15:11:15.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:15.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:15.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:15.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:15 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:16.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 -- 172.21.15.92:0/2192033104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8101990 msgr2=0x7f98f81082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 --2- 172.21.15.92:0/2192033104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8101990 0x7f98f81082b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f98f000b0a0 tx=0x7f98f000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 -- 172.21.15.92:0/2192033104 shutdown_connections 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 --2- 172.21.15.92:0/2192033104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8101990 0x7f98f81082b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 --2- 172.21.15.92:0/2192033104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f80ffe70 0x7f98f8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 --2- 172.21.15.92:0/2192033104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100fd0 0x7f98f8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 -- 172.21.15.92:0/2192033104 >> 172.21.15.92:0/2192033104 conn(0x7f98f80fb3f0 msgr2=0x7f98f80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 -- 172.21.15.92:0/2192033104 shutdown_connections 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.470+0000 7f98ff06a700 1 -- 172.21.15.92:0/2192033104 wait complete. 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 Processor -- start 2023-10-05T15:11:16.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 -- start start 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f80ffe70 0x7f98f8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 0x7f98f8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8101990 0x7f98f819e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819e8c0 con 0x7f98f80ffe70 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819ea00 con 0x7f98f8100fd0 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98ff06a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819eb90 con 0x7f98f8101990 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 0x7f98f8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 0x7f98f8197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38256/0 (socket says 172.21.15.92:38256) 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 -- 172.21.15.92:0/3314174605 learned_addr learned my addr 172.21.15.92:0/3314174605 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98fce06700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f80ffe70 0x7f98f8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98fd607700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8101990 0x7f98f819e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:16.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 -- 172.21.15.92:0/3314174605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8101990 msgr2=0x7f98f819e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8101990 0x7f98f819e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 -- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f80ffe70 msgr2=0x7f98f8196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f80ffe70 0x7f98f8196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 -- 172.21.15.92:0/3314174605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0009d00 con 0x7f98f8100fd0 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.471+0000 7f98f7fff700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 0x7f98f8197270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e9a0 tx=0x7f98e400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.472+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4009790 con 0x7f98f8100fd0 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.472+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e400cbd0 con 0x7f98f8100fd0 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.472+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f819ee70 con 0x7f98f8100fd0 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.472+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4018680 con 0x7f98f8100fd0 2023-10-05T15:11:16.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.472+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f819f2e0 con 0x7f98f8100fd0 2023-10-05T15:11:16.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.473+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f81073c0 con 0x7f98f8100fd0 2023-10-05T15:11:16.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.474+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f98e400cd40 con 0x7f98f8100fd0 2023-10-05T15:11:16.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.474+0000 7f98f5ffb700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98e80a1480 0x7f98e80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:16.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.474+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f98e4014070 con 0x7f98f8100fd0 2023-10-05T15:11:16.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.475+0000 7f98fce06700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98e80a1480 0x7f98e80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:16.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.475+0000 7f98fce06700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98e80a1480 0x7f98e80a3940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98ec007c60 tx=0x7f98ec0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:11:16.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.479+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f98e4052100 con 0x7f98f8100fd0 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] boot 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: osdmap e26: 4 total, 4 up, 4 in 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:16 smithi135 ceph-mon[103360]: osdmap e27: 4 total, 4 up, 4 in 2023-10-05T15:11:16.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:11:16.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:11:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] boot 2023-10-05T15:11:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: osdmap e26: 4 total, 4 up, 4 in 2023-10-05T15:11:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:16 smithi060 ceph-mon[99238]: osdmap e27: 4 total, 4 up, 4 in 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: osd.3 [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] boot 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: osdmap e26: 4 total, 4 up, 4 in 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:11:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:16 smithi092 ceph-mon[102944]: osdmap e27: 4 total, 4 up, 4 in 2023-10-05T15:11:16.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:16.676+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f98f802d350 con 0x7f98e80a1480 2023-10-05T15:11:17.520 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:17 smithi092 ceph-mon[102944]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:11:17.520 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:17 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:17.520 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:17 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:17.520 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:17 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:17.520 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:17 smithi092 ceph-mon[102944]: osdmap e28: 4 total, 4 up, 4 in 2023-10-05T15:11:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:17 smithi135 ceph-mon[103360]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:11:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:17 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:17 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:17 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:17 smithi135 ceph-mon[103360]: osdmap e28: 4 total, 4 up, 4 in 2023-10-05T15:11:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:17 smithi060 ceph-mon[99238]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:11:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:17 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:17 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:17 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:17 smithi060 ceph-mon[99238]: osdmap e28: 4 total, 4 up, 4 in 2023-10-05T15:11:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:18 smithi135 ceph-mon[103360]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:18 smithi135 ceph-mon[103360]: osdmap e29: 4 total, 4 up, 4 in 2023-10-05T15:11:19.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:18 smithi060 ceph-mon[99238]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:18 smithi060 ceph-mon[99238]: osdmap e29: 4 total, 4 up, 4 in 2023-10-05T15:11:19.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:18 smithi092 ceph-mon[102944]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:19.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:18 smithi092 ceph-mon[102944]: osdmap e29: 4 total, 4 up, 4 in 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: osdmap e30: 4 total, 4 up, 4 in 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/3358306151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]: dispatch 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]: dispatch 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]': finished 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: osdmap e31: 5 total, 4 up, 5 in 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:19 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/793616483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:11:20.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: osdmap e30: 4 total, 4 up, 4 in 2023-10-05T15:11:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/3358306151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]: dispatch 2023-10-05T15:11:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]: dispatch 2023-10-05T15:11:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]': finished 2023-10-05T15:11:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: osdmap e31: 5 total, 4 up, 5 in 2023-10-05T15:11:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:19 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/793616483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: osdmap e30: 4 total, 4 up, 4 in 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/3358306151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]: dispatch 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]: dispatch 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d375042-3a53-4d3d-87c6-a23e1312fcaf"}]': finished 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: osdmap e31: 5 total, 4 up, 5 in 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:19 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/793616483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:11:21.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:20 smithi135 ceph-mon[103360]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 149 KiB/s, 0 objects/s recovering 2023-10-05T15:11:21.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:20 smithi060 ceph-mon[99238]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 149 KiB/s, 0 objects/s recovering 2023-10-05T15:11:21.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:20 smithi092 ceph-mon[102944]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 149 KiB/s, 0 objects/s recovering 2023-10-05T15:11:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:22 smithi135 ceph-mon[103360]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-05T15:11:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:22 smithi060 ceph-mon[99238]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-05T15:11:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:22 smithi092 ceph-mon[102944]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-05T15:11:24.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:24 smithi092 ceph-mon[102944]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:11:25.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:24 smithi135 ceph-mon[103360]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:11:25.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:24 smithi060 ceph-mon[99238]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:11:26.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:25 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-05T15:11:26.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:25 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:26.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:25 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-05T15:11:26.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:25 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:26.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:25 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-05T15:11:26.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:25 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:26.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:26 smithi092 ceph-mon[102944]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-05T15:11:26.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:26 smithi092 ceph-mon[102944]: Deploying daemon osd.4 on smithi092 2023-10-05T15:11:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:26 smithi135 ceph-mon[103360]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-05T15:11:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:26 smithi135 ceph-mon[103360]: Deploying daemon osd.4 on smithi092 2023-10-05T15:11:27.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:26 smithi060 ceph-mon[99238]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-05T15:11:27.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:26 smithi060 ceph-mon[99238]: Deploying daemon osd.4 on smithi092 2023-10-05T15:11:28.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:28 smithi092 ceph-mon[102944]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:29.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:28 smithi135 ceph-mon[103360]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:29.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:28 smithi060 ceph-mon[99238]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:31.060 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:30 smithi092 ceph-mon[102944]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:31.060 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:31.060 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:31.060 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:31.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:30 smithi135 ceph-mon[103360]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:31.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:30 smithi060 ceph-mon[99238]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:32.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:32 smithi092 ceph-mon[102944]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:32.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:32.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:32.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:32.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:32.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:32 smithi135 ceph-mon[103360]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.101+0000 7f98f5ffb700 1 -- 172.21.15.92:0/3314174605 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f98f802d350 con 0x7f98e80a1480 2023-10-05T15:11:33.103 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 4 on host 'smithi092' 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98e80a1480 msgr2=0x7f98e80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98e80a1480 0x7f98e80a3940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98ec007c60 tx=0x7f98ec0073d0 comp rx=0 tx=0).stop 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 msgr2=0x7f98f8197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 0x7f98f8197270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e9a0 tx=0x7f98e400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 shutdown_connections 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8101990 0x7f98f819e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98e80a1480 0x7f98e80a3940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:33.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f80ffe70 0x7f98f8196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:33.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 --2- 172.21.15.92:0/3314174605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f8100fd0 0x7f98f8197270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:33.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 >> 172.21.15.92:0/3314174605 conn(0x7f98f80fb3f0 msgr2=0x7f98f8104500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:11:33.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 shutdown_connections 2023-10-05T15:11:33.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:11:33.103+0000 7f98ff06a700 1 -- 172.21.15.92:0/3314174605 wait complete. 2023-10-05T15:11:33.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:32 smithi060 ceph-mon[99238]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:33.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:33.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:33.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:33.584 DEBUG:teuthology.orchestra.run.smithi092:osd.4> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-05T15:11:33.586 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_3... 2023-10-05T15:11:33.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-05T15:11:33.619 INFO:journalctl@ceph.osd.4.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:11:34.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:34.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:34.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:34.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:34.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:34.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:11:34.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:34.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:34.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:34.410 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:11:34 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4[116680]: 2023-10-05T15:11:34.073+0000 7f3dcefa8640 -1 osd.4 0 log_to_monitors true 2023-10-05T15:11:34.975 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:34 smithi092 ceph-mon[102944]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:34.976 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:34 smithi092 ceph-mon[102944]: from='osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:11:34.976 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:34 smithi092 ceph-mon[102944]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:11:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:34 smithi135 ceph-mon[103360]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:34 smithi135 ceph-mon[103360]: from='osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:11:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:34 smithi135 ceph-mon[103360]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:11:35.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:34 smithi060 ceph-mon[99238]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:34 smithi060 ceph-mon[99238]: from='osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:11:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:34 smithi060 ceph-mon[99238]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:11:35.640 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-05T15:11:35.641 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-05T15:11:35.641 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-10-05T15:11:35.641 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-10-05T15:11:35.641 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0150036 s, 699 MB/s 2023-10-05T15:11:35.641 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-10-05T15:11:36.004 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:35 smithi135 ceph-mon[103360]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-05T15:11:36.004 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:35 smithi135 ceph-mon[103360]: from='osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:11:36.004 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:35 smithi135 ceph-mon[103360]: osdmap e32: 5 total, 4 up, 5 in 2023-10-05T15:11:36.004 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:35 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:36.004 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:35 smithi135 ceph-mon[103360]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:11:36.004 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:35 smithi135 ceph-mon[103360]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:11:36.005 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2023-10-05T15:11:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:35 smithi060 ceph-mon[99238]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-05T15:11:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:35 smithi060 ceph-mon[99238]: from='osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:11:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:35 smithi060 ceph-mon[99238]: osdmap e32: 5 total, 4 up, 5 in 2023-10-05T15:11:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:35 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:35 smithi060 ceph-mon[99238]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:11:36.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:35 smithi060 ceph-mon[99238]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:11:36.176 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4[116680]: 2023-10-05T15:11:35.817+0000 7f3dc461f700 -1 osd.4 0 waiting for initial osdmap 2023-10-05T15:11:36.176 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4[116680]: 2023-10-05T15:11:35.825+0000 7f3dbe410700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:11:36.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-mon[102944]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-05T15:11:36.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-mon[102944]: from='osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:11:36.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-mon[102944]: osdmap e32: 5 total, 4 up, 5 in 2023-10-05T15:11:36.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:36.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-mon[102944]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:11:36.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:35 smithi092 ceph-mon[102944]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:11:36.562 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: osdmap e33: 5 total, 4 up, 5 in 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: osdmap e33: 5 total, 4 up, 5 in 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: osdmap e33: 5 total, 4 up, 5 in 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:37.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:37.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:37.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:37.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 -- 172.21.15.135:0/1506054113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 msgr2=0x7fea6c100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:37.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 --2- 172.21.15.135:0/1506054113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c100290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009990 tx=0x7fea5c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:11:37.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 -- 172.21.15.135:0/1506054113 shutdown_connections 2023-10-05T15:11:37.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 --2- 172.21.15.135:0/1506054113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c101990 0x7fea6c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:37.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 --2- 172.21.15.135:0/1506054113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c100290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 --2- 172.21.15.135:0/1506054113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c100fd0 0x7fea6c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 -- 172.21.15.135:0/1506054113 >> 172.21.15.135:0/1506054113 conn(0x7fea6c0fb3f0 msgr2=0x7fea6c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 -- 172.21.15.135:0/1506054113 shutdown_connections 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 -- 172.21.15.135:0/1506054113 wait complete. 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 Processor -- start 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.767+0000 7fea73f2a700 1 -- start start 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c100fd0 0x7fea6c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c101990 0x7fea6c19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c19e6f0 con 0x7fea6c100fd0 2023-10-05T15:11:37.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c19e860 con 0x7fea6c101990 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c19ea20 con 0x7fea6c0ffe70 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54898/0 (socket says 172.21.15.135:54898) 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 -- 172.21.15.135:0/3785773262 learned_addr learned my addr 172.21.15.135:0/3785773262 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea724c7700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c101990 0x7fea6c19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea714c5700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c100fd0 0x7fea6c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 -- 172.21.15.135:0/3785773262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c101990 msgr2=0x7fea6c19df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c101990 0x7fea6c19df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 -- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c100fd0 msgr2=0x7fea6c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c100fd0 0x7fea6c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:37.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 -- 172.21.15.135:0/3785773262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0095f0 con 0x7fea6c0ffe70 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea724c7700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c101990 0x7fea6c19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea71cc6700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c069520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00f740 tx=0x7fea5c00f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c01d070 con 0x7fea6c0ffe70 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea5c00fd40 con 0x7fea6c0ffe70 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c19eca0 con 0x7fea6c0ffe70 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c005720 con 0x7fea6c0ffe70 2023-10-05T15:11:37.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.768+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c19f140 con 0x7fea6c0ffe70 2023-10-05T15:11:37.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.769+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c10b620 con 0x7fea6c0ffe70 2023-10-05T15:11:37.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.771+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fea5c004800 con 0x7fea6c0ffe70 2023-10-05T15:11:37.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.771+0000 7fea62ffd700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fea580a1480 0x7fea580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:37.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.772+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fea5c0cd4f0 con 0x7fea6c0ffe70 2023-10-05T15:11:37.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.772+0000 7fea714c5700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fea580a1480 0x7fea580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:37.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.772+0000 7fea714c5700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fea580a1480 0x7fea580a3940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea68005fd0 tx=0x7fea6800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:11:37.777 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.775+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea5c097bb0 con 0x7fea6c0ffe70 2023-10-05T15:11:37.974 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:37.972+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fea6c0612f0 con 0x7fea580a1480 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi092 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] boot 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: osdmap e34: 5 total, 5 up, 5 in 2023-10-05T15:11:38.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:11:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:11:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi092 2023-10-05T15:11:38.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-05T15:11:38.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] boot 2023-10-05T15:11:38.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: osdmap e34: 5 total, 5 up, 5 in 2023-10-05T15:11:38.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi092 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: osd.4 [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] boot 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: osdmap e34: 5 total, 5 up, 5 in 2023-10-05T15:11:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:11:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:38 smithi135 ceph-mon[103360]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:38 smithi135 ceph-mon[103360]: osdmap e35: 5 total, 5 up, 5 in 2023-10-05T15:11:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:38 smithi135 ceph-mon[103360]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:11:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:38 smithi060 ceph-mon[99238]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:38 smithi060 ceph-mon[99238]: osdmap e35: 5 total, 5 up, 5 in 2023-10-05T15:11:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:38 smithi060 ceph-mon[99238]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:11:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:38 smithi092 ceph-mon[102944]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:11:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:38 smithi092 ceph-mon[102944]: osdmap e35: 5 total, 5 up, 5 in 2023-10-05T15:11:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:38 smithi092 ceph-mon[102944]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:11:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:39.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:39.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:41.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:40 smithi060 ceph-mon[99238]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:41.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:40 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/2344410523' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]: dispatch 2023-10-05T15:11:41.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:40 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]: dispatch 2023-10-05T15:11:41.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:40 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]': finished 2023-10-05T15:11:41.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:40 smithi060 ceph-mon[99238]: osdmap e36: 6 total, 5 up, 6 in 2023-10-05T15:11:41.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:40 smithi092 ceph-mon[102944]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:40 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/2344410523' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]: dispatch 2023-10-05T15:11:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:40 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]: dispatch 2023-10-05T15:11:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:40 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]': finished 2023-10-05T15:11:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:40 smithi092 ceph-mon[102944]: osdmap e36: 6 total, 5 up, 6 in 2023-10-05T15:11:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:40 smithi135 ceph-mon[103360]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:40 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/2344410523' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]: dispatch 2023-10-05T15:11:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:40 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]: dispatch 2023-10-05T15:11:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:40 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5967fc00-aa3b-4b43-ac63-4b5444cbf486"}]': finished 2023-10-05T15:11:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:40 smithi135 ceph-mon[103360]: osdmap e36: 6 total, 5 up, 6 in 2023-10-05T15:11:41.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:42.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:41 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/2015693410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:11:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:41 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/2015693410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:11:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:41 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/2015693410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:11:43.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:42 smithi060 ceph-mon[99238]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:42 smithi092 ceph-mon[102944]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:43.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:42 smithi135 ceph-mon[103360]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:45.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:44 smithi060 ceph-mon[99238]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:45.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:44 smithi135 ceph-mon[103360]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:45.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:44 smithi092 ceph-mon[102944]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:47.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:46 smithi135 ceph-mon[103360]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:47.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-05T15:11:47.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:47.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:46 smithi060 ceph-mon[99238]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-05T15:11:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:47.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:46 smithi092 ceph-mon[102944]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:47.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-05T15:11:47.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:48.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:47 smithi135 ceph-mon[103360]: Deploying daemon osd.5 on smithi135 2023-10-05T15:11:48.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:47 smithi060 ceph-mon[99238]: Deploying daemon osd.5 on smithi135 2023-10-05T15:11:48.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:47 smithi092 ceph-mon[102944]: Deploying daemon osd.5 on smithi135 2023-10-05T15:11:49.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:48 smithi135 ceph-mon[103360]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:49.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:48 smithi060 ceph-mon[99238]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:48 smithi092 ceph-mon[102944]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:51.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:50 smithi135 ceph-mon[103360]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:51.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:50 smithi060 ceph-mon[99238]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:51.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:50 smithi092 ceph-mon[102944]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:52 smithi135 ceph-mon[103360]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:52.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:52 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:52 smithi092 ceph-mon[102944]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:52 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:52.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:52 smithi060 ceph-mon[99238]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:52.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:52.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:52.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:52 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.838+0000 7fea62ffd700 1 -- 172.21.15.135:0/3785773262 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fea6c0612f0 con 0x7fea580a1480 2023-10-05T15:11:53.841 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2023-10-05T15:11:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fea580a1480 msgr2=0x7fea580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fea580a1480 0x7fea580a3940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea68005fd0 tx=0x7fea6800a560 comp rx=0 tx=0).stop 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 msgr2=0x7fea6c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c069520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00f740 tx=0x7fea5c00f820 comp rx=0 tx=0).stop 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 shutdown_connections 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea6c101990 0x7fea6c19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea6c0ffe70 0x7fea6c069520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fea580a1480 0x7fea580a3940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 --2- 172.21.15.135:0/3785773262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c100fd0 0x7fea6c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 >> 172.21.15.135:0/3785773262 conn(0x7fea6c0fb3f0 msgr2=0x7fea6c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 shutdown_connections 2023-10-05T15:11:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:11:53.841+0000 7fea73f2a700 1 -- 172.21.15.135:0/3785773262 wait complete. 2023-10-05T15:11:54.362 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-05T15:11:54.364 INFO:tasks.cephadm:Deploying osd.6 on smithi060 with /dev/vg_nvme/lv_2... 2023-10-05T15:11:54.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-05T15:11:54.410 INFO:journalctl@ceph.osd.5.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:54.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:11:54.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:54.956 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:11:55.415 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:11:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:11:55.133+0000 7f873bae8640 -1 osd.5 0 log_to_monitors true 2023-10-05T15:11:55.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:55 smithi135 ceph-mon[103360]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:11:55.857 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:55 smithi060 ceph-mon[99238]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:11:55.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:55 smithi092 ceph-mon[102944]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:11:56.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:56 smithi060 ceph-mon[99238]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:56 smithi060 ceph-mon[99238]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-05T15:11:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:56 smithi060 ceph-mon[99238]: osdmap e37: 6 total, 5 up, 6 in 2023-10-05T15:11:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:56 smithi060 ceph-mon[99238]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:11:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:56.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-mon[103360]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:56.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-mon[103360]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-05T15:11:56.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-mon[103360]: osdmap e37: 6 total, 5 up, 6 in 2023-10-05T15:11:56.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-mon[103360]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:11:56.787 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:56.788 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:11:56.517+0000 7f873115f700 -1 osd.5 0 waiting for initial osdmap 2023-10-05T15:11:56.788 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:11:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:11:56.526+0000 7f872b751700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:11:56.826 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-05T15:11:56.826 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-05T15:11:56.826 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-05T15:11:56.826 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-05T15:11:56.826 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133105 s, 788 MB/s 2023-10-05T15:11:56.826 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-05T15:11:56.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:56 smithi092 ceph-mon[102944]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:56.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:56 smithi092 ceph-mon[102944]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-05T15:11:56.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:56 smithi092 ceph-mon[102944]: osdmap e37: 6 total, 5 up, 6 in 2023-10-05T15:11:56.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:56 smithi092 ceph-mon[102944]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:11:56.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2023-10-05T15:11:57.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:11:57.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: osdmap e38: 6 total, 5 up, 6 in 2023-10-05T15:11:57.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: osdmap e38: 6 total, 5 up, 6 in 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:57.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:57.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:57.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:57 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:57.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:57.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:57.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:57.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:57 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: osdmap e38: 6 total, 5 up, 6 in 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:11:57.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:57.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:57.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:11:57.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:57 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:11:58.526 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:11:58.526 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:11:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:11:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:11:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi135 2023-10-05T15:11:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi135 to 8584M 2023-10-05T15:11:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] boot 2023-10-05T15:11:58.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: osdmap e39: 6 total, 6 up, 6 in 2023-10-05T15:11:58.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:58.891 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi135 2023-10-05T15:11:58.891 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi135 to 8584M 2023-10-05T15:11:58.891 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:58.891 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] boot 2023-10-05T15:11:58.891 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: osdmap e39: 6 total, 6 up, 6 in 2023-10-05T15:11:58.891 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:58.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:11:58.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:11:58.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi135 2023-10-05T15:11:58.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi135 to 8584M 2023-10-05T15:11:58.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:11:58.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: osd.5 [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] boot 2023-10-05T15:11:58.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: osdmap e39: 6 total, 6 up, 6 in 2023-10-05T15:11:58.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3359229982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae80ffe70 msgr2=0x7ffae8100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3359229982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae80ffe70 0x7ffae8100290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009990 tx=0x7ffae4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3359229982 shutdown_connections 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3359229982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8101990 0x7ffae81082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3359229982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae80ffe70 0x7ffae8100290 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3359229982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae8100fd0 0x7ffae8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3359229982 >> 172.21.15.60:0/3359229982 conn(0x7ffae80fb3f0 msgr2=0x7ffae80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:11:59.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3359229982 shutdown_connections 2023-10-05T15:11:59.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.225+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3359229982 wait complete. 2023-10-05T15:11:59.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 Processor -- start 2023-10-05T15:11:59.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 -- start start 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae80ffe70 0x7ffae8196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae8100fd0 0x7ffae8197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 0x7ffae819e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae819e770 con 0x7ffae8101990 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae819e8b0 con 0x7ffae8100fd0 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.226+0000 7ffaf05e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae819ea70 con 0x7ffae80ffe70 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 0x7ffae819e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:59.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 0x7ffae819e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35162/0 (socket says 172.21.15.60:35162) 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 -- 172.21.15.60:0/3884930644 learned_addr learned my addr 172.21.15.60:0/3884930644 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaedb7f700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae8100fd0 0x7ffae8197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaee380700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae80ffe70 0x7ffae8196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 -- 172.21.15.60:0/3884930644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae80ffe70 msgr2=0x7ffae8196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae80ffe70 0x7ffae8196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 -- 172.21.15.60:0/3884930644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae8100fd0 msgr2=0x7ffae8197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae8100fd0 0x7ffae8197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 -- 172.21.15.60:0/3884930644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae40095f0 con 0x7ffae8101990 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaeeb81700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 0x7ffae819e1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffae0007ee0 tx=0x7ffae000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:11:59.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0017070 con 0x7ffae8101990 2023-10-05T15:11:59.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae819ed50 con 0x7ffae8101990 2023-10-05T15:11:59.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffae000f040 con 0x7ffae8101990 2023-10-05T15:11:59.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0005580 con 0x7ffae8101990 2023-10-05T15:11:59.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.227+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae819f1a0 con 0x7ffae8101990 2023-10-05T15:11:59.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.228+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae8107ff0 con 0x7ffae8101990 2023-10-05T15:11:59.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.229+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ffae000db20 con 0x7ffae8101990 2023-10-05T15:11:59.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.230+0000 7ffadf7fe700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffad40a1480 0x7ffad40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:11:59.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.230+0000 7ffaee380700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffad40a1480 0x7ffad40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:11:59.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.230+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4562+0+0 (secure 0 0 0) 0x7ffae00cbc30 con 0x7ffae8101990 2023-10-05T15:11:59.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.231+0000 7ffaee380700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffad40a1480 0x7ffad40a3940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffae8198100 tx=0x7ffae4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:11:59.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.234+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffae0096130 con 0x7ffae8101990 2023-10-05T15:11:59.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:11:59.444+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffae802d350 con 0x7ffad40a1480 2023-10-05T15:11:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:59 smithi135 ceph-mon[103360]: osdmap e40: 6 total, 6 up, 6 in 2023-10-05T15:11:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:59 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:59 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:11:59 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:59.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:59 smithi060 ceph-mon[99238]: osdmap e40: 6 total, 6 up, 6 in 2023-10-05T15:11:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:59 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:59 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:11:59 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:11:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:59 smithi092 ceph-mon[102944]: osdmap e40: 6 total, 6 up, 6 in 2023-10-05T15:11:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:59 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:11:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:59 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:11:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:11:59 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:00.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:00 smithi060 ceph-mon[99238]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:00 smithi060 ceph-mon[99238]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:00 smithi060 ceph-mon[99238]: osdmap e41: 6 total, 6 up, 6 in 2023-10-05T15:12:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:00 smithi135 ceph-mon[103360]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:00 smithi135 ceph-mon[103360]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:00 smithi135 ceph-mon[103360]: osdmap e41: 6 total, 6 up, 6 in 2023-10-05T15:12:00.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:00 smithi092 ceph-mon[102944]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:00.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:00 smithi092 ceph-mon[102944]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:00.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:00 smithi092 ceph-mon[102944]: osdmap e41: 6 total, 6 up, 6 in 2023-10-05T15:12:01.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:01 smithi060 ceph-mon[99238]: osdmap e42: 6 total, 6 up, 6 in 2023-10-05T15:12:01.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:01 smithi135 ceph-mon[103360]: osdmap e42: 6 total, 6 up, 6 in 2023-10-05T15:12:01.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:01 smithi092 ceph-mon[102944]: osdmap e42: 6 total, 6 up, 6 in 2023-10-05T15:12:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:02 smithi135 ceph-mon[103360]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:02 smithi135 ceph-mon[103360]: osdmap e43: 6 total, 6 up, 6 in 2023-10-05T15:12:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4053975831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acf54d89-6f62-4433-90cf-d1f90de08ca8"}]: dispatch 2023-10-05T15:12:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4053975831' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acf54d89-6f62-4433-90cf-d1f90de08ca8"}]': finished 2023-10-05T15:12:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:02 smithi135 ceph-mon[103360]: osdmap e44: 7 total, 6 up, 7 in 2023-10-05T15:12:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:02.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:02 smithi060 ceph-mon[99238]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:02.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:02 smithi060 ceph-mon[99238]: osdmap e43: 6 total, 6 up, 6 in 2023-10-05T15:12:02.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4053975831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acf54d89-6f62-4433-90cf-d1f90de08ca8"}]: dispatch 2023-10-05T15:12:02.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4053975831' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acf54d89-6f62-4433-90cf-d1f90de08ca8"}]': finished 2023-10-05T15:12:02.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:02 smithi060 ceph-mon[99238]: osdmap e44: 7 total, 6 up, 7 in 2023-10-05T15:12:02.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:02 smithi092 ceph-mon[102944]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:02 smithi092 ceph-mon[102944]: osdmap e43: 6 total, 6 up, 6 in 2023-10-05T15:12:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4053975831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acf54d89-6f62-4433-90cf-d1f90de08ca8"}]: dispatch 2023-10-05T15:12:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4053975831' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acf54d89-6f62-4433-90cf-d1f90de08ca8"}]': finished 2023-10-05T15:12:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:02 smithi092 ceph-mon[102944]: osdmap e44: 7 total, 6 up, 7 in 2023-10-05T15:12:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:03.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:03 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2514821762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:03.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:03 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2514821762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:03.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:03 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2514821762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:04.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:04 smithi135 ceph-mon[103360]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-05T15:12:04.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:04 smithi060 ceph-mon[99238]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-05T15:12:04.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:04 smithi092 ceph-mon[102944]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-05T15:12:07.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:06 smithi060 ceph-mon[99238]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2023-10-05T15:12:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:06 smithi135 ceph-mon[103360]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2023-10-05T15:12:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:06 smithi092 ceph-mon[102944]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2023-10-05T15:12:08.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:08 smithi060 ceph-mon[99238]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-10-05T15:12:08.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:08 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-05T15:12:08.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:08 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:09.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:08 smithi135 ceph-mon[103360]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-10-05T15:12:09.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:08 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-05T15:12:09.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:08 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:09.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:08 smithi092 ceph-mon[102944]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-10-05T15:12:09.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:08 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-05T15:12:09.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:08 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:09.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:09 smithi060 ceph-mon[99238]: Deploying daemon osd.6 on smithi060 2023-10-05T15:12:10.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:09 smithi135 ceph-mon[103360]: Deploying daemon osd.6 on smithi060 2023-10-05T15:12:10.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:09 smithi092 ceph-mon[102944]: Deploying daemon osd.6 on smithi060 2023-10-05T15:12:11.059 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:10 smithi060 ceph-mon[99238]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:12:11.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:10 smithi135 ceph-mon[103360]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:12:11.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:10 smithi092 ceph-mon[102944]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:12:13.066 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:12 smithi060 ceph-mon[99238]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-10-05T15:12:13.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:12 smithi135 ceph-mon[103360]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-10-05T15:12:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:12 smithi092 ceph-mon[102944]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-10-05T15:12:14.291 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:14 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:14.291 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:14 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:14.291 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:14 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:14.291 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:14 smithi060 ceph-mon[99238]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-05T15:12:14.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:14 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:14.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:14 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:14.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:14 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:14.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:14 smithi092 ceph-mon[102944]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-05T15:12:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:14 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:14 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:14 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:14 smithi135 ceph-mon[103360]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-05T15:12:15.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.751+0000 7ffadf7fe700 1 -- 172.21.15.60:0/3884930644 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffae802d350 con 0x7ffad40a1480 2023-10-05T15:12:15.753 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 6 on host 'smithi060' 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffad40a1480 msgr2=0x7ffad40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffad40a1480 0x7ffad40a3940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffae8198100 tx=0x7ffae4005960 comp rx=0 tx=0).stop 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 msgr2=0x7ffae819e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 0x7ffae819e1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffae0007ee0 tx=0x7ffae000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 shutdown_connections 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ffad40a1480 0x7ffad40a3940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8101990 0x7ffae819e1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae80ffe70 0x7ffae8196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 --2- 172.21.15.60:0/3884930644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae8100fd0 0x7ffae8197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 >> 172.21.15.60:0/3884930644 conn(0x7ffae80fb3f0 msgr2=0x7ffae80fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:12:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 shutdown_connections 2023-10-05T15:12:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:12:15.753+0000 7ffaf05e4700 1 -- 172.21.15.60:0/3884930644 wait complete. 2023-10-05T15:12:16.297 DEBUG:teuthology.orchestra.run.smithi060:osd.6> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-05T15:12:16.299 INFO:tasks.cephadm:Deploying osd.7 on smithi092 with /dev/vg_nvme/lv_2... 2023-10-05T15:12:16.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-05T15:12:16.335 INFO:journalctl@ceph.osd.6.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:12:16.876 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:12:17.015 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:16 smithi060 ceph-mon[99238]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:17.015 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.016 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.016 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.016 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:16 smithi135 ceph-mon[103360]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:17.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.090 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:16 smithi092 ceph-mon[102944]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:17.090 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.090 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.090 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.090 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:17.318 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:12:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:12:17.010+0000 7feb04ba2640 -1 osd.6 0 log_to_monitors true 2023-10-05T15:12:17.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:17 smithi060 ceph-mon[99238]: from='osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:12:17.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:17 smithi060 ceph-mon[99238]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:12:17.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:17 smithi092 ceph-mon[102944]: from='osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:12:17.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:17 smithi092 ceph-mon[102944]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:12:18.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:17 smithi135 ceph-mon[103360]: from='osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:12:18.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:17 smithi135 ceph-mon[103360]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:12:18.467 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-05T15:12:18.467 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-05T15:12:18.467 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-05T15:12:18.467 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-05T15:12:18.467 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126549 s, 829 MB/s 2023-10-05T15:12:18.467 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-05T15:12:18.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-mon[99238]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:18.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-mon[99238]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-05T15:12:18.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-mon[99238]: from='osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:12:18.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-mon[99238]: osdmap e45: 7 total, 6 up, 7 in 2023-10-05T15:12:18.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:18.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-mon[99238]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:12:18.919 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:18 smithi092 ceph-mon[102944]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:18.919 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:18 smithi092 ceph-mon[102944]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-05T15:12:18.919 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:18 smithi092 ceph-mon[102944]: from='osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:12:18.920 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:18 smithi092 ceph-mon[102944]: osdmap e45: 7 total, 6 up, 7 in 2023-10-05T15:12:18.920 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:18.920 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:18 smithi092 ceph-mon[102944]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:12:18.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2023-10-05T15:12:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:18 smithi135 ceph-mon[103360]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:18 smithi135 ceph-mon[103360]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-05T15:12:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:18 smithi135 ceph-mon[103360]: from='osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:12:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:18 smithi135 ceph-mon[103360]: osdmap e45: 7 total, 6 up, 7 in 2023-10-05T15:12:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:18 smithi135 ceph-mon[103360]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:12:19.164 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:12:18.747+0000 7feafa219700 -1 osd.6 0 waiting for initial osdmap 2023-10-05T15:12:19.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:12:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:12:18.759+0000 7feaf2006700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:12:19.478 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:12:20.017 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:12:20.017 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: osdmap e46: 7 total, 6 up, 7 in 2023-10-05T15:12:20.017 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:20.017 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:20.017 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi060 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi060 to 5724M 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.018 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:20.019 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:20.019 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:20.019 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:19 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:12:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: osdmap e46: 7 total, 6 up, 7 in 2023-10-05T15:12:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:20.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi060 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi060 to 5724M 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:20.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:20.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:20.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:20.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:19 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: osdmap e46: 7 total, 6 up, 7 in 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi060 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:20.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi060 to 5724M 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:20.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:19 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:20.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 -- 172.21.15.92:0/2535324556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101a10 msgr2=0x7f19b8108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:20.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 --2- 172.21.15.92:0/2535324556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101a10 0x7f19b8108330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b0a0 tx=0x7f19b000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:12:20.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 -- 172.21.15.92:0/2535324556 shutdown_connections 2023-10-05T15:12:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 --2- 172.21.15.92:0/2535324556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101a10 0x7f19b8108330 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 --2- 172.21.15.92:0/2535324556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ffe60 0x7f19b8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 --2- 172.21.15.92:0/2535324556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19b8101050 0x7f19b81014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 -- 172.21.15.92:0/2535324556 >> 172.21.15.92:0/2535324556 conn(0x7f19b80fb450 msgr2=0x7f19b80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:12:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 -- 172.21.15.92:0/2535324556 shutdown_connections 2023-10-05T15:12:20.802 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.798+0000 7f19bdceb700 1 -- 172.21.15.92:0/2535324556 wait complete. 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 Processor -- start 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 -- start start 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ffe60 0x7f19b8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 0x7f19b819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19b8101a10 0x7f19b819e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819e8e0 con 0x7f19b8101a10 2023-10-05T15:12:20.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819ea50 con 0x7f19b8101050 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19bdceb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819ec10 con 0x7f19b80ffe60 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19b6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 0x7f19b819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19b6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 0x7f19b819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38366/0 (socket says 172.21.15.92:38366) 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.799+0000 7f19b6ffd700 1 -- 172.21.15.92:0/1061176722 learned_addr learned my addr 172.21.15.92:0/1061176722 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b77fe700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ffe60 0x7f19b8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b7fff700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19b8101a10 0x7f19b819e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b6ffd700 1 -- 172.21.15.92:0/1061176722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ffe60 msgr2=0x7f19b8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b6ffd700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ffe60 0x7f19b8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b6ffd700 1 -- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19b8101a10 msgr2=0x7f19b819e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:20.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b6ffd700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19b8101a10 0x7f19b819e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b6ffd700 1 -- 172.21.15.92:0/1061176722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009d00 con 0x7f19b8101050 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b6ffd700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 0x7f19b819bb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00d980 tx=0x7f19ac00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac004020 con 0x7f19b8101050 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b819eef0 con 0x7f19b8101050 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19ac009730 con 0x7f19b8101050 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003a30 con 0x7f19b8101050 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.800+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b819f360 con 0x7f19b8101050 2023-10-05T15:12:20.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.801+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8106dd0 con 0x7f19b8101050 2023-10-05T15:12:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.802+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f19ac0098a0 con 0x7f19b8101050 2023-10-05T15:12:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.803+0000 7f19b4ff9700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19a00a1480 0x7f19a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.803+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f19ac0cbfe0 con 0x7f19b8101050 2023-10-05T15:12:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.803+0000 7f19b77fe700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19a00a1480 0x7f19a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:20.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.804+0000 7f19b77fe700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19a00a1480 0x7f19a00a3940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19b8100bc0 tx=0x7f19a800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:12:20.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:20.806+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f19ac096350 con 0x7f19b8101050 2023-10-05T15:12:20.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:20 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:12:20.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:20 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:12:20.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:20 smithi092 ceph-mon[102944]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:20.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:20 smithi092 ceph-mon[102944]: osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] boot 2023-10-05T15:12:20.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:20 smithi092 ceph-mon[102944]: osdmap e47: 7 total, 7 up, 7 in 2023-10-05T15:12:20.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:21.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:21.004+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b802d2f0 con 0x7f19a00a1480 2023-10-05T15:12:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:20 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:12:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:20 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:12:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:20 smithi135 ceph-mon[103360]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:20 smithi135 ceph-mon[103360]: osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] boot 2023-10-05T15:12:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:20 smithi135 ceph-mon[103360]: osdmap e47: 7 total, 7 up, 7 in 2023-10-05T15:12:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:21.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:20 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:12:21.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:20 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:12:21.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:20 smithi060 ceph-mon[99238]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:12:21.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:20 smithi060 ceph-mon[99238]: osd.6 [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] boot 2023-10-05T15:12:21.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:20 smithi060 ceph-mon[99238]: osdmap e47: 7 total, 7 up, 7 in 2023-10-05T15:12:21.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:12:22.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:21 smithi135 ceph-mon[103360]: osdmap e48: 7 total, 7 up, 7 in 2023-10-05T15:12:22.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:21 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:12:22.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:21 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:12:22.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:21 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:22.124 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:21 smithi092 ceph-mon[102944]: osdmap e48: 7 total, 7 up, 7 in 2023-10-05T15:12:22.124 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:21 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:12:22.124 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:21 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:12:22.124 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:21 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:22.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:21 smithi060 ceph-mon[99238]: osdmap e48: 7 total, 7 up, 7 in 2023-10-05T15:12:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:12:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:12:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:22 smithi092 ceph-mon[102944]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:22 smithi092 ceph-mon[102944]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:22 smithi135 ceph-mon[103360]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:22 smithi135 ceph-mon[103360]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:23.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:22 smithi060 ceph-mon[99238]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:22 smithi060 ceph-mon[99238]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:24.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:23 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/3851511659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]: dispatch 2023-10-05T15:12:24.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:23 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]: dispatch 2023-10-05T15:12:24.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:23 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]': finished 2023-10-05T15:12:24.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:23 smithi135 ceph-mon[103360]: osdmap e49: 8 total, 7 up, 8 in 2023-10-05T15:12:24.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:24.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:23 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/3851511659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]: dispatch 2023-10-05T15:12:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:23 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]: dispatch 2023-10-05T15:12:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:23 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]': finished 2023-10-05T15:12:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:23 smithi060 ceph-mon[99238]: osdmap e49: 8 total, 7 up, 8 in 2023-10-05T15:12:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:23 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/3851511659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]: dispatch 2023-10-05T15:12:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:23 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]: dispatch 2023-10-05T15:12:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:23 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "575cac22-a90b-42aa-9b1f-c2cd5fbd82e3"}]': finished 2023-10-05T15:12:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:23 smithi092 ceph-mon[102944]: osdmap e49: 8 total, 7 up, 8 in 2023-10-05T15:12:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:25.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:24 smithi135 ceph-mon[103360]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:25.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/2906162815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:25.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:24 smithi060 ceph-mon[99238]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:25.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:24 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/2906162815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:24 smithi092 ceph-mon[102944]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:24 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/2906162815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:27.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:26 smithi092 ceph-mon[102944]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:26 smithi135 ceph-mon[103360]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:27.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:26 smithi060 ceph-mon[99238]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:29.071 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:28 smithi092 ceph-mon[102944]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:29.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:28 smithi135 ceph-mon[103360]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:29.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:28 smithi060 ceph-mon[99238]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:30 smithi135 ceph-mon[103360]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-05T15:12:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:30 smithi135 ceph-mon[103360]: Deploying daemon osd.7 on smithi092 2023-10-05T15:12:31.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:30 smithi092 ceph-mon[102944]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:31.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-05T15:12:31.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:31.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:30 smithi092 ceph-mon[102944]: Deploying daemon osd.7 on smithi092 2023-10-05T15:12:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:30 smithi060 ceph-mon[99238]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-05T15:12:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:31.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:30 smithi060 ceph-mon[99238]: Deploying daemon osd.7 on smithi092 2023-10-05T15:12:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:32 smithi135 ceph-mon[103360]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:33.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:32 smithi060 ceph-mon[99238]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:32 smithi092 ceph-mon[102944]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:34 smithi135 ceph-mon[103360]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:35.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:34 smithi060 ceph-mon[99238]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:34 smithi092 ceph-mon[102944]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:36 smithi135 ceph-mon[103360]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:37.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:36 smithi092 ceph-mon[102944]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:37.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:36 smithi060 ceph-mon[99238]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:37.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.177+0000 7f19b4ff9700 1 -- 172.21.15.92:0/1061176722 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f19b802d2f0 con 0x7f19a00a1480 2023-10-05T15:12:37.178 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 7 on host 'smithi092' 2023-10-05T15:12:37.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19a00a1480 msgr2=0x7f19a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19a00a1480 0x7f19a00a3940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19b8100bc0 tx=0x7f19a800a380 comp rx=0 tx=0).stop 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 msgr2=0x7f19b819bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 0x7f19b819bb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00d980 tx=0x7f19ac00dc90 comp rx=0 tx=0).stop 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 shutdown_connections 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19a00a1480 0x7f19a00a3940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19b8101a10 0x7f19b819e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ffe60 0x7f19b8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 --2- 172.21.15.92:0/1061176722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101050 0x7f19b819bb00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:37.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 >> 172.21.15.92:0/1061176722 conn(0x7f19b80fb450 msgr2=0x7f19b80fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:12:37.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 shutdown_connections 2023-10-05T15:12:37.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:12:37.179+0000 7f19bdceb700 1 -- 172.21.15.92:0/1061176722 wait complete. 2023-10-05T15:12:37.654 DEBUG:teuthology.orchestra.run.smithi092:osd.7> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-05T15:12:37.657 INFO:tasks.cephadm:Deploying osd.8 on smithi135 with /dev/vg_nvme/lv_2... 2023-10-05T15:12:37.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-05T15:12:37.686 INFO:journalctl@ceph.osd.7.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:12:38.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:38.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:38.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:38.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:38.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.226 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:12:38.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:38.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:38.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:38.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:38.496 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:12:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:12:38.310+0000 7f26a914c640 -1 osd.7 0 log_to_monitors true 2023-10-05T15:12:38.995 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:38 smithi135 ceph-mon[103360]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:38.995 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:38 smithi135 ceph-mon[103360]: from='osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:12:38.995 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:38 smithi135 ceph-mon[103360]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:12:39.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:38 smithi060 ceph-mon[99238]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:39.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:38 smithi060 ceph-mon[99238]: from='osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:12:39.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:38 smithi060 ceph-mon[99238]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:12:39.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:38 smithi092 ceph-mon[102944]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:39.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:38 smithi092 ceph-mon[102944]: from='osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:12:39.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:38 smithi092 ceph-mon[102944]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:12:39.702 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-05T15:12:39.703 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-05T15:12:39.703 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-10-05T15:12:39.703 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-10-05T15:12:39.703 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110584 s, 948 MB/s 2023-10-05T15:12:39.703 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-10-05T15:12:40.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:39 smithi135 ceph-mon[103360]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-05T15:12:40.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:39 smithi135 ceph-mon[103360]: osdmap e50: 8 total, 7 up, 8 in 2023-10-05T15:12:40.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:39 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:40.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:39 smithi135 ceph-mon[103360]: from='osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:12:40.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:39 smithi135 ceph-mon[103360]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:12:40.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2023-10-05T15:12:40.176 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:12:39.966+0000 7f269e7c3700 -1 osd.7 0 waiting for initial osdmap 2023-10-05T15:12:40.176 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:12:39.975+0000 7f2697db3700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:12:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-mon[102944]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-05T15:12:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-mon[102944]: osdmap e50: 8 total, 7 up, 8 in 2023-10-05T15:12:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-mon[102944]: from='osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:12:40.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:39 smithi092 ceph-mon[102944]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:12:40.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:39 smithi060 ceph-mon[99238]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-05T15:12:40.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:39 smithi060 ceph-mon[99238]: osdmap e50: 8 total, 7 up, 8 in 2023-10-05T15:12:40.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:39 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:40.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:39 smithi060 ceph-mon[99238]: from='osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:12:40.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:39 smithi060 ceph-mon[99238]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:12:40.637 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: osdmap e51: 8 total, 7 up, 8 in 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] boot 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: osdmap e52: 8 total, 8 up, 8 in 2023-10-05T15:12:41.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: osdmap e51: 8 total, 7 up, 8 in 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] boot 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: osdmap e52: 8 total, 8 up, 8 in 2023-10-05T15:12:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:12:41.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:12:41.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: osdmap e51: 8 total, 7 up, 8 in 2023-10-05T15:12:41.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: osd.7 [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] boot 2023-10-05T15:12:41.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: osdmap e52: 8 total, 8 up, 8 in 2023-10-05T15:12:41.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:12:41.902 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 -- 172.21.15.135:0/1564582800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c101990 msgr2=0x7f358c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 --2- 172.21.15.135:0/1564582800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c101990 0x7f358c1082b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f358400b0a0 tx=0x7f358400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 -- 172.21.15.135:0/1564582800 shutdown_connections 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 --2- 172.21.15.135:0/1564582800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c101990 0x7f358c1082b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 --2- 172.21.15.135:0/1564582800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f358c0ffe70 0x7f358c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 --2- 172.21.15.135:0/1564582800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 -- 172.21.15.135:0/1564582800 >> 172.21.15.135:0/1564582800 conn(0x7f358c0fb3f0 msgr2=0x7f358c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 -- 172.21.15.135:0/1564582800 shutdown_connections 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.898+0000 7f359336a700 1 -- 172.21.15.135:0/1564582800 wait complete. 2023-10-05T15:12:41.903 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 Processor -- start 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 -- start start 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c0ffe70 0x7f358c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f358c101990 0x7f358c19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c19e870 con 0x7f358c0ffe70 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c19e9e0 con 0x7f358c101990 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f359336a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c19eba0 con 0x7f358c100fd0 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f3590905700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f3590905700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c19ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55014/0 (socket says 172.21.15.135:55014) 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.899+0000 7f3590905700 1 -- 172.21.15.135:0/2970289205 learned_addr learned my addr 172.21.15.135:0/2970289205 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3591106700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c0ffe70 0x7f358c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3591907700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f358c101990 0x7f358c19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3590905700 1 -- 172.21.15.135:0/2970289205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f358c101990 msgr2=0x7f358c19e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3590905700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f358c101990 0x7f358c19e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3590905700 1 -- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c0ffe70 msgr2=0x7f358c069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3590905700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c0ffe70 0x7f358c069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3590905700 1 -- 172.21.15.135:0/2970289205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009520 con 0x7f358c100fd0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f3590905700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c19ba80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f357c00eb30 tx=0x7f357c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c009880 con 0x7f358c100fd0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584009d00 con 0x7f358c100fd0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f357c0044e0 con 0x7f358c100fd0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c003e90 con 0x7f358c100fd0 2023-10-05T15:12:41.905 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.900+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c19f1e0 con 0x7f358c100fd0 2023-10-05T15:12:41.906 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.901+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c107420 con 0x7f358c100fd0 2023-10-05T15:12:41.906 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.902+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f357c004000 con 0x7f358c100fd0 2023-10-05T15:12:41.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.903+0000 7f35827fc700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35780a1480 0x7f35780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:12:41.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.903+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f357c014070 con 0x7f358c100fd0 2023-10-05T15:12:41.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.903+0000 7f3591106700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35780a1480 0x7f35780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:12:41.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.903+0000 7f3591106700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35780a1480 0x7f35780a3940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3588009c60 tx=0x7f3588009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:12:41.909 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:41.907+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f357c096800 con 0x7f358c100fd0 2023-10-05T15:12:42.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:42.105+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f358c02d2e0 con 0x7f35780a1480 2023-10-05T15:12:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:41 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:12:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:41 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:12:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:41 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi092 2023-10-05T15:12:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:41 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-05T15:12:42.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:41 smithi135 ceph-mon[103360]: osdmap e53: 8 total, 8 up, 8 in 2023-10-05T15:12:42.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:41 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:12:42.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:41 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:12:42.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:41 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi092 2023-10-05T15:12:42.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:41 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-05T15:12:42.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:41 smithi060 ceph-mon[99238]: osdmap e53: 8 total, 8 up, 8 in 2023-10-05T15:12:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:41 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:12:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:41 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:12:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:41 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi092 2023-10-05T15:12:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:41 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-05T15:12:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:41 smithi092 ceph-mon[102944]: osdmap e53: 8 total, 8 up, 8 in 2023-10-05T15:12:43.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:42 smithi135 ceph-mon[103360]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:43.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:12:43.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:12:43.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:43.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:42 smithi135 ceph-mon[103360]: osdmap e54: 8 total, 8 up, 8 in 2023-10-05T15:12:43.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:42 smithi060 ceph-mon[99238]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:43.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:12:43.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:12:43.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:43.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:42 smithi060 ceph-mon[99238]: osdmap e54: 8 total, 8 up, 8 in 2023-10-05T15:12:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:42 smithi092 ceph-mon[102944]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:12:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:12:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:42 smithi092 ceph-mon[102944]: osdmap e54: 8 total, 8 up, 8 in 2023-10-05T15:12:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:43 smithi135 ceph-mon[103360]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:44.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:43 smithi060 ceph-mon[99238]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:44.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:43 smithi092 ceph-mon[102944]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: osdmap e55: 8 total, 8 up, 8 in 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/297080777' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]: dispatch 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]: dispatch 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]': finished 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: osdmap e56: 9 total, 8 up, 9 in 2023-10-05T15:12:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:12:45.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:12:45 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:12:45.110+0000 7fce79155700 -1 calc_pg_upmaps abort due to max <= 0 2023-10-05T15:12:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: osdmap e55: 8 total, 8 up, 8 in 2023-10-05T15:12:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/297080777' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]: dispatch 2023-10-05T15:12:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]: dispatch 2023-10-05T15:12:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]': finished 2023-10-05T15:12:45.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: osdmap e56: 9 total, 8 up, 9 in 2023-10-05T15:12:45.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: osdmap e55: 8 total, 8 up, 8 in 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/297080777' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]: dispatch 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]: dispatch 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30b375fe-d15e-48c7-8154-3c1aeeaf4b93"}]': finished 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: osdmap e56: 9 total, 8 up, 9 in 2023-10-05T15:12:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:12:46.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:45 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/2123041220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:46.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:45 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/2123041220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:45 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/2123041220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:12:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:46 smithi135 ceph-mon[103360]: pgmap v166: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:47.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:46 smithi060 ceph-mon[99238]: pgmap v166: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:46 smithi092 ceph-mon[102944]: pgmap v166: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:49.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:48 smithi135 ceph-mon[103360]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:49.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:48 smithi060 ceph-mon[99238]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:49.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:48 smithi092 ceph-mon[102944]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:51.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:50 smithi135 ceph-mon[103360]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:51.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:50 smithi060 ceph-mon[99238]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:51.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:50 smithi092 ceph-mon[102944]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:52.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:51 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-05T15:12:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:51 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:52.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:51 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-05T15:12:52.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:51 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:51 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-05T15:12:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:51 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:12:53.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:52 smithi135 ceph-mon[103360]: Deploying daemon osd.8 on smithi135 2023-10-05T15:12:53.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:52 smithi135 ceph-mon[103360]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:53.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:52 smithi060 ceph-mon[99238]: Deploying daemon osd.8 on smithi135 2023-10-05T15:12:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:52 smithi060 ceph-mon[99238]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:52 smithi092 ceph-mon[102944]: Deploying daemon osd.8 on smithi135 2023-10-05T15:12:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:52 smithi092 ceph-mon[102944]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:55.299 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:54 smithi135 ceph-mon[103360]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:55.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:54 smithi060 ceph-mon[99238]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:55.425 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:54 smithi092 ceph-mon[102944]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:56.520 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:56 smithi135 ceph-mon[103360]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:56.520 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:56.520 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:56.520 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:56 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:56.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:56 smithi060 ceph-mon[99238]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:56 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:56 smithi092 ceph-mon[102944]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:56 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:12:58.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.121+0000 7f35827fc700 1 -- 172.21.15.135:0/2970289205 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f358c02d2e0 con 0x7f35780a1480 2023-10-05T15:12:58.123 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 8 on host 'smithi135' 2023-10-05T15:12:58.124 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35780a1480 msgr2=0x7f35780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35780a1480 0x7f35780a3940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3588009c60 tx=0x7f3588009260 comp rx=0 tx=0).stop 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 msgr2=0x7f358c19ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c19ba80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f357c00eb30 tx=0x7f357c00ee40 comp rx=0 tx=0).stop 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 shutdown_connections 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f358c101990 0x7f358c19e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35780a1480 0x7f35780a3940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f358c0ffe70 0x7f358c069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 --2- 172.21.15.135:0/2970289205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100fd0 0x7f358c19ba80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 >> 172.21.15.135:0/2970289205 conn(0x7f358c0fb3f0 msgr2=0x7f358c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 shutdown_connections 2023-10-05T15:12:58.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:12:58.123+0000 7f359336a700 1 -- 172.21.15.135:0/2970289205 wait complete. 2023-10-05T15:12:58.528 DEBUG:teuthology.orchestra.run.smithi135:osd.8> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-05T15:12:58.530 INFO:tasks.cephadm:Deploying osd.9 on smithi060 with /dev/vg_nvme/lv_1... 2023-10-05T15:12:58.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-05T15:12:58.553 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:58 smithi135 ceph-mon[103360]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:58.553 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.553 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.554 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.554 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:58 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.559 INFO:journalctl@ceph.osd.8.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:12:58.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:58 smithi060 ceph-mon[99238]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:58.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:58 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:58 smithi092 ceph-mon[102944]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:12:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:58 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:12:59.108 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:12:59.610 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:59 smithi060 ceph-mon[99238]: from='osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:12:59.610 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:12:59 smithi060 ceph-mon[99238]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:12:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:59 smithi092 ceph-mon[102944]: from='osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:12:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:12:59 smithi092 ceph-mon[102944]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:12:59.714 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:12:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:12:59.372+0000 7f4594dda640 -1 osd.8 0 log_to_monitors true 2023-10-05T15:12:59.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:59 smithi135 ceph-mon[103360]: from='osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:12:59.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:12:59 smithi135 ceph-mon[103360]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:13:00.598 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-05T15:13:00.599 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-05T15:13:00.599 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-05T15:13:00.599 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-05T15:13:00.599 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00801963 s, 1.3 GB/s 2023-10-05T15:13:00.599 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-05T15:13:00.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:00 smithi060 ceph-mon[99238]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:13:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:00 smithi060 ceph-mon[99238]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-05T15:13:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:00 smithi060 ceph-mon[99238]: osdmap e57: 9 total, 8 up, 9 in 2023-10-05T15:13:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:00 smithi060 ceph-mon[99238]: from='osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:13:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:00 smithi060 ceph-mon[99238]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:13:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:00 smithi092 ceph-mon[102944]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:13:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:00 smithi092 ceph-mon[102944]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-05T15:13:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:00 smithi092 ceph-mon[102944]: osdmap e57: 9 total, 8 up, 9 in 2023-10-05T15:13:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:00 smithi092 ceph-mon[102944]: from='osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:13:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:00 smithi092 ceph-mon[102944]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:13:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-mon[103360]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:13:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-mon[103360]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-05T15:13:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-mon[103360]: osdmap e57: 9 total, 8 up, 9 in 2023-10-05T15:13:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-mon[103360]: from='osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:13:00.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:00.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-mon[103360]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:13:00.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:13:00.409+0000 7f458a451700 -1 osd.8 0 waiting for initial osdmap 2023-10-05T15:13:00.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:13:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:13:00.421+0000 7f4584a43700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:13:01.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: osdmap e58: 9 total, 8 up, 9 in 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] boot 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: osdmap e59: 9 total, 9 up, 9 in 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:01.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:01 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.637 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:13:01.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: osdmap e58: 9 total, 8 up, 9 in 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] boot 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: osdmap e59: 9 total, 9 up, 9 in 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:01 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: osdmap e58: 9 total, 8 up, 9 in 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: osd.8 [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] boot 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: osdmap e59: 9 total, 9 up, 9 in 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:01.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:01 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:02.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi135 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi135 to 5722M 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:02.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:02 smithi060 ceph-mon[99238]: osdmap e60: 9 total, 9 up, 9 in 2023-10-05T15:13:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:13:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:13:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:13:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi135 2023-10-05T15:13:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi135 to 5722M 2023-10-05T15:13:02.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:02.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:02.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:02.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:02.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:02 smithi092 ceph-mon[102944]: osdmap e60: 9 total, 9 up, 9 in 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi135 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi135 to 5722M 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:02.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:02.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:02.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:02 smithi135 ceph-mon[103360]: osdmap e60: 9 total, 9 up, 9 in 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 -- 172.21.15.60:0/440747943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc0ffe70 msgr2=0x7f04dc100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 --2- 172.21.15.60:0/440747943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc0ffe70 0x7f04dc100290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009990 tx=0x7f04d0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 -- 172.21.15.60:0/440747943 shutdown_connections 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 --2- 172.21.15.60:0/440747943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04dc101990 0x7f04dc1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 --2- 172.21.15.60:0/440747943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc0ffe70 0x7f04dc100290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 --2- 172.21.15.60:0/440747943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc100fd0 0x7f04dc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:02.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 -- 172.21.15.60:0/440747943 >> 172.21.15.60:0/440747943 conn(0x7f04dc0fb3f0 msgr2=0x7f04dc0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 -- 172.21.15.60:0/440747943 shutdown_connections 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.950+0000 7f04e46e3700 1 -- 172.21.15.60:0/440747943 wait complete. 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 Processor -- start 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 -- start start 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc0ffe70 0x7f04dc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04dc100fd0 0x7f04dc19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 0x7f04dc19df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19e6c0 con 0x7f04dc101990 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19e830 con 0x7f04dc100fd0 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e46e3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19e9f0 con 0x7f04dc0ffe70 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 0x7f04dc19df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 0x7f04dc19df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35306/0 (socket says 172.21.15.60:35306) 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 -- 172.21.15.60:0/131495027 learned_addr learned my addr 172.21.15.60:0/131495027 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e247f700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc0ffe70 0x7f04dc069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e1c7e700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04dc100fd0 0x7f04dc19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 -- 172.21.15.60:0/131495027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc0ffe70 msgr2=0x7f04dc069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc0ffe70 0x7f04dc069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 -- 172.21.15.60:0/131495027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04dc100fd0 msgr2=0x7f04dc19b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.951+0000 7f04e2c80700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04dc100fd0 0x7f04dc19b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04e2c80700 1 -- 172.21.15.60:0/131495027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00095f0 con 0x7f04dc101990 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04e2c80700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 0x7f04dc19df20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04d4007ee0 tx=0x7f04d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4017070 con 0x7f04dc101990 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc19ecd0 con 0x7f04dc101990 2023-10-05T15:13:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04d400f040 con 0x7f04dc101990 2023-10-05T15:13:02.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4005740 con 0x7f04dc101990 2023-10-05T15:13:02.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.952+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc19f1d0 con 0x7f04dc101990 2023-10-05T15:13:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.953+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc10b680 con 0x7f04dc101990 2023-10-05T15:13:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.954+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f04d400dc60 con 0x7f04dc101990 2023-10-05T15:13:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.954+0000 7f04cf7fe700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04c80a1480 0x7f04c80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.955+0000 7f04e247f700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04c80a1480 0x7f04c80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.955+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f04d40cbbb0 con 0x7f04dc101990 2023-10-05T15:13:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.955+0000 7f04e247f700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04c80a1480 0x7f04c80a3940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04d000b5c0 tx=0x7f04d0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:13:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:02.959+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04d4095b00 con 0x7f04dc101990 2023-10-05T15:13:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:03.169+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f04dc0612f0 con 0x7f04c80a1480 2023-10-05T15:13:04.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:03 smithi135 ceph-mon[103360]: osdmap e61: 9 total, 9 up, 9 in 2023-10-05T15:13:04.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:03 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:04.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:03 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:04.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:03 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:04.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:03 smithi060 ceph-mon[99238]: osdmap e61: 9 total, 9 up, 9 in 2023-10-05T15:13:04.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:03 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:04.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:03 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:04.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:03 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:04.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:03 smithi092 ceph-mon[102944]: osdmap e61: 9 total, 9 up, 9 in 2023-10-05T15:13:04.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:03 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:04.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:03 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:04.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:03 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:04 smithi135 ceph-mon[103360]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:04 smithi135 ceph-mon[103360]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:05.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:04 smithi135 ceph-mon[103360]: osdmap e62: 9 total, 9 up, 9 in 2023-10-05T15:13:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:04 smithi060 ceph-mon[99238]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:04 smithi060 ceph-mon[99238]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:04 smithi060 ceph-mon[99238]: osdmap e62: 9 total, 9 up, 9 in 2023-10-05T15:13:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:04 smithi092 ceph-mon[102944]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:04 smithi092 ceph-mon[102944]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:05.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:04 smithi092 ceph-mon[102944]: osdmap e62: 9 total, 9 up, 9 in 2023-10-05T15:13:06.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:05 smithi135 ceph-mon[103360]: osdmap e63: 9 total, 9 up, 9 in 2023-10-05T15:13:06.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:05 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2501725748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "944c5503-34c9-4e9c-9429-fd03f0e9013b"}]: dispatch 2023-10-05T15:13:06.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:05 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2501725748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "944c5503-34c9-4e9c-9429-fd03f0e9013b"}]': finished 2023-10-05T15:13:06.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:05 smithi135 ceph-mon[103360]: osdmap e64: 10 total, 9 up, 10 in 2023-10-05T15:13:06.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:06.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:05 smithi060 ceph-mon[99238]: osdmap e63: 9 total, 9 up, 9 in 2023-10-05T15:13:06.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2501725748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "944c5503-34c9-4e9c-9429-fd03f0e9013b"}]: dispatch 2023-10-05T15:13:06.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2501725748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "944c5503-34c9-4e9c-9429-fd03f0e9013b"}]': finished 2023-10-05T15:13:06.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:05 smithi060 ceph-mon[99238]: osdmap e64: 10 total, 9 up, 10 in 2023-10-05T15:13:06.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:06.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:05 smithi092 ceph-mon[102944]: osdmap e63: 9 total, 9 up, 9 in 2023-10-05T15:13:06.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:05 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2501725748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "944c5503-34c9-4e9c-9429-fd03f0e9013b"}]: dispatch 2023-10-05T15:13:06.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:05 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2501725748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "944c5503-34c9-4e9c-9429-fd03f0e9013b"}]': finished 2023-10-05T15:13:06.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:05 smithi092 ceph-mon[102944]: osdmap e64: 10 total, 9 up, 10 in 2023-10-05T15:13:06.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:06 smithi135 ceph-mon[103360]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:07.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:06 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2721149584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:07.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:06 smithi060 ceph-mon[99238]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:07.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:06 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2721149584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:06 smithi092 ceph-mon[102944]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:07.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:06 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2721149584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:09.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:08 smithi135 ceph-mon[103360]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-05T15:13:09.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:08 smithi060 ceph-mon[99238]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-05T15:13:09.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:08 smithi092 ceph-mon[102944]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-05T15:13:11.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:10 smithi135 ceph-mon[103360]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:13:11.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:10 smithi060 ceph-mon[99238]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:13:11.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:10 smithi092 ceph-mon[102944]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:13:13.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:12 smithi135 ceph-mon[103360]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-05T15:13:13.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-05T15:13:13.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:12 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:13.141 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:12 smithi060 ceph-mon[99238]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-05T15:13:13.142 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-05T15:13:13.142 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:12 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:12 smithi092 ceph-mon[102944]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-05T15:13:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-05T15:13:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:12 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:14.027 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:13 smithi060 ceph-mon[99238]: Deploying daemon osd.9 on smithi060 2023-10-05T15:13:14.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:13 smithi092 ceph-mon[102944]: Deploying daemon osd.9 on smithi060 2023-10-05T15:13:14.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:13 smithi135 ceph-mon[103360]: Deploying daemon osd.9 on smithi060 2023-10-05T15:13:15.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:14 smithi060 ceph-mon[99238]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:13:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:14 smithi092 ceph-mon[102944]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:13:15.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:14 smithi135 ceph-mon[103360]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:13:17.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:16 smithi060 ceph-mon[99238]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:13:17.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:17.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:17.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:16 smithi092 ceph-mon[102944]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:13:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:16 smithi135 ceph-mon[103360]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:13:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:18.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:18 smithi060 ceph-mon[99238]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-05T15:13:19.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:18 smithi092 ceph-mon[102944]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-05T15:13:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:18 smithi135 ceph-mon[103360]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-05T15:13:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.576+0000 7f04cf7fe700 1 -- 172.21.15.60:0/131495027 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f04dc0612f0 con 0x7f04c80a1480 2023-10-05T15:13:19.579 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 9 on host 'smithi060' 2023-10-05T15:13:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.578+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04c80a1480 msgr2=0x7f04c80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.578+0000 7f04e46e3700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04c80a1480 0x7f04c80a3940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04d000b5c0 tx=0x7f04d0005960 comp rx=0 tx=0).stop 2023-10-05T15:13:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 msgr2=0x7f04dc19df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 0x7f04dc19df20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04d4007ee0 tx=0x7f04d400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:13:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 shutdown_connections 2023-10-05T15:13:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04c80a1480 0x7f04c80a3940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04dc101990 0x7f04dc19df20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc0ffe70 0x7f04dc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 --2- 172.21.15.60:0/131495027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04dc100fd0 0x7f04dc19b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 >> 172.21.15.60:0/131495027 conn(0x7f04dc0fb3f0 msgr2=0x7f04dc0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:13:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 shutdown_connections 2023-10-05T15:13:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:13:19.579+0000 7f04e46e3700 1 -- 172.21.15.60:0/131495027 wait complete. 2023-10-05T15:13:20.023 DEBUG:teuthology.orchestra.run.smithi060:osd.9> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-05T15:13:20.025 INFO:tasks.cephadm:Deploying osd.10 on smithi092 with /dev/vg_nvme/lv_1... 2023-10-05T15:13:20.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-05T15:13:20.055 INFO:journalctl@ceph.osd.9.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.381 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:20.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:20.590 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:13:20.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:13:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:13:20.616+0000 7f721a4e7640 -1 osd.9 0 log_to_monitors true 2023-10-05T15:13:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:21 smithi092 ceph-mon[102944]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:13:21.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:21 smithi135 ceph-mon[103360]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:13:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:21 smithi060 ceph-mon[99238]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:13:22.101 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-05T15:13:22.101 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-05T15:13:22.101 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-05T15:13:22.101 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-05T15:13:22.101 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011147 s, 941 MB/s 2023-10-05T15:13:22.101 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-05T15:13:22.414 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:13:22.276+0000 7f720fb5e700 -1 osd.9 0 waiting for initial osdmap 2023-10-05T15:13:22.415 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:13:22.287+0000 7f720a150700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:13:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-mon[99238]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-mon[99238]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-05T15:13:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-mon[99238]: osdmap e65: 10 total, 9 up, 10 in 2023-10-05T15:13:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-mon[99238]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:13:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:22 smithi092 ceph-mon[102944]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:22 smithi092 ceph-mon[102944]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-05T15:13:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:22 smithi092 ceph-mon[102944]: osdmap e65: 10 total, 9 up, 10 in 2023-10-05T15:13:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:22 smithi092 ceph-mon[102944]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:13:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:22.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2023-10-05T15:13:22.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:22 smithi135 ceph-mon[103360]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:22.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:22 smithi135 ceph-mon[103360]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-05T15:13:22.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:22 smithi135 ceph-mon[103360]: osdmap e65: 10 total, 9 up, 10 in 2023-10-05T15:13:22.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:22 smithi135 ceph-mon[103360]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-05T15:13:22.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.091 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:13:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:13:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: osdmap e66: 10 total, 9 up, 10 in 2023-10-05T15:13:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi060 2023-10-05T15:13:23.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi060 to 4293M 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:23.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: osdmap e66: 10 total, 9 up, 10 in 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi060 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi060 to 4293M 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:23.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: osdmap e66: 10 total, 9 up, 10 in 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi060 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi060 to 4293M 2023-10-05T15:13:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 -- 172.21.15.92:0/484303885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b40ffe70 msgr2=0x7f24b4100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 --2- 172.21.15.92:0/484303885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b40ffe70 0x7f24b4100290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009990 tx=0x7f24a8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 -- 172.21.15.92:0/484303885 shutdown_connections 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 --2- 172.21.15.92:0/484303885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b4101990 0x7f24b41082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 --2- 172.21.15.92:0/484303885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b40ffe70 0x7f24b4100290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 --2- 172.21.15.92:0/484303885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b4100fd0 0x7f24b4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 -- 172.21.15.92:0/484303885 >> 172.21.15.92:0/484303885 conn(0x7f24b40fb3f0 msgr2=0x7f24b40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:13:24.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 -- 172.21.15.92:0/484303885 shutdown_connections 2023-10-05T15:13:24.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.451+0000 7f24ba643700 1 -- 172.21.15.92:0/484303885 wait complete. 2023-10-05T15:13:24.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 Processor -- start 2023-10-05T15:13:24.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 -- start start 2023-10-05T15:13:24.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40ffe70 0x7f24b4069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 0x7f24b419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b4101990 0x7f24b419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b419e7d0 con 0x7f24b40ffe70 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b419e940 con 0x7f24b4100fd0 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24ba643700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b419eb00 con 0x7f24b4101990 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 0x7f24b419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 0x7f24b419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38520/0 (socket says 172.21.15.92:38520) 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.452+0000 7f24b37fe700 1 -- 172.21.15.92:0/1142674737 learned_addr learned my addr 172.21.15.92:0/1142674737 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b3fff700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40ffe70 0x7f24b4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b8be0700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b4101990 0x7f24b419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:24.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b37fe700 1 -- 172.21.15.92:0/1142674737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b4101990 msgr2=0x7f24b419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b37fe700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b4101990 0x7f24b419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b37fe700 1 -- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40ffe70 msgr2=0x7f24b4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b37fe700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40ffe70 0x7f24b4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b37fe700 1 -- 172.21.15.92:0/1142674737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80095f0 con 0x7f24b4100fd0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b3fff700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40ffe70 0x7f24b4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b37fe700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 0x7f24b419b9a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b530 tx=0x7f24a400b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4011830 con 0x7f24b4100fd0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b419ede0 con 0x7f24b4100fd0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24a4011e50 con 0x7f24b4100fd0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400f2e0 con 0x7f24b4100fd0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.453+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b419f2e0 con 0x7f24b4100fd0 2023-10-05T15:13:24.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.454+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b4107480 con 0x7f24b4100fd0 2023-10-05T15:13:24.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.455+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f24a4010580 con 0x7f24b4100fd0 2023-10-05T15:13:24.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.456+0000 7f24b17fa700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f249c0a1500 0x7f249c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:24.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.456+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f24a40cc0f0 con 0x7f24b4100fd0 2023-10-05T15:13:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.456+0000 7f24b3fff700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f249c0a1500 0x7f249c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.456+0000 7f24b3fff700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f249c0a1500 0x7f249c0a39c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f24a8006010 tx=0x7f24a800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:13:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.460+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f24a4095eb0 con 0x7f24b4100fd0 2023-10-05T15:13:24.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:24 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:13:24.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:24 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:13:24.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:24 smithi135 ceph-mon[103360]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:24.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:24 smithi135 ceph-mon[103360]: osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] boot 2023-10-05T15:13:24.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:24 smithi135 ceph-mon[103360]: osdmap e67: 10 total, 10 up, 10 in 2023-10-05T15:13:24.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:24.658+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f24b402d2b0 con 0x7f249c0a1500 2023-10-05T15:13:24.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:24 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:13:24.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:24 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:13:24.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:24 smithi060 ceph-mon[99238]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:24.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:24 smithi060 ceph-mon[99238]: osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] boot 2023-10-05T15:13:24.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:24 smithi060 ceph-mon[99238]: osdmap e67: 10 total, 10 up, 10 in 2023-10-05T15:13:24.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:24.675 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:24 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:13:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:24 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:13:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:24 smithi092 ceph-mon[102944]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:13:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:24 smithi092 ceph-mon[102944]: osd.9 [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] boot 2023-10-05T15:13:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:24 smithi092 ceph-mon[102944]: osdmap e67: 10 total, 10 up, 10 in 2023-10-05T15:13:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:13:25.777 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:25 smithi092 ceph-mon[102944]: osdmap e68: 10 total, 10 up, 10 in 2023-10-05T15:13:25.777 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:25 smithi092 ceph-mon[102944]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:25.777 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:25 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:25.777 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:25 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:25.777 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:25 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:25.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:25 smithi135 ceph-mon[103360]: osdmap e68: 10 total, 10 up, 10 in 2023-10-05T15:13:25.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:25 smithi135 ceph-mon[103360]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:25.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:25 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:25.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:25 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:25.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:25 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:25.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:25 smithi060 ceph-mon[99238]: osdmap e68: 10 total, 10 up, 10 in 2023-10-05T15:13:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:25 smithi060 ceph-mon[99238]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:25 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:25 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:25 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:27.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:26 smithi135 ceph-mon[103360]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:27.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:26 smithi060 ceph-mon[99238]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:27.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:26 smithi092 ceph-mon[102944]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:28.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:27 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/1032973088' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]: dispatch 2023-10-05T15:13:28.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:27 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]: dispatch 2023-10-05T15:13:28.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:27 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]': finished 2023-10-05T15:13:28.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:27 smithi135 ceph-mon[103360]: osdmap e69: 11 total, 10 up, 11 in 2023-10-05T15:13:28.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:28.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:27 smithi135 ceph-mon[103360]: from='client.? 172.21.15.92:0/2399580491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:28.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:27 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/1032973088' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]: dispatch 2023-10-05T15:13:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:27 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]: dispatch 2023-10-05T15:13:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:27 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]': finished 2023-10-05T15:13:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:27 smithi060 ceph-mon[99238]: osdmap e69: 11 total, 10 up, 11 in 2023-10-05T15:13:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:27 smithi060 ceph-mon[99238]: from='client.? 172.21.15.92:0/2399580491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:27 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/1032973088' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]: dispatch 2023-10-05T15:13:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:27 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]: dispatch 2023-10-05T15:13:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:27 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7809fa8d-bdd5-4fe7-8057-6ac9f82a8381"}]': finished 2023-10-05T15:13:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:27 smithi092 ceph-mon[102944]: osdmap e69: 11 total, 10 up, 11 in 2023-10-05T15:13:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:27 smithi092 ceph-mon[102944]: from='client.? 172.21.15.92:0/2399580491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:29.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:28 smithi135 ceph-mon[103360]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:29.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:28 smithi060 ceph-mon[99238]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:29.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:28 smithi092 ceph-mon[102944]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:31.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:30 smithi135 ceph-mon[103360]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:31.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:30 smithi060 ceph-mon[99238]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:31.167 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:30 smithi092 ceph-mon[102944]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:33.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:32 smithi135 ceph-mon[103360]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:33.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:32 smithi060 ceph-mon[99238]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:32 smithi092 ceph-mon[102944]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:33.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-05T15:13:33.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:33 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:34.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-05T15:13:34.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:33 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:34.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-05T15:13:34.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:33 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:34.914 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:34 smithi092 ceph-mon[102944]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:34.914 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:34 smithi092 ceph-mon[102944]: Deploying daemon osd.10 on smithi092 2023-10-05T15:13:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:34 smithi135 ceph-mon[103360]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:35.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:34 smithi135 ceph-mon[103360]: Deploying daemon osd.10 on smithi092 2023-10-05T15:13:35.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:34 smithi060 ceph-mon[99238]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:35.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:34 smithi060 ceph-mon[99238]: Deploying daemon osd.10 on smithi092 2023-10-05T15:13:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:36 smithi135 ceph-mon[103360]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:37.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:36 smithi060 ceph-mon[99238]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:37.168 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:36 smithi092 ceph-mon[102944]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:38.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:38 smithi092 ceph-mon[102944]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:38.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:38.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:38.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:38 smithi135 ceph-mon[103360]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:39.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:38 smithi060 ceph-mon[99238]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:39.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:40.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.872+0000 7f24b17fa700 1 -- 172.21.15.92:0/1142674737 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f24b402d2b0 con 0x7f249c0a1500 2023-10-05T15:13:40.875 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 10 on host 'smithi092' 2023-10-05T15:13:40.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f249c0a1500 msgr2=0x7f249c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:40.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f249c0a1500 0x7f249c0a39c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f24a8006010 tx=0x7f24a800b540 comp rx=0 tx=0).stop 2023-10-05T15:13:40.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 msgr2=0x7f24b419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:40.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 0x7f24b419b9a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b530 tx=0x7f24a400b8f0 comp rx=0 tx=0).stop 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 shutdown_connections 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b4101990 0x7f24b419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f249c0a1500 0x7f249c0a39c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40ffe70 0x7f24b4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 --2- 172.21.15.92:0/1142674737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b4100fd0 0x7f24b419b9a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 >> 172.21.15.92:0/1142674737 conn(0x7f24b40fb3f0 msgr2=0x7f24b41045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 shutdown_connections 2023-10-05T15:13:40.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-05T15:13:40.875+0000 7f24ba643700 1 -- 172.21.15.92:0/1142674737 wait complete. 2023-10-05T15:13:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:40 smithi135 ceph-mon[103360]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:41.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:40 smithi060 ceph-mon[99238]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:41.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:40 smithi092 ceph-mon[102944]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:41.284 DEBUG:teuthology.orchestra.run.smithi092:osd.10> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-05T15:13:41.286 INFO:tasks.cephadm:Deploying osd.11 on smithi135 with /dev/vg_nvme/lv_1... 2023-10-05T15:13:41.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-05T15:13:41.315 INFO:journalctl@ceph.osd.10.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:13:41.852 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:13:42.111 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:41 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.111 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:41 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.111 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:41 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.112 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:41 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:41 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:41 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:41 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:41 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:41 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:41 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:41 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:41 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:42.449 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:13:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:13:42.209+0000 7f8b0b1e1640 -1 osd.10 0 log_to_monitors true 2023-10-05T15:13:42.986 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:42 smithi135 ceph-mon[103360]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:42.986 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:42 smithi135 ceph-mon[103360]: from='osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:13:42.986 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:42 smithi135 ceph-mon[103360]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:13:43.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:42 smithi060 ceph-mon[99238]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:43.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:42 smithi060 ceph-mon[99238]: from='osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:13:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:42 smithi060 ceph-mon[99238]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:13:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:42 smithi092 ceph-mon[102944]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:42 smithi092 ceph-mon[102944]: from='osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:13:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:42 smithi092 ceph-mon[102944]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:13:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-05T15:13:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-05T15:13:43.476 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-10-05T15:13:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-10-05T15:13:43.477 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126989 s, 826 MB/s 2023-10-05T15:13:43.477 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-10-05T15:13:44.008 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2023-10-05T15:13:44.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:13:44.049+0000 7f8b00858700 -1 osd.10 0 waiting for initial osdmap 2023-10-05T15:13:44.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:13:44.061+0000 7f8af8e46700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:13:44.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: osdmap e70: 11 total, 10 up, 11 in 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi092 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-05T15:13:44.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:44.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:44.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:44 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: osdmap e70: 11 total, 10 up, 11 in 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi092 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:44.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:44 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: osdmap e70: 11 total, 10 up, 11 in 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi092 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:44.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:44 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:44.568 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:13:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:13:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: osdmap e71: 11 total, 10 up, 11 in 2023-10-05T15:13:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:45.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:45 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:45.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: osdmap e71: 11 total, 10 up, 11 in 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:45.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:45 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: osdmap e71: 11 total, 10 up, 11 in 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:13:45.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:45 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 -- 172.21.15.135:0/43133837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8300ffe70 msgr2=0x7ff830100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 --2- 172.21.15.135:0/43133837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8300ffe70 0x7ff830100290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff824009990 tx=0x7ff824009ca0 comp rx=0 tx=0).stop 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 -- 172.21.15.135:0/43133837 shutdown_connections 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 --2- 172.21.15.135:0/43133837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 0x7ff8301082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 --2- 172.21.15.135:0/43133837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8300ffe70 0x7ff830100290 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 --2- 172.21.15.135:0/43133837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff830100fd0 0x7ff830101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 -- 172.21.15.135:0/43133837 >> 172.21.15.135:0/43133837 conn(0x7ff8300fb3f0 msgr2=0x7ff8300fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:13:45.907 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 -- 172.21.15.135:0/43133837 shutdown_connections 2023-10-05T15:13:45.908 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.905+0000 7ff836a35700 1 -- 172.21.15.135:0/43133837 wait complete. 2023-10-05T15:13:45.908 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 Processor -- start 2023-10-05T15:13:45.908 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 -- start start 2023-10-05T15:13:45.909 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8300ffe70 0x7ff830195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:45.909 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 0x7ff830196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 0x7ff83019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83019d6c0 con 0x7ff8300ffe70 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300689a0 con 0x7ff830101990 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff836a35700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830068b60 con 0x7ff830100fd0 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 0x7ff830196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 0x7ff830196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55160/0 (socket says 172.21.15.135:55160) 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 -- 172.21.15.135:0/2251180746 learned_addr learned my addr 172.21.15.135:0/2251180746 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82ffff700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8300ffe70 0x7ff830195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff834fd2700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 0x7ff83019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 -- 172.21.15.135:0/2251180746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 msgr2=0x7ff83019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 0x7ff83019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 -- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8300ffe70 msgr2=0x7ff830195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8300ffe70 0x7ff830195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82f7fe700 1 -- 172.21.15.135:0/2251180746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240095f0 con 0x7ff830100fd0 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff834fd2700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 0x7ff83019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.906+0000 7ff82ffff700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8300ffe70 0x7ff830195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.907+0000 7ff82f7fe700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 0x7ff830196070 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c920 tx=0x7ff82000cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.907+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820007b00 con 0x7ff830100fd0 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.907+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff820004cf0 con 0x7ff830100fd0 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.907+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff830068e40 con 0x7ff830100fd0 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.907+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820005610 con 0x7ff830100fd0 2023-10-05T15:13:45.911 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.907+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff830069390 con 0x7ff830100fd0 2023-10-05T15:13:45.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.908+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff830107460 con 0x7ff830100fd0 2023-10-05T15:13:45.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.909+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff820004750 con 0x7ff830100fd0 2023-10-05T15:13:45.912 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.909+0000 7ff82d7fa700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff8180a1500 0x7ff8180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:13:45.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.909+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6723+0+0 (secure 0 0 0) 0x7ff8200cc620 con 0x7ff830100fd0 2023-10-05T15:13:45.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.909+0000 7ff82ffff700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff8180a1500 0x7ff8180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:13:45.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.910+0000 7ff82ffff700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff8180a1500 0x7ff8180a39c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff824006010 tx=0x7ff82400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:13:45.914 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:45.913+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff820096330 con 0x7ff830100fd0 2023-10-05T15:13:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:13:46.115+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff830069810 con 0x7ff8180a1500 2023-10-05T15:13:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:13:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:13:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] boot 2023-10-05T15:13:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: osdmap e72: 11 total, 11 up, 11 in 2023-10-05T15:13:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:46.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:46 smithi135 ceph-mon[103360]: osdmap e73: 11 total, 11 up, 11 in 2023-10-05T15:13:46.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:13:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:13:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] boot 2023-10-05T15:13:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: osdmap e72: 11 total, 11 up, 11 in 2023-10-05T15:13:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:46.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:46 smithi060 ceph-mon[99238]: osdmap e73: 11 total, 11 up, 11 in 2023-10-05T15:13:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:13:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:13:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: osd.10 [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] boot 2023-10-05T15:13:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: osdmap e72: 11 total, 11 up, 11 in 2023-10-05T15:13:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:13:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:13:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:46 smithi092 ceph-mon[102944]: osdmap e73: 11 total, 11 up, 11 in 2023-10-05T15:13:47.228 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:47 smithi135 ceph-mon[103360]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:47.228 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:47.228 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:47.229 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:47.229 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:47 smithi135 ceph-mon[103360]: osdmap e74: 11 total, 11 up, 11 in 2023-10-05T15:13:47.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:47 smithi060 ceph-mon[99238]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:47.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:47 smithi060 ceph-mon[99238]: osdmap e74: 11 total, 11 up, 11 in 2023-10-05T15:13:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:47 smithi092 ceph-mon[102944]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:13:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:13:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:13:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:47 smithi092 ceph-mon[102944]: osdmap e74: 11 total, 11 up, 11 in 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: osdmap e75: 11 total, 11 up, 11 in 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/2812221147' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]: dispatch 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]: dispatch 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]': finished 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: osdmap e76: 12 total, 11 up, 12 in 2023-10-05T15:13:49.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:13:49.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:13:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: osdmap e75: 11 total, 11 up, 11 in 2023-10-05T15:13:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/2812221147' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]: dispatch 2023-10-05T15:13:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]: dispatch 2023-10-05T15:13:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]': finished 2023-10-05T15:13:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: osdmap e76: 12 total, 11 up, 12 in 2023-10-05T15:13:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: osdmap e75: 11 total, 11 up, 11 in 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/2812221147' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]: dispatch 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]: dispatch 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b44347aa-119e-4c10-a5c7-56ae0b781fbc"}]': finished 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: osdmap e76: 12 total, 11 up, 12 in 2023-10-05T15:13:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:13:50.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:49 smithi135 ceph-mon[103360]: from='client.? 172.21.15.135:0/3642982619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:50.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:49 smithi060 ceph-mon[99238]: from='client.? 172.21.15.135:0/3642982619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:50.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:49 smithi092 ceph-mon[102944]: from='client.? 172.21.15.135:0/3642982619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:13:51.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:50 smithi135 ceph-mon[103360]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:13:51.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:50 smithi060 ceph-mon[99238]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:13:51.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:50 smithi092 ceph-mon[102944]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:13:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:52 smithi135 ceph-mon[103360]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-05T15:13:53.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:52 smithi060 ceph-mon[99238]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-05T15:13:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:52 smithi092 ceph-mon[102944]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-05T15:13:54.958 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:54 smithi135 ceph-mon[103360]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-05T15:13:55.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:54 smithi060 ceph-mon[99238]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-05T15:13:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:54 smithi092 ceph-mon[102944]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-05T15:13:56.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:55 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-05T15:13:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:55 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:55 smithi060 ceph-mon[99238]: Deploying daemon osd.11 on smithi135 2023-10-05T15:13:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:55 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-05T15:13:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:55 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:55 smithi092 ceph-mon[102944]: Deploying daemon osd.11 on smithi135 2023-10-05T15:13:56.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:55 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-05T15:13:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:55 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:13:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:55 smithi135 ceph-mon[103360]: Deploying daemon osd.11 on smithi135 2023-10-05T15:13:57.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:56 smithi135 ceph-mon[103360]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:13:57.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:56 smithi060 ceph-mon[99238]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:13:57.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:56 smithi092 ceph-mon[102944]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:13:59.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:13:58 smithi060 ceph-mon[99238]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-05T15:13:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:13:58 smithi092 ceph-mon[102944]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-05T15:13:59.181 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:13:58 smithi135 ceph-mon[103360]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-05T15:14:00.496 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:00 smithi135 ceph-mon[103360]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-10-05T15:14:00.496 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:00.497 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:00.497 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:00 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:00.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:00 smithi060 ceph-mon[99238]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-10-05T15:14:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:00.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:00 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:00 smithi092 ceph-mon[102944]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-10-05T15:14:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:00 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:02.290 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.287+0000 7ff82d7fa700 1 -- 172.21.15.135:0/2251180746 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ff830069810 con 0x7ff8180a1500 2023-10-05T15:14:02.290 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 11 on host 'smithi135' 2023-10-05T15:14:02.292 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff8180a1500 msgr2=0x7ff8180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:02.292 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff8180a1500 0x7ff8180a39c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff824006010 tx=0x7ff82400b540 comp rx=0 tx=0).stop 2023-10-05T15:14:02.292 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 msgr2=0x7ff830196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 0x7ff830196070 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c920 tx=0x7ff82000cce0 comp rx=0 tx=0).stop 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 shutdown_connections 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff830101990 0x7ff83019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff8180a1500 0x7ff8180a39c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8300ffe70 0x7ff830195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 --2- 172.21.15.135:0/2251180746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff830100fd0 0x7ff830196070 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 >> 172.21.15.135:0/2251180746 conn(0x7ff8300fb3f0 msgr2=0x7ff8301045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 shutdown_connections 2023-10-05T15:14:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:02.290+0000 7ff836a35700 1 -- 172.21.15.135:0/2251180746 wait complete. 2023-10-05T15:14:02.859 DEBUG:teuthology.orchestra.run.smithi135:osd.11> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-05T15:14:02.861 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-05T15:14:02.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-05T15:14:02.892 INFO:journalctl@ceph.osd.11.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:02 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-05T15:14:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:02 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:03.232 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-05T15:14:03.232 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.232 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.232 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:03.233 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:03.233 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.233 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.233 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:03.233 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:02 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:03.441 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:14:03.542 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:14:03 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:14:03.258+0000 7f131c6d8640 -1 osd.11 0 log_to_monitors true 2023-10-05T15:14:04.184 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:03 smithi060 ceph-mon[99238]: from='osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:14:04.184 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:03 smithi060 ceph-mon[99238]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:14:04.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:03 smithi135 ceph-mon[103360]: from='osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:14:04.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:03 smithi135 ceph-mon[103360]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:14:04.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:03 smithi092 ceph-mon[102944]: from='osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:14:04.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:03 smithi092 ceph-mon[102944]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:14:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 -- 172.21.15.60:0/131095095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0104390 msgr2=0x7f2ec0106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 --2- 172.21.15.60:0/131095095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0104390 0x7f2ec0106780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009990 tx=0x7f2ea8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 -- 172.21.15.60:0/131095095 shutdown_connections 2023-10-05T15:14:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 --2- 172.21.15.60:0/131095095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0106cc0 0x7f2ec01090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 --2- 172.21.15.60:0/131095095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0101a60 0x7f2ec0103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 --2- 172.21.15.60:0/131095095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0104390 0x7f2ec0106780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 -- 172.21.15.60:0/131095095 >> 172.21.15.60:0/131095095 conn(0x7f2ec00fb3f0 msgr2=0x7f2ec00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 -- 172.21.15.60:0/131095095 shutdown_connections 2023-10-05T15:14:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.614+0000 7f2ec610c700 1 -- 172.21.15.60:0/131095095 wait complete. 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 Processor -- start 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 -- start start 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0101a60 0x7f2ec0196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0104390 0x7f2ec01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 0x7f2ec019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec019e7b0 con 0x7f2ec0106cc0 2023-10-05T15:14:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec019e8f0 con 0x7f2ec0104390 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ec610c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec019eab0 con 0x7f2ec0101a60 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ebffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 0x7f2ec019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ebffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 0x7f2ec019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35462/0 (socket says 172.21.15.60:35462) 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ebffff700 1 -- 172.21.15.60:0/3598026803 learned_addr learned my addr 172.21.15.60:0/3598026803 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ebf7fe700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0101a60 0x7f2ec0196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.615+0000 7f2ebeffd700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0104390 0x7f2ec01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebffff700 1 -- 172.21.15.60:0/3598026803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0101a60 msgr2=0x7f2ec0196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebffff700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0101a60 0x7f2ec0196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebffff700 1 -- 172.21.15.60:0/3598026803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0104390 msgr2=0x7f2ec01971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebffff700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0104390 0x7f2ec01971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebffff700 1 -- 172.21.15.60:0/3598026803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80095f0 con 0x7f2ec0106cc0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebffff700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 0x7f2ec019e1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80094f0 tx=0x7f2eb800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8004db0 con 0x7f2ec0106cc0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eb800f040 con 0x7f2ec0106cc0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec019ed90 con 0x7f2ec0106cc0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8005980 con 0x7f2ec0106cc0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.616+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec019f180 con 0x7f2ec0106cc0 2023-10-05T15:14:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.617+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec00fcf70 con 0x7f2ec0106cc0 2023-10-05T15:14:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.618+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2eb8005000 con 0x7f2ec0106cc0 2023-10-05T15:14:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.619+0000 7f2ebcff9700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2eac0a1480 0x7f2eac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.619+0000 7f2ebf7fe700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2eac0a1480 0x7f2eac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.619+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f2eb80cc8a0 con 0x7f2ec0106cc0 2023-10-05T15:14:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.620+0000 7f2ebf7fe700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2eac0a1480 0x7f2eac0a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0198140 tx=0x7f2eb000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:04.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.623+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2eb80964d0 con 0x7f2ec0106cc0 2023-10-05T15:14:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.826+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2ec010c790 con 0x7f2ec0106cc0 2023-10-05T15:14:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.826+0000 7f2ebcff9700 1 -- 172.21.15.60:0/3598026803 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7f2eb8099af0 con 0x7f2ec0106cc0 2023-10-05T15:14:04.828 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2eac0a1480 msgr2=0x7f2eac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2eac0a1480 0x7f2eac0a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0198140 tx=0x7f2eb000b410 comp rx=0 tx=0).stop 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 msgr2=0x7f2ec019e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 0x7f2ec019e1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80094f0 tx=0x7f2eb800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 shutdown_connections 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2eac0a1480 0x7f2eac0a3940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec0106cc0 0x7f2ec019e1e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0101a60 0x7f2ec0196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 --2- 172.21.15.60:0/3598026803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0104390 0x7f2ec01971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 >> 172.21.15.60:0/3598026803 conn(0x7f2ec00fb3f0 msgr2=0x7f2ec0102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:04.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 shutdown_connections 2023-10-05T15:14:04.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:04.829+0000 7f2ec610c700 1 -- 172.21.15.60:0/3598026803 wait complete. 2023-10-05T15:14:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:14:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-05T15:14:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: osdmap e77: 12 total, 11 up, 12 in 2023-10-05T15:14:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:05.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: from='osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:14:05.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:14:05.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3598026803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:14:05.300 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1696518825,"num_in_osds":12,"osd_in_since":1696518828,"num_remapped_pgs":0} 2023-10-05T15:14:05.331 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:14:04.947+0000 7f1311d4f700 -1 osd.11 0 waiting for initial osdmap 2023-10-05T15:14:05.331 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:14:04.960+0000 7f130a33d700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:14:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:14:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-05T15:14:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: osdmap e77: 12 total, 11 up, 12 in 2023-10-05T15:14:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: from='osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:14:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:14:05.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3598026803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:14:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:14:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-05T15:14:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: osdmap e77: 12 total, 11 up, 12 in 2023-10-05T15:14:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: from='osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:14:05.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-10-05T15:14:05.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3598026803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:14:06.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-05T15:14:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:14:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: osdmap e78: 12 total, 11 up, 12 in 2023-10-05T15:14:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:06.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:05 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.334 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:14:06.334 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: osdmap e78: 12 total, 11 up, 12 in 2023-10-05T15:14:06.334 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:06.334 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:06.335 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.335 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.335 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.335 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.335 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.335 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.336 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.336 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:06.336 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:06.336 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:05 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-10-05T15:14:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: osdmap e78: 12 total, 11 up, 12 in 2023-10-05T15:14:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:06.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:05 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:14:07.276 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: purged_snaps scrub starts 2023-10-05T15:14:07.276 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: purged_snaps scrub ok 2023-10-05T15:14:07.276 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:14:07.276 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: Detected new or changed devices on smithi135 2023-10-05T15:14:07.276 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi135 to 4292M 2023-10-05T15:14:07.277 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] boot 2023-10-05T15:14:07.277 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: osdmap e79: 12 total, 12 up, 12 in 2023-10-05T15:14:07.277 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:06 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:07.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: purged_snaps scrub starts 2023-10-05T15:14:07.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: purged_snaps scrub ok 2023-10-05T15:14:07.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:14:07.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: Detected new or changed devices on smithi135 2023-10-05T15:14:07.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi135 to 4292M 2023-10-05T15:14:07.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] boot 2023-10-05T15:14:07.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: osdmap e79: 12 total, 12 up, 12 in 2023-10-05T15:14:07.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:06 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:07.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: purged_snaps scrub starts 2023-10-05T15:14:07.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: purged_snaps scrub ok 2023-10-05T15:14:07.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:14:07.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: Detected new or changed devices on smithi135 2023-10-05T15:14:07.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi135 to 4292M 2023-10-05T15:14:07.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: osd.11 [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] boot 2023-10-05T15:14:07.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: osdmap e79: 12 total, 12 up, 12 in 2023-10-05T15:14:07.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:06 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:14:08.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 -- 172.21.15.60:0/789787197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f40ff870 msgr2=0x7fc2f40ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 --2- 172.21.15.60:0/789787197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f40ff870 0x7fc2f40ffc90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009990 tx=0x7fc2f0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 -- 172.21.15.60:0/789787197 shutdown_connections 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 --2- 172.21.15.60:0/789787197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f4100b90 0x7fc2f4101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 --2- 172.21.15.60:0/789787197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f40ff870 0x7fc2f40ffc90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 --2- 172.21.15.60:0/789787197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41001d0 0x7fc2f4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.079+0000 7fc2fab45700 1 -- 172.21.15.60:0/789787197 >> 172.21.15.60:0/789787197 conn(0x7fc2f40fb3f0 msgr2=0x7fc2f40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 -- 172.21.15.60:0/789787197 shutdown_connections 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 -- 172.21.15.60:0/789787197 wait complete. 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 Processor -- start 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 -- start start 2023-10-05T15:14:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f40ff870 0x7fc2f4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f41001d0 0x7fc2f4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 0x7fc2f41a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41a09d0 con 0x7fc2f4100b90 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41a0b10 con 0x7fc2f40ff870 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.080+0000 7fc2fab45700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41a0ca0 con 0x7fc2f41001d0 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 0x7fc2f41a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 0x7fc2f41a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35480/0 (socket says 172.21.15.60:35480) 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 -- 172.21.15.60:0/1881673862 learned_addr learned my addr 172.21.15.60:0/1881673862 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f88e1700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f40ff870 0x7fc2f4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2ebfff700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f41001d0 0x7fc2f4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 -- 172.21.15.60:0/1881673862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f41001d0 msgr2=0x7fc2f4199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f41001d0 0x7fc2f4199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 -- 172.21.15.60:0/1881673862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f40ff870 msgr2=0x7fc2f4198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f40ff870 0x7fc2f4198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 -- 172.21.15.60:0/1881673862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00095f0 con 0x7fc2f4100b90 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2f90e2700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 0x7fc2f41a0400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00add0 tx=0x7fc2ec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00f070 con 0x7fc2f4100b90 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2ec007b30 con 0x7fc2f4100b90 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec005280 con 0x7fc2f4100b90 2023-10-05T15:14:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f41a0f80 con 0x7fc2f4100b90 2023-10-05T15:14:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.081+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f41a1390 con 0x7fc2f4100b90 2023-10-05T15:14:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.082+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f410a650 con 0x7fc2f4100b90 2023-10-05T15:14:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.083+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc2ec00c890 con 0x7fc2f4100b90 2023-10-05T15:14:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.084+0000 7fc2e9ffb700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc2dc0a1480 0x7fc2dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.084+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc2ec0cbd50 con 0x7fc2f4100b90 2023-10-05T15:14:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.084+0000 7fc2f88e1700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc2dc0a1480 0x7fc2dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.085+0000 7fc2f88e1700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc2dc0a1480 0x7fc2dc0a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000b5c0 tx=0x7fc2f0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.089+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc2ec0cf030 con 0x7fc2f4100b90 2023-10-05T15:14:08.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:07 smithi060 ceph-mon[99238]: osdmap e80: 12 total, 12 up, 12 in 2023-10-05T15:14:08.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.287+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc2f410ec10 con 0x7fc2f4100b90 2023-10-05T15:14:08.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.288+0000 7fc2e9ffb700 1 -- 172.21.15.60:0/1881673862 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7fc2ec0958e0 con 0x7fc2f4100b90 2023-10-05T15:14:08.290 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:08.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc2dc0a1480 msgr2=0x7fc2dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc2dc0a1480 0x7fc2dc0a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000b5c0 tx=0x7fc2f0005fd0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 msgr2=0x7fc2f41a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 0x7fc2f41a0400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00add0 tx=0x7fc2ec00c330 comp rx=0 tx=0).stop 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 shutdown_connections 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc2dc0a1480 0x7fc2dc0a3940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f4100b90 0x7fc2f41a0400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f40ff870 0x7fc2f4198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 --2- 172.21.15.60:0/1881673862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f41001d0 0x7fc2f4199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 >> 172.21.15.60:0/1881673862 conn(0x7fc2f40fb3f0 msgr2=0x7fc2f40fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 shutdown_connections 2023-10-05T15:14:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:08.290+0000 7fc2fab45700 1 -- 172.21.15.60:0/1881673862 wait complete. 2023-10-05T15:14:08.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:07 smithi135 ceph-mon[103360]: osdmap e80: 12 total, 12 up, 12 in 2023-10-05T15:14:08.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:07 smithi092 ceph-mon[102944]: osdmap e80: 12 total, 12 up, 12 in 2023-10-05T15:14:08.639 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1696518845,"num_in_osds":12,"osd_in_since":1696518828,"num_remapped_pgs":0} 2023-10-05T15:14:08.640 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-05T15:14:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:14:09.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:08 smithi135 ceph-mon[103360]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:09.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:08 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1881673862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:14:09.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:08 smithi060 ceph-mon[99238]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:09.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:08 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1881673862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:14:09.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:08 smithi092 ceph-mon[102944]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:09.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:08 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1881673862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:14:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3485783540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa974068c00 msgr2=0x7fa974068fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3485783540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa974068c00 0x7fa974068fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa968009990 tx=0x7fa968009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3485783540 shutdown_connections 2023-10-05T15:14:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3485783540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9741062b0 0x7fa97410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3485783540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa974068c00 0x7fa974068fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3485783540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9740695b0 0x7fa974105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3485783540 >> 172.21.15.60:0/3485783540 conn(0x7fa974075e00 msgr2=0x7fa974076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3485783540 shutdown_connections 2023-10-05T15:14:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.433+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3485783540 wait complete. 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 Processor -- start 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 -- start start 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa974068c00 0x7fa9740fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 0x7fa974100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9741062b0 0x7fa9741009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9741a5490 con 0x7fa9740695b0 2023-10-05T15:14:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9741a5600 con 0x7fa974068c00 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa97b0ca700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9741a57c0 con 0x7fa9741062b0 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa973fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 0x7fa974100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa973fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 0x7fa974100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35496/0 (socket says 172.21.15.60:35496) 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa973fff700 1 -- 172.21.15.60:0/3257218451 learned_addr learned my addr 172.21.15.60:0/3257218451 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa979667700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9741062b0 0x7fa9741009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.434+0000 7fa978e66700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa974068c00 0x7fa9740fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa973fff700 1 -- 172.21.15.60:0/3257218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9741062b0 msgr2=0x7fa9741009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa973fff700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9741062b0 0x7fa9741009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa973fff700 1 -- 172.21.15.60:0/3257218451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa974068c00 msgr2=0x7fa9740fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa973fff700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa974068c00 0x7fa9740fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa973fff700 1 -- 172.21.15.60:0/3257218451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680095f0 con 0x7fa9740695b0 2023-10-05T15:14:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa978e66700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa974068c00 0x7fa9740fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa973fff700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 0x7fa974100470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e940 tx=0x7fa96000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960009730 con 0x7fa9740695b0 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa96000ee90 con 0x7fa9740695b0 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9741a5aa0 con 0x7fa9740695b0 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960010ea0 con 0x7fa9740695b0 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.435+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9741a5ff0 con 0x7fa9740695b0 2023-10-05T15:14:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.436+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97404ebb0 con 0x7fa9740695b0 2023-10-05T15:14:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.437+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa96000cbd0 con 0x7fa9740695b0 2023-10-05T15:14:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.438+0000 7fa971ffb700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa9640a1500 0x7fa9640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.438+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa960014070 con 0x7fa9740695b0 2023-10-05T15:14:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.438+0000 7fa978e66700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa9640a1500 0x7fa9640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.438+0000 7fa978e66700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa9640a1500 0x7fa9640a39c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa96800b2e0 tx=0x7fa968005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:10.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.442+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa9600964c0 con 0x7fa9740695b0 2023-10-05T15:14:10.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.647+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa974111050 con 0x7fa9740695b0 2023-10-05T15:14:10.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.648+0000 7fa971ffb700 1 -- 172.21.15.60:0/3257218451 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fa960099ae0 con 0x7fa9740695b0 2023-10-05T15:14:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:06.954151+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa9640a1500 msgr2=0x7fa9640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa9640a1500 0x7fa9640a39c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa96800b2e0 tx=0x7fa968005fb0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 msgr2=0x7fa974100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 0x7fa974100470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e940 tx=0x7fa96000ec50 comp rx=0 tx=0).stop 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 shutdown_connections 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9741062b0 0x7fa9741009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa974068c00 0x7fa9740fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa9640a1500 0x7fa9640a39c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 --2- 172.21.15.60:0/3257218451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9740695b0 0x7fa974100470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 >> 172.21.15.60:0/3257218451 conn(0x7fa974075e00 msgr2=0x7fa9740fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 shutdown_connections 2023-10-05T15:14:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:10.651+0000 7fa97b0ca700 1 -- 172.21.15.60:0/3257218451 wait complete. 2023-10-05T15:14:10.987 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-05T15:14:10.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-05T15:14:11.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:10 smithi135 ceph-mon[103360]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:11.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:10 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3257218451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:11.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:10 smithi060 ceph-mon[99238]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:11.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:10 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3257218451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:11.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:10 smithi092 ceph-mon[102944]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:11.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:10 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3257218451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:11.552 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:14:12.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 -- 172.21.15.60:0/1929933076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80ffe60 msgr2=0x7efdb81002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 --2- 172.21.15.60:0/1929933076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80ffe60 0x7efdb81002e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdac0099c0 tx=0x7efdac009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 -- 172.21.15.60:0/1929933076 shutdown_connections 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 --2- 172.21.15.60:0/1929933076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb8100820 0x7efdb810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 --2- 172.21.15.60:0/1929933076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb8106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 --2- 172.21.15.60:0/1929933076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80ffe60 0x7efdb81002e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 -- 172.21.15.60:0/1929933076 >> 172.21.15.60:0/1929933076 conn(0x7efdb8075e00 msgr2=0x7efdb8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 -- 172.21.15.60:0/1929933076 shutdown_connections 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.776+0000 7efdbd209700 1 -- 172.21.15.60:0/1929933076 wait complete. 2023-10-05T15:14:12.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 Processor -- start 2023-10-05T15:14:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 -- start start 2023-10-05T15:14:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb80ffe60 0x7efdb8196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb8100820 0x7efdb8197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb819beb0 con 0x7efdb8100820 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb819c020 con 0x7efdb80ffe60 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.777+0000 7efdbd209700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb819c1e0 con 0x7efdb8105e70 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb80ffe60 0x7efdb8196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb819b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:49042/0 (socket says 172.21.15.60:49042) 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb759e700 1 -- 172.21.15.60:0/846480090 learned_addr learned my addr 172.21.15.60:0/846480090 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb659c700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb8100820 0x7efdb8197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 -- 172.21.15.60:0/846480090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 msgr2=0x7efdb819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 -- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb8100820 msgr2=0x7efdb8197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb8100820 0x7efdb8197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 -- 172.21.15.60:0/846480090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0095f0 con 0x7efdb80ffe60 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb759e700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efdb6d9d700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb80ffe60 0x7efdb8196ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efda800d950 tx=0x7efda800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.778+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800f890 con 0x7efdb80ffe60 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.779+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb819c4c0 con 0x7efdb80ffe60 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.779+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efda8010460 con 0x7efdb80ffe60 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.779+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800e610 con 0x7efdb80ffe60 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.779+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb81a3d20 con 0x7efdb80ffe60 2023-10-05T15:14:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.779+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb804ebb0 con 0x7efdb80ffe60 2023-10-05T15:14:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.781+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efda80108d0 con 0x7efdb80ffe60 2023-10-05T15:14:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.781+0000 7efd9ffff700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efda00a1480 0x7efda00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.782+0000 7efdb659c700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efda00a1480 0x7efda00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.782+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efda80cc930 con 0x7efdb80ffe60 2023-10-05T15:14:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.782+0000 7efdb659c700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efda00a1480 0x7efda00a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efdac000c00 tx=0x7efdac003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.785+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efda8096430 con 0x7efdb80ffe60 2023-10-05T15:14:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.985+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efdb8198250 con 0x7efdb80ffe60 2023-10-05T15:14:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.985+0000 7efd9ffff700 1 -- 172.21.15.60:0/846480090 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7efda8099a50 con 0x7efdb80ffe60 2023-10-05T15:14:12.988 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:14:12.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.987+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efda00a1480 msgr2=0x7efda00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.987+0000 7efdbd209700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efda00a1480 0x7efda00a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efdac000c00 tx=0x7efdac003680 comp rx=0 tx=0).stop 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.987+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb80ffe60 msgr2=0x7efdb8196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.987+0000 7efdbd209700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb80ffe60 0x7efdb8196ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efda800d950 tx=0x7efda800dc60 comp rx=0 tx=0).stop 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.987+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 shutdown_connections 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.987+0000 7efdbd209700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8105e70 0x7efdb819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.988+0000 7efdbd209700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdb80ffe60 0x7efdb8196ef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.988+0000 7efdbd209700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efda00a1480 0x7efda00a3940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.988+0000 7efdbd209700 1 --2- 172.21.15.60:0/846480090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb8100820 0x7efdb8197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:12.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.988+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 >> 172.21.15.60:0/846480090 conn(0x7efdb8075e00 msgr2=0x7efdb80689c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:12.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.988+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 shutdown_connections 2023-10-05T15:14:12.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:12.988+0000 7efdbd209700 1 -- 172.21.15.60:0/846480090 wait complete. 2023-10-05T15:14:13.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:12 smithi135 ceph-mon[103360]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:13.331 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:12 smithi060 ceph-mon[99238]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.a on smithi060 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.d on smithi060 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.g on smithi060 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.j on smithi060 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.b on smithi092 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.e on smithi092 2023-10-05T15:14:13.400 INFO:tasks.cephadm:Adding mds.h on smithi092 2023-10-05T15:14:13.401 INFO:tasks.cephadm:Adding mds.k on smithi092 2023-10-05T15:14:13.401 INFO:tasks.cephadm:Adding mds.c on smithi135 2023-10-05T15:14:13.401 INFO:tasks.cephadm:Adding mds.f on smithi135 2023-10-05T15:14:13.401 INFO:tasks.cephadm:Adding mds.i on smithi135 2023-10-05T15:14:13.401 INFO:tasks.cephadm:Adding mds.l on smithi135 2023-10-05T15:14:13.401 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l' 2023-10-05T15:14:13.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:12 smithi092 ceph-mon[102944]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:13.977 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:14:14.241 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:13 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/846480090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:14.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:13 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/846480090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:14.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:13 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/846480090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:15.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:14 smithi135 ceph-mon[103360]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:15.332 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 -- 172.21.15.135:0/2094175196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c101990 msgr2=0x7f340c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 --2- 172.21.15.135:0/2094175196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c101990 0x7f340c1082b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f340400b0a0 tx=0x7f340400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 -- 172.21.15.135:0/2094175196 shutdown_connections 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 --2- 172.21.15.135:0/2094175196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c101990 0x7f340c1082b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 --2- 172.21.15.135:0/2094175196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f340c0ffe70 0x7f340c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 --2- 172.21.15.135:0/2094175196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c100fd0 0x7f340c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 -- 172.21.15.135:0/2094175196 >> 172.21.15.135:0/2094175196 conn(0x7f340c0fb3f0 msgr2=0x7f340c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:15.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 -- 172.21.15.135:0/2094175196 shutdown_connections 2023-10-05T15:14:15.334 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.330+0000 7f3411e20700 1 -- 172.21.15.135:0/2094175196 wait complete. 2023-10-05T15:14:15.334 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 Processor -- start 2023-10-05T15:14:15.335 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 -- start start 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 0x7f340c196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c100fd0 0x7f340c196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f340c101990 0x7f340c19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c19e640 con 0x7f340c100fd0 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c19e780 con 0x7f340c101990 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f3411e20700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c19e910 con 0x7f340c0ffe70 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 0x7f340c196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 0x7f340c196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55288/0 (socket says 172.21.15.135:55288) 2023-10-05T15:14:15.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 -- 172.21.15.135:0/797289151 learned_addr learned my addr 172.21.15.135:0/797289151 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340affd700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c100fd0 0x7f340c196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 -- 172.21.15.135:0/797289151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f340c101990 msgr2=0x7f340c19e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f340c101990 0x7f340c19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 -- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c100fd0 msgr2=0x7f340c196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c100fd0 0x7f340c196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.331+0000 7f340b7fe700 1 -- 172.21.15.135:0/797289151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404009d00 con 0x7f340c0ffe70 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.332+0000 7f340b7fe700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 0x7f340c196ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f340000d980 tx=0x7f340000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.332+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400009b40 con 0x7f340c0ffe70 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.332+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c19ebf0 con 0x7f340c0ffe70 2023-10-05T15:14:15.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.332+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f340000b6e0 con 0x7f340c0ffe70 2023-10-05T15:14:15.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.332+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000f620 con 0x7f340c0ffe70 2023-10-05T15:14:15.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.332+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c19f0f0 con 0x7f340c0ffe70 2023-10-05T15:14:15.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.333+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c10b5c0 con 0x7f340c0ffe70 2023-10-05T15:14:15.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.334+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3400010460 con 0x7f340c0ffe70 2023-10-05T15:14:15.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.334+0000 7f3408ff9700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33f40a1480 0x7f33f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:15.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.335+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f34000cc7e0 con 0x7f340c0ffe70 2023-10-05T15:14:15.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.335+0000 7f340affd700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33f40a1480 0x7f33f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:15.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.335+0000 7f340affd700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33f40a1480 0x7f33f40a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005950 tx=0x7f33fc005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:15.340 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.338+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3400096240 con 0x7f340c0ffe70 2023-10-05T15:14:15.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:14 smithi060 ceph-mon[99238]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:15.425 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:14 smithi092 ceph-mon[102944]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:15.538 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.535+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f340c069a60 con 0x7f33f40a1480 2023-10-05T15:14:15.546 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.544+0000 7f3408ff9700 1 -- 172.21.15.135:0/797289151 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f340c069a60 con 0x7f33f40a1480 2023-10-05T15:14:15.546 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mds.all update... 2023-10-05T15:14:15.549 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33f40a1480 msgr2=0x7f33f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:15.549 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33f40a1480 0x7f33f40a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005950 tx=0x7f33fc005cf0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.549 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 msgr2=0x7f340c196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:15.549 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 0x7f340c196ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f340000d980 tx=0x7f340000dd40 comp rx=0 tx=0).stop 2023-10-05T15:14:15.549 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 shutdown_connections 2023-10-05T15:14:15.549 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f340c101990 0x7f340c19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.550 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c0ffe70 0x7f340c196ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.550 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33f40a1480 0x7f33f40a3940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.550 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 --2- 172.21.15.135:0/797289151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c100fd0 0x7f340c196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:15.550 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 >> 172.21.15.135:0/797289151 conn(0x7f340c0fb3f0 msgr2=0x7f340c069250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:15.550 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 shutdown_connections 2023-10-05T15:14:15.550 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-05T15:14:15.547+0000 7f3411e20700 1 -- 172.21.15.135:0/797289151 wait complete. 2023-10-05T15:14:16.023 DEBUG:teuthology.orchestra.run.smithi060:mds.a> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-05T15:14:16.026 DEBUG:teuthology.orchestra.run.smithi060:mds.d> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-05T15:14:16.065 INFO:journalctl@ceph.mds.a.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:14:16.066 DEBUG:teuthology.orchestra.run.smithi060:mds.g> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-05T15:14:16.096 INFO:journalctl@ceph.mds.d.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:14:16.097 DEBUG:teuthology.orchestra.run.smithi060:mds.j> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-05T15:14:16.125 INFO:journalctl@ceph.mds.g.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:14:16.126 DEBUG:teuthology.orchestra.run.smithi092:mds.b> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-05T15:14:16.129 DEBUG:teuthology.orchestra.run.smithi092:mds.e> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-05T15:14:16.154 INFO:journalctl@ceph.mds.j.smithi060.stdout:-- Logs begin at Thu 2023-10-05 14:52:44 UTC. -- 2023-10-05T15:14:16.167 INFO:journalctl@ceph.mds.b.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:14:16.168 DEBUG:teuthology.orchestra.run.smithi092:mds.h> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-05T15:14:16.201 INFO:journalctl@ceph.mds.e.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:14:16.202 DEBUG:teuthology.orchestra.run.smithi092:mds.k> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-05T15:14:16.233 INFO:journalctl@ceph.mds.h.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:14:16.234 DEBUG:teuthology.orchestra.run.smithi135:mds.c> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-05T15:14:16.236 DEBUG:teuthology.orchestra.run.smithi135:mds.f> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-05T15:14:16.265 INFO:journalctl@ceph.mds.k.smithi092.stdout:-- Logs begin at Thu 2023-10-05 14:53:00 UTC. -- 2023-10-05T15:14:16.268 INFO:journalctl@ceph.mds.c.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:14:16.269 DEBUG:teuthology.orchestra.run.smithi135:mds.i> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-05T15:14:16.295 INFO:journalctl@ceph.mds.f.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:14:16.296 DEBUG:teuthology.orchestra.run.smithi135:mds.l> sudo journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-05T15:14:16.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:14:16.322 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-05T15:14:16.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:14:16.348 INFO:journalctl@ceph.mds.l.smithi135.stdout:-- Logs begin at Thu 2023-10-05 14:52:59 UTC. -- 2023-10-05T15:14:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 -- 172.21.15.60:0/84559237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff504100fb0 msgr2=0x7ff504101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 --2- 172.21.15.60:0/84559237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff504100fb0 0x7ff504101410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80099c0 tx=0x7ff4f8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 -- 172.21.15.60:0/84559237 shutdown_connections 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 --2- 172.21.15.60:0/84559237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 0x7ff504108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 --2- 172.21.15.60:0/84559237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5040ffdc0 0x7ff5041001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 --2- 172.21.15.60:0/84559237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff504100fb0 0x7ff504101410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 -- 172.21.15.60:0/84559237 >> 172.21.15.60:0/84559237 conn(0x7ff5040fb310 msgr2=0x7ff5040fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.458+0000 7ff50b826700 1 -- 172.21.15.60:0/84559237 shutdown_connections 2023-10-05T15:14:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.459+0000 7ff50b826700 1 -- 172.21.15.60:0/84559237 wait complete. 2023-10-05T15:14:16.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.459+0000 7ff50b826700 1 Processor -- start 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.459+0000 7ff50b826700 1 -- start start 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 0x7ff504195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff504100fb0 0x7ff504195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 0x7ff50419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50419d610 con 0x7ff5040ffdc0 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50419d750 con 0x7ff504100fb0 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50419d8e0 con 0x7ff504101950 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 0x7ff504195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 0x7ff504195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35520/0 (socket says 172.21.15.60:35520) 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 -- 172.21.15.60:0/1637125263 learned_addr learned my addr 172.21.15.60:0/1637125263 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff509dc3700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 0x7ff50419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff508dc1700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff504100fb0 0x7ff504195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 -- 172.21.15.60:0/1637125263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 msgr2=0x7ff50419d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 0x7ff50419d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 -- 172.21.15.60:0/1637125263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff504100fb0 msgr2=0x7ff504195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff504100fb0 0x7ff504195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 -- 172.21.15.60:0/1637125263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80095f0 con 0x7ff5040ffdc0 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff509dc3700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 0x7ff50419d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff5095c2700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 0x7ff504195a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c970 tx=0x7ff50000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500004220 con 0x7ff5040ffdc0 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff500007d60 con 0x7ff5040ffdc0 2023-10-05T15:14:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500003d00 con 0x7ff5040ffdc0 2023-10-05T15:14:16.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff504068160 con 0x7ff5040ffdc0 2023-10-05T15:14:16.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.460+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff504068670 con 0x7ff5040ffdc0 2023-10-05T15:14:16.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.461+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50410b620 con 0x7ff5040ffdc0 2023-10-05T15:14:16.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.462+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff500004380 con 0x7ff5040ffdc0 2023-10-05T15:14:16.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.463+0000 7ff4f67fc700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4f00a1550 0x7ff4f00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.463+0000 7ff508dc1700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4f00a1550 0x7ff4f00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.463+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff5000cc760 con 0x7ff5040ffdc0 2023-10-05T15:14:16.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.463+0000 7ff508dc1700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4f00a1550 0x7ff4f00a3a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b580 tx=0x7ff4f801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:16.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.467+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff500096260 con 0x7ff5040ffdc0 2023-10-05T15:14:16.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:16 smithi060 ceph-mon[99238]: Deploying daemon mds.l on smithi135 2023-10-05T15:14:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.673+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff50410b830 con 0x7ff5040ffdc0 2023-10-05T15:14:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.674+0000 7ff4f67fc700 1 -- 172.21.15.60:0/1637125263 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18338 (secure 0 0 0) 0x7ff500099880 con 0x7ff5040ffdc0 2023-10-05T15:14:16.676 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:16.676 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:06.954151+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:14:16.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4f00a1550 msgr2=0x7ff4f00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4f00a1550 0x7ff4f00a3a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b580 tx=0x7ff4f801a040 comp rx=0 tx=0).stop 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 msgr2=0x7ff504195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 0x7ff504195a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c970 tx=0x7ff50000cd30 comp rx=0 tx=0).stop 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 shutdown_connections 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff504101950 0x7ff50419d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4f00a1550 0x7ff4f00a3a10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5040ffdc0 0x7ff504195a90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 --2- 172.21.15.60:0/1637125263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff504100fb0 0x7ff504195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.676+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 >> 172.21.15.60:0/1637125263 conn(0x7ff5040fb310 msgr2=0x7ff5040fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.677+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 shutdown_connections 2023-10-05T15:14:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.677+0000 7ff50b826700 1 -- 172.21.15.60:0/1637125263 wait complete. 2023-10-05T15:14:16.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-05T15:14:16.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:14:16.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 -- 172.21.15.60:0/1154339161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 msgr2=0x7fb734108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 --2- 172.21.15.60:0/1154339161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb734108200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00b0d0 tx=0x7fb72c00b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 -- 172.21.15.60:0/1154339161 shutdown_connections 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 --2- 172.21.15.60:0/1154339161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb734108200 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 --2- 172.21.15.60:0/1154339161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7340ffdc0 0x7fb7341001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 --2- 172.21.15.60:0/1154339161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734100fb0 0x7fb734101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 -- 172.21.15.60:0/1154339161 >> 172.21.15.60:0/1154339161 conn(0x7fb7340fb330 msgr2=0x7fb7340fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.818+0000 7fb73889a700 1 -- 172.21.15.60:0/1154339161 shutdown_connections 2023-10-05T15:14:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 -- 172.21.15.60:0/1154339161 wait complete. 2023-10-05T15:14:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 Processor -- start 2023-10-05T15:14:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 -- start start 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7340ffdc0 0x7fb734196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734100fb0 0x7fb7341971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb73419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419e820 con 0x7fb734101950 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419e990 con 0x7fb7340ffdc0 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.819+0000 7fb73889a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419eb50 con 0x7fb734100fb0 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb73419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb73419e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35538/0 (socket says 172.21.15.60:35538) 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 -- 172.21.15.60:0/2379351685 learned_addr learned my addr 172.21.15.60:0/2379351685 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb731d9b700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734100fb0 0x7fb7341971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb73259c700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7340ffdc0 0x7fb734196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 -- 172.21.15.60:0/2379351685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734100fb0 msgr2=0x7fb7341971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734100fb0 0x7fb7341971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 -- 172.21.15.60:0/2379351685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7340ffdc0 msgr2=0x7fb734196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7340ffdc0 0x7fb734196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 -- 172.21.15.60:0/2379351685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009d00 con 0x7fb734101950 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb73259c700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7340ffdc0 0x7fb734196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb732d9d700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb73419e250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb72c007a00 tx=0x7fb72c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00e040 con 0x7fb734101950 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73419edd0 con 0x7fb734101950 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72c003e10 con 0x7fb734101950 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c012a90 con 0x7fb734101950 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.820+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73419f1f0 con 0x7fb734101950 2023-10-05T15:14:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.821+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73410b5e0 con 0x7fb734101950 2023-10-05T15:14:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.822+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb72c0056c0 con 0x7fb734101950 2023-10-05T15:14:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.823+0000 7fb72b7fe700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.823+0000 7fb73259c700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:16.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.823+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb72c0cdf90 con 0x7fb734101950 2023-10-05T15:14:16.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.824+0000 7fb73259c700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb724005950 tx=0x7fb7240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:16.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:16.828+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb72c097a80 con 0x7fb734101950 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:16.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:16.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:16.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:16.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:16.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:16 smithi135 ceph-mon[103360]: Deploying daemon mds.l on smithi135 2023-10-05T15:14:16.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:16.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:14:16.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-10-05T15:14:16.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:16.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:16.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:16 smithi092 ceph-mon[102944]: Deploying daemon mds.l on smithi135 2023-10-05T15:14:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.028+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb73419f3e0 con 0x7fb734101950 2023-10-05T15:14:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.028+0000 7fb72b7fe700 1 -- 172.21.15.60:0/2379351685 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb72c09b0a0 con 0x7fb734101950 2023-10-05T15:14:17.030 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:14:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.030+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 msgr2=0x7fb7200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.030+0000 7fb73889a700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb724005950 tx=0x7fb7240058e0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.030+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 msgr2=0x7fb73419e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.030+0000 7fb73889a700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb73419e250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb72c007a00 tx=0x7fb72c0094c0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.030+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 shutdown_connections 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734101950 0x7fb73419e250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7340ffdc0 0x7fb734196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 --2- 172.21.15.60:0/2379351685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734100fb0 0x7fb7341971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 >> 172.21.15.60:0/2379351685 conn(0x7fb7340fb330 msgr2=0x7fb734068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 shutdown_connections 2023-10-05T15:14:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.031+0000 7fb73889a700 1 -- 172.21.15.60:0/2379351685 wait complete. 2023-10-05T15:14:17.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:17.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.169+0000 7f5e420ee700 1 -- 172.21.15.60:0/321809904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c101960 msgr2=0x7f5e3c108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.169+0000 7f5e420ee700 1 --2- 172.21.15.60:0/321809904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c101960 0x7f5e3c108210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400b0d0 tx=0x7f5e3400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.169+0000 7f5e420ee700 1 -- 172.21.15.60:0/321809904 shutdown_connections 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.169+0000 7f5e420ee700 1 --2- 172.21.15.60:0/321809904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c101960 0x7f5e3c108210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.169+0000 7f5e420ee700 1 --2- 172.21.15.60:0/321809904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c0ffdd0 0x7f5e3c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.169+0000 7f5e420ee700 1 --2- 172.21.15.60:0/321809904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 -- 172.21.15.60:0/321809904 >> 172.21.15.60:0/321809904 conn(0x7f5e3c0fb300 msgr2=0x7f5e3c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 -- 172.21.15.60:0/321809904 shutdown_connections 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 -- 172.21.15.60:0/321809904 wait complete. 2023-10-05T15:14:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 Processor -- start 2023-10-05T15:14:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 -- start start 2023-10-05T15:14:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c0ffdd0 0x7f5e3c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.170+0000 7f5e420ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c101960 0x7f5e3c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e420ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c19e840 con 0x7f5e3c100fc0 2023-10-05T15:14:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e420ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c19e9b0 con 0x7f5e3c101960 2023-10-05T15:14:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e420ee700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c19eb70 con 0x7f5e3c0ffdd0 2023-10-05T15:14:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35550/0 (socket says 172.21.15.60:35550) 2023-10-05T15:14:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 -- 172.21.15.60:0/804454943 learned_addr learned my addr 172.21.15.60:0/804454943 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3b7fe700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c0ffdd0 0x7f5e3c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3bfff700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c101960 0x7f5e3c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 -- 172.21.15.60:0/804454943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c0ffdd0 msgr2=0x7f5e3c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c0ffdd0 0x7f5e3c196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 -- 172.21.15.60:0/804454943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c101960 msgr2=0x7f5e3c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c101960 0x7f5e3c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 -- 172.21.15.60:0/804454943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009d00 con 0x7f5e3c100fc0 2023-10-05T15:14:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3bfff700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c101960 0x7f5e3c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e3affd700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c197240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000d950 tx=0x7f5e3000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30009940 con 0x7f5e3c100fc0 2023-10-05T15:14:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e30010460 con 0x7f5e3c100fc0 2023-10-05T15:14:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c19ee50 con 0x7f5e3c100fc0 2023-10-05T15:14:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000f620 con 0x7f5e3c100fc0 2023-10-05T15:14:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.171+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c19f270 con 0x7f5e3c100fc0 2023-10-05T15:14:17.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.172+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c1072c0 con 0x7f5e3c100fc0 2023-10-05T15:14:17.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.173+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5e300108d0 con 0x7f5e3c100fc0 2023-10-05T15:14:17.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.174+0000 7f5e38ff9700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5e240a14d0 0x7f5e240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:17.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.174+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5e300cc9d0 con 0x7f5e3c100fc0 2023-10-05T15:14:17.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.174+0000 7f5e3b7fe700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5e240a14d0 0x7f5e240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:17.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.174+0000 7f5e3b7fe700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5e240a14d0 0x7f5e240a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c1981d0 tx=0x7f5e2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:17.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.177+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e300964d0 con 0x7f5e3c100fc0 2023-10-05T15:14:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.423+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e3c02d210 con 0x7f5e3c100fc0 2023-10-05T15:14:17.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.423+0000 7f5e38ff9700 1 -- 172.21.15.60:0/804454943 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f5e30099af0 con 0x7f5e3c100fc0 2023-10-05T15:14:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:17.467 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-05T15:14:17.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.425+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5e240a14d0 msgr2=0x7f5e240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.425+0000 7f5e420ee700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5e240a14d0 0x7f5e240a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c1981d0 tx=0x7f5e2c009260 comp rx=0 tx=0).stop 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.425+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 msgr2=0x7f5e3c197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.425+0000 7f5e420ee700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c197240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000d950 tx=0x7f5e3000dc60 comp rx=0 tx=0).stop 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 shutdown_connections 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e3c101960 0x7f5e3c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c0ffdd0 0x7f5e3c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5e240a14d0 0x7f5e240a3990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 --2- 172.21.15.60:0/804454943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100fc0 0x7f5e3c197240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 >> 172.21.15.60:0/804454943 conn(0x7f5e3c0fb300 msgr2=0x7f5e3c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 shutdown_connections 2023-10-05T15:14:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:17.426+0000 7f5e420ee700 1 -- 172.21.15.60:0/804454943 wait complete. 2023-10-05T15:14:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 1 2023-10-05T15:14:17.551 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:14:17 smithi135 systemd[1]: Starting Ceph mds.l for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:17.831 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:14:17 smithi135 podman[138612]: 2023-10-05T15:14:17.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:17 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1637125263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:17.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:17 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2379351685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:17.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:17 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/804454943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:17.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:17 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1637125263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:17.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:17 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2379351685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:17.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:17 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/804454943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:17.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:17 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1637125263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:17.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:17 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2379351685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:17.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:17 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/804454943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:18.331 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:14:17 smithi135 ceph-mds[138652]: -- 172.21.15.135:0/3551844393 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56533ef771e0 con 0x56533ef4cc00 2023-10-05T15:14:18.331 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:14:17 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l[138628]: starting mds.l at 2023-10-05T15:14:18.331 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:14:17 smithi135 bash[138612]: dfb9fba072fc65a82459e9332138ed247724af835152e37ea67fb66237ee898e 2023-10-05T15:14:18.331 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:14:17 smithi135 systemd[1]: Started Ceph mds.l for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:19.015 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6832/3118655820,v1:172.21.15.135:6833/3118655820] up:boot 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: fsmap 1 up:standby 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:19.016 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:18 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6832/3118655820,v1:172.21.15.135:6833/3118655820] up:boot 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: fsmap 1 up:standby 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:19.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:19.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:18 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6832/3118655820,v1:172.21.15.135:6833/3118655820] up:boot 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: fsmap 1 up:standby 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:18 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:19.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 -- 172.21.15.60:0/4063372652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe880101950 msgr2=0x7fe880108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 --2- 172.21.15.60:0/4063372652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe880101950 0x7fe880108200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe87800b0d0 tx=0x7fe87800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 -- 172.21.15.60:0/4063372652 shutdown_connections 2023-10-05T15:14:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 --2- 172.21.15.60:0/4063372652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe880101950 0x7fe880108200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 --2- 172.21.15.60:0/4063372652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8800ffdc0 0x7fe8801001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 --2- 172.21.15.60:0/4063372652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe880100fb0 0x7fe880101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 -- 172.21.15.60:0/4063372652 >> 172.21.15.60:0/4063372652 conn(0x7fe8800fb310 msgr2=0x7fe8800fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 -- 172.21.15.60:0/4063372652 shutdown_connections 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.609+0000 7fe888770700 1 -- 172.21.15.60:0/4063372652 wait complete. 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 Processor -- start 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 -- start start 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 0x7fe880103d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe880100fb0 0x7fe880102390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe880101950 0x7fe8801028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880103070 con 0x7fe8800ffdc0 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801031e0 con 0x7fe880101950 2023-10-05T15:14:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe888770700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801a0d00 con 0x7fe880100fb0 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe88650c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 0x7fe880103d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe88650c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 0x7fe880103d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35562/0 (socket says 172.21.15.60:35562) 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.610+0000 7fe88650c700 1 -- 172.21.15.60:0/1816089902 learned_addr learned my addr 172.21.15.60:0/1816089902 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe886d0d700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe880101950 0x7fe8801028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe885d0b700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe880100fb0 0x7fe880102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe88650c700 1 -- 172.21.15.60:0/1816089902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe880100fb0 msgr2=0x7fe880102390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe88650c700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe880100fb0 0x7fe880102390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe88650c700 1 -- 172.21.15.60:0/1816089902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe880101950 msgr2=0x7fe8801028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe88650c700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe880101950 0x7fe8801028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe88650c700 1 -- 172.21.15.60:0/1816089902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009d00 con 0x7fe8800ffdc0 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe88650c700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 0x7fe880103d50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b500 tx=0x7fe87c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:19.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c011830 con 0x7fe8800ffdc0 2023-10-05T15:14:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe87c011e50 con 0x7fe8800ffdc0 2023-10-05T15:14:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8801a0fe0 con 0x7fe8800ffdc0 2023-10-05T15:14:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c010dc0 con 0x7fe8800ffdc0 2023-10-05T15:14:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.611+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8801a1480 con 0x7fe8800ffdc0 2023-10-05T15:14:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.612+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88010b6e0 con 0x7fe8800ffdc0 2023-10-05T15:14:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.613+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe87c010380 con 0x7fe8800ffdc0 2023-10-05T15:14:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.614+0000 7fe8737fe700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe86c0a14d0 0x7fe86c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.614+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe87c0cc270 con 0x7fe8800ffdc0 2023-10-05T15:14:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.614+0000 7fe885d0b700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe86c0a14d0 0x7fe86c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.614+0000 7fe885d0b700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe86c0a14d0 0x7fe86c0a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe874005950 tx=0x7fe87400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.618+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe87c095d70 con 0x7fe8800ffdc0 2023-10-05T15:14:19.676 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:14:19 smithi092 systemd[1]: Starting Ceph mds.k for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:19.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.866+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe88010b8a0 con 0x7fe8800ffdc0 2023-10-05T15:14:19.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.868+0000 7fe8737fe700 1 -- 172.21.15.60:0/1816089902 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fe87c099390 con 0x7fe8800ffdc0 2023-10-05T15:14:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:19.870 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-05T15:14:19.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.871+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe86c0a14d0 msgr2=0x7fe86c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.871+0000 7fe888770700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe86c0a14d0 0x7fe86c0a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe874005950 tx=0x7fe87400b410 comp rx=0 tx=0).stop 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.871+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 msgr2=0x7fe880103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.871+0000 7fe888770700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 0x7fe880103d50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b500 tx=0x7fe87c00b810 comp rx=0 tx=0).stop 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 shutdown_connections 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe880101950 0x7fe8801028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe86c0a14d0 0x7fe86c0a3990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8800ffdc0 0x7fe880103d50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 --2- 172.21.15.60:0/1816089902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe880100fb0 0x7fe880102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:19.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 >> 172.21.15.60:0/1816089902 conn(0x7fe8800fb310 msgr2=0x7fe880068060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:19.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 shutdown_connections 2023-10-05T15:14:19.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:19.872+0000 7fe888770700 1 -- 172.21.15.60:0/1816089902 wait complete. 2023-10-05T15:14:19.875 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 2 2023-10-05T15:14:20.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:19 smithi092 ceph-mon[102944]: Deploying daemon mds.k on smithi092 2023-10-05T15:14:20.130 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:14:19 smithi092 podman[138615]: 2023-10-05T15:14:20.130 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mds[138655]: -- 172.21.15.92:0/3306786977 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56050f51f1e0 con 0x56050f4f4c00 2023-10-05T15:14:20.131 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:14:20 smithi092 bash[138615]: 8feb6f90f7d44db4436872a811ed2c4dd8bec785da5b4d27297576f16717cfe3 2023-10-05T15:14:20.131 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k[138631]: starting mds.k at 2023-10-05T15:14:20.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:19 smithi060 ceph-mon[99238]: Deploying daemon mds.k on smithi092 2023-10-05T15:14:20.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:19 smithi135 ceph-mon[103360]: Deploying daemon mds.k on smithi092 2023-10-05T15:14:20.426 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:14:20 smithi092 systemd[1]: Started Ceph mds.k for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:21.133 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:21.133 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1816089902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:21.133 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.133 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.133 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:21.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:21.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:20 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:21.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1816089902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:21.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:20 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1816089902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:21.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:21.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:21.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:20 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:21.883 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:14:21 smithi060 systemd[1]: Starting Ceph mds.j for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:21.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 -- 172.21.15.60:0/1741655140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 msgr2=0x7f28b4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/1741655140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4101410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28a40099c0 tx=0x7f28a4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 -- 172.21.15.60:0/1741655140 shutdown_connections 2023-10-05T15:14:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/1741655140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b4101950 0x7f28b4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/1741655140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b40ffdc0 0x7f28b41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/1741655140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4101410 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 -- 172.21.15.60:0/1741655140 >> 172.21.15.60:0/1741655140 conn(0x7f28b40fb310 msgr2=0x7f28b40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 -- 172.21.15.60:0/1741655140 shutdown_connections 2023-10-05T15:14:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.019+0000 7f28bc6aa700 1 -- 172.21.15.60:0/1741655140 wait complete. 2023-10-05T15:14:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 Processor -- start 2023-10-05T15:14:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 -- start start 2023-10-05T15:14:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b40ffdc0 0x7f28b4195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b4101950 0x7f28b419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b419d5e0 con 0x7f28b4100fb0 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b419d720 con 0x7f28b40ffdc0 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bc6aa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b419d8b0 con 0x7f28b4101950 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28b9c45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28b9c45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35576/0 (socket says 172.21.15.60:35576) 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28b9c45700 1 -- 172.21.15.60:0/4081673124 learned_addr learned my addr 172.21.15.60:0/4081673124 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28bac47700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b4101950 0x7f28b419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.020+0000 7f28ba446700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b40ffdc0 0x7f28b4195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28b9c45700 1 -- 172.21.15.60:0/4081673124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b4101950 msgr2=0x7f28b419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28b9c45700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b4101950 0x7f28b419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28b9c45700 1 -- 172.21.15.60:0/4081673124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b40ffdc0 msgr2=0x7f28b4195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28b9c45700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b40ffdc0 0x7f28b4195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28b9c45700 1 -- 172.21.15.60:0/4081673124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a40095f0 con 0x7f28b4100fb0 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28ba446700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b40ffdc0 0x7f28b4195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28bac47700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b4101950 0x7f28b419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28b9c45700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4195fa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009990 tx=0x7f28a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:22.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4003f70 con 0x7f28b4100fb0 2023-10-05T15:14:22.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28a40040d0 con 0x7f28b4100fb0 2023-10-05T15:14:22.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b4068040 con 0x7f28b4100fb0 2023-10-05T15:14:22.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40206a0 con 0x7f28b4100fb0 2023-10-05T15:14:22.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.021+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b4068540 con 0x7f28b4100fb0 2023-10-05T15:14:22.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.022+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b410b5d0 con 0x7f28b4100fb0 2023-10-05T15:14:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.024+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f28a4004830 con 0x7f28b4100fb0 2023-10-05T15:14:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.024+0000 7f28ab7fe700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f28a00a1550 0x7f28a00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.024+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f28a40d04d0 con 0x7f28b4100fb0 2023-10-05T15:14:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.024+0000 7f28ba446700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f28a00a1550 0x7f28a00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.025+0000 7f28ba446700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f28a00a1550 0x7f28a00a3a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28b0005950 tx=0x7f28b00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.030+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f28a409a060 con 0x7f28b4100fb0 2023-10-05T15:14:22.164 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:14:21 smithi060 podman[148918]: 2023-10-05T15:14:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:21 smithi060 ceph-mon[99238]: Deploying daemon mds.j on smithi060 2023-10-05T15:14:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:21 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6832/1259260250,v1:172.21.15.92:6833/1259260250] up:boot 2023-10-05T15:14:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:21 smithi060 ceph-mon[99238]: fsmap 2 up:standby 2023-10-05T15:14:22.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:21 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:14:22.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:21 smithi092 ceph-mon[102944]: Deploying daemon mds.j on smithi060 2023-10-05T15:14:22.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:21 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6832/1259260250,v1:172.21.15.92:6833/1259260250] up:boot 2023-10-05T15:14:22.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:21 smithi092 ceph-mon[102944]: fsmap 2 up:standby 2023-10-05T15:14:22.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:21 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:14:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.294+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28b4068760 con 0x7f28b4100fb0 2023-10-05T15:14:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.294+0000 7f28ab7fe700 1 -- 172.21.15.60:0/4081673124 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f28a409d680 con 0x7f28b4100fb0 2023-10-05T15:14:22.296 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:22.297 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f28a00a1550 msgr2=0x7f28a00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f28a00a1550 0x7f28a00a3a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28b0005950 tx=0x7f28b00058e0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 msgr2=0x7f28b4195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4195fa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009990 tx=0x7f28a4004730 comp rx=0 tx=0).stop 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 shutdown_connections 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28b4101950 0x7f28b419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28b40ffdc0 0x7f28b4195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f28a00a1550 0x7f28a00a3a10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 --2- 172.21.15.60:0/4081673124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28b4100fb0 0x7f28b4195fa0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 >> 172.21.15.60:0/4081673124 conn(0x7f28b40fb310 msgr2=0x7f28b40fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 shutdown_connections 2023-10-05T15:14:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:22.297+0000 7f28bc6aa700 1 -- 172.21.15.60:0/4081673124 wait complete. 2023-10-05T15:14:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 3 2023-10-05T15:14:22.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:21 smithi135 ceph-mon[103360]: Deploying daemon mds.j on smithi060 2023-10-05T15:14:22.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:21 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6832/1259260250,v1:172.21.15.92:6833/1259260250] up:boot 2023-10-05T15:14:22.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:21 smithi135 ceph-mon[103360]: fsmap 2 up:standby 2023-10-05T15:14:22.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:21 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:14:22.664 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:14:22 smithi060 bash[148918]: b2c0a1390fe94644731d2752ca11473107ad132b54aae42789a7c22a80cc7af8 2023-10-05T15:14:22.665 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mds[149001]: -- 172.21.15.60:0/3938092312 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dc4e4b71e0 con 0x55dc4e48cc00 2023-10-05T15:14:22.665 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-j[148977]: starting mds.j at 2023-10-05T15:14:22.665 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:14:22 smithi060 systemd[1]: Started Ceph mds.j for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4081673124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:23.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:22 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4081673124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:23.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:22 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:23.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:23.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4081673124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:23.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:23.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:23.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:23.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:22 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:24.165 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:14:23 smithi060 systemd[1]: Starting Ceph mds.d for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:23 smithi060 ceph-mon[99238]: Deploying daemon mds.d on smithi060 2023-10-05T15:14:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:23 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.60:6834/2448218707,v1:172.21.15.60:6835/2448218707] up:boot 2023-10-05T15:14:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:23 smithi060 ceph-mon[99238]: fsmap 3 up:standby 2023-10-05T15:14:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:23 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:14:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:23 smithi092 ceph-mon[102944]: Deploying daemon mds.d on smithi060 2023-10-05T15:14:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:23 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.60:6834/2448218707,v1:172.21.15.60:6835/2448218707] up:boot 2023-10-05T15:14:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:23 smithi092 ceph-mon[102944]: fsmap 3 up:standby 2023-10-05T15:14:24.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:23 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:14:24.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:23 smithi135 ceph-mon[103360]: Deploying daemon mds.d on smithi060 2023-10-05T15:14:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:23 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.60:6834/2448218707,v1:172.21.15.60:6835/2448218707] up:boot 2023-10-05T15:14:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:23 smithi135 ceph-mon[103360]: fsmap 3 up:standby 2023-10-05T15:14:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:23 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:14:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 -- 172.21.15.60:0/4110205262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc106c50 msgr2=0x7fb8cc109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 --2- 172.21.15.60:0/4110205262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc106c50 0x7fb8cc109040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400b0a0 tx=0x7fb8c400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 -- 172.21.15.60:0/4110205262 shutdown_connections 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 --2- 172.21.15.60:0/4110205262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc106c50 0x7fb8cc109040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 --2- 172.21.15.60:0/4110205262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8cc1019f0 0x7fb8cc103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 --2- 172.21.15.60:0/4110205262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc104320 0x7fb8cc106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 -- 172.21.15.60:0/4110205262 >> 172.21.15.60:0/4110205262 conn(0x7fb8cc0fb340 msgr2=0x7fb8cc0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 -- 172.21.15.60:0/4110205262 shutdown_connections 2023-10-05T15:14:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.448+0000 7fb8d3105700 1 -- 172.21.15.60:0/4110205262 wait complete. 2023-10-05T15:14:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 Processor -- start 2023-10-05T15:14:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 -- start start 2023-10-05T15:14:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc1019f0 0x7fb8cc101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 0x7fb8cc0ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8cc106c50 0x7fb8cc0ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc100680 con 0x7fb8cc104320 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1007f0 con 0x7fb8cc1019f0 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.449+0000 7fb8d3105700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1a0c90 con 0x7fb8cc106c50 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 0x7fb8cc0ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8d0ea1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc1019f0 0x7fb8cc101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 0x7fb8cc0ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35604/0 (socket says 172.21.15.60:35604) 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 -- 172.21.15.60:0/1376950706 learned_addr learned my addr 172.21.15.60:0/1376950706 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8d16a2700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8cc106c50 0x7fb8cc0ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 -- 172.21.15.60:0/1376950706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8cc106c50 msgr2=0x7fb8cc0ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8cc106c50 0x7fb8cc0ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 -- 172.21.15.60:0/1376950706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc1019f0 msgr2=0x7fb8cc101360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc1019f0 0x7fb8cc101360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 -- 172.21.15.60:0/1376950706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4009d00 con 0x7fb8cc104320 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8d0ea1700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc1019f0 0x7fb8cc101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8cbfff700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 0x7fb8cc0ff9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800d980 tx=0x7fb8b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8004220 con 0x7fb8cc104320 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8b8007640 con 0x7fb8cc104320 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc1a0f70 con 0x7fb8cc104320 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.450+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8005690 con 0x7fb8cc104320 2023-10-05T15:14:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.451+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc1a13f0 con 0x7fb8cc104320 2023-10-05T15:14:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.451+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc0fcec0 con 0x7fb8cc104320 2023-10-05T15:14:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.452+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb8b8004750 con 0x7fb8cc104320 2023-10-05T15:14:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.453+0000 7fb8c9ffb700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb8bc0a1550 0x7fb8bc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.453+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb8b80cc560 con 0x7fb8cc104320 2023-10-05T15:14:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.453+0000 7fb8d0ea1700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb8bc0a1550 0x7fb8bc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.453+0000 7fb8d0ea1700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb8bc0a1550 0x7fb8bc0a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0005950 tx=0x7fb8c000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:24.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.457+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb8b8096060 con 0x7fb8cc104320 2023-10-05T15:14:24.565 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:14:24 smithi060 podman[149304]: 2023-10-05T15:14:24.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.714+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8cc02cf70 con 0x7fb8cc104320 2023-10-05T15:14:24.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.715+0000 7fb8c9ffb700 1 -- 172.21.15.60:0/1376950706 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2910 (secure 0 0 0) 0x7fb8b8016b70 con 0x7fb8cc104320 2023-10-05T15:14:24.717 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb8bc0a1550 msgr2=0x7fb8bc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb8bc0a1550 0x7fb8bc0a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0005950 tx=0x7fb8c000b410 comp rx=0 tx=0).stop 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 msgr2=0x7fb8cc0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 0x7fb8cc0ff9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800d980 tx=0x7fb8b800dc90 comp rx=0 tx=0).stop 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 shutdown_connections 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8cc106c50 0x7fb8cc0ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8cc1019f0 0x7fb8cc101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb8bc0a1550 0x7fb8bc0a3a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 --2- 172.21.15.60:0/1376950706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8cc104320 0x7fb8cc0ff9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:24.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 >> 172.21.15.60:0/1376950706 conn(0x7fb8cc0fb340 msgr2=0x7fb8cc102660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:24.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 shutdown_connections 2023-10-05T15:14:24.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:24.717+0000 7fb8d3105700 1 -- 172.21.15.60:0/1376950706 wait complete. 2023-10-05T15:14:24.720 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 4 2023-10-05T15:14:24.899 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mds[149387]: -- 172.21.15.60:0/3094193145 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557cf477b1e0 con 0x557cf4751000 2023-10-05T15:14:24.899 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-d[149343]: starting mds.d at 2023-10-05T15:14:24.899 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:14:24 smithi060 bash[149304]: 224de475db8a5f15c1ecd093e6d07334e59c50ed67d95437348fbfceea9f1269 2023-10-05T15:14:24.899 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:14:24 smithi060 systemd[1]: Started Ceph mds.d for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:24.900 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:24.900 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:24.900 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1376950706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:24.900 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:24.900 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:24.900 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:24.901 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:24.901 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:24 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1376950706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:24 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1376950706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:25.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:25.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:24 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:26.032 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:25 smithi092 ceph-mon[102944]: Deploying daemon mds.e on smithi092 2023-10-05T15:14:26.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:25 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.60:6836/416878759,v1:172.21.15.60:6837/416878759] up:boot 2023-10-05T15:14:26.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:25 smithi092 ceph-mon[102944]: fsmap 4 up:standby 2023-10-05T15:14:26.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:25 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:14:26.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:25 smithi060 ceph-mon[99238]: Deploying daemon mds.e on smithi092 2023-10-05T15:14:26.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:25 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.60:6836/416878759,v1:172.21.15.60:6837/416878759] up:boot 2023-10-05T15:14:26.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:25 smithi060 ceph-mon[99238]: fsmap 4 up:standby 2023-10-05T15:14:26.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:25 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:14:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:25 smithi135 ceph-mon[103360]: Deploying daemon mds.e on smithi092 2023-10-05T15:14:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:25 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.60:6836/416878759,v1:172.21.15.60:6837/416878759] up:boot 2023-10-05T15:14:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:25 smithi135 ceph-mon[103360]: fsmap 4 up:standby 2023-10-05T15:14:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:25 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:14:26.426 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:14:26 smithi092 systemd[1]: Starting Ceph mds.e for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:26.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:26.813 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:14:26 smithi092 podman[138957]: 2023-10-05T15:14:26.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 -- 172.21.15.60:0/1796094342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb4101980 msgr2=0x7fdfb4103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:26.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 --2- 172.21.15.60:0/1796094342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb4101980 0x7fdfb4103d70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009990 tx=0x7fdfa4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 -- 172.21.15.60:0/1796094342 shutdown_connections 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 --2- 172.21.15.60:0/1796094342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb4106be0 0x7fdfb4109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 --2- 172.21.15.60:0/1796094342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb4101980 0x7fdfb4103d70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 --2- 172.21.15.60:0/1796094342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb41042b0 0x7fdfb41066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.872+0000 7fdfbc204700 1 -- 172.21.15.60:0/1796094342 >> 172.21.15.60:0/1796094342 conn(0x7fdfb40fb370 msgr2=0x7fdfb40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 -- 172.21.15.60:0/1796094342 shutdown_connections 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 -- 172.21.15.60:0/1796094342 wait complete. 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 Processor -- start 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 -- start start 2023-10-05T15:14:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb4101980 0x7fdfb4196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 0x7fdfb4197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb4106be0 0x7fdfb419e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb419e680 con 0x7fdfb41042b0 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb419e7c0 con 0x7fdfb4101980 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfbc204700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb419e950 con 0x7fdfb4106be0 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfb979f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 0x7fdfb4197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfb979f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 0x7fdfb4197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35632/0 (socket says 172.21.15.60:35632) 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.873+0000 7fdfb979f700 1 -- 172.21.15.60:0/3008864450 learned_addr learned my addr 172.21.15.60:0/3008864450 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfba7a1700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb4106be0 0x7fdfb419e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfb979f700 1 -- 172.21.15.60:0/3008864450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb4106be0 msgr2=0x7fdfb419e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfb979f700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb4106be0 0x7fdfb419e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfb979f700 1 -- 172.21.15.60:0/3008864450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb4101980 msgr2=0x7fdfb4196b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfb979f700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb4101980 0x7fdfb4196b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfb979f700 1 -- 172.21.15.60:0/3008864450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40095f0 con 0x7fdfb41042b0 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfba7a1700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb4106be0 0x7fdfb419e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfb979f700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 0x7fdfb4197040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000d950 tx=0x7fdfb000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0009b40 con 0x7fdfb41042b0 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfb0009ca0 con 0x7fdfb41042b0 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb419ec30 con 0x7fdfb41042b0 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000f620 con 0x7fdfb41042b0 2023-10-05T15:14:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.874+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb419f140 con 0x7fdfb41042b0 2023-10-05T15:14:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.875+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb40fcef0 con 0x7fdfb41042b0 2023-10-05T15:14:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.876+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdfb0010460 con 0x7fdfb41042b0 2023-10-05T15:14:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.877+0000 7fdfaaffd700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdfa00a14d0 0x7fdfa00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.877+0000 7fdfb9fa0700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdfa00a14d0 0x7fdfa00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.877+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdfb00ccc80 con 0x7fdfb41042b0 2023-10-05T15:14:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.877+0000 7fdfb9fa0700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdfa00a14d0 0x7fdfa00a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400b680 tx=0x7fdfa4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:26.881+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdfb00966e0 con 0x7fdfb41042b0 2023-10-05T15:14:27.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.138+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb410c6e0 con 0x7fdfb41042b0 2023-10-05T15:14:27.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.139+0000 7fdfaaffd700 1 -- 172.21.15.60:0/3008864450 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7fdfb0099d00 con 0x7fdfb41042b0 2023-10-05T15:14:27.141 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:27.141 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdfa00a14d0 msgr2=0x7fdfa00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdfa00a14d0 0x7fdfa00a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400b680 tx=0x7fdfa4000bc0 comp rx=0 tx=0).stop 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 msgr2=0x7fdfb4197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 0x7fdfb4197040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000d950 tx=0x7fdfb000dd10 comp rx=0 tx=0).stop 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 shutdown_connections 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfb4106be0 0x7fdfb419e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb4101980 0x7fdfb4196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdfa00a14d0 0x7fdfa00a3990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 --2- 172.21.15.60:0/3008864450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfb41042b0 0x7fdfb4197040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 >> 172.21.15.60:0/3008864450 conn(0x7fdfb40fb370 msgr2=0x7fdfb41025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:27.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 shutdown_connections 2023-10-05T15:14:27.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:27.141+0000 7fdfbc204700 1 -- 172.21.15.60:0/3008864450 wait complete. 2023-10-05T15:14:27.144 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 6 2023-10-05T15:14:27.153 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:26 smithi060 ceph-mon[99238]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:27.154 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:26 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:27.176 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:14:26 smithi092 ceph-mds[138997]: -- 172.21.15.92:0/3914776218 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c56aaa11e0 con 0x55c56aa76800 2023-10-05T15:14:27.176 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:14:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e[138973]: starting mds.e at 2023-10-05T15:14:27.176 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:14:26 smithi092 bash[138957]: bd4e7ebf43b67355bfe73d130c24250cd513e31280e29e890b472e68a813f8d3 2023-10-05T15:14:27.176 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:14:26 smithi092 systemd[1]: Started Ceph mds.e for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:27.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:26 smithi092 ceph-mon[102944]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:27.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:26 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:27.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:26 smithi135 ceph-mon[103360]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:27.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:26 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] up:boot 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: fsmap 5 up:standby 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: Deploying daemon mds.f on smithi135 2023-10-05T15:14:28.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:27 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3008864450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] up:boot 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: fsmap 5 up:standby 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:28.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: Deploying daemon mds.f on smithi135 2023-10-05T15:14:28.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:27 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3008864450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] up:boot 2023-10-05T15:14:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: fsmap 5 up:standby 2023-10-05T15:14:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:14:28.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:28.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:28.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:28.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:28.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: Deploying daemon mds.f on smithi135 2023-10-05T15:14:28.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:27 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3008864450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:28.581 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:14:28 smithi135 systemd[1]: Starting Ceph mds.f for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:28.984 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:28 smithi135 ceph-mon[103360]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:28.984 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:14:28 smithi135 podman[138951]: 2023-10-05T15:14:28.984 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:14:28 smithi135 ceph-mds[138991]: -- 172.21.15.135:0/1716210815 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5641817531e0 con 0x564181729000 2023-10-05T15:14:29.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:29.186 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:28 smithi060 ceph-mon[99238]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:29.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 -- 172.21.15.60:0/3856139873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0100fb0 msgr2=0x7fadb0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:29.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3856139873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0100fb0 0x7fadb0101410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fada00099c0 tx=0x7fada0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 -- 172.21.15.60:0/3856139873 shutdown_connections 2023-10-05T15:14:29.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3856139873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0101950 0x7fadb0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3856139873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb00ffdc0 0x7fadb01001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3856139873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0100fb0 0x7fadb0101410 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 -- 172.21.15.60:0/3856139873 >> 172.21.15.60:0/3856139873 conn(0x7fadb00fb310 msgr2=0x7fadb00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:29.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 -- 172.21.15.60:0/3856139873 shutdown_connections 2023-10-05T15:14:29.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.297+0000 7fadb4c08700 1 -- 172.21.15.60:0/3856139873 wait complete. 2023-10-05T15:14:29.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 Processor -- start 2023-10-05T15:14:29.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 -- start start 2023-10-05T15:14:29.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb00ffdc0 0x7fadb0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:29.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0100fb0 0x7fadb0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:29.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 0x7fadb019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:29.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb019d610 con 0x7fadb0101950 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb019d750 con 0x7fadb00ffdc0 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadb4c08700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb019d8e0 con 0x7fadb0100fb0 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.298+0000 7fadaed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 0x7fadb019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadaed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 0x7fadb019d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35648/0 (socket says 172.21.15.60:35648) 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0100fb0 0x7fadb0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadaed9d700 1 -- 172.21.15.60:0/3556380811 learned_addr learned my addr 172.21.15.60:0/3556380811 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadae59c700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb00ffdc0 0x7fadb0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 -- 172.21.15.60:0/3556380811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb00ffdc0 msgr2=0x7fadb0195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb00ffdc0 0x7fadb0195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 -- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 msgr2=0x7fadb019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:29.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 0x7fadb019d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 -- 172.21.15.60:0/3556380811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00095f0 con 0x7fadb0100fb0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadaed9d700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 0x7fadb019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadadd9b700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0100fb0 0x7fadb0195fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fada00098e0 tx=0x7fada000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada001d070 con 0x7fadb0100fb0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fada0005020 con 0x7fadb0100fb0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb0068040 con 0x7fadb0100fb0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0004a80 con 0x7fadb0100fb0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.299+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb0068460 con 0x7fadb0100fb0 2023-10-05T15:14:29.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.300+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb0068eb0 con 0x7fadb0100fb0 2023-10-05T15:14:29.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.301+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fada0005400 con 0x7fadb0100fb0 2023-10-05T15:14:29.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.302+0000 7fada77fe700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a14d0 0x7fad9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:29.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.302+0000 7fadae59c700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a14d0 0x7fad9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:29.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.302+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fada00cd340 con 0x7fadb0100fb0 2023-10-05T15:14:29.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.302+0000 7fadae59c700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a14d0 0x7fad9c0a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fadb0100e10 tx=0x7fad9800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:29.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.305+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fada0096ed0 con 0x7fadb0100fb0 2023-10-05T15:14:29.330 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:14:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[138967]: starting mds.f at 2023-10-05T15:14:29.330 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:14:29 smithi135 bash[138951]: 42014a784aa0cf9919e9d66ba7d4673750e2f677fb657be691481b75940ae6e5 2023-10-05T15:14:29.331 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:14:29 smithi135 systemd[1]: Started Ceph mds.f for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:29.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:28 smithi092 ceph-mon[102944]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.561+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadb010b620 con 0x7fadb0100fb0 2023-10-05T15:14:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.562+0000 7fada77fe700 1 -- 172.21.15.60:0/3556380811 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7fada0005190 con 0x7fadb0100fb0 2023-10-05T15:14:29.564 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:29.564 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-05T15:14:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a14d0 msgr2=0x7fad9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a14d0 0x7fad9c0a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fadb0100e10 tx=0x7fad9800b410 comp rx=0 tx=0).stop 2023-10-05T15:14:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0100fb0 msgr2=0x7fadb0195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0100fb0 0x7fadb0195fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fada00098e0 tx=0x7fada000f690 comp rx=0 tx=0).stop 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 shutdown_connections 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a14d0 0x7fad9c0a3990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb0101950 0x7fadb019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb00ffdc0 0x7fadb0195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 --2- 172.21.15.60:0/3556380811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb0100fb0 0x7fadb0195fd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 >> 172.21.15.60:0/3556380811 conn(0x7fadb00fb310 msgr2=0x7fadb00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 shutdown_connections 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:29.564+0000 7fadb4c08700 1 -- 172.21.15.60:0/3556380811 wait complete. 2023-10-05T15:14:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 6 2023-10-05T15:14:30.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: Deploying daemon mds.c on smithi135 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3556380811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6834/4284373269,v1:172.21.15.135:6835/4284373269] up:boot 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: fsmap 6 up:standby 2023-10-05T15:14:30.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:30 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: Deploying daemon mds.c on smithi135 2023-10-05T15:14:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3556380811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:30.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6834/4284373269,v1:172.21.15.135:6835/4284373269] up:boot 2023-10-05T15:14:30.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: fsmap 6 up:standby 2023-10-05T15:14:30.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:30 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: Deploying daemon mds.c on smithi135 2023-10-05T15:14:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3556380811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6834/4284373269,v1:172.21.15.135:6835/4284373269] up:boot 2023-10-05T15:14:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: fsmap 6 up:standby 2023-10-05T15:14:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:30 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:14:31.081 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:14:30 smithi135 systemd[1]: Starting Ceph mds.c for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:31.377 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:14:31 smithi135 podman[139291]: 2023-10-05T15:14:31.377 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:14:31 smithi135 bash[139291]: 0785e1a1c522c9cd367e52a2c321f246a72edfd3b79f2e090a2110f404c9459b 2023-10-05T15:14:31.377 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:14:31 smithi135 ceph-mds[139331]: -- 172.21.15.135:0/3358912579 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c6d4cdb1e0 con 0x55c6d4cb0c00 2023-10-05T15:14:31.377 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:14:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c[139307]: starting mds.c at 2023-10-05T15:14:31.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:31.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 -- 172.21.15.60:0/1128529369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c101950 msgr2=0x7f268c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 --2- 172.21.15.60:0/1128529369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c101950 0x7f268c108200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f268400b0d0 tx=0x7f268400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 -- 172.21.15.60:0/1128529369 shutdown_connections 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 --2- 172.21.15.60:0/1128529369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c101950 0x7f268c108200 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 --2- 172.21.15.60:0/1128529369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f268c0ffdc0 0x7f268c1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 --2- 172.21.15.60:0/1128529369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f268c100fb0 0x7f268c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 -- 172.21.15.60:0/1128529369 >> 172.21.15.60:0/1128529369 conn(0x7f268c0fb310 msgr2=0x7f268c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 -- 172.21.15.60:0/1128529369 shutdown_connections 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 -- 172.21.15.60:0/1128529369 wait complete. 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.718+0000 7f2691b0b700 1 Processor -- start 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 -- start start 2023-10-05T15:14:31.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 0x7f268c196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f268c100fb0 0x7f268c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f268c101950 0x7f268c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c19e770 con 0x7f268c0ffdc0 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c19e8e0 con 0x7f268c100fb0 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f2691b0b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c19eaa0 con 0x7f268c101950 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 0x7f268c196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 0x7f268c196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35658/0 (socket says 172.21.15.60:35658) 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 -- 172.21.15.60:0/2010411082 learned_addr learned my addr 172.21.15.60:0/2010411082 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268affd700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f268c100fb0 0x7f268c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268bfff700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f268c101950 0x7f268c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:31.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 -- 172.21.15.60:0/2010411082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f268c101950 msgr2=0x7f268c19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f268c101950 0x7f268c19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 -- 172.21.15.60:0/2010411082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f268c100fb0 msgr2=0x7f268c197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f268c100fb0 0x7f268c197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 -- 172.21.15.60:0/2010411082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684009d00 con 0x7f268c0ffdc0 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.719+0000 7f268b7fe700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 0x7f268c196c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f267c00e970 tx=0x7f267c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.720+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c009790 con 0x7f268c0ffdc0 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.720+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f267c00c7e0 con 0x7f268c0ffdc0 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.720+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c19ed80 con 0x7f268c0ffdc0 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.720+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c003c70 con 0x7f268c0ffdc0 2023-10-05T15:14:31.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.720+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c19f1d0 con 0x7f268c0ffdc0 2023-10-05T15:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.721+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c10b5e0 con 0x7f268c0ffdc0 2023-10-05T15:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.722+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f267c00cc50 con 0x7f268c0ffdc0 2023-10-05T15:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.722+0000 7f2688ff9700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f26780a14d0 0x7f26780a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.722+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f267c014070 con 0x7f268c0ffdc0 2023-10-05T15:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.722+0000 7f268affd700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f26780a14d0 0x7f26780a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.723+0000 7f268affd700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f26780a14d0 0x7f26780a3990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2674009c60 tx=0x7f2674009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:31.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.727+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f267c096510 con 0x7f268c0ffdc0 2023-10-05T15:14:31.830 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:14:31 smithi135 systemd[1]: Started Ceph mds.c for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:31.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.989+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f268c19f420 con 0x7f268c0ffdc0 2023-10-05T15:14:31.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.990+0000 7f2688ff9700 1 -- 172.21.15.60:0/2010411082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6077 (secure 0 0 0) 0x7f267c003dd0 con 0x7f268c0ffdc0 2023-10-05T15:14:31.992 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:31.992 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f26780a14d0 msgr2=0x7f26780a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f26780a14d0 0x7f26780a3990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2674009c60 tx=0x7f2674009260 comp rx=0 tx=0).stop 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 msgr2=0x7f268c196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 0x7f268c196c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f267c00e970 tx=0x7f267c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 shutdown_connections 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f268c101950 0x7f268c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f26780a14d0 0x7f26780a3990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f268c0ffdc0 0x7f268c196c30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 --2- 172.21.15.60:0/2010411082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f268c100fb0 0x7f268c197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 >> 172.21.15.60:0/2010411082 conn(0x7f268c0fb310 msgr2=0x7f268c068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:31.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 shutdown_connections 2023-10-05T15:14:31.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:31.992+0000 7f2691b0b700 1 -- 172.21.15.60:0/2010411082 wait complete. 2023-10-05T15:14:31.995 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-05T15:14:32.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:32.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:32.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:32.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:32.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: Deploying daemon mds.h on smithi092 2023-10-05T15:14:32.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] up:boot 2023-10-05T15:14:32.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: fsmap 7 up:standby 2023-10-05T15:14:32.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:14:32.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:32 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2010411082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: Deploying daemon mds.h on smithi092 2023-10-05T15:14:32.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] up:boot 2023-10-05T15:14:32.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: fsmap 7 up:standby 2023-10-05T15:14:32.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:14:32.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:32 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2010411082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: Deploying daemon mds.h on smithi092 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] up:boot 2023-10-05T15:14:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: fsmap 7 up:standby 2023-10-05T15:14:32.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:14:32.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:32 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2010411082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:33.176 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:14:33 smithi092 systemd[1]: Starting Ceph mds.h for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:33.593 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:14:33 smithi092 podman[139299]: 2023-10-05T15:14:33.926 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:14:33 smithi092 ceph-mds[139339]: -- 172.21.15.92:0/3102798295 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560fda9c71e0 con 0x560fda99c800 2023-10-05T15:14:33.926 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:14:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h[139315]: starting mds.h at 2023-10-05T15:14:33.926 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:14:33 smithi092 bash[139299]: 50d3ff0515d91b7357cf123e1567cf2023e21d590a2f630ffa7e726c531ed0a2 2023-10-05T15:14:33.926 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:14:33 smithi092 systemd[1]: Started Ceph mds.h for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:34.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:34.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 -- 172.21.15.60:0/2206270944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 msgr2=0x7feed0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:34.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 --2- 172.21.15.60:0/2206270944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0100180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feeb80099c0 tx=0x7feeb8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 -- 172.21.15.60:0/2206270944 shutdown_connections 2023-10-05T15:14:34.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 --2- 172.21.15.60:0/2206270944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed01018f0 0x7feed01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 --2- 172.21.15.60:0/2206270944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0100180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 --2- 172.21.15.60:0/2206270944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0100f50 0x7feed01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 -- 172.21.15.60:0/2206270944 >> 172.21.15.60:0/2206270944 conn(0x7feed00fb2b0 msgr2=0x7feed00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 -- 172.21.15.60:0/2206270944 shutdown_connections 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.147+0000 7feed61c3700 1 -- 172.21.15.60:0/2206270944 wait complete. 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 Processor -- start 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 -- start start 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 0x7feed0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed01018f0 0x7feed019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019e6d0 con 0x7feed0100f50 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019e810 con 0x7feed00ffd60 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feed61c3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019e9a0 con 0x7feed01018f0 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 0x7feed0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 0x7feed0197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35674/0 (socket says 172.21.15.60:35674) 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 -- 172.21.15.60:0/480701643 learned_addr learned my addr 172.21.15.60:0/480701643 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feecf7fe700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feecffff700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed01018f0 0x7feed019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 -- 172.21.15.60:0/480701643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed01018f0 msgr2=0x7feed019e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed01018f0 0x7feed019e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 -- 172.21.15.60:0/480701643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 msgr2=0x7feed0196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feeceffd700 1 -- 172.21.15.60:0/480701643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80095f0 con 0x7feed0100f50 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.148+0000 7feecf7fe700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.149+0000 7feeceffd700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 0x7feed0197090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feec000e9a0 tx=0x7feec000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.149+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0009790 con 0x7feed0100f50 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.149+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feec0010430 con 0x7feed0100f50 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.149+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed019ec80 con 0x7feed0100f50 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.149+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0018680 con 0x7feed0100f50 2023-10-05T15:14:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.149+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed019f190 con 0x7feed0100f50 2023-10-05T15:14:34.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.150+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed010b5c0 con 0x7feed0100f50 2023-10-05T15:14:34.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.152+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7feec00105a0 con 0x7feed0100f50 2023-10-05T15:14:34.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.152+0000 7feeccff9700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7feebc0a14d0 0x7feebc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:34.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.152+0000 7feecf7fe700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7feebc0a14d0 0x7feebc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:34.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.152+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feec0014070 con 0x7feed0100f50 2023-10-05T15:14:34.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.153+0000 7feecf7fe700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7feebc0a14d0 0x7feebc0a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009990 tx=0x7feeb801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:34.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.156+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feec0096740 con 0x7feed0100f50 2023-10-05T15:14:34.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.409+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feed010b7d0 con 0x7feed0100f50 2023-10-05T15:14:34.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.409+0000 7feeccff9700 1 -- 172.21.15.60:0/480701643 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6077 (secure 0 0 0) 0x7feec0099d60 con 0x7feed0100f50 2023-10-05T15:14:34.411 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:34.411 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-05T15:14:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.411+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7feebc0a14d0 msgr2=0x7feebc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.411+0000 7feed61c3700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7feebc0a14d0 0x7feebc0a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009990 tx=0x7feeb801a040 comp rx=0 tx=0).stop 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.411+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 msgr2=0x7feed0197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.411+0000 7feed61c3700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 0x7feed0197090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feec000e9a0 tx=0x7feec000ecb0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 shutdown_connections 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed01018f0 0x7feed019e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed00ffd60 0x7feed0196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7feebc0a14d0 0x7feebc0a3990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 --2- 172.21.15.60:0/480701643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feed0100f50 0x7feed0197090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 >> 172.21.15.60:0/480701643 conn(0x7feed00fb2b0 msgr2=0x7feed00680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 shutdown_connections 2023-10-05T15:14:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:34.412+0000 7feed61c3700 1 -- 172.21.15.60:0/480701643 wait complete. 2023-10-05T15:14:34.415 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-05T15:14:34.970 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:34.970 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:34.970 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:34.970 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: Deploying daemon mds.i on smithi135 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/480701643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] up:boot 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: fsmap 8 up:standby 2023-10-05T15:14:34.971 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:34 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: Deploying daemon mds.i on smithi135 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/480701643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:35.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] up:boot 2023-10-05T15:14:35.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: fsmap 8 up:standby 2023-10-05T15:14:35.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:34 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: Deploying daemon mds.i on smithi135 2023-10-05T15:14:35.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/480701643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:35.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] up:boot 2023-10-05T15:14:35.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: fsmap 8 up:standby 2023-10-05T15:14:35.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:34 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:14:35.581 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:14:35 smithi135 systemd[1]: Starting Ceph mds.i for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:35.903 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:14:35 smithi135 podman[139629]: 2023-10-05T15:14:36.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:14:35 smithi135 ceph-mds[139669]: -- 172.21.15.135:0/1235393621 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56142ef391e0 con 0x56142ef0f000 2023-10-05T15:14:36.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:14:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: starting mds.i at 2023-10-05T15:14:36.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:14:35 smithi135 bash[139629]: ef3824d35edf5bfad44a13570d901c21510374921fafd745faa99ef316aa6b58 2023-10-05T15:14:36.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:14:36 smithi135 systemd[1]: Started Ceph mds.i for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:36.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:36.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 -- 172.21.15.60:0/3743905791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0341019e0 msgr2=0x7ff034103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:36.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 --2- 172.21.15.60:0/3743905791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0341019e0 0x7ff034103dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff024009990 tx=0x7ff024009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 -- 172.21.15.60:0/3743905791 shutdown_connections 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 --2- 172.21.15.60:0/3743905791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034106c40 0x7ff034109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 --2- 172.21.15.60:0/3743905791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0341019e0 0x7ff034103dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 --2- 172.21.15.60:0/3743905791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff034104310 0x7ff034106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 -- 172.21.15.60:0/3743905791 >> 172.21.15.60:0/3743905791 conn(0x7ff0340fb370 msgr2=0x7ff0340fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 -- 172.21.15.60:0/3743905791 shutdown_connections 2023-10-05T15:14:36.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.564+0000 7ff038aa2700 1 -- 172.21.15.60:0/3743905791 wait complete. 2023-10-05T15:14:36.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 Processor -- start 2023-10-05T15:14:36.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 -- start start 2023-10-05T15:14:36.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0341019e0 0x7ff034196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:36.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 0x7ff034197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:36.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff034106c40 0x7ff03419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03419e6d0 con 0x7ff034104310 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03419e810 con 0x7ff034106c40 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.565+0000 7ff038aa2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03419e9a0 con 0x7ff0341019e0 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 0x7ff034197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 0x7ff034197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35686/0 (socket says 172.21.15.60:35686) 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 -- 172.21.15.60:0/878625472 learned_addr learned my addr 172.21.15.60:0/878625472 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff032d9d700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff034106c40 0x7ff03419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff03259c700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0341019e0 0x7ff034196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 -- 172.21.15.60:0/878625472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0341019e0 msgr2=0x7ff034196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0341019e0 0x7ff034196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 -- 172.21.15.60:0/878625472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff034106c40 msgr2=0x7ff03419e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:36.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff034106c40 0x7ff03419e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 -- 172.21.15.60:0/878625472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240095f0 con 0x7ff034104310 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff031d9b700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 0x7ff034197090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d950 tx=0x7ff02800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800f890 con 0x7ff034104310 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff028010460 con 0x7ff034104310 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03419ec80 con 0x7ff034104310 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800e610 con 0x7ff034104310 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.566+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03419f190 con 0x7ff034104310 2023-10-05T15:14:36.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.567+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03410c730 con 0x7ff034104310 2023-10-05T15:14:36.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.569+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff0280108d0 con 0x7ff034104310 2023-10-05T15:14:36.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.569+0000 7ff0237fe700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff01c0a14d0 0x7ff01c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:36.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.569+0000 7ff03259c700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff01c0a14d0 0x7ff01c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:36.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.569+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff0280cc5e0 con 0x7ff034104310 2023-10-05T15:14:36.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.570+0000 7ff03259c700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff01c0a14d0 0x7ff01c0a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff02400b2e0 tx=0x7ff024005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:36.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.574+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0280960e0 con 0x7ff034104310 2023-10-05T15:14:36.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.846+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff03419f320 con 0x7ff034104310 2023-10-05T15:14:36.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.846+0000 7ff0237fe700 1 -- 172.21.15.60:0/878625472 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7664 (secure 0 0 0) 0x7ff028099700 con 0x7ff034104310 2023-10-05T15:14:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:36.848 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-05T15:14:36.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff01c0a14d0 msgr2=0x7ff01c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:36.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff01c0a14d0 0x7ff01c0a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff02400b2e0 tx=0x7ff024005fb0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 msgr2=0x7ff034197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 0x7ff034197090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d950 tx=0x7ff02800dc60 comp rx=0 tx=0).stop 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 shutdown_connections 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff034106c40 0x7ff03419e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0341019e0 0x7ff034196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff01c0a14d0 0x7ff01c0a3990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 --2- 172.21.15.60:0/878625472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff034104310 0x7ff034197090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.848+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 >> 172.21.15.60:0/878625472 conn(0x7ff0340fb370 msgr2=0x7ff034102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.849+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 shutdown_connections 2023-10-05T15:14:36.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:36.849+0000 7ff038aa2700 1 -- 172.21.15.60:0/878625472 wait complete. 2023-10-05T15:14:36.852 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 10 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:37.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:36 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:37.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:37.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:36 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:37.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:37.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:36 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:37.736 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:14:37 smithi060 systemd[1]: Starting Ceph mds.g for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:38.030 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:37 smithi060 ceph-mon[99238]: Deploying daemon mds.g on smithi060 2023-10-05T15:14:38.030 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:37 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:boot 2023-10-05T15:14:38.030 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:37 smithi060 ceph-mon[99238]: fsmap 9 up:standby 2023-10-05T15:14:38.030 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:37 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:14:38.030 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:37 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/878625472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:37 smithi092 ceph-mon[102944]: Deploying daemon mds.g on smithi060 2023-10-05T15:14:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:37 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:boot 2023-10-05T15:14:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:37 smithi092 ceph-mon[102944]: fsmap 9 up:standby 2023-10-05T15:14:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:37 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:14:38.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:37 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/878625472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:38.304 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:14:38 smithi060 podman[149916]: 2023-10-05T15:14:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:37 smithi135 ceph-mon[103360]: Deploying daemon mds.g on smithi060 2023-10-05T15:14:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:37 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:boot 2023-10-05T15:14:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:37 smithi135 ceph-mon[103360]: fsmap 9 up:standby 2023-10-05T15:14:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:37 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:14:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:37 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/878625472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:38.664 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:14:38 smithi060 bash[149916]: e37cb2320c6e1a90270c682ed770a28b5bb06fd96cc2ace8145bf4a654c0a5da 2023-10-05T15:14:38.665 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mds[149956]: -- 172.21.15.60:0/3504061062 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5613552731e0 con 0x561355249000 2023-10-05T15:14:38.665 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g[149932]: starting mds.g at 2023-10-05T15:14:38.665 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:14:38 smithi060 systemd[1]: Started Ceph mds.g for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:38.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:38.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 -- 172.21.15.60:0/6742650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 msgr2=0x7f83f0100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 --2- 172.21.15.60:0/6742650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0100220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0099c0 tx=0x7f83ec009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 -- 172.21.15.60:0/6742650 shutdown_connections 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 --2- 172.21.15.60:0/6742650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101990 0x7f83f0108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 --2- 172.21.15.60:0/6742650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0100220 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 --2- 172.21.15.60:0/6742650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83f0100ff0 0x7f83f0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 -- 172.21.15.60:0/6742650 >> 172.21.15.60:0/6742650 conn(0x7f83f00fb370 msgr2=0x7f83f00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 -- 172.21.15.60:0/6742650 shutdown_connections 2023-10-05T15:14:39.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.997+0000 7f83f72f8700 1 -- 172.21.15.60:0/6742650 wait complete. 2023-10-05T15:14:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 Processor -- start 2023-10-05T15:14:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 -- start start 2023-10-05T15:14:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83f0100ff0 0x7f83f0195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101990 0x7f83f019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019d5f0 con 0x7f83f00ffe00 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019d730 con 0x7f83f0100ff0 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.998+0000 7f83f72f8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019d8c0 con 0x7f83f0101990 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35712/0 (socket says 172.21.15.60:35712) 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 -- 172.21.15.60:0/961367722 learned_addr learned my addr 172.21.15.60:0/961367722 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5895700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101990 0x7f83f019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f4893700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83f0100ff0 0x7f83f0195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 -- 172.21.15.60:0/961367722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101990 msgr2=0x7f83f019d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101990 0x7f83f019d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 -- 172.21.15.60:0/961367722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83f0100ff0 msgr2=0x7f83f0195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83f0100ff0 0x7f83f0195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 -- 172.21.15.60:0/961367722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec0095f0 con 0x7f83f00ffe00 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f5094700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0195a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009990 tx=0x7f83ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec01f070 con 0x7f83f00ffe00 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83ec01ab50 con 0x7f83f00ffe00 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec004050 con 0x7f83f00ffe00 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f0069010 con 0x7f83f00ffe00 2023-10-05T15:14:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:38.999+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f00694c0 con 0x7f83f00ffe00 2023-10-05T15:14:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.001+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f010b610 con 0x7f83f00ffe00 2023-10-05T15:14:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.002+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f83ec023070 con 0x7f83f00ffe00 2023-10-05T15:14:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.002+0000 7f83e67fc700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83dc0a1550 0x7f83dc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.002+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f83ec0cf780 con 0x7f83f00ffe00 2023-10-05T15:14:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.002+0000 7f83f4893700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83dc0a1550 0x7f83dc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.003+0000 7f83f4893700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83dc0a1550 0x7f83dc0a3a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005950 tx=0x7f83e000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:39.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.006+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83ec099310 con 0x7f83f00ffe00 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:38 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:39.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:38 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:39.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:39.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:39.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:38 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.260+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83f0069910 con 0x7f83f00ffe00 2023-10-05T15:14:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.261+0000 7f83e67fc700 1 -- 172.21.15.60:0/961367722 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8456 (secure 0 0 0) 0x7f83ec0a1e60 con 0x7f83f00ffe00 2023-10-05T15:14:39.263 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:39.263 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-05T15:14:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83dc0a1550 msgr2=0x7f83dc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83dc0a1550 0x7f83dc0a3a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005950 tx=0x7f83e000b410 comp rx=0 tx=0).stop 2023-10-05T15:14:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 msgr2=0x7f83f0195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0195a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009990 tx=0x7f83ec004730 comp rx=0 tx=0).stop 2023-10-05T15:14:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 shutdown_connections 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101990 0x7f83f019d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83dc0a1550 0x7f83dc0a3a10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83f00ffe00 0x7f83f0195a70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 --2- 172.21.15.60:0/961367722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83f0100ff0 0x7f83f0195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 >> 172.21.15.60:0/961367722 conn(0x7f83f00fb370 msgr2=0x7f83f00fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 shutdown_connections 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:39.263+0000 7f83f72f8700 1 -- 172.21.15.60:0/961367722 wait complete. 2023-10-05T15:14:39.266 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2023-10-05T15:14:39.912 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:39 smithi060 ceph-mon[99238]: Deploying daemon mds.a on smithi060 2023-10-05T15:14:40.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:39 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.60:6838/1500527837,v1:172.21.15.60:6839/1500527837] up:boot 2023-10-05T15:14:40.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:39 smithi060 ceph-mon[99238]: fsmap 10 up:standby 2023-10-05T15:14:40.084 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:39 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:14:40.085 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:39 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/961367722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:39 smithi092 ceph-mon[102944]: Deploying daemon mds.a on smithi060 2023-10-05T15:14:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:39 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.60:6838/1500527837,v1:172.21.15.60:6839/1500527837] up:boot 2023-10-05T15:14:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:39 smithi092 ceph-mon[102944]: fsmap 10 up:standby 2023-10-05T15:14:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:39 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:14:40.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:39 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/961367722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:40.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:39 smithi135 ceph-mon[103360]: Deploying daemon mds.a on smithi060 2023-10-05T15:14:40.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:39 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.60:6838/1500527837,v1:172.21.15.60:6839/1500527837] up:boot 2023-10-05T15:14:40.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:39 smithi135 ceph-mon[103360]: fsmap 10 up:standby 2023-10-05T15:14:40.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:39 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:14:40.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:39 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/961367722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:40.461 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:14:39 smithi060 systemd[1]: Starting Ceph mds.a for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:40.461 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:14:40 smithi060 podman[150301]: 2023-10-05T15:14:40.849 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mds[150341]: -- 172.21.15.60:0/1764507009 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bfbae5d1e0 con 0x55bfbae32c00 2023-10-05T15:14:40.849 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a[150317]: starting mds.a at 2023-10-05T15:14:40.850 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:14:40 smithi060 bash[150301]: 80f1b51daa3d6e45cd3c0b53498de4ee7bb0c936da766b8db128bb7bba27f6e2 2023-10-05T15:14:40.850 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:14:40 smithi060 systemd[1]: Started Ceph mds.a for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:41.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:41.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:41.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:41.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:40 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:41.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:41.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:40 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:41.505 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.505 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.505 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:41.505 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:14:41.505 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:14:41.505 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:40 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 -- 172.21.15.60:0/4089143325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 msgr2=0x7fcf04109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 --2- 172.21.15.60:0/4089143325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 0x7fcf04109010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009f90 tx=0x7fcefc00b330 comp rx=0 tx=0).stop 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 -- 172.21.15.60:0/4089143325 shutdown_connections 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 --2- 172.21.15.60:0/4089143325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 0x7fcf04109010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 --2- 172.21.15.60:0/4089143325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041019c0 0x7fcf04103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 --2- 172.21.15.60:0/4089143325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041042f0 0x7fcf041066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 -- 172.21.15.60:0/4089143325 >> 172.21.15.60:0/4089143325 conn(0x7fcf040fb310 msgr2=0x7fcf040fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 -- 172.21.15.60:0/4089143325 shutdown_connections 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.429+0000 7fcf098b5700 1 -- 172.21.15.60:0/4089143325 wait complete. 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 Processor -- start 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 -- start start 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 0x7fcf04101330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041042f0 0x7fcf040ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 0x7fcf040ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04100650 con 0x7fcf041019c0 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041007c0 con 0x7fcf04106c20 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf098b5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041a0cc0 con 0x7fcf041042f0 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 0x7fcf04101330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:41.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 0x7fcf04101330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35738/0 (socket says 172.21.15.60:35738) 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 -- 172.21.15.60:0/2741554783 learned_addr learned my addr 172.21.15.60:0/2741554783 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf027fc700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041042f0 0x7fcf040ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf037fe700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 0x7fcf040ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 -- 172.21.15.60:0/2741554783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041042f0 msgr2=0x7fcf040ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041042f0 0x7fcf040ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 -- 172.21.15.60:0/2741554783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 msgr2=0x7fcf040ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.430+0000 7fcf02ffd700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 0x7fcf040ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf02ffd700 1 -- 172.21.15.60:0/2741554783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80095f0 con 0x7fcf041019c0 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf027fc700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041042f0 0x7fcf040ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf02ffd700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 0x7fcf04101330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcef400d950 tx=0x7fcef400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4009b40 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc009c40 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcef4009ca0 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400f620 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.431+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf041a1230 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.432+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf040fce90 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.433+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcef4010460 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.434+0000 7fcf088b3700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fceec0a14d0 0x7fceec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.434+0000 7fcf027fc700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fceec0a14d0 0x7fceec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.434+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcef40ccc20 con 0x7fcf041019c0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.434+0000 7fcf027fc700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fceec0a14d0 0x7fceec0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcef8005fd0 tx=0x7fcef8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.437+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcef4096720 con 0x7fcf041019c0 2023-10-05T15:14:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.685+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf0410c6a0 con 0x7fcf041019c0 2023-10-05T15:14:41.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.686+0000 7fcf088b3700 1 -- 172.21.15.60:0/2741554783 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9248 (secure 0 0 0) 0x7fcef4099d40 con 0x7fcf041019c0 2023-10-05T15:14:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:41.688 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-05T15:14:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fceec0a14d0 msgr2=0x7fceec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fceec0a14d0 0x7fceec0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcef8005fd0 tx=0x7fcef8009310 comp rx=0 tx=0).stop 2023-10-05T15:14:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 msgr2=0x7fcf04101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 0x7fcf04101330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcef400d950 tx=0x7fcef400dd10 comp rx=0 tx=0).stop 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 shutdown_connections 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf04106c20 0x7fcf040ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fceec0a14d0 0x7fceec0a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf041019c0 0x7fcf04101330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 --2- 172.21.15.60:0/2741554783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf041042f0 0x7fcf040ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.688+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 >> 172.21.15.60:0/2741554783 conn(0x7fcf040fb310 msgr2=0x7fcf04102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.689+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 shutdown_connections 2023-10-05T15:14:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:41.689+0000 7fcf098b5700 1 -- 172.21.15.60:0/2741554783 wait complete. 2023-10-05T15:14:41.692 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 12 2023-10-05T15:14:42.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:41 smithi060 ceph-mon[99238]: Deploying daemon mds.b on smithi092 2023-10-05T15:14:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:41 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.60:6840/1110694579,v1:172.21.15.60:6841/1110694579] up:boot 2023-10-05T15:14:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:41 smithi060 ceph-mon[99238]: fsmap 11 up:standby 2023-10-05T15:14:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:41 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:14:42.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:41 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2741554783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:41 smithi092 ceph-mon[102944]: Deploying daemon mds.b on smithi092 2023-10-05T15:14:42.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:41 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.60:6840/1110694579,v1:172.21.15.60:6841/1110694579] up:boot 2023-10-05T15:14:42.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:41 smithi092 ceph-mon[102944]: fsmap 11 up:standby 2023-10-05T15:14:42.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:41 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:14:42.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:41 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2741554783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:42.177 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:42 smithi092 systemd[1]: Starting Ceph mds.b for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:14:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:41 smithi135 ceph-mon[103360]: Deploying daemon mds.b on smithi092 2023-10-05T15:14:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:41 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.60:6840/1110694579,v1:172.21.15.60:6841/1110694579] up:boot 2023-10-05T15:14:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:41 smithi135 ceph-mon[103360]: fsmap 11 up:standby 2023-10-05T15:14:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:41 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:14:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:41 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2741554783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:42.650 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:42 smithi092 podman[139638]: 2023-10-05T15:14:42.650 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mds[139678]: -- 172.21.15.92:0/3096870351 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d841e791e0 con 0x55d841e4f000 2023-10-05T15:14:42.926 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: starting mds.b at 2023-10-05T15:14:42.926 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:42 smithi092 bash[139638]: b5df32fa0c9afcf52faa478e3e05b4101b3acc62d0470a47a49076eaaec9d5d2 2023-10-05T15:14:42.926 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:42 smithi092 systemd[1]: Started Ceph mds.b for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:14:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mon[102944]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:42.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:42.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:42.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:42.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:42.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:42 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:42 smithi060 ceph-mon[99238]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:42 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:42 smithi135 ceph-mon[103360]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:42 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:43.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:43.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 -- 172.21.15.60:0/1825156371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 msgr2=0x7ff198101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:43.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 --2- 172.21.15.60:0/1825156371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198101410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1840099c0 tx=0x7ff184009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:43.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 -- 172.21.15.60:0/1825156371 shutdown_connections 2023-10-05T15:14:43.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 --2- 172.21.15.60:0/1825156371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff198101950 0x7ff198108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 --2- 172.21.15.60:0/1825156371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1980ffdc0 0x7ff1981001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 --2- 172.21.15.60:0/1825156371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198101410 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 -- 172.21.15.60:0/1825156371 >> 172.21.15.60:0/1825156371 conn(0x7ff1980fb310 msgr2=0x7ff1980fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 -- 172.21.15.60:0/1825156371 shutdown_connections 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.831+0000 7ff19f209700 1 -- 172.21.15.60:0/1825156371 wait complete. 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 Processor -- start 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 -- start start 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1980ffdc0 0x7ff198196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198101950 0x7ff19819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19819e6d0 con 0x7ff198100fb0 2023-10-05T15:14:43.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19819e810 con 0x7ff198101950 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19f209700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19819e9a0 con 0x7ff1980ffdc0 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff197fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff197fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35750/0 (socket says 172.21.15.60:35750) 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff197fff700 1 -- 172.21.15.60:0/4172353306 learned_addr learned my addr 172.21.15.60:0/4172353306 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19d7a6700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198101950 0x7ff19819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.832+0000 7ff19cfa5700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1980ffdc0 0x7ff198196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff197fff700 1 -- 172.21.15.60:0/4172353306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1980ffdc0 msgr2=0x7ff198196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff197fff700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1980ffdc0 0x7ff198196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff197fff700 1 -- 172.21.15.60:0/4172353306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198101950 msgr2=0x7ff19819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff197fff700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198101950 0x7ff19819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff197fff700 1 -- 172.21.15.60:0/4172353306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1840095f0 con 0x7ff198100fb0 2023-10-05T15:14:43.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff197fff700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198197090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff184009fd0 tx=0x7ff18400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:43.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18401d070 con 0x7ff198100fb0 2023-10-05T15:14:43.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff184005030 con 0x7ff198100fb0 2023-10-05T15:14:43.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19819ec20 con 0x7ff198100fb0 2023-10-05T15:14:43.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184004b30 con 0x7ff198100fb0 2023-10-05T15:14:43.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.833+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19819f040 con 0x7ff198100fb0 2023-10-05T15:14:43.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.834+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19810b640 con 0x7ff198100fb0 2023-10-05T15:14:43.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.835+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff184005410 con 0x7ff198100fb0 2023-10-05T15:14:43.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.836+0000 7ff195ffb700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff1880a14d0 0x7ff1880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:43.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.836+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff1840cdad0 con 0x7ff198100fb0 2023-10-05T15:14:43.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.836+0000 7ff19cfa5700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff1880a14d0 0x7ff1880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:43.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.836+0000 7ff19cfa5700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff1880a14d0 0x7ff1880a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff198100e10 tx=0x7ff18c007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:43.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:43.839+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff184097660 con 0x7ff198100fb0 2023-10-05T15:14:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.102+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff19819f1d0 con 0x7ff198100fb0 2023-10-05T15:14:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.103+0000 7ff195ffb700 1 -- 172.21.15.60:0/4172353306 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10031 (secure 0 0 0) 0x7ff18409ac80 con 0x7ff198100fb0 2023-10-05T15:14:44.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:44.105 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-05T15:14:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff1880a14d0 msgr2=0x7ff1880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff1880a14d0 0x7ff1880a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff198100e10 tx=0x7ff18c007400 comp rx=0 tx=0).stop 2023-10-05T15:14:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 msgr2=0x7ff198197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198197090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff184009fd0 tx=0x7ff18400f690 comp rx=0 tx=0).stop 2023-10-05T15:14:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 shutdown_connections 2023-10-05T15:14:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198101950 0x7ff19819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1980ffdc0 0x7ff198196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff1880a14d0 0x7ff1880a3990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 --2- 172.21.15.60:0/4172353306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff198100fb0 0x7ff198197090 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 >> 172.21.15.60:0/4172353306 conn(0x7ff1980fb310 msgr2=0x7ff198068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 shutdown_connections 2023-10-05T15:14:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.105+0000 7ff19f209700 1 -- 172.21.15.60:0/4172353306 wait complete. 2023-10-05T15:14:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2023-10-05T15:14:44.120 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:43 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] up:boot 2023-10-05T15:14:44.120 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:43 smithi060 ceph-mon[99238]: fsmap 12 up:standby 2023-10-05T15:14:44.120 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:14:44.120 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:43 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:44.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:14:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:43 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] up:boot 2023-10-05T15:14:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:43 smithi092 ceph-mon[102944]: fsmap 12 up:standby 2023-10-05T15:14:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:14:44.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:43 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:44.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 -- 172.21.15.60:0/2511436686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900ffdc0 msgr2=0x7f5b901001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/2511436686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900ffdc0 0x7f5b901001e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009920 tx=0x7f5b8c009c30 comp rx=0 tx=0).stop 2023-10-05T15:14:44.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 -- 172.21.15.60:0/2511436686 shutdown_connections 2023-10-05T15:14:44.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/2511436686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 0x7f5b90108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/2511436686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900ffdc0 0x7f5b901001e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/2511436686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90100fb0 0x7f5b90101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 -- 172.21.15.60:0/2511436686 >> 172.21.15.60:0/2511436686 conn(0x7f5b900fb310 msgr2=0x7f5b900fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:44.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 -- 172.21.15.60:0/2511436686 shutdown_connections 2023-10-05T15:14:44.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.251+0000 7f5b97c2b700 1 -- 172.21.15.60:0/2511436686 wait complete. 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 Processor -- start 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 -- start start 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 0x7f5b90195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b90100fb0 0x7f5b901960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 0x7f5b9019d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019d700 con 0x7f5b90101950 2023-10-05T15:14:44.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019d840 con 0x7f5b90100fb0 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b97c2b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019d9d0 con 0x7f5b900ffdc0 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 0x7f5b90195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b961c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 0x7f5b9019d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 0x7f5b90195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:49292/0 (socket says 172.21.15.60:49292) 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 -- 172.21.15.60:0/3601442091 learned_addr learned my addr 172.21.15.60:0/3601442091 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b951c6700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b90100fb0 0x7f5b901960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 -- 172.21.15.60:0/3601442091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b90100fb0 msgr2=0x7f5b901960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b90100fb0 0x7f5b901960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 -- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 msgr2=0x7f5b9019d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.252+0000 7f5b959c7700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 0x7f5b9019d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b959c7700 1 -- 172.21.15.60:0/3601442091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88009d00 con 0x7f5b900ffdc0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b961c8700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 0x7f5b9019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b959c7700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 0x7f5b90195b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009230 tx=0x7f5b8c00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c01c070 con 0x7f5b900ffdc0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c009520 con 0x7f5b900ffdc0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b8c00f7d0 con 0x7f5b900ffdc0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c003a20 con 0x7f5b900ffdc0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.253+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b90068410 con 0x7f5b900ffdc0 2023-10-05T15:14:44.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.254+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9010b5d0 con 0x7f5b900ffdc0 2023-10-05T15:14:44.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.255+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5b8c020070 con 0x7f5b900ffdc0 2023-10-05T15:14:44.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.256+0000 7f5b86ffd700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5b7c0a14d0 0x7f5b7c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.256+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5b8c0cd5e0 con 0x7f5b900ffdc0 2023-10-05T15:14:44.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.256+0000 7f5b951c6700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5b7c0a14d0 0x7f5b7c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.256+0000 7f5b951c6700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5b7c0a14d0 0x7f5b7c0a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b80005950 tx=0x7f5b8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:44.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.259+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b8c097170 con 0x7f5b900ffdc0 2023-10-05T15:14:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:43 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] up:boot 2023-10-05T15:14:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:43 smithi135 ceph-mon[103360]: fsmap 12 up:standby 2023-10-05T15:14:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:14:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:43 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:44.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.469+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b90106dc0 con 0x7f5b900ffdc0 2023-10-05T15:14:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.471+0000 7f5b86ffd700 1 -- 172.21.15.60:0/3601442091 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f5b8c09a790 con 0x7f5b900ffdc0 2023-10-05T15:14:44.473 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:44.473 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:06.954151+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:14:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5b7c0a14d0 msgr2=0x7f5b7c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5b7c0a14d0 0x7f5b7c0a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b80005950 tx=0x7f5b8000b410 comp rx=0 tx=0).stop 2023-10-05T15:14:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 msgr2=0x7f5b90195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 0x7f5b90195b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009230 tx=0x7f5b8c00b790 comp rx=0 tx=0).stop 2023-10-05T15:14:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 shutdown_connections 2023-10-05T15:14:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5b7c0a14d0 0x7f5b7c0a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b90101950 0x7f5b9019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b900ffdc0 0x7f5b90195b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 --2- 172.21.15.60:0/3601442091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b90100fb0 0x7f5b901960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 >> 172.21.15.60:0/3601442091 conn(0x7f5b900fb310 msgr2=0x7f5b900fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 shutdown_connections 2023-10-05T15:14:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.473+0000 7f5b97c2b700 1 -- 172.21.15.60:0/3601442091 wait complete. 2023-10-05T15:14:44.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-05T15:14:44.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:14:44.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 -- 172.21.15.60:0/1035547899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681042f0 msgr2=0x7f11681066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 --2- 172.21.15.60:0/1035547899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681042f0 0x7f11681066e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f115c009990 tx=0x7f115c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 -- 172.21.15.60:0/1035547899 shutdown_connections 2023-10-05T15:14:44.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 --2- 172.21.15.60:0/1035547899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 0x7f1168109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 --2- 172.21.15.60:0/1035547899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11681019c0 0x7f1168103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 --2- 172.21.15.60:0/1035547899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681042f0 0x7f11681066e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 -- 172.21.15.60:0/1035547899 >> 172.21.15.60:0/1035547899 conn(0x7f11680fb330 msgr2=0x7f11680fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 -- 172.21.15.60:0/1035547899 shutdown_connections 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 -- 172.21.15.60:0/1035547899 wait complete. 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.619+0000 7f116d751700 1 Processor -- start 2023-10-05T15:14:44.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 -- start start 2023-10-05T15:14:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 0x7f1168101330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11681042f0 0x7f11680ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 0x7f11680ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168100650 con 0x7f11681019c0 2023-10-05T15:14:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681007c0 con 0x7f1168106c20 2023-10-05T15:14:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f116d751700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a0ca0 con 0x7f11681042f0 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 0x7f1168101330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 0x7f1168101330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35776/0 (socket says 172.21.15.60:35776) 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 -- 172.21.15.60:0/1155786217 learned_addr learned my addr 172.21.15.60:0/1155786217 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f11667fc700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11681042f0 0x7f11680ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f11677fe700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 0x7f11680ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 -- 172.21.15.60:0/1155786217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11681042f0 msgr2=0x7f11680ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11681042f0 0x7f11680ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 -- 172.21.15.60:0/1155786217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 msgr2=0x7f11680ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 0x7f11680ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 -- 172.21.15.60:0/1155786217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0095f0 con 0x7f11681019c0 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f11677fe700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 0x7f11680ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.620+0000 7f1166ffd700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 0x7f1168101330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f115800e9a0 tx=0x7f115800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.621+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158009790 con 0x7f11681019c0 2023-10-05T15:14:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.621+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11681a0f80 con 0x7f11681019c0 2023-10-05T15:14:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.621+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115800cbd0 con 0x7f11681019c0 2023-10-05T15:14:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.621+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158018680 con 0x7f11681019c0 2023-10-05T15:14:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.621+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681a13a0 con 0x7f11681019c0 2023-10-05T15:14:44.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.622+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11680fceb0 con 0x7f11681019c0 2023-10-05T15:14:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.623+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f115800cd40 con 0x7f11681019c0 2023-10-05T15:14:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.624+0000 7f114ffff700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f11500a1480 0x7f11500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.624+0000 7f11667fc700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f11500a1480 0x7f11500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.624+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1158014070 con 0x7f11681019c0 2023-10-05T15:14:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.625+0000 7f11667fc700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f11500a1480 0x7f11500a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f115c00b2e0 tx=0x7f115c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.628+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1158096870 con 0x7f11681019c0 2023-10-05T15:14:44.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.849+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11680008d0 con 0x7f11681019c0 2023-10-05T15:14:44.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.850+0000 7f114ffff700 1 -- 172.21.15.60:0/1155786217 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1158099e90 con 0x7f11681019c0 2023-10-05T15:14:44.852 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:14:44.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f11500a1480 msgr2=0x7f11500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f11500a1480 0x7f11500a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f115c00b2e0 tx=0x7f115c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 msgr2=0x7f1168101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 0x7f1168101330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f115800e9a0 tx=0x7f115800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 shutdown_connections 2023-10-05T15:14:44.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1168106c20 0x7f11680ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f11500a1480 0x7f11500a3940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11681019c0 0x7f1168101330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 --2- 172.21.15.60:0/1155786217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11681042f0 0x7f11680ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 >> 172.21.15.60:0/1155786217 conn(0x7f11680fb330 msgr2=0x7f1168102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:44.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 shutdown_connections 2023-10-05T15:14:44.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.852+0000 7f116d751700 1 -- 172.21.15.60:0/1155786217 wait complete. 2023-10-05T15:14:44.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-05T15:14:44.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 -- 172.21.15.60:0/2283270172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4102080 msgr2=0x7fd4a4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:44.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/2283270172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4102080 0x7fd4a4102500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009990 tx=0x7fd48c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 -- 172.21.15.60:0/2283270172 shutdown_connections 2023-10-05T15:14:44.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/2283270172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4a4102a40 0x7fd4a4109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/2283270172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4100ea0 0x7fd4a41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/2283270172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4102080 0x7fd4a4102500 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 -- 172.21.15.60:0/2283270172 >> 172.21.15.60:0/2283270172 conn(0x7fd4a40fc420 msgr2=0x7fd4a40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 -- 172.21.15.60:0/2283270172 shutdown_connections 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.994+0000 7fd4a97b9700 1 -- 172.21.15.60:0/2283270172 wait complete. 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 Processor -- start 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 -- start start 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 0x7fd4a4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4102080 0x7fd4a40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4a4102a40 0x7fd4a40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4073f80 con 0x7fd4a4100ea0 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40740f0 con 0x7fd4a4102a40 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a97b9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a41a0c00 con 0x7fd4a4102080 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 0x7fd4a4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 0x7fd4a4074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35790/0 (socket says 172.21.15.60:35790) 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 -- 172.21.15.60:0/1418864764 learned_addr learned my addr 172.21.15.60:0/1418864764 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a27fc700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4102080 0x7fd4a40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a37fe700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4a4102a40 0x7fd4a40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 -- 172.21.15.60:0/1418864764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4102080 msgr2=0x7fd4a40732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4102080 0x7fd4a40732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 -- 172.21.15.60:0/1418864764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4a4102a40 msgr2=0x7fd4a40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4a4102a40 0x7fd4a40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.995+0000 7fd4a2ffd700 1 -- 172.21.15.60:0/1418864764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0095f0 con 0x7fd4a4100ea0 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.996+0000 7fd4a2ffd700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 0x7fd4a4074c60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd494007ee0 tx=0x7fd49400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.996+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400dd20 con 0x7fd4a4100ea0 2023-10-05T15:14:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.996+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd49400f040 con 0x7fd4a4100ea0 2023-10-05T15:14:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.996+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940145e0 con 0x7fd4a4100ea0 2023-10-05T15:14:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.996+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a41a0ee0 con 0x7fd4a4100ea0 2023-10-05T15:14:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.996+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a41a1300 con 0x7fd4a4100ea0 2023-10-05T15:14:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.997+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a410c780 con 0x7fd4a4100ea0 2023-10-05T15:14:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.998+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd494015400 con 0x7fd4a4100ea0 2023-10-05T15:14:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.998+0000 7fd49bfff700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd4900a15d0 0x7fd4900a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.998+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4940cc340 con 0x7fd4a4100ea0 2023-10-05T15:14:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.999+0000 7fd4a27fc700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd4900a15d0 0x7fd4900a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:44.999+0000 7fd4a27fc700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd4900a15d0 0x7fd4900a3a90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd48c006010 tx=0x7fd48c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:45.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.003+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd494095da0 con 0x7fd4a4100ea0 2023-10-05T15:14:45.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:44 smithi060 ceph-mon[99238]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:45.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:44 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4172353306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:44 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3601442091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:45.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:44 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1155786217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:45.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:44 smithi092 ceph-mon[102944]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:45.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:44 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4172353306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:45.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:44 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3601442091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:45.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:44 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1155786217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:45.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.209+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd4a410c990 con 0x7fd4a4100ea0 2023-10-05T15:14:45.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.209+0000 7fd49bfff700 1 -- 172.21.15.60:0/1418864764 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd4940993c0 con 0x7fd4a4100ea0 2023-10-05T15:14:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:45.212 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-05T15:14:45.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:14:45.212 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-05T15:14:45.212 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-05T15:14:45.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:14:45.212 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd4900a15d0 msgr2=0x7fd4900a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd4900a15d0 0x7fd4900a3a90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd48c006010 tx=0x7fd48c005960 comp rx=0 tx=0).stop 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 msgr2=0x7fd4a4074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 0x7fd4a4074c60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd494007ee0 tx=0x7fd49400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 shutdown_connections 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4a4102a40 0x7fd4a40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd4900a15d0 0x7fd4900a3a90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4100ea0 0x7fd4a4074c60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 --2- 172.21.15.60:0/1418864764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4102080 0x7fd4a40732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 >> 172.21.15.60:0/1418864764 conn(0x7fd4a40fc420 msgr2=0x7fd4a40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:45.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 shutdown_connections 2023-10-05T15:14:45.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.211+0000 7fd4a97b9700 1 -- 172.21.15.60:0/1418864764 wait complete. 2023-10-05T15:14:45.226 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-05T15:14:45.226 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-05T15:14:45.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:44 smithi135 ceph-mon[103360]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:44 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4172353306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:44 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3601442091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:45.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:44 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1155786217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 -- 172.21.15.60:0/1665596833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734106c00 msgr2=0x7fb734109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 --2- 172.21.15.60:0/1665596833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734106c00 0x7fb734109010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00b0a0 tx=0x7fb72c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 -- 172.21.15.60:0/1665596833 shutdown_connections 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 --2- 172.21.15.60:0/1665596833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb734106c00 0x7fb734109010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 --2- 172.21.15.60:0/1665596833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7341019a0 0x7fb734103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 --2- 172.21.15.60:0/1665596833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341042d0 0x7fb7341066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 -- 172.21.15.60:0/1665596833 >> 172.21.15.60:0/1665596833 conn(0x7fb7340fb330 msgr2=0x7fb7340fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 -- 172.21.15.60:0/1665596833 shutdown_connections 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 -- 172.21.15.60:0/1665596833 wait complete. 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 Processor -- start 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.356+0000 7fb73b75b700 1 -- start start 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb73b75b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341019a0 0x7fb734194ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb73b75b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 0x7fb734195010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb73b75b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106c00 0x7fb73419c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb73b75b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419c650 con 0x7fb7341042d0 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb73b75b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419c790 con 0x7fb734106c00 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb73b75b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419c920 con 0x7fb7341019a0 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 0x7fb734195010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 0x7fb734195010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35806/0 (socket says 172.21.15.60:35806) 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 -- 172.21.15.60:0/193141952 learned_addr learned my addr 172.21.15.60:0/193141952 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb7394f7700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341019a0 0x7fb734194ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb739cf8700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106c00 0x7fb73419c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 -- 172.21.15.60:0/193141952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341019a0 msgr2=0x7fb734194ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341019a0 0x7fb734194ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 -- 172.21.15.60:0/193141952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106c00 msgr2=0x7fb73419c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106c00 0x7fb73419c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 -- 172.21.15.60:0/193141952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009d00 con 0x7fb7341042d0 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb739cf8700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106c00 0x7fb73419c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb7394f7700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341019a0 0x7fb734194ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb738cf6700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 0x7fb734195010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb72400e9a0 tx=0x7fb72400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.357+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724009790 con 0x7fb7341042d0 2023-10-05T15:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.358+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72400cbd0 con 0x7fb7341042d0 2023-10-05T15:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.358+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73419cc00 con 0x7fb7341042d0 2023-10-05T15:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.358+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724018680 con 0x7fb7341042d0 2023-10-05T15:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.358+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73419d110 con 0x7fb7341042d0 2023-10-05T15:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.359+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7340fceb0 con 0x7fb7341042d0 2023-10-05T15:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.360+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb72400cd40 con 0x7fb7341042d0 2023-10-05T15:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.360+0000 7fb72a7fc700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.361+0000 7fb7394f7700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.361+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb724014070 con 0x7fb7341042d0 2023-10-05T15:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.361+0000 7fb7394f7700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb7300096d0 tx=0x7fb730009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:45.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.365+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb724052100 con 0x7fb7341042d0 2023-10-05T15:14:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:45.586+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb73410a560 con 0x7fb7341042d0 2023-10-05T15:14:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.176+0000 7fb72a7fc700 1 -- 172.21.15.60:0/193141952 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb724096600 con 0x7fb7341042d0 2023-10-05T15:14:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 msgr2=0x7fb7200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb7300096d0 tx=0x7fb730009260 comp rx=0 tx=0).stop 2023-10-05T15:14:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 msgr2=0x7fb734195010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 0x7fb734195010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb72400e9a0 tx=0x7fb72400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 shutdown_connections 2023-10-05T15:14:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106c00 0x7fb73419c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7341019a0 0x7fb734194ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb7200a1480 0x7fb7200a3940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 --2- 172.21.15.60:0/193141952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7341042d0 0x7fb734195010 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.179+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 >> 172.21.15.60:0/193141952 conn(0x7fb7340fb330 msgr2=0x7fb734102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.180+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 shutdown_connections 2023-10-05T15:14:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.181+0000 7fb73b75b700 1 -- 172.21.15.60:0/193141952 wait complete. 2023-10-05T15:14:46.186 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-05T15:14:46.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-05T15:14:46.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 -- 172.21.15.60:0/3120257694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228101950 msgr2=0x7f6228108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 --2- 172.21.15.60:0/3120257694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228101950 0x7f6228108200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62200099c0 tx=0x7f6220009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 -- 172.21.15.60:0/3120257694 shutdown_connections 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 --2- 172.21.15.60:0/3120257694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228101950 0x7f6228108200 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 --2- 172.21.15.60:0/3120257694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62280ffdc0 0x7f62281001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 --2- 172.21.15.60:0/3120257694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6228100fb0 0x7f6228101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 -- 172.21.15.60:0/3120257694 >> 172.21.15.60:0/3120257694 conn(0x7f62280fb330 msgr2=0x7f62280fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 -- 172.21.15.60:0/3120257694 shutdown_connections 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 -- 172.21.15.60:0/3120257694 wait complete. 2023-10-05T15:14:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.328+0000 7f623007b700 1 Processor -- start 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 -- start start 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62280ffdc0 0x7f62281959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 0x7f6228195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6228101950 0x7f622819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622819d540 con 0x7f6228100fb0 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622819d680 con 0x7f6228101950 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622819d810 con 0x7f62280ffdc0 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 0x7f6228195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 0x7f6228195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35820/0 (socket says 172.21.15.60:35820) 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 -- 172.21.15.60:0/4116887220 learned_addr learned my addr 172.21.15.60:0/4116887220 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622e618700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6228101950 0x7f622819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622de17700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62280ffdc0 0x7f62281959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 -- 172.21.15.60:0/4116887220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62280ffdc0 msgr2=0x7f62281959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62280ffdc0 0x7f62281959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 -- 172.21.15.60:0/4116887220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6228101950 msgr2=0x7f622819cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6228101950 0x7f622819cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 -- 172.21.15.60:0/4116887220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200095f0 con 0x7f6228100fb0 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622de17700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62280ffdc0 0x7f62281959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f622d616700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 0x7f6228195f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c9b0 tx=0x7f621c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c007b00 con 0x7f6228100fb0 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f621c007c60 con 0x7f6228100fb0 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622819daf0 con 0x7f6228100fb0 2023-10-05T15:14:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.329+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c018660 con 0x7f6228100fb0 2023-10-05T15:14:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.330+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622819e000 con 0x7f6228100fb0 2023-10-05T15:14:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.330+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622810b5e0 con 0x7f6228100fb0 2023-10-05T15:14:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.332+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f621c00f450 con 0x7f6228100fb0 2023-10-05T15:14:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.333+0000 7f6226ffd700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f62100a1480 0x7f62100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.333+0000 7f622de17700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f62100a1480 0x7f62100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.333+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f621c0ccc40 con 0x7f6228100fb0 2023-10-05T15:14:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.333+0000 7f622de17700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f62100a1480 0x7f62100a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6228100e10 tx=0x7f6218009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:46.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.337+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f621c096660 con 0x7f6228100fb0 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1418864764' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/193141952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:46.541+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f622810b7d0 con 0x7f6228100fb0 2023-10-05T15:14:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1418864764' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-05T15:14:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/193141952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-05T15:14:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1418864764' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/193141952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:46.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:47.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.178+0000 7f6226ffd700 1 -- 172.21.15.60:0/4116887220 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v82) v1 ==== 171+0+0 (secure 0 0 0) 0x7f621c099c80 con 0x7f6228100fb0 2023-10-05T15:14:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f62100a1480 msgr2=0x7f62100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f62100a1480 0x7f62100a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6228100e10 tx=0x7f6218009040 comp rx=0 tx=0).stop 2023-10-05T15:14:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 msgr2=0x7f6228195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 0x7f6228195f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c9b0 tx=0x7f621c00ccc0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 shutdown_connections 2023-10-05T15:14:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6228101950 0x7f622819cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62280ffdc0 0x7f62281959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f62100a1480 0x7f62100a3940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 --2- 172.21.15.60:0/4116887220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6228100fb0 0x7f6228195f00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.182+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 >> 172.21.15.60:0/4116887220 conn(0x7f62280fb330 msgr2=0x7f62280fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:47.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.185+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 shutdown_connections 2023-10-05T15:14:47.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.185+0000 7f623007b700 1 -- 172.21.15.60:0/4116887220 wait complete. 2023-10-05T15:14:47.201 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-05T15:14:47.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-05T15:14:47.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 -- 172.21.15.60:0/4164598855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40ff7b0 msgr2=0x7f08f40ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 --2- 172.21.15.60:0/4164598855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40ff7b0 0x7f08f40ffbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009990 tx=0x7f08e4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 -- 172.21.15.60:0/4164598855 shutdown_connections 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 --2- 172.21.15.60:0/4164598855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f4100ad0 0x7f08f4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 --2- 172.21.15.60:0/4164598855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40ff7b0 0x7f08f40ffbd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 --2- 172.21.15.60:0/4164598855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 0x7f08f4100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 -- 172.21.15.60:0/4164598855 >> 172.21.15.60:0/4164598855 conn(0x7f08f40fb330 msgr2=0x7f08f40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 -- 172.21.15.60:0/4164598855 shutdown_connections 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.344+0000 7f08f95d2700 1 -- 172.21.15.60:0/4164598855 wait complete. 2023-10-05T15:14:47.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 Processor -- start 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 -- start start 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f40ff7b0 0x7f08f4198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 0x7f08f4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 0x7f08f41a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41a0950 con 0x7f08f4100ad0 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41a0a90 con 0x7f08f40ff7b0 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f95d2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41a0c20 con 0x7f08f4100110 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 0x7f08f41a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 0x7f08f41a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35840/0 (socket says 172.21.15.60:35840) 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 -- 172.21.15.60:0/2435527405 learned_addr learned my addr 172.21.15.60:0/2435527405 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f27fc700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 0x7f08f4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:47.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f40ff7b0 0x7f08f4198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 -- 172.21.15.60:0/2435527405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 msgr2=0x7f08f4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 0x7f08f4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 -- 172.21.15.60:0/2435527405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f40ff7b0 msgr2=0x7f08f4198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f40ff7b0 0x7f08f4198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f37fe700 1 -- 172.21.15.60:0/2435527405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec009c40 con 0x7f08f4100ad0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.345+0000 7f08f27fc700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 0x7f08f4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.346+0000 7f08f37fe700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 0x7f08f41a0380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00c370 tx=0x7f08ec00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.346+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec017070 con 0x7f08f4100ad0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.346+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08ec00f040 con 0x7f08f4100ad0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.346+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00e050 con 0x7f08f4100ad0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.346+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e40095f0 con 0x7f08f4100ad0 2023-10-05T15:14:47.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.346+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f41a11d0 con 0x7f08f4100ad0 2023-10-05T15:14:47.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.347+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f410a590 con 0x7f08f4100ad0 2023-10-05T15:14:47.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.348+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f08ec00cb60 con 0x7f08f4100ad0 2023-10-05T15:14:47.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.349+0000 7f08dbfff700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f08dc0a1480 0x7f08dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:47.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.349+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f08dc0a1480 0x7f08dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:47.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.349+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f08ec0ccb30 con 0x7f08f4100ad0 2023-10-05T15:14:47.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.350+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f08dc0a1480 0x7f08dc0a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b2e0 tx=0x7f08e4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:47.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.353+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08ec096340 con 0x7f08f4100ad0 2023-10-05T15:14:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:47 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/193141952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-05T15:14:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:47 smithi135 ceph-mon[103360]: osdmap e81: 12 total, 12 up, 12 in 2023-10-05T15:14:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:47 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4116887220' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-05T15:14:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:47.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:47.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:47.610+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f08f402d2e0 con 0x7f08f4100ad0 2023-10-05T15:14:47.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:47 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/193141952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-05T15:14:47.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:47 smithi060 ceph-mon[99238]: osdmap e81: 12 total, 12 up, 12 in 2023-10-05T15:14:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:47 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4116887220' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-05T15:14:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:47 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/193141952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-05T15:14:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:47 smithi092 ceph-mon[102944]: osdmap e81: 12 total, 12 up, 12 in 2023-10-05T15:14:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:47 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4116887220' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-05T15:14:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.195+0000 7f08dbfff700 1 -- 172.21.15.60:0/2435527405 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f08ec099960 con 0x7f08f4100ad0 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f08dc0a1480 msgr2=0x7f08dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f08dc0a1480 0x7f08dc0a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b2e0 tx=0x7f08e4005960 comp rx=0 tx=0).stop 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 msgr2=0x7f08f41a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 0x7f08f41a0380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00c370 tx=0x7f08ec00c680 comp rx=0 tx=0).stop 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 shutdown_connections 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f08dc0a1480 0x7f08dc0a3940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4100ad0 0x7f08f41a0380 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f40ff7b0 0x7f08f4198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 --2- 172.21.15.60:0/2435527405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f4100110 0x7f08f4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 >> 172.21.15.60:0/2435527405 conn(0x7f08f40fb330 msgr2=0x7f08f40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 shutdown_connections 2023-10-05T15:14:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.198+0000 7f08f95d2700 1 -- 172.21.15.60:0/2435527405 wait complete. 2023-10-05T15:14:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 2 and data pool 3 2023-10-05T15:14:48.216 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-05T15:14:48.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-05T15:14:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.350+0000 7fa8f671f700 1 -- 172.21.15.60:0/1242818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0106c60 msgr2=0x7fa8f0109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.350+0000 7fa8f671f700 1 --2- 172.21.15.60:0/1242818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0106c60 0x7fa8f0109050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800b0a0 tx=0x7fa8e800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 -- 172.21.15.60:0/1242818 shutdown_connections 2023-10-05T15:14:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 --2- 172.21.15.60:0/1242818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0106c60 0x7fa8f0109050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 --2- 172.21.15.60:0/1242818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0101a00 0x7fa8f0103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 --2- 172.21.15.60:0/1242818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0104330 0x7fa8f0106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 -- 172.21.15.60:0/1242818 >> 172.21.15.60:0/1242818 conn(0x7fa8f00fb330 msgr2=0x7fa8f00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 -- 172.21.15.60:0/1242818 shutdown_connections 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 -- 172.21.15.60:0/1242818 wait complete. 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.351+0000 7fa8f671f700 1 Processor -- start 2023-10-05T15:14:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 -- start start 2023-10-05T15:14:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 0x7fa8f0101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 0x7fa8f00ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0106c60 0x7fa8f00ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0100690 con 0x7fa8f0104330 2023-10-05T15:14:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0100800 con 0x7fa8f0101a00 2023-10-05T15:14:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f671f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f01a0d00 con 0x7fa8f0106c60 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 0x7fa8f00ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 0x7fa8f0101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 0x7fa8f00ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35854/0 (socket says 172.21.15.60:35854) 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2399368826 learned_addr learned my addr 172.21.15.60:0/2399368826 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 0x7fa8f0101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:49274/0 (socket says 172.21.15.60:49274) 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f4cbc700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0106c60 0x7fa8f00ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2399368826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0106c60 msgr2=0x7fa8f00ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0106c60 0x7fa8f00ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2399368826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 msgr2=0x7fa8f0101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 0x7fa8f0101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2399368826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009d00 con 0x7fa8f0104330 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8effff700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 0x7fa8f0101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.352+0000 7fa8f4cbc700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0106c60 0x7fa8f00ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.353+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 0x7fa8f00ff9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e9a0 tx=0x7fa8e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.353+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4009790 con 0x7fa8f0104330 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.353+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8e4010430 con 0x7fa8f0104330 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.353+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f01a0fe0 con 0x7fa8f0104330 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.353+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4018680 con 0x7fa8f0104330 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.353+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f01a1460 con 0x7fa8f0104330 2023-10-05T15:14:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.354+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f00fceb0 con 0x7fa8f0104330 2023-10-05T15:14:48.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.355+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa8e40105a0 con 0x7fa8f0104330 2023-10-05T15:14:48.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.356+0000 7fa8ed7fa700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa8d80a1480 0x7fa8d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:48.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.356+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8e4014070 con 0x7fa8f0104330 2023-10-05T15:14:48.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.356+0000 7fa8effff700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa8d80a1480 0x7fa8d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:48.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.356+0000 7fa8effff700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa8d80a1480 0x7fa8d80a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0011490 tx=0x7fa8e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:48.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.363+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8e4096740 con 0x7fa8f0104330 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: pgmap v252: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4116887220' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: osdmap e82: 12 total, 12 up, 12 in 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2435527405' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-05T15:14:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:14:48.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:48 smithi135 ceph-mon[103360]: osdmap e83: 12 total, 12 up, 12 in 2023-10-05T15:14:48.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.584+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa8f002d3f0 con 0x7fa8f0104330 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: pgmap v252: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4116887220' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: osdmap e82: 12 total, 12 up, 12 in 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2435527405' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-05T15:14:48.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:14:48.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:48 smithi060 ceph-mon[99238]: osdmap e83: 12 total, 12 up, 12 in 2023-10-05T15:14:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: pgmap v252: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:14:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4116887220' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-05T15:14:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: osdmap e82: 12 total, 12 up, 12 in 2023-10-05T15:14:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:14:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2435527405' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-05T15:14:48.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-05T15:14:48.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:14:48.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:48 smithi092 ceph-mon[102944]: osdmap e83: 12 total, 12 up, 12 in 2023-10-05T15:14:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.983+0000 7fa8ed7fa700 1 -- 172.21.15.60:0/2399368826 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v84) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa8f002d3f0 con 0x7fa8f0104330 2023-10-05T15:14:48.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa8d80a1480 msgr2=0x7fa8d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa8d80a1480 0x7fa8d80a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0011490 tx=0x7fa8e0009260 comp rx=0 tx=0).stop 2023-10-05T15:14:48.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 msgr2=0x7fa8f00ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:48.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 0x7fa8f00ff9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e9a0 tx=0x7fa8e400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 shutdown_connections 2023-10-05T15:14:48.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0106c60 0x7fa8f00ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8f0101a00 0x7fa8f0101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa8d80a1480 0x7fa8d80a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 --2- 172.21.15.60:0/2399368826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0104330 0x7fa8f00ff9b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:48.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 >> 172.21.15.60:0/2399368826 conn(0x7fa8f00fb330 msgr2=0x7fa8f0102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:48.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 shutdown_connections 2023-10-05T15:14:48.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:48.985+0000 7fa8f671f700 1 -- 172.21.15.60:0/2399368826 wait complete. 2023-10-05T15:14:49.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-05T15:14:49.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 -- 172.21.15.60:0/1064793412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 msgr2=0x7f870c101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 --2- 172.21.15.60:0/1064793412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c101440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0099c0 tx=0x7f86fc009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 -- 172.21.15.60:0/1064793412 shutdown_connections 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 --2- 172.21.15.60:0/1064793412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c101980 0x7f870c108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 --2- 172.21.15.60:0/1064793412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f870c0ffdf0 0x7f870c100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 --2- 172.21.15.60:0/1064793412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c101440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 -- 172.21.15.60:0/1064793412 >> 172.21.15.60:0/1064793412 conn(0x7f870c0fb340 msgr2=0x7f870c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 -- 172.21.15.60:0/1064793412 shutdown_connections 2023-10-05T15:14:49.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.138+0000 7f8714762700 1 -- 172.21.15.60:0/1064793412 wait complete. 2023-10-05T15:14:49.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.139+0000 7f8714762700 1 Processor -- start 2023-10-05T15:14:49.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.139+0000 7f8714762700 1 -- start start 2023-10-05T15:14:49.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c0ffdf0 0x7f870c195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:49.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f870c101980 0x7f870c19cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c19d590 con 0x7f870c100fe0 2023-10-05T15:14:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c19d6d0 con 0x7f870c101980 2023-10-05T15:14:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c19d860 con 0x7f870c0ffdf0 2023-10-05T15:14:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35868/0 (socket says 172.21.15.60:35868) 2023-10-05T15:14:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 -- 172.21.15.60:0/692648464 learned_addr learned my addr 172.21.15.60:0/692648464 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8712cff700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f870c101980 0x7f870c19cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f87124fe700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c0ffdf0 0x7f870c195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 -- 172.21.15.60:0/692648464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c0ffdf0 msgr2=0x7f870c195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c0ffdf0 0x7f870c195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 -- 172.21.15.60:0/692648464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f870c101980 msgr2=0x7f870c19cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f870c101980 0x7f870c19cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 -- 172.21.15.60:0/692648464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0095f0 con 0x7f870c100fe0 2023-10-05T15:14:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f87124fe700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c0ffdf0 0x7f870c195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8711cfd700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c195f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00bf40 tx=0x7f86fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc01d070 con 0x7f870c100fe0 2023-10-05T15:14:49.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86fc005510 con 0x7f870c100fe0 2023-10-05T15:14:49.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c069340 con 0x7f870c100fe0 2023-10-05T15:14:49.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc004c00 con 0x7f870c100fe0 2023-10-05T15:14:49.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.140+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c0697f0 con 0x7f870c100fe0 2023-10-05T15:14:49.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.141+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c10b650 con 0x7f870c100fe0 2023-10-05T15:14:49.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.142+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f86fc00fb80 con 0x7f870c100fe0 2023-10-05T15:14:49.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.143+0000 7f87037fe700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f86f80a1520 0x7f86f80a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:49.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.143+0000 7f87124fe700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f86f80a1520 0x7f86f80a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:49.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.143+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f86fc0cdb50 con 0x7f870c100fe0 2023-10-05T15:14:49.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.143+0000 7f87124fe700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f86f80a1520 0x7f86f80a39e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f870c100e40 tx=0x7f8708009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:49.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.147+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86fc05c100 con 0x7f870c100fe0 2023-10-05T15:14:49.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:49.367+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f870c10b7e0 con 0x7f870c100fe0 2023-10-05T15:14:49.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:49 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2435527405' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-05T15:14:49.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:49 smithi060 ceph-mon[99238]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-05T15:14:49.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:49 smithi060 ceph-mon[99238]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-05T15:14:49.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:49 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2399368826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:14:49.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:49 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2399368826' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-05T15:14:49.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:49 smithi060 ceph-mon[99238]: osdmap e84: 12 total, 12 up, 12 in 2023-10-05T15:14:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:49 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2435527405' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-05T15:14:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:49 smithi135 ceph-mon[103360]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-05T15:14:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:49 smithi135 ceph-mon[103360]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-05T15:14:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:49 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2399368826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:14:49.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:49 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2399368826' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-05T15:14:49.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:49 smithi135 ceph-mon[103360]: osdmap e84: 12 total, 12 up, 12 in 2023-10-05T15:14:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:49 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2435527405' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-05T15:14:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:49 smithi092 ceph-mon[102944]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-05T15:14:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:49 smithi092 ceph-mon[102944]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-05T15:14:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:49 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2399368826' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:14:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:49 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2399368826' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-05T15:14:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:49 smithi092 ceph-mon[102944]: osdmap e84: 12 total, 12 up, 12 in 2023-10-05T15:14:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: pgmap v256: 97 pgs: 22 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-10-05T15:14:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] up:active 2023-10-05T15:14:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:50.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:50.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/692648464' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:14:50.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:14:50.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: Cluster is now healthy 2023-10-05T15:14:50.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:50.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:50.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:50 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: pgmap v256: 97 pgs: 22 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-10-05T15:14:50.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] up:active 2023-10-05T15:14:50.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:50.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:50.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/692648464' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: Cluster is now healthy 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:50.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:50 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: pgmap v256: 97 pgs: 22 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] up:active 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/692648464' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: Cluster is now healthy 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:14:50.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:50 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:14:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.221+0000 7f87037fe700 1 -- 172.21.15.60:0/692648464 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v86) v1 ==== 228+0+0 (secure 0 0 0) 0x7f86fc097200 con 0x7f870c100fe0 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f86f80a1520 msgr2=0x7f86f80a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f86f80a1520 0x7f86f80a39e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f870c100e40 tx=0x7f8708009260 comp rx=0 tx=0).stop 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 msgr2=0x7f870c195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c195f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00bf40 tx=0x7f86fc00f690 comp rx=0 tx=0).stop 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 shutdown_connections 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f870c101980 0x7f870c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f870c0ffdf0 0x7f870c195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f86f80a1520 0x7f86f80a39e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 --2- 172.21.15.60:0/692648464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f870c100fe0 0x7f870c195f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.224+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 >> 172.21.15.60:0/692648464 conn(0x7f870c0fb340 msgr2=0x7f870c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:51.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.229+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 shutdown_connections 2023-10-05T15:14:51.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.229+0000 7f8714762700 1 -- 172.21.15.60:0/692648464 wait complete. 2023-10-05T15:14:51.233 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data_ec' created 2023-10-05T15:14:51.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-05T15:14:51.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 -- 172.21.15.60:0/1557404803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 msgr2=0x7f04d41001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 --2- 172.21.15.60:0/1557404803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d41001e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04c40099c0 tx=0x7f04c4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 -- 172.21.15.60:0/1557404803 shutdown_connections 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 --2- 172.21.15.60:0/1557404803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4101950 0x7f04d4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 --2- 172.21.15.60:0/1557404803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d41001e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 --2- 172.21.15.60:0/1557404803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d4100fb0 0x7f04d4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 -- 172.21.15.60:0/1557404803 >> 172.21.15.60:0/1557404803 conn(0x7f04d40fb330 msgr2=0x7f04d40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 -- 172.21.15.60:0/1557404803 shutdown_connections 2023-10-05T15:14:51.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.379+0000 7f04d8a51700 1 -- 172.21.15.60:0/1557404803 wait complete. 2023-10-05T15:14:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.380+0000 7f04d8a51700 1 Processor -- start 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.380+0000 7f04d8a51700 1 -- start start 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d8a51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d8a51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4100fb0 0x7f04d419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d8a51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d4101950 0x7f04d419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d8a51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d419e740 con 0x7f04d40ffdc0 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d8a51700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d419e8b0 con 0x7f04d4100fb0 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d8a51700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d419ea70 con 0x7f04d4101950 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d4068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35884/0 (socket says 172.21.15.60:35884) 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 -- 172.21.15.60:0/3363633754 learned_addr learned my addr 172.21.15.60:0/3363633754 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d1d9b700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4100fb0 0x7f04d419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d2d9d700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d4101950 0x7f04d419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 -- 172.21.15.60:0/3363633754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d4101950 msgr2=0x7f04d419df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d4101950 0x7f04d419df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 -- 172.21.15.60:0/3363633754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4100fb0 msgr2=0x7f04d419b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4100fb0 0x7f04d419b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 -- 172.21.15.60:0/3363633754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c40095f0 con 0x7f04d40ffdc0 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d1d9b700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4100fb0 0x7f04d419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04d259c700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d4068bd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009f50 tx=0x7f04c40057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c401d070 con 0x7f04d40ffdc0 2023-10-05T15:14:51.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.381+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c4004110 con 0x7f04d40ffdc0 2023-10-05T15:14:51.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.382+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d419ecf0 con 0x7f04d40ffdc0 2023-10-05T15:14:51.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.382+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4022dd0 con 0x7f04d40ffdc0 2023-10-05T15:14:51.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.382+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d419f1a0 con 0x7f04d40ffdc0 2023-10-05T15:14:51.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.382+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d410b5d0 con 0x7f04d40ffdc0 2023-10-05T15:14:51.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.384+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f04c4022500 con 0x7f04d40ffdc0 2023-10-05T15:14:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.384+0000 7f04c37fe700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04bc0a1500 0x7f04bc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.384+0000 7f04d1d9b700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04bc0a1500 0x7f04bc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.384+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f04c40ce9e0 con 0x7f04d40ffdc0 2023-10-05T15:14:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.385+0000 7f04d1d9b700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04bc0a1500 0x7f04bc0a39c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04c8005950 tx=0x7f04c80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.388+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04c4097f00 con 0x7f04d40ffdc0 2023-10-05T15:14:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:51 smithi135 ceph-mon[103360]: osdmap e85: 12 total, 12 up, 12 in 2023-10-05T15:14:51.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:51.589+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f04d419f500 con 0x7f04d40ffdc0 2023-10-05T15:14:51.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:51 smithi060 ceph-mon[99238]: osdmap e85: 12 total, 12 up, 12 in 2023-10-05T15:14:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:51 smithi092 ceph-mon[102944]: osdmap e85: 12 total, 12 up, 12 in 2023-10-05T15:14:52.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.222+0000 7f04c37fe700 1 -- 172.21.15.60:0/3363633754 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f04c40270c0 con 0x7f04d40ffdc0 2023-10-05T15:14:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.226+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04bc0a1500 msgr2=0x7f04bc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.226+0000 7f04d8a51700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04bc0a1500 0x7f04bc0a39c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04c8005950 tx=0x7f04c80058e0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.226+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 msgr2=0x7f04d4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.226+0000 7f04d8a51700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d4068bd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009f50 tx=0x7f04c40057d0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.227+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 shutdown_connections 2023-10-05T15:14:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.227+0000 7f04d8a51700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d4101950 0x7f04d419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.227+0000 7f04d8a51700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f04bc0a1500 0x7f04bc0a39c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.227+0000 7f04d8a51700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d40ffdc0 0x7f04d4068bd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.227+0000 7f04d8a51700 1 --2- 172.21.15.60:0/3363633754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d4100fb0 0x7f04d419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.227+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 >> 172.21.15.60:0/3363633754 conn(0x7f04d40fb330 msgr2=0x7f04d40fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:52.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.230+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 shutdown_connections 2023-10-05T15:14:52.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.236+0000 7f04d8a51700 1 -- 172.21.15.60:0/3363633754 wait complete. 2023-10-05T15:14:52.252 INFO:teuthology.orchestra.run.smithi060.stderr:set pool 4 allow_ec_overwrites to true 2023-10-05T15:14:52.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-05T15:14:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 -- 172.21.15.60:0/1790037521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac101950 msgr2=0x7f2bac108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/1790037521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac101950 0x7f2bac108200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0d0 tx=0x7f2ba400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 -- 172.21.15.60:0/1790037521 shutdown_connections 2023-10-05T15:14:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/1790037521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac101950 0x7f2bac108200 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/1790037521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/1790037521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 0x7f2bac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 -- 172.21.15.60:0/1790037521 >> 172.21.15.60:0/1790037521 conn(0x7f2bac0fb330 msgr2=0x7f2bac0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 -- 172.21.15.60:0/1790037521 shutdown_connections 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 -- 172.21.15.60:0/1790037521 wait complete. 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.398+0000 7f2bb17c2700 1 Processor -- start 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 -- start start 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 0x7f2bac1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac101950 0x7f2bac19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19e7a0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19e910 con 0x7f2bac100fb0 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bb17c2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19ead0 con 0x7f2bac101950 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35904/0 (socket says 172.21.15.60:35904) 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 -- 172.21.15.60:0/3188465648 learned_addr learned my addr 172.21.15.60:0/3188465648 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baa7fc700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 0x7f2bac1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 -- 172.21.15.60:0/3188465648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac101950 msgr2=0x7f2bac19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bab7fe700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac101950 0x7f2bac19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac101950 0x7f2bac19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 -- 172.21.15.60:0/3188465648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 msgr2=0x7f2bac1971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 0x7f2bac1971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 -- 172.21.15.60:0/3188465648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009d00 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baa7fc700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 0x7f2bac1971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2bab7fe700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac101950 0x7f2bac19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.399+0000 7f2baaffd700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac196c60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d980 tx=0x7f2ba000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.400+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000de60 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.400+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac19edb0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.400+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ba00044e0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.400+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0003be0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.400+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac19f200 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.400+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac10b5e0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.402+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2ba0009bb0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.402+0000 7f2b93fff700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b940a1480 0x7f2b940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.402+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f2ba00ccfc0 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.402+0000 7f2baa7fc700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b940a1480 0x7f2b940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.403+0000 7f2baa7fc700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b940a1480 0x7f2b940a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009be0 tx=0x7f2b9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.406+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2ba0096450 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:52 smithi135 ceph-mon[103360]: pgmap v258: 97 pgs: 22 creating+peering, 64 active+clean, 11 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:14:52.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:52 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/692648464' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-05T15:14:52.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:52 smithi135 ceph-mon[103360]: osdmap e86: 12 total, 12 up, 12 in 2023-10-05T15:14:52.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:52 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3363633754' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-05T15:14:52.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:52.657+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f2bac19f450 con 0x7f2bac0ffdc0 2023-10-05T15:14:52.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:52 smithi060 ceph-mon[99238]: pgmap v258: 97 pgs: 22 creating+peering, 64 active+clean, 11 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:14:52.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:52 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/692648464' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-05T15:14:52.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:52 smithi060 ceph-mon[99238]: osdmap e86: 12 total, 12 up, 12 in 2023-10-05T15:14:52.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:52 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3363633754' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-05T15:14:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:52 smithi092 ceph-mon[102944]: pgmap v258: 97 pgs: 22 creating+peering, 64 active+clean, 11 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:14:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:52 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/692648464' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-05T15:14:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:52 smithi092 ceph-mon[102944]: osdmap e86: 12 total, 12 up, 12 in 2023-10-05T15:14:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:52 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3363633754' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-05T15:14:53.176 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:14:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: 2023-10-05T15:14:52.865+0000 7f978642a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-05T15:14:53.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.239+0000 7f2b93fff700 1 -- 172.21.15.60:0/3188465648 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2ba0009940 con 0x7f2bac0ffdc0 2023-10-05T15:14:53.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b940a1480 msgr2=0x7f2b940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b940a1480 0x7f2b940a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009be0 tx=0x7f2b9c009260 comp rx=0 tx=0).stop 2023-10-05T15:14:53.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 msgr2=0x7f2bac196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac196c60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d980 tx=0x7f2ba000dd40 comp rx=0 tx=0).stop 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 shutdown_connections 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac101950 0x7f2bac19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.242+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b940a1480 0x7f2b940a3940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.243+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bac0ffdc0 0x7f2bac196c60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.243+0000 7f2bb17c2700 1 --2- 172.21.15.60:0/3188465648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bac100fb0 0x7f2bac1971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.243+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 >> 172.21.15.60:0/3188465648 conn(0x7f2bac0fb330 msgr2=0x7f2bac068060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.243+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 shutdown_connections 2023-10-05T15:14:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.243+0000 7f2bb17c2700 1 -- 172.21.15.60:0/3188465648 wait complete. 2023-10-05T15:14:53.247 INFO:teuthology.orchestra.run.smithi060.stderr:added data pool 4 to fsmap 2023-10-05T15:14:53.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:53.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 -- 172.21.15.60:0/3311865364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 msgr2=0x7f8328101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 --2- 172.21.15.60:0/3311865364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328101430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83140099c0 tx=0x7f8314009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 -- 172.21.15.60:0/3311865364 shutdown_connections 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 --2- 172.21.15.60:0/3311865364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8328101970 0x7f8328108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 --2- 172.21.15.60:0/3311865364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83280ffde0 0x7f8328100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 --2- 172.21.15.60:0/3311865364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328101430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 -- 172.21.15.60:0/3311865364 >> 172.21.15.60:0/3311865364 conn(0x7f83280fb330 msgr2=0x7f83280fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 -- 172.21.15.60:0/3311865364 shutdown_connections 2023-10-05T15:14:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.391+0000 7f832f1e6700 1 -- 172.21.15.60:0/3311865364 wait complete. 2023-10-05T15:14:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 Processor -- start 2023-10-05T15:14:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 -- start start 2023-10-05T15:14:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83280ffde0 0x7f8328195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8328101970 0x7f832819d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832819d600 con 0x7f8328100fd0 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832819d740 con 0x7f8328101970 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.392+0000 7f832f1e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832819d8d0 con 0x7f83280ffde0 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35920/0 (socket says 172.21.15.60:35920) 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 -- 172.21.15.60:0/209833142 learned_addr learned my addr 172.21.15.60:0/209833142 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f832cf82700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83280ffde0 0x7f8328195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f832d783700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8328101970 0x7f832819d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 -- 172.21.15.60:0/209833142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83280ffde0 msgr2=0x7f8328195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83280ffde0 0x7f8328195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 -- 172.21.15.60:0/209833142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8328101970 msgr2=0x7f832819d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8328101970 0x7f832819d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 -- 172.21.15.60:0/209833142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140095f0 con 0x7f8328100fd0 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f832d783700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8328101970 0x7f832819d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8327fff700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328195fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8314009990 tx=0x7f831401a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831401f070 con 0x7f8328100fd0 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8314005030 con 0x7f8328100fd0 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8328069050 con 0x7f8328100fd0 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314004b10 con 0x7f8328100fd0 2023-10-05T15:14:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.393+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83280694f0 con 0x7f8328100fd0 2023-10-05T15:14:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.394+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8328069f40 con 0x7f8328100fd0 2023-10-05T15:14:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.395+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8314023070 con 0x7f8328100fd0 2023-10-05T15:14:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.396+0000 7f8325ffb700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83180a1550 0x7f83180a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.396+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f83140d0680 con 0x7f8328100fd0 2023-10-05T15:14:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.396+0000 7f832cf82700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83180a1550 0x7f83180a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.396+0000 7f832cf82700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83180a1550 0x7f83180a3a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8328100e30 tx=0x7f831c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:53.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.399+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8314099b20 con 0x7f8328100fd0 2023-10-05T15:14:53.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:53 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3363633754' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-05T15:14:53.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:53 smithi135 ceph-mon[103360]: osdmap e87: 12 total, 12 up, 12 in 2023-10-05T15:14:53.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:53 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3188465648' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-05T15:14:53.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.648+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f832810b640 con 0x7f8328100fd0 2023-10-05T15:14:53.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.649+0000 7f8325ffb700 1 -- 172.21.15.60:0/209833142 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11249 (secure 0 0 0) 0x7f8314033090 con 0x7f8328100fd0 2023-10-05T15:14:53.651 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:53.652 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:14:52.659647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83180a1550 msgr2=0x7f83180a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83180a1550 0x7f83180a3a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8328100e30 tx=0x7f831c009260 comp rx=0 tx=0).stop 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 msgr2=0x7f8328195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328195fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8314009990 tx=0x7f831401a840 comp rx=0 tx=0).stop 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 shutdown_connections 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8328101970 0x7f832819d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83280ffde0 0x7f8328195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83180a1550 0x7f83180a3a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 --2- 172.21.15.60:0/209833142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8328100fd0 0x7f8328195fc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 >> 172.21.15.60:0/209833142 conn(0x7f83280fb330 msgr2=0x7f8328104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 shutdown_connections 2023-10-05T15:14:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.651+0000 7f832f1e6700 1 -- 172.21.15.60:0/209833142 wait complete. 2023-10-05T15:14:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 17 2023-10-05T15:14:53.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3363633754' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-05T15:14:53.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:53 smithi060 ceph-mon[99238]: osdmap e87: 12 total, 12 up, 12 in 2023-10-05T15:14:53.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3188465648' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-05T15:14:53.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:14:53.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:53 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3363633754' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-05T15:14:53.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:53 smithi092 ceph-mon[102944]: osdmap e87: 12 total, 12 up, 12 in 2023-10-05T15:14:53.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:53 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3188465648' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-05T15:14:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 -- 172.21.15.60:0/2603455207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a4101950 msgr2=0x7ff4a4108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/2603455207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a4101950 0x7ff4a4108200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00b0d0 tx=0x7ff49c00b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 -- 172.21.15.60:0/2603455207 shutdown_connections 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/2603455207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a4101950 0x7ff4a4108200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/2603455207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/2603455207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 0x7ff4a4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 -- 172.21.15.60:0/2603455207 >> 172.21.15.60:0/2603455207 conn(0x7ff4a40fb310 msgr2=0x7ff4a40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 -- 172.21.15.60:0/2603455207 shutdown_connections 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.791+0000 7ff4ac48c700 1 -- 172.21.15.60:0/2603455207 wait complete. 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 Processor -- start 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 -- start start 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a4068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 0x7ff4a419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a4101950 0x7ff4a419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a419e7b0 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a419e920 con 0x7ff4a4101950 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4ac48c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a419eae0 con 0x7ff4a4100fb0 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a4068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a4068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35932/0 (socket says 172.21.15.60:35932) 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 -- 172.21.15.60:0/3280130424 learned_addr learned my addr 172.21.15.60:0/3280130424 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aaa29700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a4101950 0x7ff4a419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4a9a27700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 0x7ff4a419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 -- 172.21.15.60:0/3280130424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 msgr2=0x7ff4a419b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 0x7ff4a419b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 -- 172.21.15.60:0/3280130424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a4101950 msgr2=0x7ff4a419e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a4101950 0x7ff4a419e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aa228700 1 -- 172.21.15.60:0/3280130424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009d00 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4aaa29700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a4101950 0x7ff4a419e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.792+0000 7ff4a9a27700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 0x7ff4a419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.793+0000 7ff4aa228700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a4068bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000e970 tx=0x7ff4a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.793+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0009790 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.793+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4a00044e0 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.793+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a419edc0 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.793+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0003e30 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.793+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a419f240 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.794+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a41072b0 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.795+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff4a0004000 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.795+0000 7ff4977fe700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4900a1550 0x7ff4900a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:53.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.796+0000 7ff4a9a27700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4900a1550 0x7ff4900a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:53.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.796+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff4a0014070 con 0x7ff4a40ffdc0 2023-10-05T15:14:53.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.796+0000 7ff4a9a27700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4900a1550 0x7ff4900a3a10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff498009c00 tx=0x7ff498009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:53.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:53.799+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff4a0096740 con 0x7ff4a40ffdc0 2023-10-05T15:14:54.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.003+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4a402cf70 con 0x7ff4a40ffdc0 2023-10-05T15:14:54.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.005+0000 7ff4977fe700 1 -- 172.21.15.60:0/3280130424 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7ff4a0017e90 con 0x7ff4a40ffdc0 2023-10-05T15:14:54.008 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:54.008 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:14:54.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4900a1550 msgr2=0x7ff4900a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4900a1550 0x7ff4900a3a10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff498009c00 tx=0x7ff498009260 comp rx=0 tx=0).stop 2023-10-05T15:14:54.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 msgr2=0x7ff4a4068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a4068bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000e970 tx=0x7ff4a000ed30 comp rx=0 tx=0).stop 2023-10-05T15:14:54.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 shutdown_connections 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4a4101950 0x7ff4a419e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff4900a1550 0x7ff4900a3a10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a40ffdc0 0x7ff4a4068bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 --2- 172.21.15.60:0/3280130424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a4100fb0 0x7ff4a419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 >> 172.21.15.60:0/3280130424 conn(0x7ff4a40fb310 msgr2=0x7ff4a41043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 shutdown_connections 2023-10-05T15:14:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.007+0000 7ff4ac48c700 1 -- 172.21.15.60:0/3280130424 wait complete. 2023-10-05T15:14:54.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:14:54.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 -- 172.21.15.60:0/1557336998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540100e80 msgr2=0x7f35401012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 --2- 172.21.15.60:0/1557336998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540100e80 0x7f35401012a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3534009990 tx=0x7f3534009ca0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 -- 172.21.15.60:0/1557336998 shutdown_connections 2023-10-05T15:14:54.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 --2- 172.21.15.60:0/1557336998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3540102a20 0x7f3540109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 --2- 172.21.15.60:0/1557336998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540100e80 0x7f35401012a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 --2- 172.21.15.60:0/1557336998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102060 0x7f35401024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 -- 172.21.15.60:0/1557336998 >> 172.21.15.60:0/1557336998 conn(0x7f35400fc420 msgr2=0x7f35400fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 -- 172.21.15.60:0/1557336998 shutdown_connections 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 -- 172.21.15.60:0/1557336998 wait complete. 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 Processor -- start 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.146+0000 7f3547165700 1 -- start start 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3540100e80 0x7f3540196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 0x7f3540197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102a20 0x7f354019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354019e650 con 0x7f3540102060 2023-10-05T15:14:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354019e790 con 0x7f3540100e80 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354019e920 con 0x7f3540102a20 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 0x7f3540197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 0x7f3540197010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35948/0 (socket says 172.21.15.60:35948) 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 -- 172.21.15.60:0/3974559659 learned_addr learned my addr 172.21.15.60:0/3974559659 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3544f01700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3540100e80 0x7f3540196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3545702700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102a20 0x7f354019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 -- 172.21.15.60:0/3974559659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102a20 msgr2=0x7f354019e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102a20 0x7f354019e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 -- 172.21.15.60:0/3974559659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3540100e80 msgr2=0x7f3540196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3540100e80 0x7f3540196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 -- 172.21.15.60:0/3974559659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340095f0 con 0x7f3540102060 2023-10-05T15:14:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3545702700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102a20 0x7f354019e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353ffff700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 0x7f3540197010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f352c00c990 tx=0x7f352c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c007b00 con 0x7f3540102060 2023-10-05T15:14:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f352c007c60 con 0x7f3540102060 2023-10-05T15:14:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c018660 con 0x7f3540102060 2023-10-05T15:14:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.147+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354019ec00 con 0x7f3540102060 2023-10-05T15:14:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.148+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354019f110 con 0x7f3540102060 2023-10-05T15:14:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.149+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35401083a0 con 0x7f3540102060 2023-10-05T15:14:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.150+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f352c00f450 con 0x7f3540102060 2023-10-05T15:14:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.150+0000 7f353dffb700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35300a1550 0x7f35300a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.150+0000 7f3544f01700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35300a1550 0x7f35300a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.150+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f352c0ccdc0 con 0x7f3540102060 2023-10-05T15:14:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.151+0000 7f3544f01700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35300a1550 0x7f35300a3a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f353400b5c0 tx=0x7f3534005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:54.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.154+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f352c096230 con 0x7f3540102060 2023-10-05T15:14:54.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.359+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f354010c740 con 0x7f3540102060 2023-10-05T15:14:54.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.361+0000 7f353dffb700 1 -- 172.21.15.60:0/3974559659 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7f352c099850 con 0x7f3540102060 2023-10-05T15:14:54.364 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:54.364 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:14:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35300a1550 msgr2=0x7f35300a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35300a1550 0x7f35300a3a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f353400b5c0 tx=0x7f3534005fd0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 msgr2=0x7f3540197010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 0x7f3540197010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f352c00c990 tx=0x7f352c00cca0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 shutdown_connections 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3540102a20 0x7f354019e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3540100e80 0x7f3540196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f35300a1550 0x7f35300a3a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 --2- 172.21.15.60:0/3974559659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3540102060 0x7f3540197010 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 >> 172.21.15.60:0/3974559659 conn(0x7f35400fc420 msgr2=0x7f35401054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 shutdown_connections 2023-10-05T15:14:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.363+0000 7f3547165700 1 -- 172.21.15.60:0/3974559659 wait complete. 2023-10-05T15:14:54.377 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: pgmap v261: 129 pgs: 4 creating+peering, 107 active+clean, 18 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 9 op/s 2023-10-05T15:14:54.377 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:14:54.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3188465648' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-05T15:14:54.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: osdmap e88: 12 total, 12 up, 12 in 2023-10-05T15:14:54.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:54.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/209833142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:54.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:54 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3280130424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:54.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 -- 172.21.15.60:0/4287134102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 msgr2=0x7f98b8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 --2- 172.21.15.60:0/4287134102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8101410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0099c0 tx=0x7f98ac009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 -- 172.21.15.60:0/4287134102 shutdown_connections 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 --2- 172.21.15.60:0/4287134102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b8101950 0x7f98b8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 --2- 172.21.15.60:0/4287134102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b80ffdc0 0x7f98b81001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 --2- 172.21.15.60:0/4287134102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8101410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 -- 172.21.15.60:0/4287134102 >> 172.21.15.60:0/4287134102 conn(0x7f98b80fb310 msgr2=0x7f98b80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 -- 172.21.15.60:0/4287134102 shutdown_connections 2023-10-05T15:14:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.515+0000 7f98be921700 1 -- 172.21.15.60:0/4287134102 wait complete. 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 Processor -- start 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 -- start start 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b80ffdc0 0x7f98b8196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b8101950 0x7f98b819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b819e6d0 con 0x7f98b8100fb0 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b819e810 con 0x7f98b8101950 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98be921700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b819e9a0 con 0x7f98b80ffdc0 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35962/0 (socket says 172.21.15.60:35962) 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.516+0000 7f98b77fe700 1 -- 172.21.15.60:0/264926252 learned_addr learned my addr 172.21.15.60:0/264926252 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98bcebe700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b8101950 0x7f98b819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b7fff700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b80ffdc0 0x7f98b8196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b77fe700 1 -- 172.21.15.60:0/264926252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b80ffdc0 msgr2=0x7f98b8196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b77fe700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b80ffdc0 0x7f98b8196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b77fe700 1 -- 172.21.15.60:0/264926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b8101950 msgr2=0x7f98b819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b77fe700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b8101950 0x7f98b819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b77fe700 1 -- 172.21.15.60:0/264926252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0095f0 con 0x7f98b8100fb0 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98bcebe700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b8101950 0x7f98b819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b77fe700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8197090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009990 tx=0x7f98ac005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac01d070 con 0x7f98b8100fb0 2023-10-05T15:14:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98ac022470 con 0x7f98b8100fb0 2023-10-05T15:14:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b819ec20 con 0x7f98b8100fb0 2023-10-05T15:14:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac004230 con 0x7f98b8100fb0 2023-10-05T15:14:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.517+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b819f120 con 0x7f98b8100fb0 2023-10-05T15:14:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.518+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b810b5d0 con 0x7f98b8100fb0 2023-10-05T15:14:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.519+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f98ac0225e0 con 0x7f98b8100fb0 2023-10-05T15:14:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.520+0000 7f98b57fa700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98a00a1550 0x7f98a00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.520+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f98ac0ce410 con 0x7f98b8100fb0 2023-10-05T15:14:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.520+0000 7f98b7fff700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98a00a1550 0x7f98a00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.520+0000 7f98b7fff700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98a00a1550 0x7f98a00a3a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98a8005950 tx=0x7f98a80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:54.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.523+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f98ac097990 con 0x7f98b8100fb0 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: pgmap v261: 129 pgs: 4 creating+peering, 107 active+clean, 18 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 9 op/s 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3188465648' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: osdmap e88: 12 total, 12 up, 12 in 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/209833142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:54.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:54 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3280130424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:54.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: pgmap v261: 129 pgs: 4 creating+peering, 107 active+clean, 18 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 9 op/s 2023-10-05T15:14:54.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:14:54.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3188465648' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-05T15:14:54.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: osdmap e88: 12 total, 12 up, 12 in 2023-10-05T15:14:54.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:14:54.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/209833142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:54.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:54 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3280130424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:54.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.767+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98b819f2b0 con 0x7f98b8100fb0 2023-10-05T15:14:54.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.768+0000 7f98b57fa700 1 -- 172.21.15.60:0/264926252 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11249 (secure 0 0 0) 0x7f98ac027090 con 0x7f98b8100fb0 2023-10-05T15:14:54.771 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:54.771 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:14:52.659647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98a00a1550 msgr2=0x7f98a00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98a00a1550 0x7f98a00a3a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98a8005950 tx=0x7f98a80058e0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 msgr2=0x7f98b8197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8197090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009990 tx=0x7f98ac005e80 comp rx=0 tx=0).stop 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 shutdown_connections 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98b8101950 0x7f98b819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b80ffdc0 0x7f98b8196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f98a00a1550 0x7f98a00a3a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 --2- 172.21.15.60:0/264926252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b8100fb0 0x7f98b8197090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 >> 172.21.15.60:0/264926252 conn(0x7f98b80fb310 msgr2=0x7f98b8068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 shutdown_connections 2023-10-05T15:14:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.770+0000 7f98be921700 1 -- 172.21.15.60:0/264926252 wait complete. 2023-10-05T15:14:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 17 2023-10-05T15:14:54.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:14:54.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 -- 172.21.15.60:0/585503834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38180ffd60 msgr2=0x7f3818100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 --2- 172.21.15.60:0/585503834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38180ffd60 0x7f3818100180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38080099c0 tx=0x7f3808009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 -- 172.21.15.60:0/585503834 shutdown_connections 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 --2- 172.21.15.60:0/585503834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38181018f0 0x7f38181081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 --2- 172.21.15.60:0/585503834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38180ffd60 0x7f3818100180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 --2- 172.21.15.60:0/585503834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3818100f50 0x7f38181013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 -- 172.21.15.60:0/585503834 >> 172.21.15.60:0/585503834 conn(0x7f38180fb2b0 msgr2=0x7f38180fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 -- 172.21.15.60:0/585503834 shutdown_connections 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.908+0000 7f381ff1a700 1 -- 172.21.15.60:0/585503834 wait complete. 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 Processor -- start 2023-10-05T15:14:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 -- start start 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffd60 0x7f3818196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3818100f50 0x7f38181970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 0x7f381819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381819e700 con 0x7f38181018f0 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381819e840 con 0x7f38180ffd60 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381ff1a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381819e9d0 con 0x7f3818100f50 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381e4b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 0x7f381819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381e4b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 0x7f381819e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35978/0 (socket says 172.21.15.60:35978) 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381e4b7700 1 -- 172.21.15.60:0/3392903979 learned_addr learned my addr 172.21.15.60:0/3392903979 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381dcb6700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffd60 0x7f3818196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.909+0000 7f381d4b5700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3818100f50 0x7f38181970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381e4b7700 1 -- 172.21.15.60:0/3392903979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3818100f50 msgr2=0x7f38181970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381e4b7700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3818100f50 0x7f38181970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381e4b7700 1 -- 172.21.15.60:0/3392903979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffd60 msgr2=0x7f3818196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381e4b7700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffd60 0x7f3818196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381e4b7700 1 -- 172.21.15.60:0/3392903979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080095f0 con 0x7f38181018f0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381d4b5700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3818100f50 0x7f38181970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381e4b7700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 0x7f381819e130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3810007ee0 tx=0x7f381000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810017070 con 0x7f38181018f0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381819ecb0 con 0x7f38181018f0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f381000f040 con 0x7f38181018f0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810005740 con 0x7f38181018f0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.910+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381819f1c0 con 0x7f38181018f0 2023-10-05T15:14:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.911+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381810b5c0 con 0x7f38181018f0 2023-10-05T15:14:54.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.912+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f381000dc60 con 0x7f38181018f0 2023-10-05T15:14:54.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.913+0000 7f380effd700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38040a14d0 0x7f38040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:54.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.913+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f38100ccd50 con 0x7f38181018f0 2023-10-05T15:14:54.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.913+0000 7f381dcb6700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38040a14d0 0x7f38040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:54.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.913+0000 7f381dcb6700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38040a14d0 0x7f38040a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f380800b580 tx=0x7f3808009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:54.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:54.917+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38100961c0 con 0x7f38181018f0 2023-10-05T15:14:55.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.122+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f381819f3b0 con 0x7f38181018f0 2023-10-05T15:14:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.124+0000 7f380effd700 1 -- 172.21.15.60:0/3392903979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7f38100997e0 con 0x7f38181018f0 2023-10-05T15:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:14:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38040a14d0 msgr2=0x7f38040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38040a14d0 0x7f38040a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f380800b580 tx=0x7f3808009f10 comp rx=0 tx=0).stop 2023-10-05T15:14:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 msgr2=0x7f381819e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 0x7f381819e130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3810007ee0 tx=0x7f381000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 shutdown_connections 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38040a14d0 0x7f38040a3990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38181018f0 0x7f381819e130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38180ffd60 0x7f3818196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 --2- 172.21.15.60:0/3392903979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3818100f50 0x7f38181970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 >> 172.21.15.60:0/3392903979 conn(0x7f38180fb2b0 msgr2=0x7f3818068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 shutdown_connections 2023-10-05T15:14:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.126+0000 7f381ff1a700 1 -- 172.21.15.60:0/3392903979 wait complete. 2023-10-05T15:14:55.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-05T15:14:47.613338+0000', 'modified': '2023-10-05T15:14:52.659647+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6839/3541269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3541269}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3541269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-05T15:14:55.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-05T15:14:55.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-05T15:14:55.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 -- 172.21.15.60:0/3610179291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 msgr2=0x7f8bfc101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 --2- 172.21.15.60:0/3610179291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc101450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00099c0 tx=0x7f8bf0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 -- 172.21.15.60:0/3610179291 shutdown_connections 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 --2- 172.21.15.60:0/3610179291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc101990 0x7f8bfc108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 --2- 172.21.15.60:0/3610179291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc0ffe00 0x7f8bfc100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 --2- 172.21.15.60:0/3610179291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc101450 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 -- 172.21.15.60:0/3610179291 >> 172.21.15.60:0/3610179291 conn(0x7f8bfc0fb3b0 msgr2=0x7f8bfc0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 -- 172.21.15.60:0/3610179291 shutdown_connections 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.269+0000 7f8c0229c700 1 -- 172.21.15.60:0/3610179291 wait complete. 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 Processor -- start 2023-10-05T15:14:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 -- start start 2023-10-05T15:14:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc0ffe00 0x7f8bfc069b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc101990 0x7f8bfc19df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc19e700 con 0x7f8bfc100ff0 2023-10-05T15:14:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc19e870 con 0x7f8bfc101990 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c0229c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc19ea30 con 0x7f8bfc0ffe00 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35990/0 (socket says 172.21.15.60:35990) 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/2771601997 learned_addr learned my addr 172.21.15.60:0/2771601997 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.270+0000 7f8c00839700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc101990 0x7f8bfc19df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc0ffe00 0x7f8bfc069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/2771601997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc0ffe00 msgr2=0x7f8bfc069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc0ffe00 0x7f8bfc069b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/2771601997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc101990 msgr2=0x7f8bfc19df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc101990 0x7f8bfc19df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/2771601997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00095f0 con 0x7f8bfc100ff0 2023-10-05T15:14:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc19b920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009990 tx=0x7f8bf0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bf97fa700 1 -- 172.21.15.60:0/2771601997 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf001d070 con 0x7f8bfc100ff0 2023-10-05T15:14:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bf97fa700 1 -- 172.21.15.60:0/2771601997 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf0022470 con 0x7f8bfc100ff0 2023-10-05T15:14:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc19ecb0 con 0x7f8bfc100ff0 2023-10-05T15:14:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8bf97fa700 1 -- 172.21.15.60:0/2771601997 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0004230 con 0x7f8bfc100ff0 2023-10-05T15:14:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.271+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc19f160 con 0x7f8bfc100ff0 2023-10-05T15:14:55.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.273+0000 7f8bf97fa700 1 -- 172.21.15.60:0/2771601997 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8bf00225e0 con 0x7f8bfc100ff0 2023-10-05T15:14:55.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.274+0000 7f8bf97fa700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8be40a1480 0x7f8be40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.274+0000 7f8bf97fa700 1 -- 172.21.15.60:0/2771601997 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8bf00ce190 con 0x7f8bfc100ff0 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.274+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8be40a1480 0x7f8be40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8be40a1480 0x7f8be40a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bec005950 tx=0x7f8bec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 Processor -- start 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 -- start start 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30d3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30d3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b303a410 con 0x5587b30d2b70 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b302bbd0 con 0x5587b30d2210 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b30294f0 con 0x5587b30d3a10 2023-10-05T15:14:55.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30d3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35998/0 (socket says 172.21.15.60:35998) 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/47827950 learned_addr learned my addr 172.21.15.60:0/47827950 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8c00839700 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30d3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/47827950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 msgr2=0x5587b30d3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30d3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/47827950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 msgr2=0x5587b30d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.275+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/47827950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b2e4fd90 con 0x5587b30d2b70 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.276+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30d3430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bf009b2e0 tx=0x7f8bf0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573dbfc650fd62f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.276+0000 7f8be27fc700 1 -- 172.21.15.60:0/47827950 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00ce020 con 0x5587b30d2b70 2023-10-05T15:14:55.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.276+0000 7f8be27fc700 1 -- 172.21.15.60:0/47827950 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf00228e0 con 0x5587b30d2b70 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.276+0000 7f8be27fc700 1 -- 172.21.15.60:0/47827950 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00996f0 con 0x5587b30d2b70 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.276+0000 7f8c0e486b80 1 -- 172.21.15.60:0/47827950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 msgr2=0x5587b30d3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.276+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30d3430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bf009b2e0 tx=0x7f8bf0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- 172.21.15.60:0/47827950 shutdown_connections 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30d3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/47827950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30d3430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- 172.21.15.60:0/47827950 >> 172.21.15.60:0/47827950 conn(0x5587b3046210 msgr2=0x5587b30cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- 172.21.15.60:0/47827950 shutdown_connections 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- 172.21.15.60:0/47827950 wait complete. 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- start start 2023-10-05T15:14:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 Processor -- start 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2b70 0x5587b30dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 0x5587b30e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b3024de0 con 0x5587b30d3a10 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b2fc16c0 con 0x5587b30d2210 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b2fc1360 con 0x5587b30d2b70 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.277+0000 7f8c0e486b80 10 client.0 _ll_register_callbacks cb 0x5587b2e1e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 0x5587b30e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 0x5587b30e3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36006/0 (socket says 172.21.15.60:36006) 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 -- 172.21.15.60:0/3847541939 learned_addr learned my addr 172.21.15.60:0/3847541939 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2b70 0x5587b30dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 -- 172.21.15.60:0/3847541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2b70 msgr2=0x5587b30dc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2b70 0x5587b30dc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 -- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 msgr2=0x5587b30dbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30dbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 -- 172.21.15.60:0/3847541939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc19f160 con 0x5587b30d3a10 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2b70 0x5587b30dc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c00839700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 0x5587b30e3220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007af0 tx=0x7f8bf4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5c88c0f8bcb4ab server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bdb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/3847541939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4012b40 con 0x5587b30d3a10 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/3847541939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8bf4012ca0 con 0x5587b30d3a10 2023-10-05T15:14:55.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587b30c4ec0 con 0x5587b30d3a10 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/3847541939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bf4007e70 con 0x5587b30d3a10 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c0e486b80 10 client.14724 fetch_fsmap learned FSMap version 17 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.278+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5587b2e38c10 con 0x5587b30d3a10 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/3847541939 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5587b30c4ec0 con 0x5587b30d3a10 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/3847541939 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8bf4014040 con 0x5587b30d3a10 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8c0e486b80 10 client.14724 fetch_fsmap finished waiting for FSMap version 17 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8c0e486b80 10 client.14724 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8c0e486b80 20 client.14724 populate_metadata read hostname 'smithi060' 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b30e78e0 0x5587b30e6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8c0e486b80 4 client.14724 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587b301ddc0 con 0x5587b30e78e0 2023-10-05T15:14:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.279+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b30e78e0 0x5587b30e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8bdb7fe700 10 client.14724 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:14:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b30e78e0 0x5587b30e6380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6438700b59a7b339 server_cookie=4595d28ec80f16aa in_seq=0 out_seq=0 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/3847541939 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5587b301ddc0 con 0x5587b30e78e0 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8bdb7fe700 10 client.14724 handle_command_reply: tid=0 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 client.14724 shutdown 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 msgr2=0x5587b30e3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 0x5587b30e3220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007af0 tx=0x7f8bf4007e00 comp rx=0 tx=0).stop 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 shutdown_connections 2023-10-05T15:14:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b30e78e0 0x5587b30e6380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d3a10 0x5587b30e3220 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8bdb7fe700 0 client.14724 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30dbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/3847541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2b70 0x5587b30dc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.280+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 >> 172.21.15.60:0/3847541939 conn(0x5587b3046210 msgr2=0x5587b30ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.281+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 shutdown_connections 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.281+0000 7f8c0e486b80 1 -- 172.21.15.60:0/3847541939 wait complete. 2023-10-05T15:14:55.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.281+0000 7f8c0e486b80 20 client.14724 trim_cache size 0 max 16384 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 Processor -- start 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 -- start start 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30e3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b30db870 con 0x5587b30d2b70 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b2ea58d0 con 0x5587b30d2210 2023-10-05T15:14:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b3020ed0 con 0x5587b30d3a10 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36012/0 (socket says 172.21.15.60:36012) 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/1977713593 learned_addr learned my addr 172.21.15.60:0/1977713593 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/1977713593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 msgr2=0x5587b30e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/1977713593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 msgr2=0x5587b30ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/1977713593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b2e76200 con 0x5587b30d2b70 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:14:55.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e3140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0022a50 tx=0x7f8bf0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf3bd40784f1245 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8be2ffd700 1 -- 172.21.15.60:0/1977713593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf009b350 con 0x5587b30d2b70 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8be2ffd700 1 -- 172.21.15.60:0/1977713593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf009ba50 con 0x5587b30d2b70 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.299+0000 7f8be2ffd700 1 -- 172.21.15.60:0/1977713593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00a31c0 con 0x5587b30d2b70 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 -- 172.21.15.60:0/1977713593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 msgr2=0x5587b30e3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e3140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0022a50 tx=0x7f8bf0009310 comp rx=0 tx=0).stop 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 -- 172.21.15.60:0/1977713593 shutdown_connections 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d3a10 0x5587b30e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d2210 0x5587b30ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/1977713593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e3140 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 -- 172.21.15.60:0/1977713593 >> 172.21.15.60:0/1977713593 conn(0x5587b3046210 msgr2=0x5587b30cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 -- 172.21.15.60:0/1977713593 shutdown_connections 2023-10-05T15:14:55.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 -- 172.21.15.60:0/1977713593 wait complete. 2023-10-05T15:14:55.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 -- start start 2023-10-05T15:14:55.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.300+0000 7f8c0e486b80 1 Processor -- start 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2210 0x5587b30e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d3a10 0x5587b30e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b30e2ce0 con 0x5587b30d2b70 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b30e2e50 con 0x5587b30d3a10 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b30e3010 con 0x5587b30d2210 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 10 client.0 _ll_register_callbacks cb 0x7f8bf4009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36018/0 (socket says 172.21.15.60:36018) 2023-10-05T15:14:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/294315140 learned_addr learned my addr 172.21.15.60:0/294315140 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c00839700 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d3a10 0x5587b30e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/294315140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2210 msgr2=0x5587b30e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2210 0x5587b30e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d3a10 msgr2=0x5587b30e26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d3a10 0x5587b30e26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 -- 172.21.15.60:0/294315140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587b2e4fd90 con 0x5587b30d2b70 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bfb7fe700 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e2180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00cbe10 tx=0x7f8bf0022c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10127ac41a686b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bdb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/294315140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0003d70 con 0x5587b30d2b70 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/294315140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8bf0003ed0 con 0x5587b30d2b70 2023-10-05T15:14:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bf00228e0 con 0x5587b30d2b70 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/294315140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bf0004090 con 0x5587b30d2b70 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 10 client.14730 fetch_fsmap learned FSMap version 17 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.301+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5587b2e4e260 con 0x5587b30d2b70 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/294315140 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf00a7080 con 0x5587b30d2b70 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/294315140 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8bf0097320 con 0x5587b30d2b70 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8c0e486b80 10 client.14730 fetch_fsmap finished waiting for FSMap version 17 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8c0e486b80 10 client.14730 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8c0e486b80 20 client.14730 populate_metadata read hostname 'smithi060' 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b313f7d0 0x5587b313bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8c0e486b80 4 client.14730 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5587b301dae0 con 0x5587b313f7d0 2023-10-05T15:14:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.302+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b313f7d0 0x5587b313bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8bdb7fe700 10 client.14730 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8bfbfff700 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b313f7d0 0x5587b313bda0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d480b17b4808eaaa server_cookie=f584a931daf18e2 in_seq=0 out_seq=0 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8bdb7fe700 1 -- 172.21.15.60:0/294315140 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5587b301dae0 con 0x5587b313f7d0 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8bdb7fe700 10 client.14730 handle_command_reply: tid=0 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 client.14730 shutdown 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 msgr2=0x5587b30e2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e2180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00cbe10 tx=0x7f8bf0022c80 comp rx=0 tx=0).stop 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 shutdown_connections 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5587b313f7d0 0x5587b313bda0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5587b30d3a10 0x5587b30e26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587b30d2210 0x5587b30e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8bdb7fe700 0 client.14730 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 --2- 172.21.15.60:0/294315140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587b30d2b70 0x5587b30e2180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 >> 172.21.15.60:0/294315140 conn(0x5587b3046210 msgr2=0x5587b30ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 shutdown_connections 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 1 -- 172.21.15.60:0/294315140 wait complete. 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.303+0000 7f8c0e486b80 20 client.14730 trim_cache size 0 max 16384 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:14:55.313 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24533, 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 7.106780358, 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 17, 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 88, 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 87, 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 12.65345402 2023-10-05T15:14:55.314 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8be40a1480 msgr2=0x7f8be40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8be40a1480 0x7f8be40a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bec005950 tx=0x7f8bec0058e0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 msgr2=0x7f8bfc19b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc19b920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009990 tx=0x7f8bf0005e80 comp rx=0 tx=0).stop 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 shutdown_connections 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc101990 0x7f8bfc19df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc0ffe00 0x7f8bfc069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8be40a1480 0x7f8be40a3940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 --2- 172.21.15.60:0/2771601997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bfc100ff0 0x7f8bfc19b920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 >> 172.21.15.60:0/2771601997 conn(0x7f8bfc0fb3b0 msgr2=0x7f8bfc0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 shutdown_connections 2023-10-05T15:14:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:55.304+0000 7f8c0229c700 1 -- 172.21.15.60:0/2771601997 wait complete. 2023-10-05T15:14:55.319 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-05T15:14:55.319 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:55.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-05T15:14:55.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:55 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3974559659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:55 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/264926252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:55 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3392903979' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:55 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3974559659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:55 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/264926252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:55 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3392903979' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:55 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3974559659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:55 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/264926252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:55 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3392903979' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:14:55.879 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:14:56.386 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:56 smithi060 ceph-mon[99238]: pgmap v263: 129 pgs: 4 creating+peering, 119 active+clean, 6 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 828 B/s wr, 6 op/s 2023-10-05T15:14:56.387 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:56 smithi060 ceph-mon[99238]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:14:56.387 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:56 smithi060 ceph-mon[99238]: Cluster is now healthy 2023-10-05T15:14:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:56 smithi135 ceph-mon[103360]: pgmap v263: 129 pgs: 4 creating+peering, 119 active+clean, 6 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 828 B/s wr, 6 op/s 2023-10-05T15:14:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:56 smithi135 ceph-mon[103360]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:14:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:56 smithi135 ceph-mon[103360]: Cluster is now healthy 2023-10-05T15:14:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:56 smithi092 ceph-mon[102944]: pgmap v263: 129 pgs: 4 creating+peering, 119 active+clean, 6 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 828 B/s wr, 6 op/s 2023-10-05T15:14:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:56 smithi092 ceph-mon[102944]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:14:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:56 smithi092 ceph-mon[102944]: Cluster is now healthy 2023-10-05T15:14:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 -- 172.21.15.60:0/3558560370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf20100820 msgr2=0x7fcf2010cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 --2- 172.21.15.60:0/3558560370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf20100820 0x7fcf2010cc90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b0d0 tx=0x7fcf1800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 -- 172.21.15.60:0/3558560370 shutdown_connections 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 --2- 172.21.15.60:0/3558560370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf20100820 0x7fcf2010cc90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 --2- 172.21.15.60:0/3558560370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20105e70 0x7fcf20106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 --2- 172.21.15.60:0/3558560370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf200ffe60 0x7fcf201002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 -- 172.21.15.60:0/3558560370 >> 172.21.15.60:0/3558560370 conn(0x7fcf20075e00 msgr2=0x7fcf20076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 -- 172.21.15.60:0/3558560370 shutdown_connections 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.232+0000 7fcf270ce700 1 -- 172.21.15.60:0/3558560370 wait complete. 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 Processor -- start 2023-10-05T15:14:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 -- start start 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 0x7fcf20197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100820 0x7fcf201984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf20105e70 0x7fcf201a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20198df0 con 0x7fcf200ffe60 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201a3560 con 0x7fcf20100820 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf270ce700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201a36d0 con 0x7fcf20105e70 2023-10-05T15:14:57.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf24e6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 0x7fcf20197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf24e6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 0x7fcf20197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36028/0 (socket says 172.21.15.60:36028) 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.233+0000 7fcf24e6a700 1 -- 172.21.15.60:0/1888677684 learned_addr learned my addr 172.21.15.60:0/1888677684 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf1ffff700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100820 0x7fcf201984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf2566b700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf20105e70 0x7fcf201a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf24e6a700 1 -- 172.21.15.60:0/1888677684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf20105e70 msgr2=0x7fcf201a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf24e6a700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf20105e70 0x7fcf201a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf24e6a700 1 -- 172.21.15.60:0/1888677684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100820 msgr2=0x7fcf201984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf24e6a700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100820 0x7fcf201984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf24e6a700 1 -- 172.21.15.60:0/1888677684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009d00 con 0x7fcf200ffe60 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf1ffff700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100820 0x7fcf201984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:14:57.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf24e6a700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 0x7fcf20197fa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000d950 tx=0x7fcf1000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:57.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10009940 con 0x7fcf200ffe60 2023-10-05T15:14:57.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf20195eb0 con 0x7fcf200ffe60 2023-10-05T15:14:57.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf10010460 con 0x7fcf200ffe60 2023-10-05T15:14:57.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000f620 con 0x7fcf200ffe60 2023-10-05T15:14:57.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.234+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf201963b0 con 0x7fcf200ffe60 2023-10-05T15:14:57.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.235+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2004ebb0 con 0x7fcf200ffe60 2023-10-05T15:14:57.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.236+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcf100108d0 con 0x7fcf200ffe60 2023-10-05T15:14:57.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.237+0000 7fcf1dffb700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf0c0a1480 0x7fcf0c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:14:57.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.237+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcf100cccf0 con 0x7fcf200ffe60 2023-10-05T15:14:57.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.237+0000 7fcf1ffff700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf0c0a1480 0x7fcf0c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:14:57.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.237+0000 7fcf1ffff700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf0c0a1480 0x7fcf0c0a3940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005950 tx=0x7fcf080058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:14:57.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.241+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf100d1070 con 0x7fcf200ffe60 2023-10-05T15:14:57.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.485+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf20068f90 con 0x7fcf200ffe60 2023-10-05T15:14:57.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.486+0000 7fcf1dffb700 1 -- 172.21.15.60:0/1888677684 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcf10016070 con 0x7fcf200ffe60 2023-10-05T15:14:57.488 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf0c0a1480 msgr2=0x7fcf0c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf0c0a1480 0x7fcf0c0a3940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005950 tx=0x7fcf080058e0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 msgr2=0x7fcf20197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 0x7fcf20197fa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000d950 tx=0x7fcf1000dc60 comp rx=0 tx=0).stop 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 shutdown_connections 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf20105e70 0x7fcf201a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf0c0a1480 0x7fcf0c0a3940 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf200ffe60 0x7fcf20197fa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 --2- 172.21.15.60:0/1888677684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100820 0x7fcf201984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:14:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 >> 172.21.15.60:0/1888677684 conn(0x7fcf20075e00 msgr2=0x7fcf20103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:14:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 shutdown_connections 2023-10-05T15:14:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:57.488+0000 7fcf270ce700 1 -- 172.21.15.60:0/1888677684 wait complete. 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-05T15:14:57.927 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-05T15:14:57.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:57.928 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-05T15:14:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-05T15:14:57.946 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-05T15:14:57.946 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:14:57.947 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-05T15:14:57.948 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 41882sec preferred_lft 41882sec 2023-10-05T15:14:57.948 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-05T15:14:57.948 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:14:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:14:57.948 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:14:57.948 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-05T15:14:57.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-05T15:14:57.949 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:14:58.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.117 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-05T15:14:58.148 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-05T15:14:58.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.149 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-05T15:14:58.223 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-05T15:14:58.224 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-05T15:14:58.224 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-05T15:14:58.224 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-05T15:14:58.224 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-05T15:14:58.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.225 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:14:58.225 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:14:58.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-05T15:14:58.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-05T15:14:58.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-05T15:14:58.225 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:14:58.531 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:58 smithi060 ceph-mon[99238]: pgmap v264: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2023-10-05T15:14:58.531 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:14:58 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1888677684' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:14:58.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.532 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-05T15:14:58.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.549 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-05T15:14:58.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:58 smithi135 ceph-mon[103360]: pgmap v264: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2023-10-05T15:14:58.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:14:58 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1888677684' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:14:58.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.607 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:14:58.608 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:14:58.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:14:58.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-05T15:14:58.608 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:14:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:58 smithi092 ceph-mon[102944]: pgmap v264: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2023-10-05T15:14:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:14:58 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1888677684' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:14:58.704 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-05T15:14:58.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.705 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:14:58.705 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:14:58.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-05T15:14:58.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-05T15:14:58.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-05T15:14:58.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-05T15:14:58.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-05T15:14:58.706 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:14:58.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:58.957 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:14:58.957 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:14:58.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-05T15:14:58.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-10-05T15:14:58.957 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:14:59.057 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-05T15:14:59.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:14:59.057 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:59.075 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-05T15:14:59.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:14:59.075 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:59.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-10-05T15:14:59.200 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2023-10-05T15:14:59.258 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/rdma 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/memory 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/pids 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/devices 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:14:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:14:59.260 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/a3567ba73698be9d5bd4ff8f7457aa29910f9e075755e49cc77c771a6313f2a2/merged 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/f6074f2f444060461ada69f1eb0c0116b4fca51d7ad55bb70b463411ad2ab1a8/merged 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/0 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/08ffc18a4f613c923e2e103a58fb69560c18a24496ee0afcc3b3d4078d1ad062/merged 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/e6a70e94f58e35d081a793dbb6525ab8cba8abf78735fb52515d060bf0439f59/merged 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/962c2103d26acf697ed49645084394eefedb308beb0f3d5ef1aba1b1eedc12ae/merged 2023-10-05T15:14:59.261 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/98b16ee777535fe2d26f03b6df0f8756356d207f1a4e72e379d94bad1c633e9f/merged 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/2bcf59923e36b3d3ceba135a4dd596fefed6bbf6360c28bb4ab0b9792a412a4e/merged 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/be1090f2978af41197824bf16111cbbd1051d71d10c2e82ada08e3fd3711fd76/merged 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/4523ace40912bed7e267d1f4ff0507a68cc559ca995df9cce2119317dc02f49b/merged 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/34e4696f7caba1ad03bb6cf08c85246cc16ae3eb3eecdeda23f12516b5c86b70/merged 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:14:59.262 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:14:59.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:59.263 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-10-05T15:14:59.321 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-05T15:14:59.321 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-05T15:14:59.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-10-05T15:14:59.390 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2023-10-05T15:14:59.448 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/rdma 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/memory 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/pids 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/devices 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:14:59.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2023-10-05T15:14:59.450 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/a3567ba73698be9d5bd4ff8f7457aa29910f9e075755e49cc77c771a6313f2a2/merged 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/f6074f2f444060461ada69f1eb0c0116b4fca51d7ad55bb70b463411ad2ab1a8/merged 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/0 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/08ffc18a4f613c923e2e103a58fb69560c18a24496ee0afcc3b3d4078d1ad062/merged 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/e6a70e94f58e35d081a793dbb6525ab8cba8abf78735fb52515d060bf0439f59/merged 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/962c2103d26acf697ed49645084394eefedb308beb0f3d5ef1aba1b1eedc12ae/merged 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/98b16ee777535fe2d26f03b6df0f8756356d207f1a4e72e379d94bad1c633e9f/merged 2023-10-05T15:14:59.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/2bcf59923e36b3d3ceba135a4dd596fefed6bbf6360c28bb4ab0b9792a412a4e/merged 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/be1090f2978af41197824bf16111cbbd1051d71d10c2e82ada08e3fd3711fd76/merged 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/4523ace40912bed7e267d1f4ff0507a68cc559ca995df9cce2119317dc02f49b/merged 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/34e4696f7caba1ad03bb6cf08c85246cc16ae3eb3eecdeda23f12516b5c86b70/merged 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:14:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:59.452 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-10-05T15:14:59.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:2023-10-05T15:14:59.473+0000 7f2d566f55c0 -1 init, newargv = 0x561c1cfe1e40 newargc=15 2023-10-05T15:14:59.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:ceph-fuse[152793]: starting ceph client 2023-10-05T15:14:59.482 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:ceph-fuse[152793]: starting fuse 2023-10-05T15:14:59.494 INFO:teuthology.orchestra.run.smithi060.stdout:124 2023-10-05T15:14:59.494 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-10-05T15:14:59.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo stdin-killer -- python3 -c ' 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> import glob 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> import re 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> def _find_admin_socket(client_name): 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-05T15:14:59.495 DEBUG:teuthology.orchestra.run.smithi060:> files = glob.glob(asok_path) 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> # Given a non-glob path, it better be there 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> if "*" not in asok_path: 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> assert(len(files) == 1) 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> return files[0] 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-05T15:14:59.496 DEBUG:teuthology.orchestra.run.smithi060:> for f in files: 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> contents = proc_f.read() 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> if mountpoint in contents: 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> return f 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-05T15:14:59.497 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-05T15:14:59.498 DEBUG:teuthology.orchestra.run.smithi060:> print(_find_admin_socket("client.admin")) 2023-10-05T15:14:59.498 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-05T15:14:59.621 INFO:teuthology.orchestra.run.smithi060.stdout:/var/run/ceph/ceph-client.admin.152793.asok 2023-10-05T15:14:59.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:14:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-05T15:14:59.630 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.152793.asok 2023-10-05T15:14:59.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:59.631 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.152793.asok status 2023-10-05T15:14:59.791 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:14:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": { 2023-10-05T15:14:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_sha1": "689b3d5ae1ed3e8efe9a65281cd9bd422749e95f", 2023-10-05T15:14:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:14:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "entity_id": "admin", 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": "smithi060", 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "pid": "152793", 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "root": "/" 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_count": 0, 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_pinned_count": 0, 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 14742, 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "inst": { 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "name": { 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2023-10-05T15:14:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 14742 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2980817962 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2980817962 2023-10-05T15:14:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "inst_str": "client.14742 192.168.0.1:0/2980817962", 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr_str": "192.168.0.1:0/2980817962", 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "inode_count": 1, 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_epoch": 17, 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch": 88, 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch_barrier": 0, 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklisted": false, 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs" 2023-10-05T15:14:59.794 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:14:59.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:59.802 DEBUG:teuthology.orchestra.run.smithi060:> stat --file-system '--printf=%T 2023-10-05T15:14:59.802 DEBUG:teuthology.orchestra.run.smithi060:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:59.819 INFO:teuthology.orchestra.run.smithi060.stdout:fuseblk 2023-10-05T15:14:59.820 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:59.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:59.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:14:59.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:14:59.890 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-05T15:15:00.000 INFO:teuthology.orchestra.run.smithi060.stdout:# file: . 2023-10-05T15:15:00.000 INFO:teuthology.orchestra.run.smithi060.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-05T15:15:00.000 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:00.001 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:15:00.001 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:15:00.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:15:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 -- 172.21.15.60:0/1392795436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 msgr2=0x7f3f80102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 --2- 172.21.15.60:0/1392795436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f80102510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009990 tx=0x7f3f6c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 -- 172.21.15.60:0/1392795436 shutdown_connections 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 --2- 172.21.15.60:0/1392795436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80102a50 0x7f3f80109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 --2- 172.21.15.60:0/1392795436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f80100eb0 0x7f3f801012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 --2- 172.21.15.60:0/1392795436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f80102510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 -- 172.21.15.60:0/1392795436 >> 172.21.15.60:0/1392795436 conn(0x7f3f800fc470 msgr2=0x7f3f800fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 -- 172.21.15.60:0/1392795436 shutdown_connections 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.183+0000 7f3f87058700 1 -- 172.21.15.60:0/1392795436 wait complete. 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.184+0000 7f3f87058700 1 Processor -- start 2023-10-05T15:15:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.184+0000 7f3f87058700 1 -- start start 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.184+0000 7f3f87058700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80100eb0 0x7f3f80196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.184+0000 7f3f87058700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f801971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f87058700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f80102a50 0x7f3f8019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f87058700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8019e7b0 con 0x7f3f80102090 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f87058700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8019e920 con 0x7f3f80102a50 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f87058700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8019eae0 con 0x7f3f80100eb0 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f801971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f801971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36058/0 (socket says 172.21.15.60:36058) 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 -- 172.21.15.60:0/1415924319 learned_addr learned my addr 172.21.15.60:0/1415924319 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f855f5700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f80102a50 0x7f3f8019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f84df4700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80100eb0 0x7f3f80196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 -- 172.21.15.60:0/1415924319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80100eb0 msgr2=0x7f3f80196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80100eb0 0x7f3f80196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 -- 172.21.15.60:0/1415924319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f80102a50 msgr2=0x7f3f8019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f80102a50 0x7f3f8019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 -- 172.21.15.60:0/1415924319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c0095f0 con 0x7f3f80102090 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7ffff700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f801971b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0098e0 tx=0x7f3f6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c01d070 con 0x7f3f80102090 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f6c0054f0 con 0x7f3f80102090 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8019ed60 con 0x7f3f80102090 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.185+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c004be0 con 0x7f3f80102090 2023-10-05T15:15:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.186+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8019f120 con 0x7f3f80102090 2023-10-05T15:15:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.187+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f80108470 con 0x7f3f80102090 2023-10-05T15:15:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.188+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3f6c00fbc0 con 0x7f3f80102090 2023-10-05T15:15:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.188+0000 7f3f7dffb700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3f700a14d0 0x7f3f700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.188+0000 7f3f84df4700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3f700a14d0 0x7f3f700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.189+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3f6c0ce130 con 0x7f3f80102090 2023-10-05T15:15:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.189+0000 7f3f84df4700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3f700a14d0 0x7f3f700a3990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3f80198140 tx=0x7f3f74009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:00.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.193+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3f6c05b100 con 0x7f3f80102090 2023-10-05T15:15:00.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.403+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f8010c970 con 0x7f3f80102090 2023-10-05T15:15:00.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.405+0000 7f3f7dffb700 1 -- 172.21.15.60:0/1415924319 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7f3f6c097630 con 0x7f3f80102090 2023-10-05T15:15:00.407 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:00.407 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3f700a14d0 msgr2=0x7f3f700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3f700a14d0 0x7f3f700a3990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3f80198140 tx=0x7f3f74009260 comp rx=0 tx=0).stop 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 msgr2=0x7f3f801971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f801971b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0098e0 tx=0x7f3f6c004730 comp rx=0 tx=0).stop 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 shutdown_connections 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f80102a50 0x7f3f8019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80100eb0 0x7f3f80196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3f700a14d0 0x7f3f700a3990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 --2- 172.21.15.60:0/1415924319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f80102090 0x7f3f801971b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 >> 172.21.15.60:0/1415924319 conn(0x7f3f800fc470 msgr2=0x7f3f801055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:00.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 shutdown_connections 2023-10-05T15:15:00.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.407+0000 7f3f87058700 1 -- 172.21.15.60:0/1415924319 wait complete. 2023-10-05T15:15:00.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:00 smithi060 ceph-mon[99238]: pgmap v265: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s wr, 3 op/s 2023-10-05T15:15:00.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:15:00.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:15:00.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.549+0000 7fd6fbf57700 1 -- 172.21.15.60:0/1442628746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f41042d0 msgr2=0x7fd6f41066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.549+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/1442628746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f41042d0 0x7fd6f41066c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009990 tx=0x7fd6f0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.549+0000 7fd6fbf57700 1 -- 172.21.15.60:0/1442628746 shutdown_connections 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.549+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/1442628746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f4106c00 0x7fd6f4109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.549+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/1442628746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f41019a0 0x7fd6f4103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.549+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/1442628746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f41042d0 0x7fd6f41066c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- 172.21.15.60:0/1442628746 >> 172.21.15.60:0/1442628746 conn(0x7fd6f40fb330 msgr2=0x7fd6f40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- 172.21.15.60:0/1442628746 shutdown_connections 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- 172.21.15.60:0/1442628746 wait complete. 2023-10-05T15:15:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 Processor -- start 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- start start 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f41019a0 0x7fd6f4194980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f41042d0 0x7fd6f4194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 0x7fd6f419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f419c500 con 0x7fd6f4106c00 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f419c640 con 0x7fd6f41019a0 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.550+0000 7fd6fbf57700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f419c7d0 con 0x7fd6f41042d0 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 0x7fd6f419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 0x7fd6f419bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36092/0 (socket says 172.21.15.60:36092) 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 -- 172.21.15.60:0/4022437728 learned_addr learned my addr 172.21.15.60:0/4022437728 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6f9cf3700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f41019a0 0x7fd6f4194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 -- 172.21.15.60:0/4022437728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f41042d0 msgr2=0x7fd6f4194ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f41042d0 0x7fd6f4194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 -- 172.21.15.60:0/4022437728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f41019a0 msgr2=0x7fd6f4194980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f41019a0 0x7fd6f4194980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 -- 172.21.15.60:0/4022437728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00095f0 con 0x7fd6f4106c00 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6f9cf3700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f41019a0 0x7fd6f4194980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fa4f4700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 0x7fd6f419bf30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00ef30 tx=0x7fd6ec00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec018070 con 0x7fd6f4106c00 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f419ca50 con 0x7fd6f4106c00 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6ec00f040 con 0x7fd6f4106c00 2023-10-05T15:15:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec003dc0 con 0x7fd6f4106c00 2023-10-05T15:15:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.551+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f419cf10 con 0x7fd6f4106c00 2023-10-05T15:15:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.552+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f40fceb0 con 0x7fd6f4106c00 2023-10-05T15:15:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.553+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd6ec00caa0 con 0x7fd6f4106c00 2023-10-05T15:15:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.554+0000 7fd6eaffd700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6e00a1480 0x7fd6e00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.554+0000 7fd6f9cf3700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6e00a1480 0x7fd6e00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.554+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd6ec0cd560 con 0x7fd6f4106c00 2023-10-05T15:15:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.555+0000 7fd6f9cf3700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6e00a1480 0x7fd6e00a3940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4005950 tx=0x7fd6e4005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:00.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.558+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6ec096a60 con 0x7fd6f4106c00 2023-10-05T15:15:00.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:00 smithi135 ceph-mon[103360]: pgmap v265: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s wr, 3 op/s 2023-10-05T15:15:00.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:00 smithi092 ceph-mon[102944]: pgmap v265: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s wr, 3 op/s 2023-10-05T15:15:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.760+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6f410a640 con 0x7fd6f4106c00 2023-10-05T15:15:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.760+0000 7fd6eaffd700 1 -- 172.21.15.60:0/4022437728 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6ec09a080 con 0x7fd6f4106c00 2023-10-05T15:15:00.762 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:15:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6e00a1480 msgr2=0x7fd6e00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6e00a1480 0x7fd6e00a3940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4005950 tx=0x7fd6e4005f50 comp rx=0 tx=0).stop 2023-10-05T15:15:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 msgr2=0x7fd6f419bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 0x7fd6f419bf30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00ef30 tx=0x7fd6ec00c450 comp rx=0 tx=0).stop 2023-10-05T15:15:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 shutdown_connections 2023-10-05T15:15:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6e00a1480 0x7fd6e00a3940 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f4106c00 0x7fd6f419bf30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6f41019a0 0x7fd6f4194980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 --2- 172.21.15.60:0/4022437728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f41042d0 0x7fd6f4194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 >> 172.21.15.60:0/4022437728 conn(0x7fd6f40fb330 msgr2=0x7fd6f4102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:00.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 shutdown_connections 2023-10-05T15:15:00.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.762+0000 7fd6fbf57700 1 -- 172.21.15.60:0/4022437728 wait complete. 2023-10-05T15:15:00.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:15:00.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 -- 172.21.15.60:0/2432442906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c101950 msgr2=0x7f2d5c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 --2- 172.21.15.60:0/2432442906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c101950 0x7f2d5c108200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b0d0 tx=0x7f2d5400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 -- 172.21.15.60:0/2432442906 shutdown_connections 2023-10-05T15:15:00.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 --2- 172.21.15.60:0/2432442906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c101950 0x7f2d5c108200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 --2- 172.21.15.60:0/2432442906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d5c0ffdc0 0x7f2d5c1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 --2- 172.21.15.60:0/2432442906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 -- 172.21.15.60:0/2432442906 >> 172.21.15.60:0/2432442906 conn(0x7f2d5c0fb330 msgr2=0x7f2d5c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 -- 172.21.15.60:0/2432442906 shutdown_connections 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.903+0000 7f2d64196700 1 -- 172.21.15.60:0/2432442906 wait complete. 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 Processor -- start 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 -- start start 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d5c0ffdc0 0x7f2d5c196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d5c101950 0x7f2d5c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c19e830 con 0x7f2d5c100fb0 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c19e9a0 con 0x7f2d5c0ffdc0 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d64196700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c19eb60 con 0x7f2d5c101950 2023-10-05T15:15:00.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d61731700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d61731700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36104/0 (socket says 172.21.15.60:36104) 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d61731700 1 -- 172.21.15.60:0/2524412114 learned_addr learned my addr 172.21.15.60:0/2524412114 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d61f32700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d5c0ffdc0 0x7f2d5c196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.904+0000 7f2d62733700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d5c101950 0x7f2d5c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d61731700 1 -- 172.21.15.60:0/2524412114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d5c101950 msgr2=0x7f2d5c19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d61731700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d5c101950 0x7f2d5c19e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d61731700 1 -- 172.21.15.60:0/2524412114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d5c0ffdc0 msgr2=0x7f2d5c196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d61731700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d5c0ffdc0 0x7f2d5c196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d61731700 1 -- 172.21.15.60:0/2524412114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54009d00 con 0x7f2d5c100fb0 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d61731700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c197200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800e9a0 tx=0x7f2d5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:00.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58009790 con 0x7f2d5c100fb0 2023-10-05T15:15:00.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d58010430 con 0x7f2d5c100fb0 2023-10-05T15:15:00.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58018680 con 0x7f2d5c100fb0 2023-10-05T15:15:00.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c19ee40 con 0x7f2d5c100fb0 2023-10-05T15:15:00.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.905+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c19f270 con 0x7f2d5c100fb0 2023-10-05T15:15:00.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.906+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c10b5e0 con 0x7f2d5c100fb0 2023-10-05T15:15:00.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.907+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2d580105a0 con 0x7f2d5c100fb0 2023-10-05T15:15:00.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.908+0000 7f2d52ffd700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2d480a1480 0x7f2d480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:00.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.908+0000 7f2d61f32700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2d480a1480 0x7f2d480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:00.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.908+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2d58014070 con 0x7f2d5c100fb0 2023-10-05T15:15:00.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.908+0000 7f2d61f32700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2d480a1480 0x7f2d480a3940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c197b90 tx=0x7f2d4c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:00.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:00.911+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2d580966f0 con 0x7f2d5c100fb0 2023-10-05T15:15:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.114+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d5c19f460 con 0x7f2d5c100fb0 2023-10-05T15:15:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.115+0000 7f2d52ffd700 1 -- 172.21.15.60:0/2524412114 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d58099d10 con 0x7f2d5c100fb0 2023-10-05T15:15:01.117 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2d480a1480 msgr2=0x7f2d480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2d480a1480 0x7f2d480a3940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c197b90 tx=0x7f2d4c00b410 comp rx=0 tx=0).stop 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 msgr2=0x7f2d5c197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c197200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800e9a0 tx=0x7f2d5800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 shutdown_connections 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d5c101950 0x7f2d5c19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d5c0ffdc0 0x7f2d5c196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2d480a1480 0x7f2d480a3940 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 --2- 172.21.15.60:0/2524412114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d5c100fb0 0x7f2d5c197200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 >> 172.21.15.60:0/2524412114 conn(0x7f2d5c0fb330 msgr2=0x7f2d5c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 shutdown_connections 2023-10-05T15:15:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.117+0000 7f2d64196700 1 -- 172.21.15.60:0/2524412114 wait complete. 2023-10-05T15:15:01.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:15:01.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 -- 172.21.15.60:0/87197047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c0ffdc0 msgr2=0x7fd73c1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 --2- 172.21.15.60:0/87197047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c1001e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd7300099c0 tx=0x7fd730009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 -- 172.21.15.60:0/87197047 shutdown_connections 2023-10-05T15:15:01.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 --2- 172.21.15.60:0/87197047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c101950 0x7fd73c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 --2- 172.21.15.60:0/87197047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c1001e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 --2- 172.21.15.60:0/87197047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c100fb0 0x7fd73c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 -- 172.21.15.60:0/87197047 >> 172.21.15.60:0/87197047 conn(0x7fd73c0fb330 msgr2=0x7fd73c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 -- 172.21.15.60:0/87197047 shutdown_connections 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 -- 172.21.15.60:0/87197047 wait complete. 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.258+0000 7fd74121b700 1 Processor -- start 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 -- start start 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 0x7fd73c1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 0x7fd73c19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19e7a0 con 0x7fd73c101950 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19e910 con 0x7fd73c0ffdc0 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd74121b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19ead0 con 0x7fd73c100fb0 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 0x7fd73c19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 0x7fd73c1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:49538/0 (socket says 172.21.15.60:49538) 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 0x7fd73c1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:49648/0 (socket says 172.21.15.60:49648) 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73ad9d700 1 -- 172.21.15.60:0/2131254162 learned_addr learned my addr 172.21.15.60:0/2131254162 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:01.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.259+0000 7fd73b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 0x7fd73c19e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36120/0 (socket says 172.21.15.60:36120) 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73b59e700 1 -- 172.21.15.60:0/2131254162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 msgr2=0x7fd73c1971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73b59e700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 0x7fd73c1971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73b59e700 1 -- 172.21.15.60:0/2131254162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c0ffdc0 msgr2=0x7fd73c196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73b59e700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73b59e700 1 -- 172.21.15.60:0/2131254162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300095f0 con 0x7fd73c101950 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73a59c700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 0x7fd73c1971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:15:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.260+0000 7fd73b59e700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 0x7fd73c19e1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd73400efc0 tx=0x7fd73400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:01.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.262+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734018070 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.262+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd73400f040 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.262+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c19ed50 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.262+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400cd40 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.262+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c19f1b0 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.263+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c10b620 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.264+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd734003a00 con 0x7fd73c101950 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.265+0000 7fd723fff700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd7240a1500 0x7fd7240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.265+0000 7fd73ad9d700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd7240a1500 0x7fd7240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.265+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd7340cd3d0 con 0x7fd73c101950 2023-10-05T15:15:01.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.265+0000 7fd73ad9d700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd7240a1500 0x7fd7240a39c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd730004800 tx=0x7fd73001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:01.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.269+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7340968d0 con 0x7fd73c101950 2023-10-05T15:15:01.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:01 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1415924319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:01.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:01 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4022437728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:15:01.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:01 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2524412114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:15:01.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.472+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd73c19f3d0 con 0x7fd73c101950 2023-10-05T15:15:01.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.473+0000 7fd723fff700 1 -- 172.21.15.60:0/2131254162 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd734099ef0 con 0x7fd73c101950 2023-10-05T15:15:01.475 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:15:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd7240a1500 msgr2=0x7fd7240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd7240a1500 0x7fd7240a39c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd730004800 tx=0x7fd73001a040 comp rx=0 tx=0).stop 2023-10-05T15:15:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 msgr2=0x7fd73c19e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 0x7fd73c19e1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd73400efc0 tx=0x7fd73400c3a0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 shutdown_connections 2023-10-05T15:15:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd7240a1500 0x7fd7240a39c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73c101950 0x7fd73c19e1d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73c0ffdc0 0x7fd73c196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 --2- 172.21.15.60:0/2131254162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd73c100fb0 0x7fd73c1971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 >> 172.21.15.60:0/2131254162 conn(0x7fd73c0fb330 msgr2=0x7fd73c0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 shutdown_connections 2023-10-05T15:15:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.475+0000 7fd74121b700 1 -- 172.21.15.60:0/2131254162 wait complete. 2023-10-05T15:15:01.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:15:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:01 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1415924319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:01 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4022437728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:15:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:01 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2524412114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:15:01.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 -- 172.21.15.60:0/2119472299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff600106c20 msgr2=0x7ff600109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 --2- 172.21.15.60:0/2119472299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff600106c20 0x7ff600109050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800b0a0 tx=0x7ff5f800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 -- 172.21.15.60:0/2119472299 shutdown_connections 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 --2- 172.21.15.60:0/2119472299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff600106c20 0x7ff600109050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 --2- 172.21.15.60:0/2119472299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001019c0 0x7ff600103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 --2- 172.21.15.60:0/2119472299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6001042f0 0x7ff6001066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 -- 172.21.15.60:0/2119472299 >> 172.21.15.60:0/2119472299 conn(0x7ff6000fb3b0 msgr2=0x7ff6000fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 -- 172.21.15.60:0/2119472299 shutdown_connections 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.615+0000 7ff608254700 1 -- 172.21.15.60:0/2119472299 wait complete. 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 Processor -- start 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 -- start start 2023-10-05T15:15:01.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6001019c0 0x7ff600196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 0x7ff6001971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106c20 0x7ff60019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60019e820 con 0x7ff6001042f0 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60019e990 con 0x7ff600106c20 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff608254700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60019eb50 con 0x7ff6001019c0 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff6057ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 0x7ff6001971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff6057ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 0x7ff6001971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36132/0 (socket says 172.21.15.60:36132) 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff6057ef700 1 -- 172.21.15.60:0/3260611503 learned_addr learned my addr 172.21.15.60:0/3260611503 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff605ff0700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6001019c0 0x7ff600196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.616+0000 7ff6067f1700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106c20 0x7ff60019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6057ef700 1 -- 172.21.15.60:0/3260611503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6001019c0 msgr2=0x7ff600196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6057ef700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6001019c0 0x7ff600196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6057ef700 1 -- 172.21.15.60:0/3260611503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106c20 msgr2=0x7ff60019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6057ef700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106c20 0x7ff60019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6057ef700 1 -- 172.21.15.60:0/3260611503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009d00 con 0x7ff6001042f0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6067f1700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106c20 0x7ff60019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff6057ef700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 0x7ff6001971f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000e9a0 tx=0x7ff5f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0009790 con 0x7ff6001042f0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5f000cbd0 con 0x7ff6001042f0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60019ee30 con 0x7ff6001042f0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0018680 con 0x7ff6001042f0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.617+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60019f2b0 con 0x7ff6001042f0 2023-10-05T15:15:01.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.618+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000fcf30 con 0x7ff6001042f0 2023-10-05T15:15:01.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.620+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff5f000cd40 con 0x7ff6001042f0 2023-10-05T15:15:01.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.620+0000 7ff5f6ffd700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff5ec0a1480 0x7ff5ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.620+0000 7ff605ff0700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff5ec0a1480 0x7ff5ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.620+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff5f0014070 con 0x7ff6001042f0 2023-10-05T15:15:01.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.621+0000 7ff605ff0700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff5ec0a1480 0x7ff5ec0a3940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff600197b80 tx=0x7ff5fc0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:01.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.624+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff5f0096820 con 0x7ff6001042f0 2023-10-05T15:15:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:01 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1415924319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:01 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4022437728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:15:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:01 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2524412114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:15:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.824+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff60010c980 con 0x7ff6001042f0 2023-10-05T15:15:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.824+0000 7ff5f6ffd700 1 -- 172.21.15.60:0/3260611503 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff5f0099e40 con 0x7ff6001042f0 2023-10-05T15:15:01.826 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:15:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff5ec0a1480 msgr2=0x7ff5ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff5ec0a1480 0x7ff5ec0a3940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff600197b80 tx=0x7ff5fc0073d0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 msgr2=0x7ff6001971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 0x7ff6001971f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000e9a0 tx=0x7ff5f000ecb0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 shutdown_connections 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106c20 0x7ff60019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6001019c0 0x7ff600196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff5ec0a1480 0x7ff5ec0a3940 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 --2- 172.21.15.60:0/3260611503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6001042f0 0x7ff6001971f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.826+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 >> 172.21.15.60:0/3260611503 conn(0x7ff6000fb3b0 msgr2=0x7ff600102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.827+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 shutdown_connections 2023-10-05T15:15:01.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.827+0000 7ff608254700 1 -- 172.21.15.60:0/3260611503 wait complete. 2023-10-05T15:15:01.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:15:01.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 -- 172.21.15.60:0/2512425935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620102090 msgr2=0x7ff620102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2512425935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620102090 0x7ff620102510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff614009990 tx=0x7ff614009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 -- 172.21.15.60:0/2512425935 shutdown_connections 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2512425935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff620102a50 0x7ff620109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2512425935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff620100eb0 0x7ff6201012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2512425935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620102090 0x7ff620102510 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 -- 172.21.15.60:0/2512425935 >> 172.21.15.60:0/2512425935 conn(0x7ff6200fc470 msgr2=0x7ff6200fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 -- 172.21.15.60:0/2512425935 shutdown_connections 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.965+0000 7ff6265ad700 1 -- 172.21.15.60:0/2512425935 wait complete. 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 Processor -- start 2023-10-05T15:15:01.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 -- start start 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 0x7ff620196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff620102090 0x7ff620197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff620102a50 0x7ff62019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62019e790 con 0x7ff620100eb0 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62019e900 con 0x7ff620102a50 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff6265ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62019eac0 con 0x7ff620102090 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff61ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 0x7ff620196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff61ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 0x7ff620196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36144/0 (socket says 172.21.15.60:36144) 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff61ffff700 1 -- 172.21.15.60:0/2328755582 learned_addr learned my addr 172.21.15.60:0/2328755582 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:01.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.966+0000 7ff624b4a700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff620102a50 0x7ff62019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61f7fe700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff620102090 0x7ff620197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61ffff700 1 -- 172.21.15.60:0/2328755582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff620102090 msgr2=0x7ff620197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61ffff700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff620102090 0x7ff620197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61ffff700 1 -- 172.21.15.60:0/2328755582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff620102a50 msgr2=0x7ff62019e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61ffff700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff620102a50 0x7ff62019e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61ffff700 1 -- 172.21.15.60:0/2328755582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140095f0 con 0x7ff620100eb0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61ffff700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 0x7ff620196c50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff61000d980 tx=0x7ff61000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610004020 con 0x7ff620100eb0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff610009730 con 0x7ff620100eb0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62019eda0 con 0x7ff620100eb0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610003a80 con 0x7ff620100eb0 2023-10-05T15:15:01.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.967+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62019f1f0 con 0x7ff620100eb0 2023-10-05T15:15:01.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.968+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff620107eb0 con 0x7ff620100eb0 2023-10-05T15:15:01.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.969+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff6100098a0 con 0x7ff620100eb0 2023-10-05T15:15:01.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.970+0000 7ff61d7fa700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6080a1480 0x7ff6080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:01.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.970+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff6100ccf70 con 0x7ff620100eb0 2023-10-05T15:15:01.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.970+0000 7ff61f7fe700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6080a1480 0x7ff6080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:01.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.970+0000 7ff61f7fe700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6080a1480 0x7ff6080a3940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff614000c00 tx=0x7ff614005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:01.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:01.973+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff6100963e0 con 0x7ff620100eb0 2023-10-05T15:15:02.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.190+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff62010ca00 con 0x7ff620100eb0 2023-10-05T15:15:02.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.191+0000 7ff61d7fa700 1 -- 172.21.15.60:0/2328755582 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+590 (secure 0 0 0) 0x7ff610017260 con 0x7ff620100eb0 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1216724188 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/2843655042 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/2843655042 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4045235795 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4067501312 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4045235795 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4231976701 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2162692982 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:02.193 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/649476863 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:02.194 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/364014604 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6080a1480 msgr2=0x7ff6080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6080a1480 0x7ff6080a3940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff614000c00 tx=0x7ff614005fb0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 msgr2=0x7ff620196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 0x7ff620196c50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff61000d980 tx=0x7ff61000dc90 comp rx=0 tx=0).stop 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 shutdown_connections 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff620102a50 0x7ff62019e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6080a1480 0x7ff6080a3940 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620100eb0 0x7ff620196c50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 --2- 172.21.15.60:0/2328755582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff620102090 0x7ff620197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 >> 172.21.15.60:0/2328755582 conn(0x7ff6200fc470 msgr2=0x7ff6200fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:02.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 shutdown_connections 2023-10-05T15:15:02.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.193+0000 7ff6265ad700 1 -- 172.21.15.60:0/2328755582 wait complete. 2023-10-05T15:15:02.196 INFO:teuthology.orchestra.run.smithi060.stderr:listed 10 entries 2023-10-05T15:15:02.207 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:15:02.207 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:15:02.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:15:02.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 -- 172.21.15.60:0/3081014049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c104270 msgr2=0x7fc09c106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 --2- 172.21.15.60:0/3081014049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c104270 0x7fc09c106660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009990 tx=0x7fc08c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 -- 172.21.15.60:0/3081014049 shutdown_connections 2023-10-05T15:15:02.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 --2- 172.21.15.60:0/3081014049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc09c106ba0 0x7fc09c109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 --2- 172.21.15.60:0/3081014049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c101940 0x7fc09c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 --2- 172.21.15.60:0/3081014049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c104270 0x7fc09c106660 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 -- 172.21.15.60:0/3081014049 >> 172.21.15.60:0/3081014049 conn(0x7fc09c0fb310 msgr2=0x7fc09c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 -- 172.21.15.60:0/3081014049 shutdown_connections 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 -- 172.21.15.60:0/3081014049 wait complete. 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.390+0000 7fc0a193c700 1 Processor -- start 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 -- start start 2023-10-05T15:15:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 0x7fc09c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c104270 0x7fc09c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc09c106ba0 0x7fc09c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c19e6e0 con 0x7fc09c101940 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c19e820 con 0x7fc09c104270 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc0a193c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c19e9b0 con 0x7fc09c106ba0 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 0x7fc09c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 0x7fc09c196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36158/0 (socket says 172.21.15.60:36158) 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 -- 172.21.15.60:0/4064824995 learned_addr learned my addr 172.21.15.60:0/4064824995 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09b7fe700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc09c106ba0 0x7fc09c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09a7fc700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c104270 0x7fc09c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 -- 172.21.15.60:0/4064824995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc09c106ba0 msgr2=0x7fc09c19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc09c106ba0 0x7fc09c19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 -- 172.21.15.60:0/4064824995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c104270 msgr2=0x7fc09c1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c104270 0x7fc09c1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 -- 172.21.15.60:0/4064824995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0095f0 con 0x7fc09c101940 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09a7fc700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c104270 0x7fc09c1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.391+0000 7fc09affd700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 0x7fc09c196b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc09000d950 tx=0x7fc09000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.392+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090009b40 con 0x7fc09c101940 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.392+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c19ec90 con 0x7fc09c101940 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.392+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc090009ca0 con 0x7fc09c101940 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.392+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000f620 con 0x7fc09c101940 2023-10-05T15:15:02.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.392+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c19f1a0 con 0x7fc09c101940 2023-10-05T15:15:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.393+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c0fce90 con 0x7fc09c101940 2023-10-05T15:15:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.394+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc090010460 con 0x7fc09c101940 2023-10-05T15:15:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.394+0000 7fc0a093a700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc0840a14d0 0x7fc0840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.395+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc0900cd290 con 0x7fc09c101940 2023-10-05T15:15:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.395+0000 7fc09a7fc700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc0840a14d0 0x7fc0840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.395+0000 7fc09a7fc700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc0840a14d0 0x7fc0840a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b2e0 tx=0x7fc08c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.398+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc090096700 con 0x7fc09c101940 2023-10-05T15:15:02.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:02 smithi135 ceph-mon[103360]: pgmap v266: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 343 B/s wr, 0 op/s 2023-10-05T15:15:02.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2131254162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:15:02.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3260611503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:15:02.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2328755582' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:15:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.598+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc09c10c850 con 0x7fc09c101940 2023-10-05T15:15:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.600+0000 7fc0a093a700 1 -- 172.21.15.60:0/4064824995 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7fc090099d20 con 0x7fc09c101940 2023-10-05T15:15:02.602 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:02.603 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc0840a14d0 msgr2=0x7fc0840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc0840a14d0 0x7fc0840a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b2e0 tx=0x7fc08c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 msgr2=0x7fc09c196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 0x7fc09c196b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc09000d950 tx=0x7fc09000dd10 comp rx=0 tx=0).stop 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 shutdown_connections 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc09c106ba0 0x7fc09c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc0840a14d0 0x7fc0840a3990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc09c101940 0x7fc09c196b60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 --2- 172.21.15.60:0/4064824995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc09c104270 0x7fc09c1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 >> 172.21.15.60:0/4064824995 conn(0x7fc09c0fb310 msgr2=0x7fc09c1025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 shutdown_connections 2023-10-05T15:15:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.602+0000 7fc0a193c700 1 -- 172.21.15.60:0/4064824995 wait complete. 2023-10-05T15:15:02.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:02 smithi060 ceph-mon[99238]: pgmap v266: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 343 B/s wr, 0 op/s 2023-10-05T15:15:02.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2131254162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:15:02.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3260611503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:15:02.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2328755582' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:15:02.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:15:02.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:15:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:02 smithi092 ceph-mon[102944]: pgmap v266: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 343 B/s wr, 0 op/s 2023-10-05T15:15:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2131254162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:15:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3260611503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:15:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2328755582' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 -- 172.21.15.60:0/3206850470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f4100000 msgr2=0x7fd3f4100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 --2- 172.21.15.60:0/3206850470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f4100000 0x7fd3f4100480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009990 tx=0x7fd3e4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 -- 172.21.15.60:0/3206850470 shutdown_connections 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 --2- 172.21.15.60:0/3206850470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f41009c0 0x7fd3f4108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 --2- 172.21.15.60:0/3206850470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f4101440 0x7fd3f4101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 --2- 172.21.15.60:0/3206850470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f4100000 0x7fd3f4100480 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 -- 172.21.15.60:0/3206850470 >> 172.21.15.60:0/3206850470 conn(0x7fd3f40faab0 msgr2=0x7fd3f40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 -- 172.21.15.60:0/3206850470 shutdown_connections 2023-10-05T15:15:02.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.744+0000 7fd3f9334700 1 -- 172.21.15.60:0/3206850470 wait complete. 2023-10-05T15:15:02.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.745+0000 7fd3f9334700 1 Processor -- start 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.745+0000 7fd3f9334700 1 -- start start 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f4100000 0x7fd3f40ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 0x7fd3f419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f4101440 0x7fd3f419df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419e6f0 con 0x7fd3f41009c0 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419e860 con 0x7fd3f4100000 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419ea20 con 0x7fd3f4101440 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 0x7fd3f419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 0x7fd3f419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36174/0 (socket says 172.21.15.60:36174) 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 -- 172.21.15.60:0/749101933 learned_addr learned my addr 172.21.15.60:0/749101933 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:02.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f2ffd700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f4100000 0x7fd3f40ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f37fe700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f4101440 0x7fd3f419df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 -- 172.21.15.60:0/749101933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f4101440 msgr2=0x7fd3f419df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f4101440 0x7fd3f419df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 -- 172.21.15.60:0/749101933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f4100000 msgr2=0x7fd3f40ffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f4100000 0x7fd3f40ffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 -- 172.21.15.60:0/749101933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40095f0 con 0x7fd3f41009c0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f27fc700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 0x7fd3f419b8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b680 tx=0x7fd3e40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401d070 con 0x7fd3f41009c0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f419eca0 con 0x7fd3f41009c0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3e400fbc0 con 0x7fd3f41009c0 2023-10-05T15:15:02.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.746+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4017650 con 0x7fd3f41009c0 2023-10-05T15:15:02.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.747+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f419f0c0 con 0x7fd3f41009c0 2023-10-05T15:15:02.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.747+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f410b670 con 0x7fd3f41009c0 2023-10-05T15:15:02.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.748+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd3e4022470 con 0x7fd3f41009c0 2023-10-05T15:15:02.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.749+0000 7fd3dbfff700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd3dc0a1480 0x7fd3dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:02.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.749+0000 7fd3f2ffd700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd3dc0a1480 0x7fd3dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:02.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.749+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd3e40ce620 con 0x7fd3f41009c0 2023-10-05T15:15:02.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.750+0000 7fd3f2ffd700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd3dc0a1480 0x7fd3dc0a3940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009c60 tx=0x7fd3e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:02.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.753+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3e4097b20 con 0x7fd3f41009c0 2023-10-05T15:15:02.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.954+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3f4106d10 con 0x7fd3f41009c0 2023-10-05T15:15:02.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.955+0000 7fd3dbfff700 1 -- 172.21.15.60:0/749101933 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3e409b140 con 0x7fd3f41009c0 2023-10-05T15:15:02.957 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:15:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd3dc0a1480 msgr2=0x7fd3dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd3dc0a1480 0x7fd3dc0a3940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009c60 tx=0x7fd3e8009260 comp rx=0 tx=0).stop 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 msgr2=0x7fd3f419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 0x7fd3f419b8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b680 tx=0x7fd3e40057b0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 shutdown_connections 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f4101440 0x7fd3f419df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f4100000 0x7fd3f40ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd3dc0a1480 0x7fd3dc0a3940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 --2- 172.21.15.60:0/749101933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3f41009c0 0x7fd3f419b8d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 >> 172.21.15.60:0/749101933 conn(0x7fd3f40faab0 msgr2=0x7fd3f40fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 shutdown_connections 2023-10-05T15:15:02.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:02.957+0000 7fd3f9334700 1 -- 172.21.15.60:0/749101933 wait complete. 2023-10-05T15:15:02.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:15:03.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 -- 172.21.15.60:0/2371523404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844102090 msgr2=0x7f4844102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 --2- 172.21.15.60:0/2371523404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844102090 0x7f4844102510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4840009990 tx=0x7f4840009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 -- 172.21.15.60:0/2371523404 shutdown_connections 2023-10-05T15:15:03.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 --2- 172.21.15.60:0/2371523404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4844102a50 0x7f4844109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 --2- 172.21.15.60:0/2371523404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844100f40 0x7f4844101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 --2- 172.21.15.60:0/2371523404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844102090 0x7f4844102510 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 -- 172.21.15.60:0/2371523404 >> 172.21.15.60:0/2371523404 conn(0x7f48440fc4d0 msgr2=0x7f48440fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 -- 172.21.15.60:0/2371523404 shutdown_connections 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 -- 172.21.15.60:0/2371523404 wait complete. 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.098+0000 7f484b917700 1 Processor -- start 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 -- start start 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 0x7f4844196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4844102090 0x7f4844197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844102a50 0x7f484419e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484419e740 con 0x7f4844100f40 2023-10-05T15:15:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484419e880 con 0x7f4844102090 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f484b917700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484419ea10 con 0x7f4844102a50 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 0x7f4844196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 0x7f4844196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36186/0 (socket says 172.21.15.60:36186) 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 -- 172.21.15.60:0/3040568716 learned_addr learned my addr 172.21.15.60:0/3040568716 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f4848eb2700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4844102090 0x7f4844197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f4849eb4700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844102a50 0x7f484419e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 -- 172.21.15.60:0/3040568716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844102a50 msgr2=0x7f484419e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844102a50 0x7f484419e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 -- 172.21.15.60:0/3040568716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4844102090 msgr2=0x7f4844197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4844102090 0x7f4844197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 -- 172.21.15.60:0/3040568716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400095f0 con 0x7f4844100f40 2023-10-05T15:15:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f4849eb4700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844102a50 0x7f484419e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f48496b3700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 0x7f4844196bc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f483400d950 tx=0x7f483400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.099+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834009940 con 0x7f4844100f40 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.100+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4834010460 con 0x7f4844100f40 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.100+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483400f620 con 0x7f4844100f40 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.100+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484419ecf0 con 0x7f4844100f40 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.100+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484419f1b0 con 0x7f4844100f40 2023-10-05T15:15:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.100+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484410c6d0 con 0x7f4844100f40 2023-10-05T15:15:03.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.102+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f48340108d0 con 0x7f4844100f40 2023-10-05T15:15:03.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.102+0000 7f483a7fc700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f48300a1500 0x7f48300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.103+0000 7f4848eb2700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f48300a1500 0x7f48300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.103+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f48340ccce0 con 0x7f4844100f40 2023-10-05T15:15:03.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.103+0000 7f4848eb2700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f48300a1500 0x7f48300a39c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f484000b5c0 tx=0x7f4840005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.106+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f48340960f0 con 0x7f4844100f40 2023-10-05T15:15:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.310+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f484419f550 con 0x7f4844100f40 2023-10-05T15:15:03.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.310+0000 7f483a7fc700 1 -- 172.21.15.60:0/3040568716 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4834020020 con 0x7f4844100f40 2023-10-05T15:15:03.312 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:15:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f48300a1500 msgr2=0x7f48300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f48300a1500 0x7f48300a39c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f484000b5c0 tx=0x7f4840005960 comp rx=0 tx=0).stop 2023-10-05T15:15:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 msgr2=0x7f4844196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 0x7f4844196bc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f483400d950 tx=0x7f483400dc60 comp rx=0 tx=0).stop 2023-10-05T15:15:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 shutdown_connections 2023-10-05T15:15:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4844102a50 0x7f484419e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f48300a1500 0x7f48300a39c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4844100f40 0x7f4844196bc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 --2- 172.21.15.60:0/3040568716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4844102090 0x7f4844197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 >> 172.21.15.60:0/3040568716 conn(0x7f48440fc4d0 msgr2=0x7f48440fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 shutdown_connections 2023-10-05T15:15:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.312+0000 7f484b917700 1 -- 172.21.15.60:0/3040568716 wait complete. 2023-10-05T15:15:03.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:15:03.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 -- 172.21.15.60:0/1287157546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480ffdc0 msgr2=0x7f24481001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 --2- 172.21.15.60:0/1287157546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480ffdc0 0x7f24481001e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f24380099c0 tx=0x7f2438009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 -- 172.21.15.60:0/1287157546 shutdown_connections 2023-10-05T15:15:03.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 --2- 172.21.15.60:0/1287157546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2448101950 0x7f2448108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 --2- 172.21.15.60:0/1287157546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480ffdc0 0x7f24481001e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 --2- 172.21.15.60:0/1287157546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2448100fb0 0x7f2448101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 -- 172.21.15.60:0/1287157546 >> 172.21.15.60:0/1287157546 conn(0x7f24480fb330 msgr2=0x7f24480fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 -- 172.21.15.60:0/1287157546 shutdown_connections 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.453+0000 7f244e2f6700 1 -- 172.21.15.60:0/1287157546 wait complete. 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 Processor -- start 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 -- start start 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24480ffdc0 0x7f2448068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2448100fb0 0x7f244819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 0x7f244819df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244819e6f0 con 0x7f2448101950 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244819e860 con 0x7f2448100fb0 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244e2f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244819ea20 con 0x7f24480ffdc0 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244c893700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 0x7f244819df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244c893700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 0x7f244819df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36206/0 (socket says 172.21.15.60:36206) 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244c893700 1 -- 172.21.15.60:0/2038906369 learned_addr learned my addr 172.21.15.60:0/2038906369 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f2447fff700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24480ffdc0 0x7f2448068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f24477fe700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2448100fb0 0x7f244819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244c893700 1 -- 172.21.15.60:0/2038906369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24480ffdc0 msgr2=0x7f2448068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.454+0000 7f244c893700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24480ffdc0 0x7f2448068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f244c893700 1 -- 172.21.15.60:0/2038906369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2448100fb0 msgr2=0x7f244819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f244c893700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2448100fb0 0x7f244819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f244c893700 1 -- 172.21.15.60:0/2038906369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380095f0 con 0x7f2448101950 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f244c893700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 0x7f244819df50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2440007ee0 tx=0x7f244000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440017070 con 0x7f2448101950 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f244000f040 con 0x7f2448101950 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244819ed00 con 0x7f2448101950 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440005740 con 0x7f2448101950 2023-10-05T15:15:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.455+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244819f1c0 con 0x7f2448101950 2023-10-05T15:15:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.456+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2448106d70 con 0x7f2448101950 2023-10-05T15:15:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.458+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f24400058a0 con 0x7f2448101950 2023-10-05T15:15:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.458+0000 7f24457fa700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f24340a1480 0x7f24340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.458+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f24400ccdc0 con 0x7f2448101950 2023-10-05T15:15:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.458+0000 7f2447fff700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f24340a1480 0x7f24340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.459+0000 7f2447fff700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f24340a1480 0x7f24340a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f243800b580 tx=0x7f2438005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:03.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.462+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2440096230 con 0x7f2448101950 2023-10-05T15:15:03.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:03 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4064824995' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:03.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:03 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/749101933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:15:03.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:03 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4064824995' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:03.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:03 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/749101933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:15:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.665+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f244810b760 con 0x7f2448101950 2023-10-05T15:15:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.666+0000 7f24457fa700 1 -- 172.21.15.60:0/2038906369 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2440099850 con 0x7f2448101950 2023-10-05T15:15:03.667 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f24340a1480 msgr2=0x7f24340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f24340a1480 0x7f24340a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f243800b580 tx=0x7f2438005fb0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 msgr2=0x7f244819df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 0x7f244819df50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2440007ee0 tx=0x7f244000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 shutdown_connections 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f24340a1480 0x7f24340a3940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2448101950 0x7f244819df50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24480ffdc0 0x7f2448068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 --2- 172.21.15.60:0/2038906369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2448100fb0 0x7f244819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 >> 172.21.15.60:0/2038906369 conn(0x7f24480fb330 msgr2=0x7f24480fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 shutdown_connections 2023-10-05T15:15:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.668+0000 7f244e2f6700 1 -- 172.21.15.60:0/2038906369 wait complete. 2023-10-05T15:15:03.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:03 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4064824995' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:03.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:03 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/749101933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:15:03.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:15:03.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 -- 172.21.15.60:0/3205679073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500ffdf0 msgr2=0x7fd650100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 --2- 172.21.15.60:0/3205679073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500ffdf0 0x7fd650100210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6400099c0 tx=0x7fd640009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 -- 172.21.15.60:0/3205679073 shutdown_connections 2023-10-05T15:15:03.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 --2- 172.21.15.60:0/3205679073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd650101980 0x7fd650108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 --2- 172.21.15.60:0/3205679073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500ffdf0 0x7fd650100210 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 --2- 172.21.15.60:0/3205679073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd650100fe0 0x7fd650101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 -- 172.21.15.60:0/3205679073 >> 172.21.15.60:0/3205679073 conn(0x7fd6500fb380 msgr2=0x7fd6500fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 -- 172.21.15.60:0/3205679073 shutdown_connections 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.808+0000 7fd6553fa700 1 -- 172.21.15.60:0/3205679073 wait complete. 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 Processor -- start 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 -- start start 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6500ffdf0 0x7fd650196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 0x7fd650197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd650101980 0x7fd65019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65019e760 con 0x7fd650100fe0 2023-10-05T15:15:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65019e8a0 con 0x7fd6500ffdf0 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd6553fa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65019ea30 con 0x7fd650101980 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.809+0000 7fd64e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 0x7fd650197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 0x7fd650197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36216/0 (socket says 172.21.15.60:36216) 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 -- 172.21.15.60:0/541138434 learned_addr learned my addr 172.21.15.60:0/541138434 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6500ffdf0 0x7fd650196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64f7fe700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd650101980 0x7fd65019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 -- 172.21.15.60:0/541138434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd650101980 msgr2=0x7fd65019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd650101980 0x7fd65019e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 -- 172.21.15.60:0/541138434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6500ffdf0 msgr2=0x7fd650196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6500ffdf0 0x7fd650196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 -- 172.21.15.60:0/541138434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400095f0 con 0x7fd650100fe0 2023-10-05T15:15:03.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd64e7fc700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 0x7fd650197120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd64400c920 tx=0x7fd64400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644007b00 con 0x7fd650100fe0 2023-10-05T15:15:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd64400ce70 con 0x7fd650100fe0 2023-10-05T15:15:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65019ed10 con 0x7fd650100fe0 2023-10-05T15:15:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440054e0 con 0x7fd650100fe0 2023-10-05T15:15:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.810+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65019f1d0 con 0x7fd650100fe0 2023-10-05T15:15:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.811+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd650106da0 con 0x7fd650100fe0 2023-10-05T15:15:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.813+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd644004750 con 0x7fd650100fe0 2023-10-05T15:15:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.814+0000 7fd637fff700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6380a1480 0x7fd6380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.814+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd6440cce90 con 0x7fd650100fe0 2023-10-05T15:15:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.814+0000 7fd64effd700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6380a1480 0x7fd6380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.814+0000 7fd64effd700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6380a1480 0x7fd6380a3940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd640009f50 tx=0x7fd64000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:03.817+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6440962a0 con 0x7fd650100fe0 2023-10-05T15:15:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.018+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd65010c960 con 0x7fd650100fe0 2023-10-05T15:15:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.019+0000 7fd637fff700 1 -- 172.21.15.60:0/541138434 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd64401d020 con 0x7fd650100fe0 2023-10-05T15:15:04.021 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:15:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6380a1480 msgr2=0x7fd6380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6380a1480 0x7fd6380a3940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd640009f50 tx=0x7fd64000b540 comp rx=0 tx=0).stop 2023-10-05T15:15:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 msgr2=0x7fd650197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 0x7fd650197120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd64400c920 tx=0x7fd64400cc30 comp rx=0 tx=0).stop 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 shutdown_connections 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd650101980 0x7fd65019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6500ffdf0 0x7fd650196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6380a1480 0x7fd6380a3940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 --2- 172.21.15.60:0/541138434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd650100fe0 0x7fd650197120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 >> 172.21.15.60:0/541138434 conn(0x7fd6500fb380 msgr2=0x7fd6500fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 shutdown_connections 2023-10-05T15:15:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.021+0000 7fd6553fa700 1 -- 172.21.15.60:0/541138434 wait complete. 2023-10-05T15:15:04.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:15:04.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 -- 172.21.15.60:0/1963135677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 msgr2=0x7f4f8c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 --2- 172.21.15.60:0/1963135677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c101410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f800099c0 tx=0x7f4f80009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 -- 172.21.15.60:0/1963135677 shutdown_connections 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 --2- 172.21.15.60:0/1963135677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f8c101950 0x7f4f8c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 --2- 172.21.15.60:0/1963135677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 0x7f4f8c1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 --2- 172.21.15.60:0/1963135677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c101410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 -- 172.21.15.60:0/1963135677 >> 172.21.15.60:0/1963135677 conn(0x7f4f8c0fb330 msgr2=0x7f4f8c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 -- 172.21.15.60:0/1963135677 shutdown_connections 2023-10-05T15:15:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.161+0000 7f4f93f51700 1 -- 172.21.15.60:0/1963135677 wait complete. 2023-10-05T15:15:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 Processor -- start 2023-10-05T15:15:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 -- start start 2023-10-05T15:15:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 0x7f4f8c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f8c101950 0x7f4f8c19e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c19e6f0 con 0x7f4f8c100fb0 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c19e830 con 0x7f4f8c0ffdc0 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f93f51700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c19e9c0 con 0x7f4f8c101950 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f914ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f914ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36230/0 (socket says 172.21.15.60:36230) 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f914ec700 1 -- 172.21.15.60:0/2652194022 learned_addr learned my addr 172.21.15.60:0/2652194022 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f924ee700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f8c101950 0x7f4f8c19e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f91ced700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 0x7f4f8c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f914ec700 1 -- 172.21.15.60:0/2652194022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f8c101950 msgr2=0x7f4f8c19e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.162+0000 7f4f914ec700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f8c101950 0x7f4f8c19e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f914ec700 1 -- 172.21.15.60:0/2652194022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 msgr2=0x7f4f8c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f914ec700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 0x7f4f8c196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f914ec700 1 -- 172.21.15.60:0/2652194022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800095f0 con 0x7f4f8c100fb0 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f91ced700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 0x7f4f8c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f914ec700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c1970b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009990 tx=0x7f4f80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8001d070 con 0x7f4f8c100fb0 2023-10-05T15:15:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f80004090 con 0x7f4f8c100fb0 2023-10-05T15:15:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c19ec40 con 0x7f4f8c100fb0 2023-10-05T15:15:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80004a00 con 0x7f4f8c100fb0 2023-10-05T15:15:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.163+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c19f0f0 con 0x7f4f8c100fb0 2023-10-05T15:15:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.164+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c10b5d0 con 0x7f4f8c100fb0 2023-10-05T15:15:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.165+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4f80003bd0 con 0x7f4f8c100fb0 2023-10-05T15:15:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.166+0000 7f4f7effd700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f780a1480 0x7f4f780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.166+0000 7f4f91ced700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f780a1480 0x7f4f780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.166+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4f800cde40 con 0x7f4f8c100fb0 2023-10-05T15:15:04.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.166+0000 7f4f91ced700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f780a1480 0x7f4f780a3940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c100e10 tx=0x7f4f8800b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:04.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.170+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4f80097340 con 0x7f4f8c100fb0 2023-10-05T15:15:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.393+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4f8c19f280 con 0x7f4f8c100fb0 2023-10-05T15:15:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.393+0000 7f4f7effd700 1 -- 172.21.15.60:0/2652194022 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+590 (secure 0 0 0) 0x7f4f8009a960 con 0x7f4f8c100fb0 2023-10-05T15:15:04.395 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1216724188 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:04.395 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/2843655042 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:04.395 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/2843655042 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:04.395 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4045235795 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:04.396 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4067501312 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:04.396 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4045235795 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:04.396 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4231976701 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:04.396 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2162692982 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:04.396 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/649476863 2023-10-06T15:08:18.717027+0000 2023-10-05T15:15:04.396 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/364014604 2023-10-06T15:08:45.079337+0000 2023-10-05T15:15:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f780a1480 msgr2=0x7f4f780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f780a1480 0x7f4f780a3940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c100e10 tx=0x7f4f8800b670 comp rx=0 tx=0).stop 2023-10-05T15:15:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 msgr2=0x7f4f8c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c1970b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009990 tx=0x7f4f80004730 comp rx=0 tx=0).stop 2023-10-05T15:15:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 shutdown_connections 2023-10-05T15:15:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f8c101950 0x7f4f8c19e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0ffdc0 0x7f4f8c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4f780a1480 0x7f4f780a3940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 --2- 172.21.15.60:0/2652194022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8c100fb0 0x7f4f8c1970b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 >> 172.21.15.60:0/2652194022 conn(0x7f4f8c0fb330 msgr2=0x7f4f8c0fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 shutdown_connections 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.395+0000 7f4f93f51700 1 -- 172.21.15.60:0/2652194022 wait complete. 2023-10-05T15:15:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:listed 10 entries 2023-10-05T15:15:04.408 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:04 smithi060 ceph-mon[99238]: pgmap v267: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2023-10-05T15:15:04.408 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3040568716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.408 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2038906369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.408 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/541138434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.409 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi060.front.sepia.ceph.com... 2023-10-05T15:15:04.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:15:04.410 DEBUG:teuthology.orchestra.run.smithi060:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:15:04.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:ceph-fuse[152793]: fuse finished with error 0 and tester_r 0 2023-10-05T15:15:04.447 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T15:15:04.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:15:04.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:15:04.462 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-05T15:15:04.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:15:04.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:04 smithi135 ceph-mon[103360]: pgmap v267: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2023-10-05T15:15:04.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3040568716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2038906369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/541138434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:04 smithi092 ceph-mon[102944]: pgmap v267: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2023-10-05T15:15:04.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3040568716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2038906369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/541138434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:15:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 -- 172.21.15.60:0/2325457139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 msgr2=0x7fb2c41017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2325457139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c41017a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009990 tx=0x7fb2b8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 -- 172.21.15.60:0/2325457139 shutdown_connections 2023-10-05T15:15:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2325457139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c4100990 0x7fb2c4108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2325457139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c41017a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2325457139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c40fffd0 0x7fb2c4100450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 -- 172.21.15.60:0/2325457139 >> 172.21.15.60:0/2325457139 conn(0x7fb2c40faac0 msgr2=0x7fb2c40fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 -- 172.21.15.60:0/2325457139 shutdown_connections 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.695+0000 7fb2caa64700 1 -- 172.21.15.60:0/2325457139 wait complete. 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 Processor -- start 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 -- start start 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c40fffd0 0x7fb2c40ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c4100990 0x7fb2c419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c419e6d0 con 0x7fb2c4101380 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c419e840 con 0x7fb2c40fffd0 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2caa64700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c419ea00 con 0x7fb2c4100990 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c419df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36246/0 (socket says 172.21.15.60:36246) 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 -- 172.21.15.60:0/2595839478 learned_addr learned my addr 172.21.15.60:0/2595839478 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c3fff700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c4100990 0x7fb2c419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c8800700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c40fffd0 0x7fb2c40ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 -- 172.21.15.60:0/2595839478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c4100990 msgr2=0x7fb2c419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c4100990 0x7fb2c419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 -- 172.21.15.60:0/2595839478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c40fffd0 msgr2=0x7fb2c40ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c40fffd0 0x7fb2c40ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.696+0000 7fb2c9001700 1 -- 172.21.15.60:0/2595839478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80095f0 con 0x7fb2c4101380 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.697+0000 7fb2c9001700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c419df00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc007ee0 tx=0x7fb2bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.697+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc017070 con 0x7fb2c4101380 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.697+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2bc00f040 con 0x7fb2c4101380 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.697+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c419ece0 con 0x7fb2c4101380 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.697+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc005740 con 0x7fb2c4101380 2023-10-05T15:15:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.697+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c419f1a0 con 0x7fb2c4101380 2023-10-05T15:15:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.698+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c4106d70 con 0x7fb2c4101380 2023-10-05T15:15:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.699+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb2bc00dc60 con 0x7fb2c4101380 2023-10-05T15:15:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.699+0000 7fb2c1ffb700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2b40a14d0 0x7fb2b40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.700+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb2bc0cc6f0 con 0x7fb2c4101380 2023-10-05T15:15:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.700+0000 7fb2c8800700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2b40a14d0 0x7fb2b40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:04.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.700+0000 7fb2c8800700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2b40a14d0 0x7fb2b40a3990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8006010 tx=0x7fb2b800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.704+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2bc095b60 con 0x7fb2c4101380 2023-10-05T15:15:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.906+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c410b5c0 con 0x7fb2c4101380 2023-10-05T15:15:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.907+0000 7fb2c1ffb700 1 -- 172.21.15.60:0/2595839478 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7fb2bc099180 con 0x7fb2c4101380 2023-10-05T15:15:04.909 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:04.910 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2b40a14d0 msgr2=0x7fb2b40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2b40a14d0 0x7fb2b40a3990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8006010 tx=0x7fb2b800b260 comp rx=0 tx=0).stop 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 msgr2=0x7fb2c419df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c419df00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc007ee0 tx=0x7fb2bc00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 shutdown_connections 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb2b40a14d0 0x7fb2b40a3990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2c4101380 0x7fb2c419df00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c40fffd0 0x7fb2c40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 --2- 172.21.15.60:0/2595839478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c4100990 0x7fb2c419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 >> 172.21.15.60:0/2595839478 conn(0x7fb2c40faac0 msgr2=0x7fb2c40fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 shutdown_connections 2023-10-05T15:15:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:04.910+0000 7fb2caa64700 1 -- 172.21.15.60:0/2595839478 wait complete. 2023-10-05T15:15:04.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:15:05.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/2521815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b08101990 msgr2=0x7f8b08108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/2521815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b08101990 0x7f8b08108240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000b0d0 tx=0x7f8b0000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/2521815790 shutdown_connections 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/2521815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b08101990 0x7f8b08108240 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/2521815790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffe00 0x7f8b08100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/2521815790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08100ff0 0x7f8b08101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/2521815790 >> 172.21.15.60:0/2521815790 conn(0x7f8b080fb370 msgr2=0x7f8b080fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.048+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/2521815790 shutdown_connections 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/2521815790 wait complete. 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 Processor -- start 2023-10-05T15:15:05.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 -- start start 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 0x7f8b08103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b08100ff0 0x7f8b08102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08101990 0x7f8b08102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b08103310 con 0x7f8b080ffe00 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b08103480 con 0x7f8b08101990 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0f1fc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081a0d00 con 0x7f8b08100ff0 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0cf98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 0x7f8b08103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0cf98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 0x7f8b08103ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36256/0 (socket says 172.21.15.60:36256) 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.049+0000 7f8b0cf98700 1 -- 172.21.15.60:0/1146187149 learned_addr learned my addr 172.21.15.60:0/1146187149 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b07fff700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b08100ff0 0x7f8b08102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0d799700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08101990 0x7f8b08102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0cf98700 1 -- 172.21.15.60:0/1146187149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b08100ff0 msgr2=0x7f8b08102630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0cf98700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b08100ff0 0x7f8b08102630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0cf98700 1 -- 172.21.15.60:0/1146187149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08101990 msgr2=0x7f8b08102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0cf98700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08101990 0x7f8b08102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0cf98700 1 -- 172.21.15.60:0/1146187149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009d00 con 0x7f8b080ffe00 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0d799700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08101990 0x7f8b08102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0cf98700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 0x7f8b08103ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00d980 tx=0x7f8afc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc004020 con 0x7f8b080ffe00 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8afc009730 con 0x7f8b080ffe00 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b081a0fe0 con 0x7f8b080ffe00 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc003a80 con 0x7f8b080ffe00 2023-10-05T15:15:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.050+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b081a1460 con 0x7f8b080ffe00 2023-10-05T15:15:05.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.051+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b08107e30 con 0x7f8b080ffe00 2023-10-05T15:15:05.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.052+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8afc0098a0 con 0x7f8b080ffe00 2023-10-05T15:15:05.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.053+0000 7f8b05ffb700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8af80a1550 0x7f8af80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.053+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8afc0ccb80 con 0x7f8b080ffe00 2023-10-05T15:15:05.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.053+0000 7f8b07fff700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8af80a1550 0x7f8af80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.053+0000 7f8b07fff700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8af80a1550 0x7f8af80a3a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8af4005950 tx=0x7f8af400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.057+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8afc095ff0 con 0x7f8b080ffe00 2023-10-05T15:15:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.261+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b0810b620 con 0x7f8b080ffe00 2023-10-05T15:15:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.263+0000 7f8b05ffb700 1 -- 172.21.15.60:0/1146187149 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7f8afc099610 con 0x7f8b080ffe00 2023-10-05T15:15:05.265 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:05.265 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.265+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8af80a1550 msgr2=0x7f8af80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.265+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8af80a1550 0x7f8af80a3a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8af4005950 tx=0x7f8af400a300 comp rx=0 tx=0).stop 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.265+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 msgr2=0x7f8b08103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.265+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 0x7f8b08103ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00d980 tx=0x7f8afc00dc90 comp rx=0 tx=0).stop 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 shutdown_connections 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b08101990 0x7f8b08102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8af80a1550 0x7f8af80a3a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080ffe00 0x7f8b08103ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 --2- 172.21.15.60:0/1146187149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b08100ff0 0x7f8b08102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 >> 172.21.15.60:0/1146187149 conn(0x7f8b080fb370 msgr2=0x7f8b080fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 shutdown_connections 2023-10-05T15:15:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.266+0000 7f8b0f1fc700 1 -- 172.21.15.60:0/1146187149 wait complete. 2023-10-05T15:15:05.281 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-05T15:15:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 -- 172.21.15.60:0/3211379823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 msgr2=0x7f61e4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 --2- 172.21.15.60:0/3211379823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e4103d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009990 tx=0x7f61d4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 -- 172.21.15.60:0/3211379823 shutdown_connections 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 --2- 172.21.15.60:0/3211379823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e4106ba0 0x7f61e4109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 --2- 172.21.15.60:0/3211379823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e4103d30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 --2- 172.21.15.60:0/3211379823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4104270 0x7f61e4106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 -- 172.21.15.60:0/3211379823 >> 172.21.15.60:0/3211379823 conn(0x7f61e40fb330 msgr2=0x7f61e40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 -- 172.21.15.60:0/3211379823 shutdown_connections 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 -- 172.21.15.60:0/3211379823 wait complete. 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.408+0000 7f61ec553700 1 Processor -- start 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 -- start start 2023-10-05T15:15:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e41012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e4104270 0x7f61e40ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4106ba0 0x7f61e40ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41005d0 con 0x7f61e4101940 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4100740 con 0x7f61e4106ba0 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ec553700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41a0bf0 con 0x7f61e4104270 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e41012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e41012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36270/0 (socket says 172.21.15.60:36270) 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 -- 172.21.15.60:0/724417398 learned_addr learned my addr 172.21.15.60:0/724417398 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61e9aee700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e4104270 0x7f61e40ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61eaaf0700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4106ba0 0x7f61e40ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 -- 172.21.15.60:0/724417398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e4104270 msgr2=0x7f61e40ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e4104270 0x7f61e40ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 -- 172.21.15.60:0/724417398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4106ba0 msgr2=0x7f61e40ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4106ba0 0x7f61e40ffe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 -- 172.21.15.60:0/724417398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40095f0 con 0x7f61e4101940 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61eaaf0700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4106ba0 0x7f61e40ffe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.409+0000 7f61ea2ef700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e41012b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000c00 tx=0x7f61d400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.410+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d401d070 con 0x7f61e4101940 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.410+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61d400fc00 con 0x7f61e4101940 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.410+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4017650 con 0x7f61e4101940 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.410+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e41a0e70 con 0x7f61e4101940 2023-10-05T15:15:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.410+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e41a1240 con 0x7f61e4101940 2023-10-05T15:15:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.411+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e40fceb0 con 0x7f61e4101940 2023-10-05T15:15:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.412+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f61d4022470 con 0x7f61e4101940 2023-10-05T15:15:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.412+0000 7f61db7fe700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61d00a1500 0x7f61d00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.413+0000 7f61e9aee700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61d00a1500 0x7f61d00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.413+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f61d40ce400 con 0x7f61e4101940 2023-10-05T15:15:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.413+0000 7f61e9aee700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61d00a1500 0x7f61d00a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005950 tx=0x7f61e00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.416+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f61d4097900 con 0x7f61e4101940 2023-10-05T15:15:05.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:05 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2652194022' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:15:05.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:05 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2595839478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:05.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:05 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1146187149' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:05.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2652194022' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:15:05.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2595839478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:05.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1146187149' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:05.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:05.667+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f61e410c910 con 0x7f61e4101940 2023-10-05T15:15:05.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:05 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2652194022' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:15:05.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:05 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2595839478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:05.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:05 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1146187149' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:06.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.278+0000 7f61db7fe700 1 -- 172.21.15.60:0/724417398 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f61d409af20 con 0x7f61e4101940 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61d00a1500 msgr2=0x7f61d00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61d00a1500 0x7f61d00a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005950 tx=0x7f61e00058e0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 msgr2=0x7f61e41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e41012b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000c00 tx=0x7f61d400f710 comp rx=0 tx=0).stop 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 shutdown_connections 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4106ba0 0x7f61e40ffe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61d00a1500 0x7f61d00a39c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4101940 0x7f61e41012b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 --2- 172.21.15.60:0/724417398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e4104270 0x7f61e40ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 >> 172.21.15.60:0/724417398 conn(0x7f61e40fb330 msgr2=0x7f61e41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:06.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 shutdown_connections 2023-10-05T15:15:06.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.281+0000 7f61ec553700 1 -- 172.21.15.60:0/724417398 wait complete. 2023-10-05T15:15:06.298 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-05T15:15:06.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-05T15:15:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 -- 172.21.15.60:0/3530751758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640ffe40 msgr2=0x7faa64100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 --2- 172.21.15.60:0/3530751758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640ffe40 0x7faa64100260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa54009990 tx=0x7faa54009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 -- 172.21.15.60:0/3530751758 shutdown_connections 2023-10-05T15:15:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 --2- 172.21.15.60:0/3530751758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa64101950 0x7faa64108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 --2- 172.21.15.60:0/3530751758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640ffe40 0x7faa64100260 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 --2- 172.21.15.60:0/3530751758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64100f90 0x7faa64101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 -- 172.21.15.60:0/3530751758 >> 172.21.15.60:0/3530751758 conn(0x7faa640fb3d0 msgr2=0x7faa640fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:06.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 -- 172.21.15.60:0/3530751758 shutdown_connections 2023-10-05T15:15:06.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.432+0000 7faa69933700 1 -- 172.21.15.60:0/3530751758 wait complete. 2023-10-05T15:15:06.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.433+0000 7faa69933700 1 Processor -- start 2023-10-05T15:15:06.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.433+0000 7faa69933700 1 -- start start 2023-10-05T15:15:06.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa640ffe40 0x7faa64195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:06.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa64100f90 0x7faa64195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:06.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 0x7faa6419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6419d5a0 con 0x7faa64101950 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6419d6e0 con 0x7faa64100f90 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6419d870 con 0x7faa640ffe40 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 0x7faa6419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 0x7faa6419cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36288/0 (socket says 172.21.15.60:36288) 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 -- 172.21.15.60:0/3065434173 learned_addr learned my addr 172.21.15.60:0/3065434173 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa627fc700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa64100f90 0x7faa64195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa62ffd700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa640ffe40 0x7faa64195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 -- 172.21.15.60:0/3065434173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa640ffe40 msgr2=0x7faa64195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa640ffe40 0x7faa64195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 -- 172.21.15.60:0/3065434173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa64100f90 msgr2=0x7faa64195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa64100f90 0x7faa64195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 -- 172.21.15.60:0/3065434173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540095f0 con 0x7faa64101950 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa637fe700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 0x7faa6419cfd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faa5c007ee0 tx=0x7faa5c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c017070 con 0x7faa64101950 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6419db50 con 0x7faa64101950 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa5c00f040 con 0x7faa64101950 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.434+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c005740 con 0x7faa64101950 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.435+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6419e060 con 0x7faa64101950 2023-10-05T15:15:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.435+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64106d60 con 0x7faa64101950 2023-10-05T15:15:06.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.437+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faa5c00dc60 con 0x7faa64101950 2023-10-05T15:15:06.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.437+0000 7faa68931700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7faa4c0a1480 0x7faa4c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:06.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.438+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7faa5c0ccd90 con 0x7faa64101950 2023-10-05T15:15:06.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.438+0000 7faa62ffd700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7faa4c0a1480 0x7faa4c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:06.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.438+0000 7faa62ffd700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7faa4c0a1480 0x7faa4c0a3940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa54006010 tx=0x7faa5400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:06.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.441+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faa5c0961a0 con 0x7faa64101950 2023-10-05T15:15:06.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:06 smithi135 ceph-mon[103360]: pgmap v268: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 257 B/s wr, 0 op/s 2023-10-05T15:15:06.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:06 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/724417398' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-05T15:15:06.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:06 smithi060 ceph-mon[99238]: pgmap v268: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 257 B/s wr, 0 op/s 2023-10-05T15:15:06.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:06 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/724417398' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-05T15:15:06.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:06 smithi092 ceph-mon[102944]: pgmap v268: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 257 B/s wr, 0 op/s 2023-10-05T15:15:06.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:06 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/724417398' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-05T15:15:06.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:06.691+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7faa6402d1c0 con 0x7faa64101950 2023-10-05T15:15:07.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.283+0000 7faa68931700 1 -- 172.21.15.60:0/3065434173 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7faa5c0997c0 con 0x7faa64101950 2023-10-05T15:15:07.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7faa4c0a1480 msgr2=0x7faa4c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:07.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7faa4c0a1480 0x7faa4c0a3940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa54006010 tx=0x7faa5400b540 comp rx=0 tx=0).stop 2023-10-05T15:15:07.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 msgr2=0x7faa6419cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 0x7faa6419cfd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faa5c007ee0 tx=0x7faa5c00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 shutdown_connections 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7faa4c0a1480 0x7faa4c0a3940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64101950 0x7faa6419cfd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa640ffe40 0x7faa64195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 --2- 172.21.15.60:0/3065434173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa64100f90 0x7faa64195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 >> 172.21.15.60:0/3065434173 conn(0x7faa640fb3d0 msgr2=0x7faa640fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 shutdown_connections 2023-10-05T15:15:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.286+0000 7faa69933700 1 -- 172.21.15.60:0/3065434173 wait complete. 2023-10-05T15:15:07.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-05T15:15:07.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 -- 172.21.15.60:0/1905750843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc100ea0 msgr2=0x7f43cc1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:07.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 --2- 172.21.15.60:0/1905750843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc100ea0 0x7f43cc1012c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009990 tx=0x7f43bc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 -- 172.21.15.60:0/1905750843 shutdown_connections 2023-10-05T15:15:07.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 --2- 172.21.15.60:0/1905750843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43cc102a40 0x7f43cc109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 --2- 172.21.15.60:0/1905750843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc100ea0 0x7f43cc1012c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 --2- 172.21.15.60:0/1905750843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43cc102080 0x7f43cc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 -- 172.21.15.60:0/1905750843 >> 172.21.15.60:0/1905750843 conn(0x7f43cc0fc460 msgr2=0x7f43cc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:07.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 -- 172.21.15.60:0/1905750843 shutdown_connections 2023-10-05T15:15:07.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.437+0000 7f43d0836700 1 -- 172.21.15.60:0/1905750843 wait complete. 2023-10-05T15:15:07.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 Processor -- start 2023-10-05T15:15:07.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 -- start start 2023-10-05T15:15:07.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43cc100ea0 0x7f43cc196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:07.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 0x7f43cc197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43cc102a40 0x7f43cc19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc19e830 con 0x7f43cc102080 2023-10-05T15:15:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc19e9a0 con 0x7f43cc102a40 2023-10-05T15:15:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43d0836700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc19eb60 con 0x7f43cc100ea0 2023-10-05T15:15:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 0x7f43cc197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 0x7f43cc197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36300/0 (socket says 172.21.15.60:36300) 2023-10-05T15:15:07.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 -- 172.21.15.60:0/3181830363 learned_addr learned my addr 172.21.15.60:0/3181830363 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:07.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43cad9d700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43cc102a40 0x7f43cc19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:07.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43ca59c700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43cc100ea0 0x7f43cc196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:07.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 -- 172.21.15.60:0/3181830363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43cc100ea0 msgr2=0x7f43cc196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:07.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43cc100ea0 0x7f43cc196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 -- 172.21.15.60:0/3181830363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43cc102a40 msgr2=0x7f43cc19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43cc102a40 0x7f43cc19e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.438+0000 7f43c9d9b700 1 -- 172.21.15.60:0/3181830363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0095f0 con 0x7f43cc102080 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.439+0000 7f43c9d9b700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 0x7f43cc197230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f43c000b500 tx=0x7f43c000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.439+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43cc102080 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.439+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43c0011e50 con 0x7f43cc102080 2023-10-05T15:15:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.439+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc19ee40 con 0x7f43cc102080 2023-10-05T15:15:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.439+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000f2e0 con 0x7f43cc102080 2023-10-05T15:15:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.439+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc19f200 con 0x7f43cc102080 2023-10-05T15:15:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.440+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc10c7d0 con 0x7f43cc102080 2023-10-05T15:15:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.441+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f43c0010580 con 0x7f43cc102080 2023-10-05T15:15:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.442+0000 7f43bb7fe700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43b40a1480 0x7f43b40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.442+0000 7f43ca59c700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43b40a1480 0x7f43b40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.442+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f43c00cceb0 con 0x7f43cc102080 2023-10-05T15:15:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.442+0000 7f43ca59c700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43b40a1480 0x7f43b40a3940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00b5c0 tx=0x7f43bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.445+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43c00fa100 con 0x7f43cc102080 2023-10-05T15:15:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:07 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/724417398' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-05T15:15:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:07 smithi135 ceph-mon[103360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:15:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:07 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3065434173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-05T15:15:07.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:07 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/724417398' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-05T15:15:07.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:07 smithi060 ceph-mon[99238]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:15:07.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:07 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3065434173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-05T15:15:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:07 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/724417398' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-05T15:15:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:07 smithi092 ceph-mon[102944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:15:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:07 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3065434173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-05T15:15:07.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:07.696+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f43cc19f480 con 0x7f43cc102080 2023-10-05T15:15:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.290+0000 7f43bb7fe700 1 -- 172.21.15.60:0/3181830363 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f43c0096320 con 0x7f43cc102080 2023-10-05T15:15:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43b40a1480 msgr2=0x7f43b40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43b40a1480 0x7f43b40a3940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00b5c0 tx=0x7f43bc005fd0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 msgr2=0x7f43cc197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 0x7f43cc197230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f43c000b500 tx=0x7f43c000b810 comp rx=0 tx=0).stop 2023-10-05T15:15:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 shutdown_connections 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43cc102a40 0x7f43cc19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43cc100ea0 0x7f43cc196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43b40a1480 0x7f43b40a3940 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 --2- 172.21.15.60:0/3181830363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc102080 0x7f43cc197230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 >> 172.21.15.60:0/3181830363 conn(0x7f43cc0fc460 msgr2=0x7f43cc0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 shutdown_connections 2023-10-05T15:15:08.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.293+0000 7f43d0836700 1 -- 172.21.15.60:0/3181830363 wait complete. 2023-10-05T15:15:08.316 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-05T15:15:08.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: pgmap v269: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-05T15:15:08.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-05T15:15:08.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3065434173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-05T15:15:08.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-05T15:15:08.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:15:08.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-05T15:15:08.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-05T15:15:08.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:08 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3181830363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-05T15:15:08.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 -- 172.21.15.60:0/760872835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201019b0 msgr2=0x7f8d20108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- 172.21.15.60:0/760872835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201019b0 0x7f8d20108240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b0a0 tx=0x7f8d1800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 -- 172.21.15.60:0/760872835 shutdown_connections 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- 172.21.15.60:0/760872835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201019b0 0x7f8d20108240 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- 172.21.15.60:0/760872835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d201002e0 0x7f8d20100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- 172.21.15.60:0/760872835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 0x7f8d20101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 -- 172.21.15.60:0/760872835 >> 172.21.15.60:0/760872835 conn(0x7f8d200faab0 msgr2=0x7f8d200fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 -- 172.21.15.60:0/760872835 shutdown_connections 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 -- 172.21.15.60:0/760872835 wait complete. 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 Processor -- start 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 -- start start 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 0x7f8d20196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 0x7f8d201971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.451+0000 7f8d274a8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d201019b0 0x7f8d2019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:08.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d274a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2019e7f0 con 0x7f8d201002e0 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d274a8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2019e960 con 0x7f8d201019b0 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d274a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2019eb20 con 0x7f8d20100ff0 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 0x7f8d20196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 0x7f8d20196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36312/0 (socket says 172.21.15.60:36312) 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 -- 172.21.15.60:0/1138188075 learned_addr learned my addr 172.21.15.60:0/1138188075 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25a45700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d201019b0 0x7f8d2019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:08.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 -- 172.21.15.60:0/1138188075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 msgr2=0x7f8d201971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d24a43700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 0x7f8d201971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 0x7f8d201971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 -- 172.21.15.60:0/1138188075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d201019b0 msgr2=0x7f8d2019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d201019b0 0x7f8d2019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 -- 172.21.15.60:0/1138188075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009d00 con 0x7f8d201002e0 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d24a43700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 0x7f8d201971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d25244700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 0x7f8d20196c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d980 tx=0x7f8d1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:08.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c004020 con 0x7f8d201002e0 2023-10-05T15:15:08.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d1c009730 con 0x7f8d201002e0 2023-10-05T15:15:08.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2019ee00 con 0x7f8d201002e0 2023-10-05T15:15:08.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c003a80 con 0x7f8d201002e0 2023-10-05T15:15:08.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.452+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2019f230 con 0x7f8d201002e0 2023-10-05T15:15:08.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.453+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2010b5f0 con 0x7f8d201002e0 2023-10-05T15:15:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.454+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8d1c0098a0 con 0x7f8d201002e0 2023-10-05T15:15:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.455+0000 7f8d167fc700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8d0c0a1480 0x7f8d0c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.455+0000 7f8d24a43700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8d0c0a1480 0x7f8d0c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.455+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8d1c0ccfd0 con 0x7f8d201002e0 2023-10-05T15:15:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.455+0000 7f8d24a43700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8d0c0a1480 0x7f8d0c0a3940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d10005fd0 tx=0x7f8d10005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.458+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8d1c0963e0 con 0x7f8d201002e0 2023-10-05T15:15:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: pgmap v269: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-05T15:15:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-05T15:15:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3065434173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-05T15:15:08.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-05T15:15:08.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:15:08.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-05T15:15:08.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-05T15:15:08.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:08 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3181830363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-05T15:15:08.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: pgmap v269: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-05T15:15:08.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-05T15:15:08.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3065434173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-05T15:15:08.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-05T15:15:08.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:15:08.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-05T15:15:08.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-05T15:15:08.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:08 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3181830363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-05T15:15:08.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:08.711+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f8d2019f4e0 con 0x7f8d201002e0 2023-10-05T15:15:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.301+0000 7f8d167fc700 1 -- 172.21.15.60:0/1138188075 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8d1c099a00 con 0x7f8d201002e0 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8d0c0a1480 msgr2=0x7f8d0c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8d0c0a1480 0x7f8d0c0a3940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d10005fd0 tx=0x7f8d10005e40 comp rx=0 tx=0).stop 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 msgr2=0x7f8d20196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 0x7f8d20196c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d980 tx=0x7f8d1c00dc90 comp rx=0 tx=0).stop 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 shutdown_connections 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d201019b0 0x7f8d2019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8d0c0a1480 0x7f8d0c0a3940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d201002e0 0x7f8d20196c80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 --2- 172.21.15.60:0/1138188075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d20100ff0 0x7f8d201971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 >> 172.21.15.60:0/1138188075 conn(0x7f8d200faab0 msgr2=0x7f8d200fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 shutdown_connections 2023-10-05T15:15:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.304+0000 7f8d274a8700 1 -- 172.21.15.60:0/1138188075 wait complete. 2023-10-05T15:15:09.326 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-05T15:15:09.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-05T15:15:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 -- 172.21.15.60:0/1839553644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 msgr2=0x7fa60c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 --2- 172.21.15.60:0/1839553644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c1012c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa600009990 tx=0x7fa600009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 -- 172.21.15.60:0/1839553644 shutdown_connections 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 --2- 172.21.15.60:0/1839553644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa60c102a40 0x7fa60c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 --2- 172.21.15.60:0/1839553644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c1012c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 --2- 172.21.15.60:0/1839553644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa60c102080 0x7fa60c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 -- 172.21.15.60:0/1839553644 >> 172.21.15.60:0/1839553644 conn(0x7fa60c0fc460 msgr2=0x7fa60c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 -- 172.21.15.60:0/1839553644 shutdown_connections 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 -- 172.21.15.60:0/1839553644 wait complete. 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 Processor -- start 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.461+0000 7fa612af5700 1 -- start start 2023-10-05T15:15:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa60c102080 0x7fa60c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa60c102a40 0x7fa60c19e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c19e740 con 0x7fa60c100ea0 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c19e880 con 0x7fa60c102a40 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c19ea10 con 0x7fa60c102080 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36326/0 (socket says 172.21.15.60:36326) 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 -- 172.21.15.60:0/1198315018 learned_addr learned my addr 172.21.15.60:0/1198315018 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 -- 172.21.15.60:0/1198315018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa60c102080 msgr2=0x7fa60c197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa60c102080 0x7fa60c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 -- 172.21.15.60:0/1198315018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa60c102a40 msgr2=0x7fa60c19e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa60c102a40 0x7fa60c19e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 -- 172.21.15.60:0/1198315018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000095f0 con 0x7fa60c100ea0 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa610891700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c196bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa60000f730 tx=0x7fa60000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60001d070 con 0x7fa60c100ea0 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa60000fd30 con 0x7fa60c100ea0 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600005710 con 0x7fa60c100ea0 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c19ec90 con 0x7fa60c100ea0 2023-10-05T15:15:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.462+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c19f0b0 con 0x7fa60c100ea0 2023-10-05T15:15:09.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.463+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c108470 con 0x7fa60c100ea0 2023-10-05T15:15:09.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.464+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa6000047e0 con 0x7fa60c100ea0 2023-10-05T15:15:09.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.465+0000 7fa609ffb700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa5fc0a1500 0x7fa5fc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:09.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.465+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa6000ce610 con 0x7fa60c100ea0 2023-10-05T15:15:09.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.465+0000 7fa60bfff700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa5fc0a1500 0x7fa5fc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:09.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.466+0000 7fa60bfff700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa5fc0a1500 0x7fa5fc0a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa60c100bc0 tx=0x7fa5f8005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:09.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.468+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa600097ab0 con 0x7fa60c100ea0 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3181830363' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:active 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-05T15:15:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:09 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1138188075' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-05T15:15:09.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3181830363' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-05T15:15:09.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:active 2023-10-05T15:15:09.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-05T15:15:09.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-05T15:15:09.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-10-05T15:15:09.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-05T15:15:09.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1138188075' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3181830363' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:active 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-05T15:15:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:09 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1138188075' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-05T15:15:09.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:09.703+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fa60c10c760 con 0x7fa5fc0a1500 2023-10-05T15:15:10.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:15:09.708+0000 7fce4bcdd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:15:10.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:15:09.708+0000 7fce4bcdd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:15:10.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:15:09.708+0000 7fce4bcdd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:15:10.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:15:09.708+0000 7fce4bcdd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:15:10.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:15:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:15:09.708+0000 7fce4bcdd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:15:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.355+0000 7fa609ffb700 1 -- 172.21.15.60:0/1198315018 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa60c10c760 con 0x7fa5fc0a1500 2023-10-05T15:15:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa5fc0a1500 msgr2=0x7fa5fc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa5fc0a1500 0x7fa5fc0a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa60c100bc0 tx=0x7fa5f8005d20 comp rx=0 tx=0).stop 2023-10-05T15:15:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 msgr2=0x7fa60c196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c196bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa60000f730 tx=0x7fa60000f810 comp rx=0 tx=0).stop 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 shutdown_connections 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa60c102a40 0x7fa60c19e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa5fc0a1500 0x7fa5fc0a39c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c100ea0 0x7fa60c196bc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 --2- 172.21.15.60:0/1198315018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa60c102080 0x7fa60c197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.357+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 >> 172.21.15.60:0/1198315018 conn(0x7fa60c0fc460 msgr2=0x7fa60c1055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.358+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 shutdown_connections 2023-10-05T15:15:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.358+0000 7fa612af5700 1 -- 172.21.15.60:0/1198315018 wait complete. 2023-10-05T15:15:10.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 -- 172.21.15.60:0/3493624853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102080 msgr2=0x7fe7c0102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/3493624853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102080 0x7fe7c0102500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009990 tx=0x7fe7bc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 -- 172.21.15.60:0/3493624853 shutdown_connections 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/3493624853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0102a40 0x7fe7c0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/3493624853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 0x7fe7c01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/3493624853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102080 0x7fe7c0102500 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 -- 172.21.15.60:0/3493624853 >> 172.21.15.60:0/3493624853 conn(0x7fe7c00fc460 msgr2=0x7fe7c00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:10.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 -- 172.21.15.60:0/3493624853 shutdown_connections 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 -- 172.21.15.60:0/3493624853 wait complete. 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 Processor -- start 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.507+0000 7fe7c76f7700 1 -- start start 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 0x7fe7c0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0102080 0x7fe7c01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 0x7fe7c019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019e800 con 0x7fe7c0102a40 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019e970 con 0x7fe7c0100ea0 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019eb30 con 0x7fe7c0102080 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 0x7fe7c019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 0x7fe7c019e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36364/0 (socket says 172.21.15.60:36364) 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 -- 172.21.15.60:0/2364736174 learned_addr learned my addr 172.21.15.60:0/2364736174 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c4c92700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0102080 0x7fe7c01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5493700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 0x7fe7c0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 -- 172.21.15.60:0/2364736174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0102080 msgr2=0x7fe7c01971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0102080 0x7fe7c01971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 -- 172.21.15.60:0/2364736174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 msgr2=0x7fe7c0196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 0x7fe7c0196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 -- 172.21.15.60:0/2364736174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0095f0 con 0x7fe7c0102a40 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5493700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 0x7fe7c0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c5c94700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 0x7fe7c019e230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8007ee0 tx=0x7fe7b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8017070 con 0x7fe7c0102a40 2023-10-05T15:15:10.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c019ee10 con 0x7fe7c0102a40 2023-10-05T15:15:10.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7b800f040 con 0x7fe7c0102a40 2023-10-05T15:15:10.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8005740 con 0x7fe7c0102a40 2023-10-05T15:15:10.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.508+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c019f2e0 con 0x7fe7c0102a40 2023-10-05T15:15:10.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.509+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0108500 con 0x7fe7c0102a40 2023-10-05T15:15:10.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.511+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe7b8022020 con 0x7fe7c0102a40 2023-10-05T15:15:10.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.511+0000 7fe7b67fc700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe7ac0a1480 0x7fe7ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.511+0000 7fe7c5493700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe7ac0a1480 0x7fe7ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.511+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe7b80cc4d0 con 0x7fe7c0102a40 2023-10-05T15:15:10.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.512+0000 7fe7c5493700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe7ac0a1480 0x7fe7ac0a3940 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0197b60 tx=0x7fe7b000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:10.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.515+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe7b8095940 con 0x7fe7c0102a40 2023-10-05T15:15:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: pgmap v270: 129 pgs: 129 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2023-10-05T15:15:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1138188075' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-05T15:15:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] up:active 2023-10-05T15:15:10.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-05T15:15:10.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-10-05T15:15:10.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-10-05T15:15:10.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-10-05T15:15:10.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:10 smithi135 ceph-mon[103360]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: pgmap v270: 129 pgs: 129 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1138188075' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] up:active 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-10-05T15:15:10.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-10-05T15:15:10.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:10 smithi060 ceph-mon[99238]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: pgmap v270: 129 pgs: 129 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1138188075' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] up:active 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-10-05T15:15:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:10 smithi092 ceph-mon[102944]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:10.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.754+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c002d210 con 0x7fe7ac0a1480 2023-10-05T15:15:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.759+0000 7fe7b67fc700 1 -- 172.21.15.60:0/2364736174 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fe7c002d210 con 0x7fe7ac0a1480 2023-10-05T15:15:10.761 INFO:teuthology.orchestra.run.smithi060.stdout:/volumes/_nogroup/sv_0/59b8b5f4-3126-4ead-8faa-907c62dedace 2023-10-05T15:15:10.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe7ac0a1480 msgr2=0x7fe7ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe7ac0a1480 0x7fe7ac0a3940 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0197b60 tx=0x7fe7b000b610 comp rx=0 tx=0).stop 2023-10-05T15:15:10.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 msgr2=0x7fe7c019e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 0x7fe7c019e230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8007ee0 tx=0x7fe7b800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 shutdown_connections 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe7ac0a1480 0x7fe7ac0a3940 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7c0102a40 0x7fe7c019e230 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0100ea0 0x7fe7c0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 --2- 172.21.15.60:0/2364736174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0102080 0x7fe7c01971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 >> 172.21.15.60:0/2364736174 conn(0x7fe7c00fc460 msgr2=0x7fe7c0105640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.761+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 shutdown_connections 2023-10-05T15:15:10.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.762+0000 7fe7c76f7700 1 -- 172.21.15.60:0/2364736174 wait complete. 2023-10-05T15:15:10.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 -- 172.21.15.60:0/295660735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90100fb0 msgr2=0x7f8a90101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 --2- 172.21.15.60:0/295660735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90100fb0 0x7f8a90101410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8a800099c0 tx=0x7f8a80009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 -- 172.21.15.60:0/295660735 shutdown_connections 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 --2- 172.21.15.60:0/295660735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90101950 0x7f8a90108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 --2- 172.21.15.60:0/295660735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 0x7f8a901001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 --2- 172.21.15.60:0/295660735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90100fb0 0x7f8a90101410 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 -- 172.21.15.60:0/295660735 >> 172.21.15.60:0/295660735 conn(0x7f8a900fb330 msgr2=0x7f8a900fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 -- 172.21.15.60:0/295660735 shutdown_connections 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.904+0000 7f8a986d3700 1 -- 172.21.15.60:0/295660735 wait complete. 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 Processor -- start 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 -- start start 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 0x7f8a90068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90100fb0 0x7f8a9019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 0x7f8a9019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9019e730 con 0x7f8a90101950 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9019e8a0 con 0x7f8a900ffdc0 2023-10-05T15:15:10.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a986d3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9019ea60 con 0x7f8a90100fb0 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 0x7f8a9019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 0x7f8a9019df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36376/0 (socket says 172.21.15.60:36376) 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 -- 172.21.15.60:0/2581911678 learned_addr learned my addr 172.21.15.60:0/2581911678 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a95c6e700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90100fb0 0x7f8a9019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a9646f700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 0x7f8a90068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 -- 172.21.15.60:0/2581911678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90100fb0 msgr2=0x7f8a9019b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90100fb0 0x7f8a9019b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 -- 172.21.15.60:0/2581911678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 msgr2=0x7f8a90068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 0x7f8a90068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 -- 172.21.15.60:0/2581911678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800095f0 con 0x7f8a90101950 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a95c6e700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90100fb0 0x7f8a9019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:10.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a9646f700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 0x7f8a90068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a96c70700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 0x7f8a9019df90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8a88007ee0 tx=0x7f8a8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.905+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88017070 con 0x7f8a90101950 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.906+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9019ed40 con 0x7f8a90101950 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.906+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a8800f040 con 0x7f8a90101950 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.906+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88005740 con 0x7f8a90101950 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.906+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9019f1f0 con 0x7f8a90101950 2023-10-05T15:15:10.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.907+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a90106d40 con 0x7f8a90101950 2023-10-05T15:15:10.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.908+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8a880058a0 con 0x7f8a90101950 2023-10-05T15:15:10.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.908+0000 7f8a877fe700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8a7c0a1480 0x7f8a7c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:10.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.909+0000 7f8a9646f700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8a7c0a1480 0x7f8a7c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:10.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.909+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8a880ccdb0 con 0x7f8a90101950 2023-10-05T15:15:10.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.909+0000 7f8a9646f700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8a7c0a1480 0x7f8a7c0a3940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a90100e10 tx=0x7f8a8c009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:10.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:10.912+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8a88096220 con 0x7f8a90101950 2023-10-05T15:15:11.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.152+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a9002d2b0 con 0x7f8a7c0a1480 2023-10-05T15:15:11.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.177+0000 7f8a877fe700 1 -- 172.21.15.60:0/2581911678 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8a9002d2b0 con 0x7f8a7c0a1480 2023-10-05T15:15:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.179+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8a7c0a1480 msgr2=0x7f8a7c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.179+0000 7f8a986d3700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8a7c0a1480 0x7f8a7c0a3940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a90100e10 tx=0x7f8a8c009670 comp rx=0 tx=0).stop 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.179+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 msgr2=0x7f8a9019df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.179+0000 7f8a986d3700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 0x7f8a9019df90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8a88007ee0 tx=0x7f8a8800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 shutdown_connections 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8a7c0a1480 0x7f8a7c0a3940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a90101950 0x7f8a9019df90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a900ffdc0 0x7f8a90068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 --2- 172.21.15.60:0/2581911678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a90100fb0 0x7f8a9019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 >> 172.21.15.60:0/2581911678 conn(0x7f8a900fb330 msgr2=0x7f8a900fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 shutdown_connections 2023-10-05T15:15:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.180+0000 7f8a986d3700 1 -- 172.21.15.60:0/2581911678 wait complete. 2023-10-05T15:15:11.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 -- 172.21.15.60:0/3339678186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc100fe0 msgr2=0x7fdadc101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/3339678186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc100fe0 0x7fdadc101440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0099c0 tx=0x7fdacc009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 -- 172.21.15.60:0/3339678186 shutdown_connections 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/3339678186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdadc101980 0x7fdadc108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/3339678186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/3339678186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc100fe0 0x7fdadc101440 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 -- 172.21.15.60:0/3339678186 >> 172.21.15.60:0/3339678186 conn(0x7fdadc0fb380 msgr2=0x7fdadc0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 -- 172.21.15.60:0/3339678186 shutdown_connections 2023-10-05T15:15:11.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 -- 172.21.15.60:0/3339678186 wait complete. 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 Processor -- start 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 -- start start 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.323+0000 7fdae1a4c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdadc100fe0 0x7fdadc195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc101980 0x7fdadc19cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc19d5c0 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc19d700 con 0x7fdadc100fe0 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc19d890 con 0x7fdadc101980 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36412/0 (socket says 172.21.15.60:36412) 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 -- 172.21.15.60:0/2167661572 learned_addr learned my addr 172.21.15.60:0/2167661572 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:11.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdada7fc700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdadc100fe0 0x7fdadc195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadb7fe700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc101980 0x7fdadc19cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 -- 172.21.15.60:0/2167661572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc101980 msgr2=0x7fdadc19cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc101980 0x7fdadc19cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 -- 172.21.15.60:0/2167661572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdadc100fe0 msgr2=0x7fdadc195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdadc100fe0 0x7fdadc195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 -- 172.21.15.60:0/2167661572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0095f0 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadb7fe700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc101980 0x7fdadc19cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdadaffd700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc195a40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007b50 tx=0x7fdad0007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0011070 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdad000c2e0 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc069290 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad000e500 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.324+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc0697f0 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.325+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc10b600 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.327+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdad0003f10 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.327+0000 7fdae0a4a700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdac40a1500 0x7fdac40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.327+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdad00ce420 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.327+0000 7fdada7fc700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdac40a1500 0x7fdac40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.328+0000 7fdada7fc700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdac40a1500 0x7fdac40a39c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00b580 tx=0x7fdacc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:11.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.331+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdad0097920 con 0x7fdadc0ffdf0 2023-10-05T15:15:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.566+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdadc106fe0 con 0x7fdac40a1500 2023-10-05T15:15:11.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.571+0000 7fdae0a4a700 1 -- 172.21.15.60:0/2167661572 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fdadc106fe0 con 0x7fdac40a1500 2023-10-05T15:15:11.573 INFO:teuthology.orchestra.run.smithi060.stdout:/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf 2023-10-05T15:15:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdac40a1500 msgr2=0x7fdac40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdac40a1500 0x7fdac40a39c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00b580 tx=0x7fdacc000bc0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 msgr2=0x7fdadc195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc195a40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007b50 tx=0x7fdad0007e60 comp rx=0 tx=0).stop 2023-10-05T15:15:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 shutdown_connections 2023-10-05T15:15:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc101980 0x7fdadc19cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdac40a1500 0x7fdac40a39c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0ffdf0 0x7fdadc195a40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 --2- 172.21.15.60:0/2167661572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdadc100fe0 0x7fdadc195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 >> 172.21.15.60:0/2167661572 conn(0x7fdadc0fb380 msgr2=0x7fdadc1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 shutdown_connections 2023-10-05T15:15:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.573+0000 7fdae1a4c700 1 -- 172.21.15.60:0/2167661572 wait complete. 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] up:active 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: Cluster is now healthy 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] up:active 2023-10-05T15:15:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:11 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:15:11.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] up:active 2023-10-05T15:15:11.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-05T15:15:11.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-05T15:15:11.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: Cluster is now healthy 2023-10-05T15:15:11.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2023-10-05T15:15:11.587 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-05T15:15:11.587 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-10-05T15:15:11.587 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:11.587 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] up:active 2023-10-05T15:15:11.587 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:11 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:15:11.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:15:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] up:active 2023-10-05T15:15:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-05T15:15:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: Cluster is now healthy 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] up:active 2023-10-05T15:15:11.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:11 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:15:11.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 -- 172.21.15.60:0/2853585597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 msgr2=0x7f9b9c109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/2853585597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c109340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400b0a0 tx=0x7f9b9400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 -- 172.21.15.60:0/2853585597 shutdown_connections 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/2853585597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c109340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/2853585597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c100e80 0x7f9b9c1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/2853585597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b9c102060 0x7f9b9c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 -- 172.21.15.60:0/2853585597 >> 172.21.15.60:0/2853585597 conn(0x7f9b9c0fc420 msgr2=0x7f9b9c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 -- 172.21.15.60:0/2853585597 shutdown_connections 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.711+0000 7f9ba40a9700 1 -- 172.21.15.60:0/2853585597 wait complete. 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 Processor -- start 2023-10-05T15:15:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 -- start start 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b9c100e80 0x7f9b9c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c102060 0x7f9b9c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c073f80 con 0x7f9b9c102a20 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0740f0 con 0x7f9b9c100e80 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba40a9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1a0c20 con 0x7f9b9c102060 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba2646700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba2646700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36428/0 (socket says 172.21.15.60:36428) 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba2646700 1 -- 172.21.15.60:0/3228687940 learned_addr learned my addr 172.21.15.60:0/3228687940 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba1644700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c102060 0x7f9b9c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.712+0000 7f9ba1e45700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b9c100e80 0x7f9b9c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba2646700 1 -- 172.21.15.60:0/3228687940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c102060 msgr2=0x7f9b9c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba2646700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c102060 0x7f9b9c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba2646700 1 -- 172.21.15.60:0/3228687940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b9c100e80 msgr2=0x7f9b9c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba2646700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b9c100e80 0x7f9b9c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba2646700 1 -- 172.21.15.60:0/3228687940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009d00 con 0x7f9b9c102a20 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba2646700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c0737e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b940062a0 tx=0x7f9b94004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400e040 con 0x7f9b9c102a20 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b9400cec0 con 0x7f9b9c102a20 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9401baf0 con 0x7f9b9c102a20 2023-10-05T15:15:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c1a0ea0 con 0x7f9b9c102a20 2023-10-05T15:15:11.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.713+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1a1210 con 0x7f9b9c102a20 2023-10-05T15:15:11.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.714+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c108400 con 0x7f9b9c102a20 2023-10-05T15:15:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.716+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9b9401bc50 con 0x7f9b9c102a20 2023-10-05T15:15:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.716+0000 7f9b92ffd700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9b880a14d0 0x7f9b880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.716+0000 7f9ba1e45700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9b880a14d0 0x7f9b880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.717+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9b940cefb0 con 0x7f9b9c102a20 2023-10-05T15:15:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.717+0000 7f9ba1e45700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9b880a14d0 0x7f9b880a3990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c101bd0 tx=0x7f9b8c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:11.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.720+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9b940984b0 con 0x7f9b9c102a20 2023-10-05T15:15:11.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.967+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b9c10c940 con 0x7f9b9c102a20 2023-10-05T15:15:11.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.968+0000 7f9b92ffd700 1 -- 172.21.15.60:0/3228687940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7f9b9409bad0 con 0x7f9b9c102a20 2023-10-05T15:15:11.970 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:11.970 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:15:11.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9b880a14d0 msgr2=0x7f9b880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9b880a14d0 0x7f9b880a3990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c101bd0 tx=0x7f9b8c00b410 comp rx=0 tx=0).stop 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 msgr2=0x7f9b9c0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c0737e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b940062a0 tx=0x7f9b94004d00 comp rx=0 tx=0).stop 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 shutdown_connections 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9b880a14d0 0x7f9b880a3990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b9c102a20 0x7f9b9c0737e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b9c100e80 0x7f9b9c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 --2- 172.21.15.60:0/3228687940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c102060 0x7f9b9c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.970+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 >> 172.21.15.60:0/3228687940 conn(0x7f9b9c0fc420 msgr2=0x7f9b9c105540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.971+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 shutdown_connections 2023-10-05T15:15:11.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:11.971+0000 7f9ba40a9700 1 -- 172.21.15.60:0/3228687940 wait complete. 2023-10-05T15:15:11.974 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:15:11.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 -- 172.21.15.60:0/3262588618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c102060 msgr2=0x7fcd8c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 --2- 172.21.15.60:0/3262588618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c102060 0x7fcd8c1024e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009990 tx=0x7fcd7c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 -- 172.21.15.60:0/3262588618 shutdown_connections 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 --2- 172.21.15.60:0/3262588618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd8c102a20 0x7fcd8c109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 --2- 172.21.15.60:0/3262588618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd8c100e80 0x7fcd8c1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 --2- 172.21.15.60:0/3262588618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c102060 0x7fcd8c1024e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 -- 172.21.15.60:0/3262588618 >> 172.21.15.60:0/3262588618 conn(0x7fcd8c0fc420 msgr2=0x7fcd8c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 -- 172.21.15.60:0/3262588618 shutdown_connections 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.116+0000 7fcd91887700 1 -- 172.21.15.60:0/3262588618 wait complete. 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 Processor -- start 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 -- start start 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 0x7fcd8c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd8c102060 0x7fcd8c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd8c102a20 0x7fcd8c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c073f80 con 0x7fcd8c100e80 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0740f0 con 0x7fcd8c102a20 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd91887700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c1a0c00 con 0x7fcd8c102060 2023-10-05T15:15:12.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 0x7fcd8c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 0x7fcd8c074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36438/0 (socket says 172.21.15.60:36438) 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 -- 172.21.15.60:0/2872656586 learned_addr learned my addr 172.21.15.60:0/2872656586 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8a7fc700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd8c102060 0x7fcd8c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8b7fe700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd8c102a20 0x7fcd8c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 -- 172.21.15.60:0/2872656586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd8c102060 msgr2=0x7fcd8c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd8c102060 0x7fcd8c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 -- 172.21.15.60:0/2872656586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd8c102a20 msgr2=0x7fcd8c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd8c102a20 0x7fcd8c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.117+0000 7fcd8affd700 1 -- 172.21.15.60:0/2872656586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80009520 con 0x7fcd8c100e80 2023-10-05T15:15:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.118+0000 7fcd8affd700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 0x7fcd8c074c60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000ea50 tx=0x7fcd8000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.118+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000cbd0 con 0x7fcd8c100e80 2023-10-05T15:15:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.118+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd8000cd30 con 0x7fcd8c100e80 2023-10-05T15:15:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.118+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800186c0 con 0x7fcd8c100e80 2023-10-05T15:15:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.118+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c0095f0 con 0x7fcd8c100e80 2023-10-05T15:15:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.118+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c1a11b0 con 0x7fcd8c100e80 2023-10-05T15:15:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.119+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c10c740 con 0x7fcd8c100e80 2023-10-05T15:15:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.120+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fcd80018820 con 0x7fcd8c100e80 2023-10-05T15:15:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.120+0000 7fcd90885700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcd740a15d0 0x7fcd740a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.121+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcd80014070 con 0x7fcd8c100e80 2023-10-05T15:15:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.121+0000 7fcd8a7fc700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcd740a15d0 0x7fcd740a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.121+0000 7fcd8a7fc700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcd740a15d0 0x7fcd740a3a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b2e0 tx=0x7fcd7c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.125+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd80096850 con 0x7fcd8c100e80 2023-10-05T15:15:12.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.331+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd8c107e00 con 0x7fcd8c100e80 2023-10-05T15:15:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.332+0000 7fcd90885700 1 -- 172.21.15.60:0/2872656586 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7fcd80099e70 con 0x7fcd8c100e80 2023-10-05T15:15:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:12.335 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcd740a15d0 msgr2=0x7fcd740a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcd740a15d0 0x7fcd740a3a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b2e0 tx=0x7fcd7c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 msgr2=0x7fcd8c074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 0x7fcd8c074c60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000ea50 tx=0x7fcd8000ed60 comp rx=0 tx=0).stop 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 shutdown_connections 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd8c102a20 0x7fcd8c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcd740a15d0 0x7fcd740a3a90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd8c100e80 0x7fcd8c074c60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 --2- 172.21.15.60:0/2872656586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd8c102060 0x7fcd8c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 >> 172.21.15.60:0/2872656586 conn(0x7fcd8c0fc420 msgr2=0x7fcd8c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 shutdown_connections 2023-10-05T15:15:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.334+0000 7fcd91887700 1 -- 172.21.15.60:0/2872656586 wait complete. 2023-10-05T15:15:12.349 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-05T15:15:12.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:15:12.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.473+0000 7fede6ddc700 1 -- 172.21.15.60:0/147006104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 msgr2=0x7fede01024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.473+0000 7fede6ddc700 1 --2- 172.21.15.60:0/147006104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01024e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009990 tx=0x7fedcc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.473+0000 7fede6ddc700 1 -- 172.21.15.60:0/147006104 shutdown_connections 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.473+0000 7fede6ddc700 1 --2- 172.21.15.60:0/147006104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0102a20 0x7fede0109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.473+0000 7fede6ddc700 1 --2- 172.21.15.60:0/147006104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0100e80 0x7fede01012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.473+0000 7fede6ddc700 1 --2- 172.21.15.60:0/147006104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01024e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- 172.21.15.60:0/147006104 >> 172.21.15.60:0/147006104 conn(0x7fede00fc420 msgr2=0x7fede00fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- 172.21.15.60:0/147006104 shutdown_connections 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- 172.21.15.60:0/147006104 wait complete. 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 Processor -- start 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- start start 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0100e80 0x7fede0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0102a20 0x7fede019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019e720 con 0x7fede0102060 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019e860 con 0x7fede0100e80 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede6ddc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019e9f0 con 0x7fede0102a20 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7feddffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7feddffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36454/0 (socket says 172.21.15.60:36454) 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7feddffff700 1 -- 172.21.15.60:0/991276600 learned_addr learned my addr 172.21.15.60:0/991276600 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.474+0000 7fede4b78700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0100e80 0x7fede0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fede5379700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0102a20 0x7fede019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7feddffff700 1 -- 172.21.15.60:0/991276600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0102a20 msgr2=0x7fede019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7feddffff700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0102a20 0x7fede019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7feddffff700 1 -- 172.21.15.60:0/991276600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0100e80 msgr2=0x7fede0196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7feddffff700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0100e80 0x7fede0196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7feddffff700 1 -- 172.21.15.60:0/991276600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0095f0 con 0x7fede0102060 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fede5379700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0102a20 0x7fede019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7feddffff700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01970e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0095c0 tx=0x7fedcc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc01d070 con 0x7fede0102060 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede019ec70 con 0x7fede0102060 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedcc004830 con 0x7fede0102060 2023-10-05T15:15:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc005420 con 0x7fede0102060 2023-10-05T15:15:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.475+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede019f040 con 0x7fede0102060 2023-10-05T15:15:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.476+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede010c740 con 0x7fede0102060 2023-10-05T15:15:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.477+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fedcc0049a0 con 0x7fede0102060 2023-10-05T15:15:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.478+0000 7fedddffb700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fedd00a1550 0x7fedd00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.478+0000 7fede4b78700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fedd00a1550 0x7fedd00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.478+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fedcc0ce730 con 0x7fede0102060 2023-10-05T15:15:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.478+0000 7fede4b78700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fedd00a1550 0x7fedd00a3a10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fede0101bd0 tx=0x7fedd400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:12.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.482+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fedcc097a70 con 0x7fede0102060 2023-10-05T15:15:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:12 smithi135 ceph-mon[103360]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:12 smithi135 ceph-mon[103360]: pgmap v271: 129 pgs: 129 active+clean; 601 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-10-05T15:15:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:12 smithi135 ceph-mon[103360]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:12 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3228687940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:15:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:12 smithi135 ceph-mon[103360]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-10-05T15:15:12.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:12 smithi060 ceph-mon[99238]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:12.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:12 smithi060 ceph-mon[99238]: pgmap v271: 129 pgs: 129 active+clean; 601 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-10-05T15:15:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:12 smithi060 ceph-mon[99238]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:12 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3228687940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:15:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:12 smithi060 ceph-mon[99238]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-10-05T15:15:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-mon[102944]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-mon[102944]: pgmap v271: 129 pgs: 129 active+clean; 601 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-10-05T15:15:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-mon[102944]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:15:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3228687940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:15:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-mon[102944]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-10-05T15:15:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.681+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fede00612f0 con 0x7fedd00a1550 2023-10-05T15:15:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.696+0000 7fedddffb700 1 -- 172.21.15.60:0/991276600 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+418524 (secure 0 0 0) 0x7fede00612f0 con 0x7fedd00a1550 2023-10-05T15:15:12.703 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fedd00a1550 msgr2=0x7fedd00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fedd00a1550 0x7fedd00a3a10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fede0101bd0 tx=0x7fedd400b410 comp rx=0 tx=0).stop 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 msgr2=0x7fede01970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01970e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0095c0 tx=0x7fedcc00f690 comp rx=0 tx=0).stop 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 shutdown_connections 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede0102a20 0x7fede019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0100e80 0x7fede0196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fedd00a1550 0x7fedd00a3a10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 --2- 172.21.15.60:0/991276600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fede0102060 0x7fede01970e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 >> 172.21.15.60:0/991276600 conn(0x7fede00fc420 msgr2=0x7fede00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 shutdown_connections 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.700+0000 7fede6ddc700 1 -- 172.21.15.60:0/991276600 wait complete. 2023-10-05T15:15:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:15:12.714 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2023-10-05T15:15:11.163966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615890,"num_objects":64,"num_object_clones":0,"num_object_copies":193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":142,"num_read_kb":144,"num_write":326,"num_write_kb":3001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":264,"ondisk_log_size":264,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337468,"kb_used_data":13260,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604356,"statfs":{"total":1151940427776,"available":1151594860544,"internally_reserved":0,"allocated":13578240,"data_stored":7419321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23112,"num_objects":40,"num_object_clones":0,"num_object_copies":121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6,"num_read_kb":25,"num_write":100,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003945"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234852+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:14:52.234852+0000","last_peered":"2023-10-05T15:14:52.234852+0000","last_clean":"2023-10-05T15:14:52.234852+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:14:52.234852+0000","last_undegraded":"2023-10-05T15:14:52.234852+0000","last_fullsized":"2023-10-05T15:14:52.234852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227415+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:14:52.227415+0000","last_peered":"2023-10-05T15:14:52.227415+0000","last_clean":"2023-10-05T15:14:52.227415+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:14:52.227415+0000","last_undegraded":"2023-10-05T15:14:52.227415+0000","last_fullsized":"2023-10-05T15:14:52.227415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226989+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:14:52.226989+0000","last_peered":"2023-10-05T15:14:52.226989+0000","last_clean":"2023-10-05T15:14:52.226989+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:14:52.226989+0000","last_undegraded":"2023-10-05T15:14:52.226989+0000","last_fullsized":"2023-10-05T15:14:52.226989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.236558+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:14:52.236558+0000","last_peered":"2023-10-05T15:14:52.236558+0000","last_clean":"2023-10-05T15:14:52.236558+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:14:52.236558+0000","last_undegraded":"2023-10-05T15:14:52.236558+0000","last_fullsized":"2023-10-05T15:14:52.236558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227102+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:14:52.227102+0000","last_peered":"2023-10-05T15:14:52.227102+0000","last_clean":"2023-10-05T15:14:52.227102+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:14:52.227102+0000","last_undegraded":"2023-10-05T15:14:52.227102+0000","last_fullsized":"2023-10-05T15:14:52.227102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.252486+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:14:52.252486+0000","last_peered":"2023-10-05T15:14:52.252486+0000","last_clean":"2023-10-05T15:14:52.252486+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:14:52.252486+0000","last_undegraded":"2023-10-05T15:14:52.252486+0000","last_fullsized":"2023-10-05T15:14:52.252486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233243+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:14:52.233243+0000","last_peered":"2023-10-05T15:14:52.233243+0000","last_clean":"2023-10-05T15:14:52.233243+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:14:52.233243+0000","last_undegraded":"2023-10-05T15:14:52.233243+0000","last_fullsized":"2023-10-05T15:14:52.233243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231544+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:14:52.231544+0000","last_peered":"2023-10-05T15:14:52.231544+0000","last_clean":"2023-10-05T15:14:52.231544+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:14:52.231544+0000","last_undegraded":"2023-10-05T15:14:52.231544+0000","last_fullsized":"2023-10-05T15:14:52.231544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233317+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:14:52.233317+0000","last_peered":"2023-10-05T15:14:52.233317+0000","last_clean":"2023-10-05T15:14:52.233317+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:14:52.233317+0000","last_undegraded":"2023-10-05T15:14:52.233317+0000","last_fullsized":"2023-10-05T15:14:52.233317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.253460+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:14:52.253460+0000","last_peered":"2023-10-05T15:14:52.253460+0000","last_clean":"2023-10-05T15:14:52.253460+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:14:52.253460+0000","last_undegraded":"2023-10-05T15:14:52.253460+0000","last_fullsized":"2023-10-05T15:14:52.253460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233328+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:14:52.233328+0000","last_peered":"2023-10-05T15:14:52.233328+0000","last_clean":"2023-10-05T15:14:52.233328+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:14:52.233328+0000","last_undegraded":"2023-10-05T15:14:52.233328+0000","last_fullsized":"2023-10-05T15:14:52.233328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.236505+0000","last_change":"2023-10-05T15:14:47.995939+0000","last_active":"2023-10-05T15:14:52.236505+0000","last_peered":"2023-10-05T15:14:52.236505+0000","last_clean":"2023-10-05T15:14:52.236505+0000","last_became_active":"2023-10-05T15:14:47.995606+0000","last_became_peered":"2023-10-05T15:14:47.995606+0000","last_unstale":"2023-10-05T15:14:52.236505+0000","last_undegraded":"2023-10-05T15:14:52.236505+0000","last_fullsized":"2023-10-05T15:14:52.236505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:19:46.741709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230578+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:14:52.230578+0000","last_peered":"2023-10-05T15:14:52.230578+0000","last_clean":"2023-10-05T15:14:52.230578+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:14:52.230578+0000","last_undegraded":"2023-10-05T15:14:52.230578+0000","last_fullsized":"2023-10-05T15:14:52.230578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226560+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:14:52.226560+0000","last_peered":"2023-10-05T15:14:52.226560+0000","last_clean":"2023-10-05T15:14:52.226560+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:14:52.226560+0000","last_undegraded":"2023-10-05T15:14:52.226560+0000","last_fullsized":"2023-10-05T15:14:52.226560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226537+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:14:52.226537+0000","last_peered":"2023-10-05T15:14:52.226537+0000","last_clean":"2023-10-05T15:14:52.226537+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:14:52.226537+0000","last_undegraded":"2023-10-05T15:14:52.226537+0000","last_fullsized":"2023-10-05T15:14:52.226537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232973+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:14:52.232973+0000","last_peered":"2023-10-05T15:14:52.232973+0000","last_clean":"2023-10-05T15:14:52.232973+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:14:52.232973+0000","last_undegraded":"2023-10-05T15:14:52.232973+0000","last_fullsized":"2023-10-05T15:14:52.232973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234762+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:14:52.234762+0000","last_peered":"2023-10-05T15:14:52.234762+0000","last_clean":"2023-10-05T15:14:52.234762+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:14:52.234762+0000","last_undegraded":"2023-10-05T15:14:52.234762+0000","last_fullsized":"2023-10-05T15:14:52.234762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.249098+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:14:52.249098+0000","last_peered":"2023-10-05T15:14:52.249098+0000","last_clean":"2023-10-05T15:14:52.249098+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:14:52.249098+0000","last_undegraded":"2023-10-05T15:14:52.249098+0000","last_fullsized":"2023-10-05T15:14:52.249098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232273+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:14:52.232273+0000","last_peered":"2023-10-05T15:14:52.232273+0000","last_clean":"2023-10-05T15:14:52.232273+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:14:52.232273+0000","last_undegraded":"2023-10-05T15:14:52.232273+0000","last_fullsized":"2023-10-05T15:14:52.232273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727181+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:14:53.727181+0000","last_peered":"2023-10-05T15:14:53.727181+0000","last_clean":"2023-10-05T15:14:53.727181+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:14:53.727181+0000","last_undegraded":"2023-10-05T15:14:53.727181+0000","last_fullsized":"2023-10-05T15:14:53.727181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.309498+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:15:08.309498+0000","last_peered":"2023-10-05T15:15:08.309498+0000","last_clean":"2023-10-05T15:15:08.309498+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:15:08.309498+0000","last_undegraded":"2023-10-05T15:15:08.309498+0000","last_fullsized":"2023-10-05T15:15:08.309498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232017+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:14:52.232017+0000","last_peered":"2023-10-05T15:14:52.232017+0000","last_clean":"2023-10-05T15:14:52.232017+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:14:52.232017+0000","last_undegraded":"2023-10-05T15:14:52.232017+0000","last_fullsized":"2023-10-05T15:14:52.232017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726715+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:14:53.726715+0000","last_peered":"2023-10-05T15:14:53.726715+0000","last_clean":"2023-10-05T15:14:53.726715+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:14:53.726715+0000","last_undegraded":"2023-10-05T15:14:53.726715+0000","last_fullsized":"2023-10-05T15:14:53.726715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.728220+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:14:53.728220+0000","last_peered":"2023-10-05T15:14:53.728220+0000","last_clean":"2023-10-05T15:14:53.728220+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:14:53.728220+0000","last_undegraded":"2023-10-05T15:14:53.728220+0000","last_fullsized":"2023-10-05T15:14:53.728220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227163+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:14:52.227163+0000","last_peered":"2023-10-05T15:14:52.227163+0000","last_clean":"2023-10-05T15:14:52.227163+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:14:52.227163+0000","last_undegraded":"2023-10-05T15:14:52.227163+0000","last_fullsized":"2023-10-05T15:14:52.227163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726853+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:14:53.726853+0000","last_peered":"2023-10-05T15:14:53.726853+0000","last_clean":"2023-10-05T15:14:53.726853+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:14:53.726853+0000","last_undegraded":"2023-10-05T15:14:53.726853+0000","last_fullsized":"2023-10-05T15:14:53.726853+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227419+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:14:52.227419+0000","last_peered":"2023-10-05T15:14:52.227419+0000","last_clean":"2023-10-05T15:14:52.227419+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:14:52.227419+0000","last_undegraded":"2023-10-05T15:14:52.227419+0000","last_fullsized":"2023-10-05T15:14:52.227419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233542+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:14:52.233542+0000","last_peered":"2023-10-05T15:14:52.233542+0000","last_clean":"2023-10-05T15:14:52.233542+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:14:52.233542+0000","last_undegraded":"2023-10-05T15:14:52.233542+0000","last_fullsized":"2023-10-05T15:14:52.233542+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726783+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:14:53.726783+0000","last_peered":"2023-10-05T15:14:53.726783+0000","last_clean":"2023-10-05T15:14:53.726783+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:14:53.726783+0000","last_undegraded":"2023-10-05T15:14:53.726783+0000","last_fullsized":"2023-10-05T15:14:53.726783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227648+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:14:52.227648+0000","last_peered":"2023-10-05T15:14:52.227648+0000","last_clean":"2023-10-05T15:14:52.227648+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:14:52.227648+0000","last_undegraded":"2023-10-05T15:14:52.227648+0000","last_fullsized":"2023-10-05T15:14:52.227648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232633+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:14:52.232633+0000","last_peered":"2023-10-05T15:14:52.232633+0000","last_clean":"2023-10-05T15:14:52.232633+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:14:52.232633+0000","last_undegraded":"2023-10-05T15:14:52.232633+0000","last_fullsized":"2023-10-05T15:14:52.232633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727098+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:14:53.727098+0000","last_peered":"2023-10-05T15:14:53.727098+0000","last_clean":"2023-10-05T15:14:53.727098+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:14:53.727098+0000","last_undegraded":"2023-10-05T15:14:53.727098+0000","last_fullsized":"2023-10-05T15:14:53.727098+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.300766+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:15:07.300766+0000","last_peered":"2023-10-05T15:15:07.300766+0000","last_clean":"2023-10-05T15:15:07.300766+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:15:07.300766+0000","last_undegraded":"2023-10-05T15:15:07.300766+0000","last_fullsized":"2023-10-05T15:15:07.300766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227629+0000","last_change":"2023-10-05T15:14:48.000773+0000","last_active":"2023-10-05T15:14:52.227629+0000","last_peered":"2023-10-05T15:14:52.227629+0000","last_clean":"2023-10-05T15:14:52.227629+0000","last_became_active":"2023-10-05T15:14:48.000501+0000","last_became_peered":"2023-10-05T15:14:48.000501+0000","last_unstale":"2023-10-05T15:14:52.227629+0000","last_undegraded":"2023-10-05T15:14:52.227629+0000","last_fullsized":"2023-10-05T15:14:52.227629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:11.631108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727144+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:14:53.727144+0000","last_peered":"2023-10-05T15:14:53.727144+0000","last_clean":"2023-10-05T15:14:53.727144+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:14:53.727144+0000","last_undegraded":"2023-10-05T15:14:53.727144+0000","last_fullsized":"2023-10-05T15:14:53.727144+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:09.320478+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:09.320478+0000","last_peered":"2023-10-05T15:15:09.320478+0000","last_clean":"2023-10-05T15:15:09.320478+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:09.320478+0000","last_undegraded":"2023-10-05T15:15:09.320478+0000","last_fullsized":"2023-10-05T15:15:09.320478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232559+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:14:52.232559+0000","last_peered":"2023-10-05T15:14:52.232559+0000","last_clean":"2023-10-05T15:14:52.232559+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:14:52.232559+0000","last_undegraded":"2023-10-05T15:14:52.232559+0000","last_fullsized":"2023-10-05T15:14:52.232559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243807+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:14:53.243807+0000","last_peered":"2023-10-05T15:14:53.243807+0000","last_clean":"2023-10-05T15:14:53.243807+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:14:53.243807+0000","last_undegraded":"2023-10-05T15:14:53.243807+0000","last_fullsized":"2023-10-05T15:14:53.243807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.309584+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:08.309584+0000","last_peered":"2023-10-05T15:15:08.309584+0000","last_clean":"2023-10-05T15:15:08.309584+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:08.309584+0000","last_undegraded":"2023-10-05T15:15:08.309584+0000","last_fullsized":"2023-10-05T15:15:08.309584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231454+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:14:52.231454+0000","last_peered":"2023-10-05T15:14:52.231454+0000","last_clean":"2023-10-05T15:14:52.231454+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:14:52.231454+0000","last_undegraded":"2023-10-05T15:14:52.231454+0000","last_fullsized":"2023-10-05T15:14:52.231454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727429+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:14:53.727429+0000","last_peered":"2023-10-05T15:14:53.727429+0000","last_clean":"2023-10-05T15:14:53.727429+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:14:53.727429+0000","last_undegraded":"2023-10-05T15:14:53.727429+0000","last_fullsized":"2023-10-05T15:14:53.727429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.266551+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:14:53.266551+0000","last_peered":"2023-10-05T15:14:53.266551+0000","last_clean":"2023-10-05T15:14:53.266551+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:14:53.266551+0000","last_undegraded":"2023-10-05T15:14:53.266551+0000","last_fullsized":"2023-10-05T15:14:53.266551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.249162+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:14:52.249162+0000","last_peered":"2023-10-05T15:14:52.249162+0000","last_clean":"2023-10-05T15:14:52.249162+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:14:52.249162+0000","last_undegraded":"2023-10-05T15:14:52.249162+0000","last_fullsized":"2023-10-05T15:14:52.249162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726890+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:14:53.726890+0000","last_peered":"2023-10-05T15:14:53.726890+0000","last_clean":"2023-10-05T15:14:53.726890+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:14:53.726890+0000","last_undegraded":"2023-10-05T15:14:53.726890+0000","last_fullsized":"2023-10-05T15:14:53.726890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:11.034461+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:15:11.034461+0000","last_peered":"2023-10-05T15:15:11.034461+0000","last_clean":"2023-10-05T15:15:11.034461+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:15:11.034461+0000","last_undegraded":"2023-10-05T15:15:11.034461+0000","last_fullsized":"2023-10-05T15:15:11.034461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233565+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:14:52.233565+0000","last_peered":"2023-10-05T15:14:52.233565+0000","last_clean":"2023-10-05T15:14:52.233565+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:14:52.233565+0000","last_undegraded":"2023-10-05T15:14:52.233565+0000","last_fullsized":"2023-10-05T15:14:52.233565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243293+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:14:53.243293+0000","last_peered":"2023-10-05T15:14:53.243293+0000","last_clean":"2023-10-05T15:14:53.243293+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:14:53.243293+0000","last_undegraded":"2023-10-05T15:14:53.243293+0000","last_fullsized":"2023-10-05T15:14:53.243293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:10.330782+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:10.330782+0000","last_peered":"2023-10-05T15:15:10.330782+0000","last_clean":"2023-10-05T15:15:10.330782+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:10.330782+0000","last_undegraded":"2023-10-05T15:15:10.330782+0000","last_fullsized":"2023-10-05T15:15:10.330782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227049+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:14:52.227049+0000","last_peered":"2023-10-05T15:14:52.227049+0000","last_clean":"2023-10-05T15:14:52.227049+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:14:52.227049+0000","last_undegraded":"2023-10-05T15:14:52.227049+0000","last_fullsized":"2023-10-05T15:14:52.227049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727014+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:14:53.727014+0000","last_peered":"2023-10-05T15:14:53.727014+0000","last_clean":"2023-10-05T15:14:53.727014+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:14:53.727014+0000","last_undegraded":"2023-10-05T15:14:53.727014+0000","last_fullsized":"2023-10-05T15:14:53.727014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.267038+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:14:53.267038+0000","last_peered":"2023-10-05T15:14:53.267038+0000","last_clean":"2023-10-05T15:14:53.267038+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:14:53.267038+0000","last_undegraded":"2023-10-05T15:14:53.267038+0000","last_fullsized":"2023-10-05T15:14:53.267038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233649+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:14:52.233649+0000","last_peered":"2023-10-05T15:14:52.233649+0000","last_clean":"2023-10-05T15:14:52.233649+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:14:52.233649+0000","last_undegraded":"2023-10-05T15:14:52.233649+0000","last_fullsized":"2023-10-05T15:14:52.233649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243963+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:14:53.243963+0000","last_peered":"2023-10-05T15:14:53.243963+0000","last_clean":"2023-10-05T15:14:53.243963+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:14:53.243963+0000","last_undegraded":"2023-10-05T15:14:53.243963+0000","last_fullsized":"2023-10-05T15:14:53.243963+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'20","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:11.037348+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:15:11.037348+0000","last_peered":"2023-10-05T15:15:11.037348+0000","last_clean":"2023-10-05T15:15:11.037348+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:15:11.037348+0000","last_undegraded":"2023-10-05T15:15:11.037348+0000","last_fullsized":"2023-10-05T15:15:11.037348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21223,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":22,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227184+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:14:52.227184+0000","last_peered":"2023-10-05T15:14:52.227184+0000","last_clean":"2023-10-05T15:14:52.227184+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:14:52.227184+0000","last_undegraded":"2023-10-05T15:14:52.227184+0000","last_fullsized":"2023-10-05T15:14:52.227184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.267516+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:14:53.267516+0000","last_peered":"2023-10-05T15:14:53.267516+0000","last_clean":"2023-10-05T15:14:53.267516+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:14:53.267516+0000","last_undegraded":"2023-10-05T15:14:53.267516+0000","last_fullsized":"2023-10-05T15:14:53.267516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.308258+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:08.308258+0000","last_peered":"2023-10-05T15:15:08.308258+0000","last_clean":"2023-10-05T15:15:08.308258+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:08.308258+0000","last_undegraded":"2023-10-05T15:15:08.308258+0000","last_fullsized":"2023-10-05T15:15:08.308258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230121+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:14:52.230121+0000","last_peered":"2023-10-05T15:14:52.230121+0000","last_clean":"2023-10-05T15:14:52.230121+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:14:52.230121+0000","last_undegraded":"2023-10-05T15:14:52.230121+0000","last_fullsized":"2023-10-05T15:14:52.230121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243457+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:14:53.243457+0000","last_peered":"2023-10-05T15:14:53.243457+0000","last_clean":"2023-10-05T15:14:53.243457+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:14:53.243457+0000","last_undegraded":"2023-10-05T15:14:53.243457+0000","last_fullsized":"2023-10-05T15:14:53.243457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.301165+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:07.301165+0000","last_peered":"2023-10-05T15:15:07.301165+0000","last_clean":"2023-10-05T15:15:07.301165+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:07.301165+0000","last_undegraded":"2023-10-05T15:15:07.301165+0000","last_fullsized":"2023-10-05T15:15:07.301165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233449+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:14:52.233449+0000","last_peered":"2023-10-05T15:14:52.233449+0000","last_clean":"2023-10-05T15:14:52.233449+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:14:52.233449+0000","last_undegraded":"2023-10-05T15:14:52.233449+0000","last_fullsized":"2023-10-05T15:14:52.233449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.244050+0000","last_change":"2023-10-05T15:14:52.246864+0000","last_active":"2023-10-05T15:14:53.244050+0000","last_peered":"2023-10-05T15:14:53.244050+0000","last_clean":"2023-10-05T15:14:53.244050+0000","last_became_active":"2023-10-05T15:14:52.246451+0000","last_became_peered":"2023-10-05T15:14:52.246451+0000","last_unstale":"2023-10-05T15:14:53.244050+0000","last_undegraded":"2023-10-05T15:14:53.244050+0000","last_fullsized":"2023-10-05T15:14:53.244050+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:32:47.081258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.235218+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:14:52.235218+0000","last_peered":"2023-10-05T15:14:52.235218+0000","last_clean":"2023-10-05T15:14:52.235218+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:14:52.235218+0000","last_undegraded":"2023-10-05T15:14:52.235218+0000","last_fullsized":"2023-10-05T15:14:52.235218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233086+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:14:52.233086+0000","last_peered":"2023-10-05T15:14:52.233086+0000","last_clean":"2023-10-05T15:14:52.233086+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:14:52.233086+0000","last_undegraded":"2023-10-05T15:14:52.233086+0000","last_fullsized":"2023-10-05T15:14:52.233086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727374+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:14:53.727374+0000","last_peered":"2023-10-05T15:14:53.727374+0000","last_clean":"2023-10-05T15:14:53.727374+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:14:53.727374+0000","last_undegraded":"2023-10-05T15:14:53.727374+0000","last_fullsized":"2023-10-05T15:14:53.727374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227009+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:14:52.227009+0000","last_peered":"2023-10-05T15:14:52.227009+0000","last_clean":"2023-10-05T15:14:52.227009+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:14:52.227009+0000","last_undegraded":"2023-10-05T15:14:52.227009+0000","last_fullsized":"2023-10-05T15:14:52.227009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231659+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:14:52.231659+0000","last_peered":"2023-10-05T15:14:52.231659+0000","last_clean":"2023-10-05T15:14:52.231659+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:14:52.231659+0000","last_undegraded":"2023-10-05T15:14:52.231659+0000","last_fullsized":"2023-10-05T15:14:52.231659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.266750+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:14:53.266750+0000","last_peered":"2023-10-05T15:14:53.266750+0000","last_clean":"2023-10-05T15:14:53.266750+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:14:53.266750+0000","last_undegraded":"2023-10-05T15:14:53.266750+0000","last_fullsized":"2023-10-05T15:14:53.266750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227477+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:14:52.227477+0000","last_peered":"2023-10-05T15:14:52.227477+0000","last_clean":"2023-10-05T15:14:52.227477+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:14:52.227477+0000","last_undegraded":"2023-10-05T15:14:52.227477+0000","last_fullsized":"2023-10-05T15:14:52.227477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233210+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:14:52.233210+0000","last_peered":"2023-10-05T15:14:52.233210+0000","last_clean":"2023-10-05T15:14:52.233210+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:14:52.233210+0000","last_undegraded":"2023-10-05T15:14:52.233210+0000","last_fullsized":"2023-10-05T15:14:52.233210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727019+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:14:53.727019+0000","last_peered":"2023-10-05T15:14:53.727019+0000","last_clean":"2023-10-05T15:14:53.727019+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:14:53.727019+0000","last_undegraded":"2023-10-05T15:14:53.727019+0000","last_fullsized":"2023-10-05T15:14:53.727019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.248603+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:14:52.248603+0000","last_peered":"2023-10-05T15:14:52.248603+0000","last_clean":"2023-10-05T15:14:52.248603+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:14:52.248603+0000","last_undegraded":"2023-10-05T15:14:52.248603+0000","last_fullsized":"2023-10-05T15:14:52.248603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.252884+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:14:52.252884+0000","last_peered":"2023-10-05T15:14:52.252884+0000","last_clean":"2023-10-05T15:14:52.252884+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:14:52.252884+0000","last_undegraded":"2023-10-05T15:14:52.252884+0000","last_fullsized":"2023-10-05T15:14:52.252884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.728637+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:14:53.728637+0000","last_peered":"2023-10-05T15:14:53.728637+0000","last_clean":"2023-10-05T15:14:53.728637+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:14:53.728637+0000","last_undegraded":"2023-10-05T15:14:53.728637+0000","last_fullsized":"2023-10-05T15:14:53.728637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:10.329981+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:15:10.329981+0000","last_peered":"2023-10-05T15:15:10.329981+0000","last_clean":"2023-10-05T15:15:10.329981+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:15:10.329981+0000","last_undegraded":"2023-10-05T15:15:10.329981+0000","last_fullsized":"2023-10-05T15:15:10.329981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.252490+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:14:52.252490+0000","last_peered":"2023-10-05T15:14:52.252490+0000","last_clean":"2023-10-05T15:14:52.252490+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:14:52.252490+0000","last_undegraded":"2023-10-05T15:14:52.252490+0000","last_fullsized":"2023-10-05T15:14:52.252490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727656+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:14:53.727656+0000","last_peered":"2023-10-05T15:14:53.727656+0000","last_clean":"2023-10-05T15:14:53.727656+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:14:53.727656+0000","last_undegraded":"2023-10-05T15:14:53.727656+0000","last_fullsized":"2023-10-05T15:14:53.727656+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232242+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:14:52.232242+0000","last_peered":"2023-10-05T15:14:52.232242+0000","last_clean":"2023-10-05T15:14:52.232242+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:14:52.232242+0000","last_undegraded":"2023-10-05T15:14:52.232242+0000","last_fullsized":"2023-10-05T15:14:52.232242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.309932+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:15:08.309932+0000","last_peered":"2023-10-05T15:15:08.309932+0000","last_clean":"2023-10-05T15:15:08.309932+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:15:08.309932+0000","last_undegraded":"2023-10-05T15:15:08.309932+0000","last_fullsized":"2023-10-05T15:15:08.309932+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:55.980184+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:14:55.980184+0000","last_peered":"2023-10-05T15:14:55.980184+0000","last_clean":"2023-10-05T15:14:55.980184+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:14:55.980184+0000","last_undegraded":"2023-10-05T15:14:55.980184+0000","last_fullsized":"2023-10-05T15:14:55.980184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.235734+0000","last_change":"2023-10-05T15:14:48.011045+0000","last_active":"2023-10-05T15:14:52.235734+0000","last_peered":"2023-10-05T15:14:52.235734+0000","last_clean":"2023-10-05T15:14:52.235734+0000","last_became_active":"2023-10-05T15:14:48.010701+0000","last_became_peered":"2023-10-05T15:14:48.010701+0000","last_unstale":"2023-10-05T15:14:52.235734+0000","last_undegraded":"2023-10-05T15:14:52.235734+0000","last_fullsized":"2023-10-05T15:14:52.235734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.641985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.301128+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:07.301128+0000","last_peered":"2023-10-05T15:15:07.301128+0000","last_clean":"2023-10-05T15:15:07.301128+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:07.301128+0000","last_undegraded":"2023-10-05T15:15:07.301128+0000","last_fullsized":"2023-10-05T15:15:07.301128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232933+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:14:52.232933+0000","last_peered":"2023-10-05T15:14:52.232933+0000","last_clean":"2023-10-05T15:14:52.232933+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:14:52.232933+0000","last_undegraded":"2023-10-05T15:14:52.232933+0000","last_fullsized":"2023-10-05T15:14:52.232933+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.267268+0000","last_change":"2023-10-05T15:14:52.255126+0000","last_active":"2023-10-05T15:14:53.267268+0000","last_peered":"2023-10-05T15:14:53.267268+0000","last_clean":"2023-10-05T15:14:53.267268+0000","last_became_active":"2023-10-05T15:14:52.254544+0000","last_became_peered":"2023-10-05T15:14:52.254544+0000","last_unstale":"2023-10-05T15:14:53.267268+0000","last_undegraded":"2023-10-05T15:14:53.267268+0000","last_fullsized":"2023-10-05T15:14:53.267268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:22:56.856370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.229457+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:14:52.229457+0000","last_peered":"2023-10-05T15:14:52.229457+0000","last_clean":"2023-10-05T15:14:52.229457+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:14:52.229457+0000","last_undegraded":"2023-10-05T15:14:52.229457+0000","last_fullsized":"2023-10-05T15:14:52.229457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.305069+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:08.305069+0000","last_peered":"2023-10-05T15:15:08.305069+0000","last_clean":"2023-10-05T15:15:08.305069+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:08.305069+0000","last_undegraded":"2023-10-05T15:15:08.305069+0000","last_fullsized":"2023-10-05T15:15:08.305069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243461+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:14:53.243461+0000","last_peered":"2023-10-05T15:14:53.243461+0000","last_clean":"2023-10-05T15:14:53.243461+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:14:53.243461+0000","last_undegraded":"2023-10-05T15:14:53.243461+0000","last_fullsized":"2023-10-05T15:14:53.243461+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227564+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:14:52.227564+0000","last_peered":"2023-10-05T15:14:52.227564+0000","last_clean":"2023-10-05T15:14:52.227564+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:14:52.227564+0000","last_undegraded":"2023-10-05T15:14:52.227564+0000","last_fullsized":"2023-10-05T15:14:52.227564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230694+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:14:52.230694+0000","last_peered":"2023-10-05T15:14:52.230694+0000","last_clean":"2023-10-05T15:14:52.230694+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:14:52.230694+0000","last_undegraded":"2023-10-05T15:14:52.230694+0000","last_fullsized":"2023-10-05T15:14:52.230694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727634+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:14:53.727634+0000","last_peered":"2023-10-05T15:14:53.727634+0000","last_clean":"2023-10-05T15:14:53.727634+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:14:53.727634+0000","last_undegraded":"2023-10-05T15:14:53.727634+0000","last_fullsized":"2023-10-05T15:14:53.727634+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.306485+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:15:08.306485+0000","last_peered":"2023-10-05T15:15:08.306485+0000","last_clean":"2023-10-05T15:15:08.306485+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:15:08.306485+0000","last_undegraded":"2023-10-05T15:15:08.306485+0000","last_fullsized":"2023-10-05T15:15:08.306485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231569+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:14:52.231569+0000","last_peered":"2023-10-05T15:14:52.231569+0000","last_clean":"2023-10-05T15:14:52.231569+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:14:52.231569+0000","last_undegraded":"2023-10-05T15:14:52.231569+0000","last_fullsized":"2023-10-05T15:14:52.231569+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726678+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:14:53.726678+0000","last_peered":"2023-10-05T15:14:53.726678+0000","last_clean":"2023-10-05T15:14:53.726678+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:14:53.726678+0000","last_undegraded":"2023-10-05T15:14:53.726678+0000","last_fullsized":"2023-10-05T15:14:53.726678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.300849+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:07.300849+0000","last_peered":"2023-10-05T15:15:07.300849+0000","last_clean":"2023-10-05T15:15:07.300849+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:07.300849+0000","last_undegraded":"2023-10-05T15:15:07.300849+0000","last_fullsized":"2023-10-05T15:15:07.300849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227316+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:14:52.227316+0000","last_peered":"2023-10-05T15:14:52.227316+0000","last_clean":"2023-10-05T15:14:52.227316+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:14:52.227316+0000","last_undegraded":"2023-10-05T15:14:52.227316+0000","last_fullsized":"2023-10-05T15:14:52.227316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727213+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:14:53.727213+0000","last_peered":"2023-10-05T15:14:53.727213+0000","last_clean":"2023-10-05T15:14:53.727213+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:14:53.727213+0000","last_undegraded":"2023-10-05T15:14:53.727213+0000","last_fullsized":"2023-10-05T15:14:53.727213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.300391+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:07.300391+0000","last_peered":"2023-10-05T15:15:07.300391+0000","last_clean":"2023-10-05T15:15:07.300391+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:07.300391+0000","last_undegraded":"2023-10-05T15:15:07.300391+0000","last_fullsized":"2023-10-05T15:15:07.300391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227008+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:14:52.227008+0000","last_peered":"2023-10-05T15:14:52.227008+0000","last_clean":"2023-10-05T15:14:52.227008+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:14:52.227008+0000","last_undegraded":"2023-10-05T15:14:52.227008+0000","last_fullsized":"2023-10-05T15:14:52.227008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.244244+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:14:53.244244+0000","last_peered":"2023-10-05T15:14:53.244244+0000","last_clean":"2023-10-05T15:14:53.244244+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:14:53.244244+0000","last_undegraded":"2023-10-05T15:14:53.244244+0000","last_fullsized":"2023-10-05T15:14:53.244244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:09.320661+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:09.320661+0000","last_peered":"2023-10-05T15:15:09.320661+0000","last_clean":"2023-10-05T15:15:09.320661+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:09.320661+0000","last_undegraded":"2023-10-05T15:15:09.320661+0000","last_fullsized":"2023-10-05T15:15:09.320661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232767+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:14:52.232767+0000","last_peered":"2023-10-05T15:14:52.232767+0000","last_clean":"2023-10-05T15:14:52.232767+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:14:52.232767+0000","last_undegraded":"2023-10-05T15:14:52.232767+0000","last_fullsized":"2023-10-05T15:14:52.232767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727131+0000","last_change":"2023-10-05T15:14:52.252385+0000","last_active":"2023-10-05T15:14:53.727131+0000","last_peered":"2023-10-05T15:14:53.727131+0000","last_clean":"2023-10-05T15:14:53.727131+0000","last_became_active":"2023-10-05T15:14:52.251957+0000","last_became_peered":"2023-10-05T15:14:52.251957+0000","last_unstale":"2023-10-05T15:14:53.727131+0000","last_undegraded":"2023-10-05T15:14:53.727131+0000","last_fullsized":"2023-10-05T15:14:53.727131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:16.265244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727510+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:14:53.727510+0000","last_peered":"2023-10-05T15:14:53.727510+0000","last_clean":"2023-10-05T15:14:53.727510+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:14:53.727510+0000","last_undegraded":"2023-10-05T15:14:53.727510+0000","last_fullsized":"2023-10-05T15:14:53.727510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231006+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:14:52.231006+0000","last_peered":"2023-10-05T15:14:52.231006+0000","last_clean":"2023-10-05T15:14:52.231006+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:14:52.231006+0000","last_undegraded":"2023-10-05T15:14:52.231006+0000","last_fullsized":"2023-10-05T15:14:52.231006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727157+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:14:53.727157+0000","last_peered":"2023-10-05T15:14:53.727157+0000","last_clean":"2023-10-05T15:14:53.727157+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:14:53.727157+0000","last_undegraded":"2023-10-05T15:14:53.727157+0000","last_fullsized":"2023-10-05T15:14:53.727157+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227135+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:14:52.227135+0000","last_peered":"2023-10-05T15:14:52.227135+0000","last_clean":"2023-10-05T15:14:52.227135+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:14:52.227135+0000","last_undegraded":"2023-10-05T15:14:52.227135+0000","last_fullsized":"2023-10-05T15:14:52.227135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232829+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:14:52.232829+0000","last_peered":"2023-10-05T15:14:52.232829+0000","last_clean":"2023-10-05T15:14:52.232829+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:14:52.232829+0000","last_undegraded":"2023-10-05T15:14:52.232829+0000","last_fullsized":"2023-10-05T15:14:52.232829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.472925+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:14:53.472925+0000","last_peered":"2023-10-05T15:14:53.472925+0000","last_clean":"2023-10-05T15:14:53.472925+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:14:53.472925+0000","last_undegraded":"2023-10-05T15:14:53.472925+0000","last_fullsized":"2023-10-05T15:14:53.472925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:09.320796+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:15:09.320796+0000","last_peered":"2023-10-05T15:15:09.320796+0000","last_clean":"2023-10-05T15:15:09.320796+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:15:09.320796+0000","last_undegraded":"2023-10-05T15:15:09.320796+0000","last_fullsized":"2023-10-05T15:15:09.320796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233421+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:14:52.233421+0000","last_peered":"2023-10-05T15:14:52.233421+0000","last_clean":"2023-10-05T15:14:52.233421+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:14:52.233421+0000","last_undegraded":"2023-10-05T15:14:52.233421+0000","last_fullsized":"2023-10-05T15:14:52.233421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727015+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:14:53.727015+0000","last_peered":"2023-10-05T15:14:53.727015+0000","last_clean":"2023-10-05T15:14:53.727015+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:14:53.727015+0000","last_undegraded":"2023-10-05T15:14:53.727015+0000","last_fullsized":"2023-10-05T15:14:53.727015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232736+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:14:52.232736+0000","last_peered":"2023-10-05T15:14:52.232736+0000","last_clean":"2023-10-05T15:14:52.232736+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:14:52.232736+0000","last_undegraded":"2023-10-05T15:14:52.232736+0000","last_fullsized":"2023-10-05T15:14:52.232736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233861+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:14:52.233861+0000","last_peered":"2023-10-05T15:14:52.233861+0000","last_clean":"2023-10-05T15:14:52.233861+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:14:52.233861+0000","last_undegraded":"2023-10-05T15:14:52.233861+0000","last_fullsized":"2023-10-05T15:14:52.233861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.266520+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:14:53.266520+0000","last_peered":"2023-10-05T15:14:53.266520+0000","last_clean":"2023-10-05T15:14:53.266520+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:14:53.266520+0000","last_undegraded":"2023-10-05T15:14:53.266520+0000","last_fullsized":"2023-10-05T15:14:53.266520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:10.328935+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:10.328935+0000","last_peered":"2023-10-05T15:15:10.328935+0000","last_clean":"2023-10-05T15:15:10.328935+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:10.328935+0000","last_undegraded":"2023-10-05T15:15:10.328935+0000","last_fullsized":"2023-10-05T15:15:10.328935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234585+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:14:52.234585+0000","last_peered":"2023-10-05T15:14:52.234585+0000","last_clean":"2023-10-05T15:14:52.234585+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:14:52.234585+0000","last_undegraded":"2023-10-05T15:14:52.234585+0000","last_fullsized":"2023-10-05T15:14:52.234585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232862+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:14:52.232862+0000","last_peered":"2023-10-05T15:14:52.232862+0000","last_clean":"2023-10-05T15:14:52.232862+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:14:52.232862+0000","last_undegraded":"2023-10-05T15:14:52.232862+0000","last_fullsized":"2023-10-05T15:14:52.232862+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232327+0000","last_change":"2023-10-05T15:14:48.002891+0000","last_active":"2023-10-05T15:14:52.232327+0000","last_peered":"2023-10-05T15:14:52.232327+0000","last_clean":"2023-10-05T15:14:52.232327+0000","last_became_active":"2023-10-05T15:14:48.002592+0000","last_became_peered":"2023-10-05T15:14:48.002592+0000","last_unstale":"2023-10-05T15:14:52.232327+0000","last_undegraded":"2023-10-05T15:14:52.232327+0000","last_fullsized":"2023-10-05T15:14:52.232327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:28:34.775538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230923+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:14:52.230923+0000","last_peered":"2023-10-05T15:14:52.230923+0000","last_clean":"2023-10-05T15:14:52.230923+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:14:52.230923+0000","last_undegraded":"2023-10-05T15:14:52.230923+0000","last_fullsized":"2023-10-05T15:14:52.230923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226954+0000","last_change":"2023-10-05T15:14:48.007464+0000","last_active":"2023-10-05T15:14:52.226954+0000","last_peered":"2023-10-05T15:14:52.226954+0000","last_clean":"2023-10-05T15:14:52.226954+0000","last_became_active":"2023-10-05T15:14:48.007163+0000","last_became_peered":"2023-10-05T15:14:48.007163+0000","last_unstale":"2023-10-05T15:14:52.226954+0000","last_undegraded":"2023-10-05T15:14:52.226954+0000","last_fullsized":"2023-10-05T15:14:52.226954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:47:39.644587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230792+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:14:52.230792+0000","last_peered":"2023-10-05T15:14:52.230792+0000","last_clean":"2023-10-05T15:14:52.230792+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:14:52.230792+0000","last_undegraded":"2023-10-05T15:14:52.230792+0000","last_fullsized":"2023-10-05T15:14:52.230792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233094+0000","last_change":"2023-10-05T15:14:48.007576+0000","last_active":"2023-10-05T15:14:52.233094+0000","last_peered":"2023-10-05T15:14:52.233094+0000","last_clean":"2023-10-05T15:14:52.233094+0000","last_became_active":"2023-10-05T15:14:48.007229+0000","last_became_peered":"2023-10-05T15:14:48.007229+0000","last_unstale":"2023-10-05T15:14:52.233094+0000","last_undegraded":"2023-10-05T15:14:52.233094+0000","last_fullsized":"2023-10-05T15:14:52.233094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:28:12.377440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232292+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:14:52.232292+0000","last_peered":"2023-10-05T15:14:52.232292+0000","last_clean":"2023-10-05T15:14:52.232292+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:14:52.232292+0000","last_undegraded":"2023-10-05T15:14:52.232292+0000","last_fullsized":"2023-10-05T15:14:52.232292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231663+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:14:52.231663+0000","last_peered":"2023-10-05T15:14:52.231663+0000","last_clean":"2023-10-05T15:14:52.231663+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:14:52.231663+0000","last_undegraded":"2023-10-05T15:14:52.231663+0000","last_fullsized":"2023-10-05T15:14:52.231663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231987+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:14:52.231987+0000","last_peered":"2023-10-05T15:14:52.231987+0000","last_clean":"2023-10-05T15:14:52.231987+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:14:52.231987+0000","last_undegraded":"2023-10-05T15:14:52.231987+0000","last_fullsized":"2023-10-05T15:14:52.231987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230662+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:14:52.230662+0000","last_peered":"2023-10-05T15:14:52.230662+0000","last_clean":"2023-10-05T15:14:52.230662+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:14:52.230662+0000","last_undegraded":"2023-10-05T15:14:52.230662+0000","last_fullsized":"2023-10-05T15:14:52.230662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234010+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:14:52.234010+0000","last_peered":"2023-10-05T15:14:52.234010+0000","last_clean":"2023-10-05T15:14:52.234010+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:14:52.234010+0000","last_undegraded":"2023-10-05T15:14:52.234010+0000","last_fullsized":"2023-10-05T15:14:52.234010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230481+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:14:52.230481+0000","last_peered":"2023-10-05T15:14:52.230481+0000","last_clean":"2023-10-05T15:14:52.230481+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:14:52.230481+0000","last_undegraded":"2023-10-05T15:14:52.230481+0000","last_fullsized":"2023-10-05T15:14:52.230481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232456+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:14:52.232456+0000","last_peered":"2023-10-05T15:14:52.232456+0000","last_clean":"2023-10-05T15:14:52.232456+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:14:52.232456+0000","last_undegraded":"2023-10-05T15:14:52.232456+0000","last_fullsized":"2023-10-05T15:14:52.232456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25399,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":6,"num_read_kb":25,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":42451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":467123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1080509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.621}]},{"osd":3,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.35699999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54500000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.75900000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":467941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.317}]},{"osd":4,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.433},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.498},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.38100000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.55300000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":467727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.629},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.443,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.496}]},{"osd":4,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.69499999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.0170000000000003,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.78600000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.92400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299424,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1065509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66500000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72499999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.54700000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84099999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45700000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54100000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64800000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":467235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.51700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.23,"15min":1.23},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.625},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.436,"15min":0.436},"max":{"1min":0.96599999999999997,"5min":1.147,"15min":1.147},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.52600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.627}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84999999999999998,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79500000000000004,"15min":0.81699999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":1.181,"15min":1.181},"last":0.72299999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.45200000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":470692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.496,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81299999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91600000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.55600000000000005,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"min":{"1min":0.52700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89300000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.504}]},{"osd":5,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59899999999999998,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95399999999999996,"5min":0.995,"15min":0.995},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84299999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64000000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95899999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.876,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.69199999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.78200000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":466940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.57699999999999996,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.29,"5min":6.29,"15min":6.29},"last":0.872},{"interface":"front","average":{"1min":0.625,"5min":0.55600000000000005,"15min":0.52300000000000002},"min":{"1min":0.42099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55200000000000005,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.52300000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.86699999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40500000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.622},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.30299999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.117,"15min":1.117},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.88800000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.89000000000000001,"15min":0.86099999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":6.3150000000000004,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.70799999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":472937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":1.623,"15min":1.623},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.753,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.503},"min":{"1min":0.47499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Oct 5 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.75700000000000001,"5min":1.639,"15min":1.639},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Oct 5 15:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77100000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.873},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.32400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":1.046},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.0640000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.83699999999999997}]},{"osd":9,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":1.018},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":1.004}]},{"osd":10,"last update":"Thu Oct 5 15:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":1.089}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":467200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.375,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.40400000000000003,"15min":0.39000000000000001},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.57099999999999995,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.44700000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Oct 5 15:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.61799999999999999,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.63},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.623}]},{"osd":5,"last update":"Thu Oct 5 15:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63800000000000001,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":1.149,"15min":1.149},"last":0.502},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.442},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53600000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.46899999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.52400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888109,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":466872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.35299999999999998},"min":{"1min":0.27400000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.375},"min":{"1min":0.29999999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.312,"15min":0.312},"max":{"1min":0.77700000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69499999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.76100000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1058636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58099999999999996,"15min":0.55500000000000005},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42699999999999999,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.434,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:14:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.44800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.753}]},{"osd":7,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.74099999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.443},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69099999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:14:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67700000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":23349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:15:12.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:15:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 -- 172.21.15.60:0/2029185107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740ffe10 msgr2=0x7f4a74100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 --2- 172.21.15.60:0/2029185107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740ffe10 0x7f4a74100230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009990 tx=0x7f4a64009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 -- 172.21.15.60:0/2029185107 shutdown_connections 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 --2- 172.21.15.60:0/2029185107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a74101920 0x7f4a74108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 --2- 172.21.15.60:0/2029185107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740ffe10 0x7f4a74100230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 --2- 172.21.15.60:0/2029185107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a74100f60 0x7f4a741013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 -- 172.21.15.60:0/2029185107 >> 172.21.15.60:0/2029185107 conn(0x7f4a740fb380 msgr2=0x7f4a740fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 -- 172.21.15.60:0/2029185107 shutdown_connections 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.879+0000 7f4a79721700 1 -- 172.21.15.60:0/2029185107 wait complete. 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 Processor -- start 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 -- start start 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a740ffe10 0x7f4a74069e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a74100f60 0x7f4a7419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 0x7f4a7419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7419e760 con 0x7f4a74101920 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7419e8d0 con 0x7f4a740ffe10 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.880+0000 7f4a79721700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7419ea90 con 0x7f4a74100f60 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 0x7f4a7419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a740ffe10 0x7f4a74069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 0x7f4a7419df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36470/0 (socket says 172.21.15.60:36470) 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a740ffe10 0x7f4a74069e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:49888/0 (socket says 172.21.15.60:49888) 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 -- 172.21.15.60:0/502550132 learned_addr learned my addr 172.21.15.60:0/502550132 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a727fc700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a74100f60 0x7f4a7419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 -- 172.21.15.60:0/502550132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a74100f60 msgr2=0x7f4a7419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a74100f60 0x7f4a7419b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 -- 172.21.15.60:0/502550132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a740ffe10 msgr2=0x7f4a74069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a740ffe10 0x7f4a74069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 -- 172.21.15.60:0/502550132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640095f0 con 0x7f4a74101920 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a737fe700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 0x7f4a7419df90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b970 tx=0x7f4a6c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00c930 con 0x7f4a74101920 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6c014440 con 0x7f4a74101920 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7419ed70 con 0x7f4a74101920 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0075d0 con 0x7f4a74101920 2023-10-05T15:15:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.881+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7419f250 con 0x7f4a74101920 2023-10-05T15:15:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.882+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7410b750 con 0x7f4a74101920 2023-10-05T15:15:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.883+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4a6c0145b0 con 0x7f4a74101920 2023-10-05T15:15:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.884+0000 7f4a5bfff700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a5c0a1550 0x7f4a5c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.884+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4a6c006e40 con 0x7f4a74101920 2023-10-05T15:15:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.884+0000 7f4a72ffd700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a5c0a1550 0x7f4a5c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.884+0000 7f4a72ffd700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a5c0a1550 0x7f4a5c0a3a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400b5c0 tx=0x7f4a64005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:12.888+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4a6c04f100 con 0x7f4a74101920 2023-10-05T15:15:13.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.087+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a740612f0 con 0x7f4a5c0a1550 2023-10-05T15:15:13.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.102+0000 7f4a5bfff700 1 -- 172.21.15.60:0/502550132 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+418524 (secure 0 0 0) 0x7f4a740612f0 con 0x7f4a5c0a1550 2023-10-05T15:15:13.108 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:13.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a5c0a1550 msgr2=0x7f4a5c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a5c0a1550 0x7f4a5c0a3a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400b5c0 tx=0x7f4a64005fd0 comp rx=0 tx=0).stop 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 msgr2=0x7f4a7419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 0x7f4a7419df90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b970 tx=0x7f4a6c00bc80 comp rx=0 tx=0).stop 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 shutdown_connections 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4a5c0a1550 0x7f4a5c0a3a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a74101920 0x7f4a7419df90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a740ffe10 0x7f4a74069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 --2- 172.21.15.60:0/502550132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a74100f60 0x7f4a7419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 >> 172.21.15.60:0/502550132 conn(0x7f4a740fb380 msgr2=0x7f4a740fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 shutdown_connections 2023-10-05T15:15:13.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:13.106+0000 7f4a79721700 1 -- 172.21.15.60:0/502550132 wait complete. 2023-10-05T15:15:13.113 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:15:13.120 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2023-10-05T15:15:11.163966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615890,"num_objects":64,"num_object_clones":0,"num_object_copies":193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":142,"num_read_kb":144,"num_write":326,"num_write_kb":3001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":264,"ondisk_log_size":264,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337468,"kb_used_data":13260,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604356,"statfs":{"total":1151940427776,"available":1151594860544,"internally_reserved":0,"allocated":13578240,"data_stored":7419321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23112,"num_objects":40,"num_object_clones":0,"num_object_copies":121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6,"num_read_kb":25,"num_write":100,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003945"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234852+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:14:52.234852+0000","last_peered":"2023-10-05T15:14:52.234852+0000","last_clean":"2023-10-05T15:14:52.234852+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:14:52.234852+0000","last_undegraded":"2023-10-05T15:14:52.234852+0000","last_fullsized":"2023-10-05T15:14:52.234852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227415+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:14:52.227415+0000","last_peered":"2023-10-05T15:14:52.227415+0000","last_clean":"2023-10-05T15:14:52.227415+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:14:52.227415+0000","last_undegraded":"2023-10-05T15:14:52.227415+0000","last_fullsized":"2023-10-05T15:14:52.227415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226989+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:14:52.226989+0000","last_peered":"2023-10-05T15:14:52.226989+0000","last_clean":"2023-10-05T15:14:52.226989+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:14:52.226989+0000","last_undegraded":"2023-10-05T15:14:52.226989+0000","last_fullsized":"2023-10-05T15:14:52.226989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.236558+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:14:52.236558+0000","last_peered":"2023-10-05T15:14:52.236558+0000","last_clean":"2023-10-05T15:14:52.236558+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:14:52.236558+0000","last_undegraded":"2023-10-05T15:14:52.236558+0000","last_fullsized":"2023-10-05T15:14:52.236558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227102+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:14:52.227102+0000","last_peered":"2023-10-05T15:14:52.227102+0000","last_clean":"2023-10-05T15:14:52.227102+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:14:52.227102+0000","last_undegraded":"2023-10-05T15:14:52.227102+0000","last_fullsized":"2023-10-05T15:14:52.227102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.252486+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:14:52.252486+0000","last_peered":"2023-10-05T15:14:52.252486+0000","last_clean":"2023-10-05T15:14:52.252486+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:14:52.252486+0000","last_undegraded":"2023-10-05T15:14:52.252486+0000","last_fullsized":"2023-10-05T15:14:52.252486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233243+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:14:52.233243+0000","last_peered":"2023-10-05T15:14:52.233243+0000","last_clean":"2023-10-05T15:14:52.233243+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:14:52.233243+0000","last_undegraded":"2023-10-05T15:14:52.233243+0000","last_fullsized":"2023-10-05T15:14:52.233243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231544+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:14:52.231544+0000","last_peered":"2023-10-05T15:14:52.231544+0000","last_clean":"2023-10-05T15:14:52.231544+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:14:52.231544+0000","last_undegraded":"2023-10-05T15:14:52.231544+0000","last_fullsized":"2023-10-05T15:14:52.231544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233317+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:14:52.233317+0000","last_peered":"2023-10-05T15:14:52.233317+0000","last_clean":"2023-10-05T15:14:52.233317+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:14:52.233317+0000","last_undegraded":"2023-10-05T15:14:52.233317+0000","last_fullsized":"2023-10-05T15:14:52.233317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.253460+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:14:52.253460+0000","last_peered":"2023-10-05T15:14:52.253460+0000","last_clean":"2023-10-05T15:14:52.253460+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:14:52.253460+0000","last_undegraded":"2023-10-05T15:14:52.253460+0000","last_fullsized":"2023-10-05T15:14:52.253460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233328+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:14:52.233328+0000","last_peered":"2023-10-05T15:14:52.233328+0000","last_clean":"2023-10-05T15:14:52.233328+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:14:52.233328+0000","last_undegraded":"2023-10-05T15:14:52.233328+0000","last_fullsized":"2023-10-05T15:14:52.233328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.236505+0000","last_change":"2023-10-05T15:14:47.995939+0000","last_active":"2023-10-05T15:14:52.236505+0000","last_peered":"2023-10-05T15:14:52.236505+0000","last_clean":"2023-10-05T15:14:52.236505+0000","last_became_active":"2023-10-05T15:14:47.995606+0000","last_became_peered":"2023-10-05T15:14:47.995606+0000","last_unstale":"2023-10-05T15:14:52.236505+0000","last_undegraded":"2023-10-05T15:14:52.236505+0000","last_fullsized":"2023-10-05T15:14:52.236505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:19:46.741709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230578+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:14:52.230578+0000","last_peered":"2023-10-05T15:14:52.230578+0000","last_clean":"2023-10-05T15:14:52.230578+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:14:52.230578+0000","last_undegraded":"2023-10-05T15:14:52.230578+0000","last_fullsized":"2023-10-05T15:14:52.230578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226560+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:14:52.226560+0000","last_peered":"2023-10-05T15:14:52.226560+0000","last_clean":"2023-10-05T15:14:52.226560+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:14:52.226560+0000","last_undegraded":"2023-10-05T15:14:52.226560+0000","last_fullsized":"2023-10-05T15:14:52.226560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226537+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:14:52.226537+0000","last_peered":"2023-10-05T15:14:52.226537+0000","last_clean":"2023-10-05T15:14:52.226537+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:14:52.226537+0000","last_undegraded":"2023-10-05T15:14:52.226537+0000","last_fullsized":"2023-10-05T15:14:52.226537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232973+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:14:52.232973+0000","last_peered":"2023-10-05T15:14:52.232973+0000","last_clean":"2023-10-05T15:14:52.232973+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:14:52.232973+0000","last_undegraded":"2023-10-05T15:14:52.232973+0000","last_fullsized":"2023-10-05T15:14:52.232973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234762+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:14:52.234762+0000","last_peered":"2023-10-05T15:14:52.234762+0000","last_clean":"2023-10-05T15:14:52.234762+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:14:52.234762+0000","last_undegraded":"2023-10-05T15:14:52.234762+0000","last_fullsized":"2023-10-05T15:14:52.234762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.249098+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:14:52.249098+0000","last_peered":"2023-10-05T15:14:52.249098+0000","last_clean":"2023-10-05T15:14:52.249098+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:14:52.249098+0000","last_undegraded":"2023-10-05T15:14:52.249098+0000","last_fullsized":"2023-10-05T15:14:52.249098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232273+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:14:52.232273+0000","last_peered":"2023-10-05T15:14:52.232273+0000","last_clean":"2023-10-05T15:14:52.232273+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:14:52.232273+0000","last_undegraded":"2023-10-05T15:14:52.232273+0000","last_fullsized":"2023-10-05T15:14:52.232273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727181+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:14:53.727181+0000","last_peered":"2023-10-05T15:14:53.727181+0000","last_clean":"2023-10-05T15:14:53.727181+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:14:53.727181+0000","last_undegraded":"2023-10-05T15:14:53.727181+0000","last_fullsized":"2023-10-05T15:14:53.727181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.309498+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:15:08.309498+0000","last_peered":"2023-10-05T15:15:08.309498+0000","last_clean":"2023-10-05T15:15:08.309498+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:15:08.309498+0000","last_undegraded":"2023-10-05T15:15:08.309498+0000","last_fullsized":"2023-10-05T15:15:08.309498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232017+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:14:52.232017+0000","last_peered":"2023-10-05T15:14:52.232017+0000","last_clean":"2023-10-05T15:14:52.232017+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:14:52.232017+0000","last_undegraded":"2023-10-05T15:14:52.232017+0000","last_fullsized":"2023-10-05T15:14:52.232017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726715+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:14:53.726715+0000","last_peered":"2023-10-05T15:14:53.726715+0000","last_clean":"2023-10-05T15:14:53.726715+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:14:53.726715+0000","last_undegraded":"2023-10-05T15:14:53.726715+0000","last_fullsized":"2023-10-05T15:14:53.726715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.728220+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:14:53.728220+0000","last_peered":"2023-10-05T15:14:53.728220+0000","last_clean":"2023-10-05T15:14:53.728220+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:14:53.728220+0000","last_undegraded":"2023-10-05T15:14:53.728220+0000","last_fullsized":"2023-10-05T15:14:53.728220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227163+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:14:52.227163+0000","last_peered":"2023-10-05T15:14:52.227163+0000","last_clean":"2023-10-05T15:14:52.227163+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:14:52.227163+0000","last_undegraded":"2023-10-05T15:14:52.227163+0000","last_fullsized":"2023-10-05T15:14:52.227163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726853+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:14:53.726853+0000","last_peered":"2023-10-05T15:14:53.726853+0000","last_clean":"2023-10-05T15:14:53.726853+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:14:53.726853+0000","last_undegraded":"2023-10-05T15:14:53.726853+0000","last_fullsized":"2023-10-05T15:14:53.726853+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227419+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:14:52.227419+0000","last_peered":"2023-10-05T15:14:52.227419+0000","last_clean":"2023-10-05T15:14:52.227419+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:14:52.227419+0000","last_undegraded":"2023-10-05T15:14:52.227419+0000","last_fullsized":"2023-10-05T15:14:52.227419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233542+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:14:52.233542+0000","last_peered":"2023-10-05T15:14:52.233542+0000","last_clean":"2023-10-05T15:14:52.233542+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:14:52.233542+0000","last_undegraded":"2023-10-05T15:14:52.233542+0000","last_fullsized":"2023-10-05T15:14:52.233542+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726783+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:14:53.726783+0000","last_peered":"2023-10-05T15:14:53.726783+0000","last_clean":"2023-10-05T15:14:53.726783+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:14:53.726783+0000","last_undegraded":"2023-10-05T15:14:53.726783+0000","last_fullsized":"2023-10-05T15:14:53.726783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227648+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:14:52.227648+0000","last_peered":"2023-10-05T15:14:52.227648+0000","last_clean":"2023-10-05T15:14:52.227648+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:14:52.227648+0000","last_undegraded":"2023-10-05T15:14:52.227648+0000","last_fullsized":"2023-10-05T15:14:52.227648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232633+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:14:52.232633+0000","last_peered":"2023-10-05T15:14:52.232633+0000","last_clean":"2023-10-05T15:14:52.232633+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:14:52.232633+0000","last_undegraded":"2023-10-05T15:14:52.232633+0000","last_fullsized":"2023-10-05T15:14:52.232633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727098+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:14:53.727098+0000","last_peered":"2023-10-05T15:14:53.727098+0000","last_clean":"2023-10-05T15:14:53.727098+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:14:53.727098+0000","last_undegraded":"2023-10-05T15:14:53.727098+0000","last_fullsized":"2023-10-05T15:14:53.727098+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.300766+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:15:07.300766+0000","last_peered":"2023-10-05T15:15:07.300766+0000","last_clean":"2023-10-05T15:15:07.300766+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:15:07.300766+0000","last_undegraded":"2023-10-05T15:15:07.300766+0000","last_fullsized":"2023-10-05T15:15:07.300766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227629+0000","last_change":"2023-10-05T15:14:48.000773+0000","last_active":"2023-10-05T15:14:52.227629+0000","last_peered":"2023-10-05T15:14:52.227629+0000","last_clean":"2023-10-05T15:14:52.227629+0000","last_became_active":"2023-10-05T15:14:48.000501+0000","last_became_peered":"2023-10-05T15:14:48.000501+0000","last_unstale":"2023-10-05T15:14:52.227629+0000","last_undegraded":"2023-10-05T15:14:52.227629+0000","last_fullsized":"2023-10-05T15:14:52.227629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:11.631108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727144+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:14:53.727144+0000","last_peered":"2023-10-05T15:14:53.727144+0000","last_clean":"2023-10-05T15:14:53.727144+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:14:53.727144+0000","last_undegraded":"2023-10-05T15:14:53.727144+0000","last_fullsized":"2023-10-05T15:14:53.727144+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:09.320478+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:09.320478+0000","last_peered":"2023-10-05T15:15:09.320478+0000","last_clean":"2023-10-05T15:15:09.320478+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:09.320478+0000","last_undegraded":"2023-10-05T15:15:09.320478+0000","last_fullsized":"2023-10-05T15:15:09.320478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232559+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:14:52.232559+0000","last_peered":"2023-10-05T15:14:52.232559+0000","last_clean":"2023-10-05T15:14:52.232559+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:14:52.232559+0000","last_undegraded":"2023-10-05T15:14:52.232559+0000","last_fullsized":"2023-10-05T15:14:52.232559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243807+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:14:53.243807+0000","last_peered":"2023-10-05T15:14:53.243807+0000","last_clean":"2023-10-05T15:14:53.243807+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:14:53.243807+0000","last_undegraded":"2023-10-05T15:14:53.243807+0000","last_fullsized":"2023-10-05T15:14:53.243807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.309584+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:08.309584+0000","last_peered":"2023-10-05T15:15:08.309584+0000","last_clean":"2023-10-05T15:15:08.309584+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:08.309584+0000","last_undegraded":"2023-10-05T15:15:08.309584+0000","last_fullsized":"2023-10-05T15:15:08.309584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231454+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:14:52.231454+0000","last_peered":"2023-10-05T15:14:52.231454+0000","last_clean":"2023-10-05T15:14:52.231454+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:14:52.231454+0000","last_undegraded":"2023-10-05T15:14:52.231454+0000","last_fullsized":"2023-10-05T15:14:52.231454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727429+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:14:53.727429+0000","last_peered":"2023-10-05T15:14:53.727429+0000","last_clean":"2023-10-05T15:14:53.727429+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:14:53.727429+0000","last_undegraded":"2023-10-05T15:14:53.727429+0000","last_fullsized":"2023-10-05T15:14:53.727429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.266551+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:14:53.266551+0000","last_peered":"2023-10-05T15:14:53.266551+0000","last_clean":"2023-10-05T15:14:53.266551+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:14:53.266551+0000","last_undegraded":"2023-10-05T15:14:53.266551+0000","last_fullsized":"2023-10-05T15:14:53.266551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.249162+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:14:52.249162+0000","last_peered":"2023-10-05T15:14:52.249162+0000","last_clean":"2023-10-05T15:14:52.249162+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:14:52.249162+0000","last_undegraded":"2023-10-05T15:14:52.249162+0000","last_fullsized":"2023-10-05T15:14:52.249162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726890+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:14:53.726890+0000","last_peered":"2023-10-05T15:14:53.726890+0000","last_clean":"2023-10-05T15:14:53.726890+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:14:53.726890+0000","last_undegraded":"2023-10-05T15:14:53.726890+0000","last_fullsized":"2023-10-05T15:14:53.726890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:11.034461+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:15:11.034461+0000","last_peered":"2023-10-05T15:15:11.034461+0000","last_clean":"2023-10-05T15:15:11.034461+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:15:11.034461+0000","last_undegraded":"2023-10-05T15:15:11.034461+0000","last_fullsized":"2023-10-05T15:15:11.034461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233565+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:14:52.233565+0000","last_peered":"2023-10-05T15:14:52.233565+0000","last_clean":"2023-10-05T15:14:52.233565+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:14:52.233565+0000","last_undegraded":"2023-10-05T15:14:52.233565+0000","last_fullsized":"2023-10-05T15:14:52.233565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243293+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:14:53.243293+0000","last_peered":"2023-10-05T15:14:53.243293+0000","last_clean":"2023-10-05T15:14:53.243293+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:14:53.243293+0000","last_undegraded":"2023-10-05T15:14:53.243293+0000","last_fullsized":"2023-10-05T15:14:53.243293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:10.330782+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:10.330782+0000","last_peered":"2023-10-05T15:15:10.330782+0000","last_clean":"2023-10-05T15:15:10.330782+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:10.330782+0000","last_undegraded":"2023-10-05T15:15:10.330782+0000","last_fullsized":"2023-10-05T15:15:10.330782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227049+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:14:52.227049+0000","last_peered":"2023-10-05T15:14:52.227049+0000","last_clean":"2023-10-05T15:14:52.227049+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:14:52.227049+0000","last_undegraded":"2023-10-05T15:14:52.227049+0000","last_fullsized":"2023-10-05T15:14:52.227049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727014+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:14:53.727014+0000","last_peered":"2023-10-05T15:14:53.727014+0000","last_clean":"2023-10-05T15:14:53.727014+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:14:53.727014+0000","last_undegraded":"2023-10-05T15:14:53.727014+0000","last_fullsized":"2023-10-05T15:14:53.727014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.267038+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:14:53.267038+0000","last_peered":"2023-10-05T15:14:53.267038+0000","last_clean":"2023-10-05T15:14:53.267038+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:14:53.267038+0000","last_undegraded":"2023-10-05T15:14:53.267038+0000","last_fullsized":"2023-10-05T15:14:53.267038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233649+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:14:52.233649+0000","last_peered":"2023-10-05T15:14:52.233649+0000","last_clean":"2023-10-05T15:14:52.233649+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:14:52.233649+0000","last_undegraded":"2023-10-05T15:14:52.233649+0000","last_fullsized":"2023-10-05T15:14:52.233649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243963+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:14:53.243963+0000","last_peered":"2023-10-05T15:14:53.243963+0000","last_clean":"2023-10-05T15:14:53.243963+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:14:53.243963+0000","last_undegraded":"2023-10-05T15:14:53.243963+0000","last_fullsized":"2023-10-05T15:14:53.243963+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'20","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:11.037348+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:15:11.037348+0000","last_peered":"2023-10-05T15:15:11.037348+0000","last_clean":"2023-10-05T15:15:11.037348+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:15:11.037348+0000","last_undegraded":"2023-10-05T15:15:11.037348+0000","last_fullsized":"2023-10-05T15:15:11.037348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21223,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":22,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227184+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:14:52.227184+0000","last_peered":"2023-10-05T15:14:52.227184+0000","last_clean":"2023-10-05T15:14:52.227184+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:14:52.227184+0000","last_undegraded":"2023-10-05T15:14:52.227184+0000","last_fullsized":"2023-10-05T15:14:52.227184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.267516+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:14:53.267516+0000","last_peered":"2023-10-05T15:14:53.267516+0000","last_clean":"2023-10-05T15:14:53.267516+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:14:53.267516+0000","last_undegraded":"2023-10-05T15:14:53.267516+0000","last_fullsized":"2023-10-05T15:14:53.267516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.308258+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:08.308258+0000","last_peered":"2023-10-05T15:15:08.308258+0000","last_clean":"2023-10-05T15:15:08.308258+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:08.308258+0000","last_undegraded":"2023-10-05T15:15:08.308258+0000","last_fullsized":"2023-10-05T15:15:08.308258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230121+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:14:52.230121+0000","last_peered":"2023-10-05T15:14:52.230121+0000","last_clean":"2023-10-05T15:14:52.230121+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:14:52.230121+0000","last_undegraded":"2023-10-05T15:14:52.230121+0000","last_fullsized":"2023-10-05T15:14:52.230121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243457+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:14:53.243457+0000","last_peered":"2023-10-05T15:14:53.243457+0000","last_clean":"2023-10-05T15:14:53.243457+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:14:53.243457+0000","last_undegraded":"2023-10-05T15:14:53.243457+0000","last_fullsized":"2023-10-05T15:14:53.243457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.301165+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:07.301165+0000","last_peered":"2023-10-05T15:15:07.301165+0000","last_clean":"2023-10-05T15:15:07.301165+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:07.301165+0000","last_undegraded":"2023-10-05T15:15:07.301165+0000","last_fullsized":"2023-10-05T15:15:07.301165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233449+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:14:52.233449+0000","last_peered":"2023-10-05T15:14:52.233449+0000","last_clean":"2023-10-05T15:14:52.233449+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:14:52.233449+0000","last_undegraded":"2023-10-05T15:14:52.233449+0000","last_fullsized":"2023-10-05T15:14:52.233449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.244050+0000","last_change":"2023-10-05T15:14:52.246864+0000","last_active":"2023-10-05T15:14:53.244050+0000","last_peered":"2023-10-05T15:14:53.244050+0000","last_clean":"2023-10-05T15:14:53.244050+0000","last_became_active":"2023-10-05T15:14:52.246451+0000","last_became_peered":"2023-10-05T15:14:52.246451+0000","last_unstale":"2023-10-05T15:14:53.244050+0000","last_undegraded":"2023-10-05T15:14:53.244050+0000","last_fullsized":"2023-10-05T15:14:53.244050+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:32:47.081258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.235218+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:14:52.235218+0000","last_peered":"2023-10-05T15:14:52.235218+0000","last_clean":"2023-10-05T15:14:52.235218+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:14:52.235218+0000","last_undegraded":"2023-10-05T15:14:52.235218+0000","last_fullsized":"2023-10-05T15:14:52.235218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233086+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:14:52.233086+0000","last_peered":"2023-10-05T15:14:52.233086+0000","last_clean":"2023-10-05T15:14:52.233086+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:14:52.233086+0000","last_undegraded":"2023-10-05T15:14:52.233086+0000","last_fullsized":"2023-10-05T15:14:52.233086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727374+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:14:53.727374+0000","last_peered":"2023-10-05T15:14:53.727374+0000","last_clean":"2023-10-05T15:14:53.727374+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:14:53.727374+0000","last_undegraded":"2023-10-05T15:14:53.727374+0000","last_fullsized":"2023-10-05T15:14:53.727374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227009+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:14:52.227009+0000","last_peered":"2023-10-05T15:14:52.227009+0000","last_clean":"2023-10-05T15:14:52.227009+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:14:52.227009+0000","last_undegraded":"2023-10-05T15:14:52.227009+0000","last_fullsized":"2023-10-05T15:14:52.227009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231659+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:14:52.231659+0000","last_peered":"2023-10-05T15:14:52.231659+0000","last_clean":"2023-10-05T15:14:52.231659+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:14:52.231659+0000","last_undegraded":"2023-10-05T15:14:52.231659+0000","last_fullsized":"2023-10-05T15:14:52.231659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.266750+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:14:53.266750+0000","last_peered":"2023-10-05T15:14:53.266750+0000","last_clean":"2023-10-05T15:14:53.266750+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:14:53.266750+0000","last_undegraded":"2023-10-05T15:14:53.266750+0000","last_fullsized":"2023-10-05T15:14:53.266750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227477+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:14:52.227477+0000","last_peered":"2023-10-05T15:14:52.227477+0000","last_clean":"2023-10-05T15:14:52.227477+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:14:52.227477+0000","last_undegraded":"2023-10-05T15:14:52.227477+0000","last_fullsized":"2023-10-05T15:14:52.227477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233210+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:14:52.233210+0000","last_peered":"2023-10-05T15:14:52.233210+0000","last_clean":"2023-10-05T15:14:52.233210+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:14:52.233210+0000","last_undegraded":"2023-10-05T15:14:52.233210+0000","last_fullsized":"2023-10-05T15:14:52.233210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727019+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:14:53.727019+0000","last_peered":"2023-10-05T15:14:53.727019+0000","last_clean":"2023-10-05T15:14:53.727019+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:14:53.727019+0000","last_undegraded":"2023-10-05T15:14:53.727019+0000","last_fullsized":"2023-10-05T15:14:53.727019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.248603+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:14:52.248603+0000","last_peered":"2023-10-05T15:14:52.248603+0000","last_clean":"2023-10-05T15:14:52.248603+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:14:52.248603+0000","last_undegraded":"2023-10-05T15:14:52.248603+0000","last_fullsized":"2023-10-05T15:14:52.248603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.252884+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:14:52.252884+0000","last_peered":"2023-10-05T15:14:52.252884+0000","last_clean":"2023-10-05T15:14:52.252884+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:14:52.252884+0000","last_undegraded":"2023-10-05T15:14:52.252884+0000","last_fullsized":"2023-10-05T15:14:52.252884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.728637+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:14:53.728637+0000","last_peered":"2023-10-05T15:14:53.728637+0000","last_clean":"2023-10-05T15:14:53.728637+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:14:53.728637+0000","last_undegraded":"2023-10-05T15:14:53.728637+0000","last_fullsized":"2023-10-05T15:14:53.728637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:10.329981+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:15:10.329981+0000","last_peered":"2023-10-05T15:15:10.329981+0000","last_clean":"2023-10-05T15:15:10.329981+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:15:10.329981+0000","last_undegraded":"2023-10-05T15:15:10.329981+0000","last_fullsized":"2023-10-05T15:15:10.329981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.252490+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:14:52.252490+0000","last_peered":"2023-10-05T15:14:52.252490+0000","last_clean":"2023-10-05T15:14:52.252490+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:14:52.252490+0000","last_undegraded":"2023-10-05T15:14:52.252490+0000","last_fullsized":"2023-10-05T15:14:52.252490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727656+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:14:53.727656+0000","last_peered":"2023-10-05T15:14:53.727656+0000","last_clean":"2023-10-05T15:14:53.727656+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:14:53.727656+0000","last_undegraded":"2023-10-05T15:14:53.727656+0000","last_fullsized":"2023-10-05T15:14:53.727656+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232242+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:14:52.232242+0000","last_peered":"2023-10-05T15:14:52.232242+0000","last_clean":"2023-10-05T15:14:52.232242+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:14:52.232242+0000","last_undegraded":"2023-10-05T15:14:52.232242+0000","last_fullsized":"2023-10-05T15:14:52.232242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.309932+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:15:08.309932+0000","last_peered":"2023-10-05T15:15:08.309932+0000","last_clean":"2023-10-05T15:15:08.309932+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:15:08.309932+0000","last_undegraded":"2023-10-05T15:15:08.309932+0000","last_fullsized":"2023-10-05T15:15:08.309932+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:55.980184+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:14:55.980184+0000","last_peered":"2023-10-05T15:14:55.980184+0000","last_clean":"2023-10-05T15:14:55.980184+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:14:55.980184+0000","last_undegraded":"2023-10-05T15:14:55.980184+0000","last_fullsized":"2023-10-05T15:14:55.980184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.235734+0000","last_change":"2023-10-05T15:14:48.011045+0000","last_active":"2023-10-05T15:14:52.235734+0000","last_peered":"2023-10-05T15:14:52.235734+0000","last_clean":"2023-10-05T15:14:52.235734+0000","last_became_active":"2023-10-05T15:14:48.010701+0000","last_became_peered":"2023-10-05T15:14:48.010701+0000","last_unstale":"2023-10-05T15:14:52.235734+0000","last_undegraded":"2023-10-05T15:14:52.235734+0000","last_fullsized":"2023-10-05T15:14:52.235734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.641985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.301128+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:07.301128+0000","last_peered":"2023-10-05T15:15:07.301128+0000","last_clean":"2023-10-05T15:15:07.301128+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:07.301128+0000","last_undegraded":"2023-10-05T15:15:07.301128+0000","last_fullsized":"2023-10-05T15:15:07.301128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232933+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:14:52.232933+0000","last_peered":"2023-10-05T15:14:52.232933+0000","last_clean":"2023-10-05T15:14:52.232933+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:14:52.232933+0000","last_undegraded":"2023-10-05T15:14:52.232933+0000","last_fullsized":"2023-10-05T15:14:52.232933+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.267268+0000","last_change":"2023-10-05T15:14:52.255126+0000","last_active":"2023-10-05T15:14:53.267268+0000","last_peered":"2023-10-05T15:14:53.267268+0000","last_clean":"2023-10-05T15:14:53.267268+0000","last_became_active":"2023-10-05T15:14:52.254544+0000","last_became_peered":"2023-10-05T15:14:52.254544+0000","last_unstale":"2023-10-05T15:14:53.267268+0000","last_undegraded":"2023-10-05T15:14:53.267268+0000","last_fullsized":"2023-10-05T15:14:53.267268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:22:56.856370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.229457+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:14:52.229457+0000","last_peered":"2023-10-05T15:14:52.229457+0000","last_clean":"2023-10-05T15:14:52.229457+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:14:52.229457+0000","last_undegraded":"2023-10-05T15:14:52.229457+0000","last_fullsized":"2023-10-05T15:14:52.229457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.305069+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:08.305069+0000","last_peered":"2023-10-05T15:15:08.305069+0000","last_clean":"2023-10-05T15:15:08.305069+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:08.305069+0000","last_undegraded":"2023-10-05T15:15:08.305069+0000","last_fullsized":"2023-10-05T15:15:08.305069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.243461+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:14:53.243461+0000","last_peered":"2023-10-05T15:14:53.243461+0000","last_clean":"2023-10-05T15:14:53.243461+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:14:53.243461+0000","last_undegraded":"2023-10-05T15:14:53.243461+0000","last_fullsized":"2023-10-05T15:14:53.243461+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227564+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:14:52.227564+0000","last_peered":"2023-10-05T15:14:52.227564+0000","last_clean":"2023-10-05T15:14:52.227564+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:14:52.227564+0000","last_undegraded":"2023-10-05T15:14:52.227564+0000","last_fullsized":"2023-10-05T15:14:52.227564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230694+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:14:52.230694+0000","last_peered":"2023-10-05T15:14:52.230694+0000","last_clean":"2023-10-05T15:14:52.230694+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:14:52.230694+0000","last_undegraded":"2023-10-05T15:14:52.230694+0000","last_fullsized":"2023-10-05T15:14:52.230694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727634+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:14:53.727634+0000","last_peered":"2023-10-05T15:14:53.727634+0000","last_clean":"2023-10-05T15:14:53.727634+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:14:53.727634+0000","last_undegraded":"2023-10-05T15:14:53.727634+0000","last_fullsized":"2023-10-05T15:14:53.727634+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:08.306485+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:15:08.306485+0000","last_peered":"2023-10-05T15:15:08.306485+0000","last_clean":"2023-10-05T15:15:08.306485+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:15:08.306485+0000","last_undegraded":"2023-10-05T15:15:08.306485+0000","last_fullsized":"2023-10-05T15:15:08.306485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231569+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:14:52.231569+0000","last_peered":"2023-10-05T15:14:52.231569+0000","last_clean":"2023-10-05T15:14:52.231569+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:14:52.231569+0000","last_undegraded":"2023-10-05T15:14:52.231569+0000","last_fullsized":"2023-10-05T15:14:52.231569+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.726678+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:14:53.726678+0000","last_peered":"2023-10-05T15:14:53.726678+0000","last_clean":"2023-10-05T15:14:53.726678+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:14:53.726678+0000","last_undegraded":"2023-10-05T15:14:53.726678+0000","last_fullsized":"2023-10-05T15:14:53.726678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.300849+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:07.300849+0000","last_peered":"2023-10-05T15:15:07.300849+0000","last_clean":"2023-10-05T15:15:07.300849+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:07.300849+0000","last_undegraded":"2023-10-05T15:15:07.300849+0000","last_fullsized":"2023-10-05T15:15:07.300849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227316+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:14:52.227316+0000","last_peered":"2023-10-05T15:14:52.227316+0000","last_clean":"2023-10-05T15:14:52.227316+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:14:52.227316+0000","last_undegraded":"2023-10-05T15:14:52.227316+0000","last_fullsized":"2023-10-05T15:14:52.227316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727213+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:14:53.727213+0000","last_peered":"2023-10-05T15:14:53.727213+0000","last_clean":"2023-10-05T15:14:53.727213+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:14:53.727213+0000","last_undegraded":"2023-10-05T15:14:53.727213+0000","last_fullsized":"2023-10-05T15:14:53.727213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:07.300391+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:07.300391+0000","last_peered":"2023-10-05T15:15:07.300391+0000","last_clean":"2023-10-05T15:15:07.300391+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:07.300391+0000","last_undegraded":"2023-10-05T15:15:07.300391+0000","last_fullsized":"2023-10-05T15:15:07.300391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227008+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:14:52.227008+0000","last_peered":"2023-10-05T15:14:52.227008+0000","last_clean":"2023-10-05T15:14:52.227008+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:14:52.227008+0000","last_undegraded":"2023-10-05T15:14:52.227008+0000","last_fullsized":"2023-10-05T15:14:52.227008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.244244+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:14:53.244244+0000","last_peered":"2023-10-05T15:14:53.244244+0000","last_clean":"2023-10-05T15:14:53.244244+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:14:53.244244+0000","last_undegraded":"2023-10-05T15:14:53.244244+0000","last_fullsized":"2023-10-05T15:14:53.244244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:09.320661+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:09.320661+0000","last_peered":"2023-10-05T15:15:09.320661+0000","last_clean":"2023-10-05T15:15:09.320661+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:09.320661+0000","last_undegraded":"2023-10-05T15:15:09.320661+0000","last_fullsized":"2023-10-05T15:15:09.320661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232767+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:14:52.232767+0000","last_peered":"2023-10-05T15:14:52.232767+0000","last_clean":"2023-10-05T15:14:52.232767+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:14:52.232767+0000","last_undegraded":"2023-10-05T15:14:52.232767+0000","last_fullsized":"2023-10-05T15:14:52.232767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727131+0000","last_change":"2023-10-05T15:14:52.252385+0000","last_active":"2023-10-05T15:14:53.727131+0000","last_peered":"2023-10-05T15:14:53.727131+0000","last_clean":"2023-10-05T15:14:53.727131+0000","last_became_active":"2023-10-05T15:14:52.251957+0000","last_became_peered":"2023-10-05T15:14:52.251957+0000","last_unstale":"2023-10-05T15:14:53.727131+0000","last_undegraded":"2023-10-05T15:14:53.727131+0000","last_fullsized":"2023-10-05T15:14:53.727131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:16.265244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727510+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:14:53.727510+0000","last_peered":"2023-10-05T15:14:53.727510+0000","last_clean":"2023-10-05T15:14:53.727510+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:14:53.727510+0000","last_undegraded":"2023-10-05T15:14:53.727510+0000","last_fullsized":"2023-10-05T15:14:53.727510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231006+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:14:52.231006+0000","last_peered":"2023-10-05T15:14:52.231006+0000","last_clean":"2023-10-05T15:14:52.231006+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:14:52.231006+0000","last_undegraded":"2023-10-05T15:14:52.231006+0000","last_fullsized":"2023-10-05T15:14:52.231006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727157+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:14:53.727157+0000","last_peered":"2023-10-05T15:14:53.727157+0000","last_clean":"2023-10-05T15:14:53.727157+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:14:53.727157+0000","last_undegraded":"2023-10-05T15:14:53.727157+0000","last_fullsized":"2023-10-05T15:14:53.727157+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.227135+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:14:52.227135+0000","last_peered":"2023-10-05T15:14:52.227135+0000","last_clean":"2023-10-05T15:14:52.227135+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:14:52.227135+0000","last_undegraded":"2023-10-05T15:14:52.227135+0000","last_fullsized":"2023-10-05T15:14:52.227135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232829+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:14:52.232829+0000","last_peered":"2023-10-05T15:14:52.232829+0000","last_clean":"2023-10-05T15:14:52.232829+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:14:52.232829+0000","last_undegraded":"2023-10-05T15:14:52.232829+0000","last_fullsized":"2023-10-05T15:14:52.232829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.472925+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:14:53.472925+0000","last_peered":"2023-10-05T15:14:53.472925+0000","last_clean":"2023-10-05T15:14:53.472925+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:14:53.472925+0000","last_undegraded":"2023-10-05T15:14:53.472925+0000","last_fullsized":"2023-10-05T15:14:53.472925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:09.320796+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:15:09.320796+0000","last_peered":"2023-10-05T15:15:09.320796+0000","last_clean":"2023-10-05T15:15:09.320796+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:15:09.320796+0000","last_undegraded":"2023-10-05T15:15:09.320796+0000","last_fullsized":"2023-10-05T15:15:09.320796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233421+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:14:52.233421+0000","last_peered":"2023-10-05T15:14:52.233421+0000","last_clean":"2023-10-05T15:14:52.233421+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:14:52.233421+0000","last_undegraded":"2023-10-05T15:14:52.233421+0000","last_fullsized":"2023-10-05T15:14:52.233421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.727015+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:14:53.727015+0000","last_peered":"2023-10-05T15:14:53.727015+0000","last_clean":"2023-10-05T15:14:53.727015+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:14:53.727015+0000","last_undegraded":"2023-10-05T15:14:53.727015+0000","last_fullsized":"2023-10-05T15:14:53.727015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232736+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:14:52.232736+0000","last_peered":"2023-10-05T15:14:52.232736+0000","last_clean":"2023-10-05T15:14:52.232736+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:14:52.232736+0000","last_undegraded":"2023-10-05T15:14:52.232736+0000","last_fullsized":"2023-10-05T15:14:52.232736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233861+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:14:52.233861+0000","last_peered":"2023-10-05T15:14:52.233861+0000","last_clean":"2023-10-05T15:14:52.233861+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:14:52.233861+0000","last_undegraded":"2023-10-05T15:14:52.233861+0000","last_fullsized":"2023-10-05T15:14:52.233861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:14:53.266520+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:14:53.266520+0000","last_peered":"2023-10-05T15:14:53.266520+0000","last_clean":"2023-10-05T15:14:53.266520+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:14:53.266520+0000","last_undegraded":"2023-10-05T15:14:53.266520+0000","last_fullsized":"2023-10-05T15:14:53.266520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-05T15:15:10.328935+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:10.328935+0000","last_peered":"2023-10-05T15:15:10.328935+0000","last_clean":"2023-10-05T15:15:10.328935+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:10.328935+0000","last_undegraded":"2023-10-05T15:15:10.328935+0000","last_fullsized":"2023-10-05T15:15:10.328935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234585+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:14:52.234585+0000","last_peered":"2023-10-05T15:14:52.234585+0000","last_clean":"2023-10-05T15:14:52.234585+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:14:52.234585+0000","last_undegraded":"2023-10-05T15:14:52.234585+0000","last_fullsized":"2023-10-05T15:14:52.234585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232862+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:14:52.232862+0000","last_peered":"2023-10-05T15:14:52.232862+0000","last_clean":"2023-10-05T15:14:52.232862+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:14:52.232862+0000","last_undegraded":"2023-10-05T15:14:52.232862+0000","last_fullsized":"2023-10-05T15:14:52.232862+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232327+0000","last_change":"2023-10-05T15:14:48.002891+0000","last_active":"2023-10-05T15:14:52.232327+0000","last_peered":"2023-10-05T15:14:52.232327+0000","last_clean":"2023-10-05T15:14:52.232327+0000","last_became_active":"2023-10-05T15:14:48.002592+0000","last_became_peered":"2023-10-05T15:14:48.002592+0000","last_unstale":"2023-10-05T15:14:52.232327+0000","last_undegraded":"2023-10-05T15:14:52.232327+0000","last_fullsized":"2023-10-05T15:14:52.232327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:28:34.775538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230923+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:14:52.230923+0000","last_peered":"2023-10-05T15:14:52.230923+0000","last_clean":"2023-10-05T15:14:52.230923+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:14:52.230923+0000","last_undegraded":"2023-10-05T15:14:52.230923+0000","last_fullsized":"2023-10-05T15:14:52.230923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.226954+0000","last_change":"2023-10-05T15:14:48.007464+0000","last_active":"2023-10-05T15:14:52.226954+0000","last_peered":"2023-10-05T15:14:52.226954+0000","last_clean":"2023-10-05T15:14:52.226954+0000","last_became_active":"2023-10-05T15:14:48.007163+0000","last_became_peered":"2023-10-05T15:14:48.007163+0000","last_unstale":"2023-10-05T15:14:52.226954+0000","last_undegraded":"2023-10-05T15:14:52.226954+0000","last_fullsized":"2023-10-05T15:14:52.226954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:47:39.644587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230792+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:14:52.230792+0000","last_peered":"2023-10-05T15:14:52.230792+0000","last_clean":"2023-10-05T15:14:52.230792+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:14:52.230792+0000","last_undegraded":"2023-10-05T15:14:52.230792+0000","last_fullsized":"2023-10-05T15:14:52.230792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.233094+0000","last_change":"2023-10-05T15:14:48.007576+0000","last_active":"2023-10-05T15:14:52.233094+0000","last_peered":"2023-10-05T15:14:52.233094+0000","last_clean":"2023-10-05T15:14:52.233094+0000","last_became_active":"2023-10-05T15:14:48.007229+0000","last_became_peered":"2023-10-05T15:14:48.007229+0000","last_unstale":"2023-10-05T15:14:52.233094+0000","last_undegraded":"2023-10-05T15:14:52.233094+0000","last_fullsized":"2023-10-05T15:14:52.233094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:28:12.377440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232292+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:14:52.232292+0000","last_peered":"2023-10-05T15:14:52.232292+0000","last_clean":"2023-10-05T15:14:52.232292+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:14:52.232292+0000","last_undegraded":"2023-10-05T15:14:52.232292+0000","last_fullsized":"2023-10-05T15:14:52.232292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231663+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:14:52.231663+0000","last_peered":"2023-10-05T15:14:52.231663+0000","last_clean":"2023-10-05T15:14:52.231663+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:14:52.231663+0000","last_undegraded":"2023-10-05T15:14:52.231663+0000","last_fullsized":"2023-10-05T15:14:52.231663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.231987+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:14:52.231987+0000","last_peered":"2023-10-05T15:14:52.231987+0000","last_clean":"2023-10-05T15:14:52.231987+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:14:52.231987+0000","last_undegraded":"2023-10-05T15:14:52.231987+0000","last_fullsized":"2023-10-05T15:14:52.231987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230662+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:14:52.230662+0000","last_peered":"2023-10-05T15:14:52.230662+0000","last_clean":"2023-10-05T15:14:52.230662+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:14:52.230662+0000","last_undegraded":"2023-10-05T15:14:52.230662+0000","last_fullsized":"2023-10-05T15:14:52.230662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.234010+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:14:52.234010+0000","last_peered":"2023-10-05T15:14:52.234010+0000","last_clean":"2023-10-05T15:14:52.234010+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:14:52.234010+0000","last_undegraded":"2023-10-05T15:14:52.234010+0000","last_fullsized":"2023-10-05T15:14:52.234010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.230481+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:14:52.230481+0000","last_peered":"2023-10-05T15:14:52.230481+0000","last_clean":"2023-10-05T15:14:52.230481+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:14:52.230481+0000","last_undegraded":"2023-10-05T15:14:52.230481+0000","last_fullsized":"2023-10-05T15:14:52.230481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-05T15:14:52.232456+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:14:52.232456+0000","last_peered":"2023-10-05T15:14:52.232456+0000","last_clean":"2023-10-05T15:14:52.232456+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:14:52.232456+0000","last_undegraded":"2023-10-05T15:14:52.232456+0000","last_fullsized":"2023-10-05T15:14:52.232456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25399,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":6,"num_read_kb":25,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":42451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":467123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1080509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.621}]},{"osd":3,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.35699999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54500000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.75900000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":467941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.317}]},{"osd":4,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.433},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.498},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.38100000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.55300000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":467727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.629},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.443,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.496}]},{"osd":4,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.69499999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.0170000000000003,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.78600000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.92400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299424,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1065509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66500000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72499999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.54700000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84099999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45700000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54100000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64800000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":467235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.51700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.23,"15min":1.23},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.625},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.436,"15min":0.436},"max":{"1min":0.96599999999999997,"5min":1.147,"15min":1.147},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.52600000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.627}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84999999999999998,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79500000000000004,"15min":0.81699999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":1.181,"15min":1.181},"last":0.72299999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.45200000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":470692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.496,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81299999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91600000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.55600000000000005,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"min":{"1min":0.52700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89300000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.504}]},{"osd":5,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59899999999999998,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95399999999999996,"5min":0.995,"15min":0.995},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84299999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64000000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95899999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.876,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.69199999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.78200000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":466940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.57699999999999996,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.29,"5min":6.29,"15min":6.29},"last":0.872},{"interface":"front","average":{"1min":0.625,"5min":0.55600000000000005,"15min":0.52300000000000002},"min":{"1min":0.42099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55200000000000005,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.52300000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.86699999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40500000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.622},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.30299999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.117,"15min":1.117},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.88800000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.89000000000000001,"15min":0.86099999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":6.3150000000000004,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.70799999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":472937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":1.623,"15min":1.623},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.753,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.503},"min":{"1min":0.47499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Oct 5 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.75700000000000001,"5min":1.639,"15min":1.639},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Oct 5 15:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77100000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.873},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.32400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":1.046},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.0640000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.83699999999999997}]},{"osd":9,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":1.018},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":1.004}]},{"osd":10,"last update":"Thu Oct 5 15:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":1.089}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":467200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.375,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.40400000000000003,"15min":0.39000000000000001},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.57099999999999995,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.44700000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Oct 5 15:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.61799999999999999,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.63},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.623}]},{"osd":5,"last update":"Thu Oct 5 15:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63800000000000001,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":1.149,"15min":1.149},"last":0.502},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.442},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53600000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.46899999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.52400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888109,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":466872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.35299999999999998},"min":{"1min":0.27400000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.375},"min":{"1min":0.29999999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.312,"15min":0.312},"max":{"1min":0.77700000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69499999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.76100000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1058636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58099999999999996,"15min":0.55500000000000005},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42699999999999999,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.434,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:14:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.44800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.753}]},{"osd":7,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.74099999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.443},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69099999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:14:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67700000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":23349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:15:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-05T15:15:13.130 INFO:tasks.cephadm:Setting up client nodes... 2023-10-05T15:15:13.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-05T15:15:13.176 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: 2023-10-05T15:15:12.866+0000 7f978642a700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-10-05T15:15:13.176 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: 2023-10-05T15:15:12.866+0000 7f978642a700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-05T15:15:13.176 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:15:12 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: 2023-10-05T15:15:12.866+0000 7f978642a700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-05T15:15:13.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:13 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2872656586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:13.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:13 smithi060 ceph-mon[99238]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:13 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2872656586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:13 smithi135 ceph-mon[103360]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:13.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:13 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2872656586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:13.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:13 smithi092 ceph-mon[102944]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:14 smithi135 ceph-mon[103360]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:14 smithi135 ceph-mon[103360]: pgmap v272: 129 pgs: 129 active+clean; 603 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2023-10-05T15:15:14.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:14 smithi060 ceph-mon[99238]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:14.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:14 smithi060 ceph-mon[99238]: pgmap v272: 129 pgs: 129 active+clean; 603 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2023-10-05T15:15:14.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:14 smithi092 ceph-mon[102944]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:14.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:14 smithi092 ceph-mon[102944]: pgmap v272: 129 pgs: 129 active+clean; 603 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/1019723860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 msgr2=0x7f0fd01014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/1019723860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01014c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009990 tx=0x7f0fc4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/1019723860 shutdown_connections 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/1019723860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 0x7f0fd0108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/1019723860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 0x7f0fd0100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/1019723860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01014c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/1019723860 >> 172.21.15.60:0/1019723860 conn(0x7f0fd00fb420 msgr2=0x7f0fd00fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/1019723860 shutdown_connections 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.059+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/1019723860 wait complete. 2023-10-05T15:15:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 Processor -- start 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 -- start start 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 0x7f0fd0196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 0x7f0fd019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd019e7f0 con 0x7f0fd0101040 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd019e930 con 0x7f0fd0101a00 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fd4c7f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd019eaf0 con 0x7f0fd00ffe50 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36482/0 (socket says 172.21.15.60:36482) 2023-10-05T15:15:15.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 -- 172.21.15.60:0/444074804 learned_addr learned my addr 172.21.15.60:0/444074804 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fce59c700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 0x7f0fd0196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fced9d700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 0x7f0fd019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 -- 172.21.15.60:0/444074804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 msgr2=0x7f0fd0196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 0x7f0fd0196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 -- 172.21.15.60:0/444074804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 msgr2=0x7f0fd019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 0x7f0fd019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 -- 172.21.15.60:0/444074804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40095f0 con 0x7f0fd0101040 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fce59c700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 0x7f0fd0196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fced9d700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 0x7f0fd019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.060+0000 7f0fcdd9b700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01971b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400b680 tx=0x7f0fc4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.061+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc401d070 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.061+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fc4004ca0 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.061+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd019ed70 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.061+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40055f0 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.061+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd019f180 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.062+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd0106e60 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.063+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0fc400fc70 con 0x7f0fd0101040 2023-10-05T15:15:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.063+0000 7f0fbf7fe700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0fb80a1590 0x7f0fb80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:15.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.063+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0fc40ce830 con 0x7f0fd0101040 2023-10-05T15:15:15.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.063+0000 7f0fce59c700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0fb80a1590 0x7f0fb80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:15.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.064+0000 7f0fce59c700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0fb80a1590 0x7f0fb80a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005fd0 tx=0x7f0fc0005f20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.067+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0fc4097bd0 con 0x7f0fd0101040 2023-10-05T15:15:15.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.350+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f0fd002cf70 con 0x7f0fd0101040 2023-10-05T15:15:15.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.352+0000 7f0fbf7fe700 1 -- 172.21.15.60:0/444074804 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0fc409b1f0 con 0x7f0fd0101040 2023-10-05T15:15:15.354 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-10-05T15:15:15.354 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAD0x5lZd30FBAA1KGzEPD3mO5SpMEJDAtb7w== 2023-10-05T15:15:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0fb80a1590 msgr2=0x7f0fb80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0fb80a1590 0x7f0fb80a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005fd0 tx=0x7f0fc0005f20 comp rx=0 tx=0).stop 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 msgr2=0x7f0fd01971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01971b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400b680 tx=0x7f0fc4005ef0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 shutdown_connections 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd0101a00 0x7f0fd019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fd00ffe50 0x7f0fd0196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0fb80a1590 0x7f0fb80a3a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 --2- 172.21.15.60:0/444074804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd0101040 0x7f0fd01971b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 >> 172.21.15.60:0/444074804 conn(0x7f0fd00fb420 msgr2=0x7f0fd00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 shutdown_connections 2023-10-05T15:15:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:15.354+0000 7f0fd4c7f700 1 -- 172.21.15.60:0/444074804 wait complete. 2023-10-05T15:15:15.784 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:15:15.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-05T15:15:15.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-05T15:15:15.827 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-05T15:15:15.827 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-05T15:15:15.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-05T15:15:16.426 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:16 smithi135 ceph-mon[103360]: pgmap v273: 129 pgs: 129 active+clean; 605 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2023-10-05T15:15:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:16 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/444074804' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-05T15:15:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:16 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/444074804' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-05T15:15:16.648 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:16 smithi060 ceph-mon[99238]: pgmap v273: 129 pgs: 129 active+clean; 605 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2023-10-05T15:15:16.648 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:16 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/444074804' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-05T15:15:16.649 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:16 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/444074804' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-05T15:15:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:16 smithi092 ceph-mon[102944]: pgmap v273: 129 pgs: 129 active+clean; 605 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2023-10-05T15:15:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:16 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/444074804' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-05T15:15:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:16 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/444074804' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-05T15:15:17.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 -- 172.21.15.60:0/1288934487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 msgr2=0x7fd53810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 --2- 172.21.15.60:0/1288934487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd53810cc90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd53000b0d0 tx=0x7fd53000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 -- 172.21.15.60:0/1288934487 shutdown_connections 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 --2- 172.21.15.60:0/1288934487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd53810cc90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 --2- 172.21.15.60:0/1288934487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 0x7fd538106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 --2- 172.21.15.60:0/1288934487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5380ffe60 0x7fd5381002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 -- 172.21.15.60:0/1288934487 >> 172.21.15.60:0/1288934487 conn(0x7fd538075e00 msgr2=0x7fd538076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 -- 172.21.15.60:0/1288934487 shutdown_connections 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.737+0000 7fd53d132700 1 -- 172.21.15.60:0/1288934487 wait complete. 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 Processor -- start 2023-10-05T15:15:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 -- start start 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5380ffe60 0x7fd5381991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd538199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 0x7fd53819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819e180 con 0x7fd538100820 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819e2f0 con 0x7fd538105e70 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53d132700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819e4b0 con 0x7fd5380ffe60 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd538199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd538199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36496/0 (socket says 172.21.15.60:36496) 2023-10-05T15:15:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53659c700 1 -- 172.21.15.60:0/56406504 learned_addr learned my addr 172.21.15.60:0/56406504 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd53759e700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 0x7fd53819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.738+0000 7fd536d9d700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5380ffe60 0x7fd5381991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53659c700 1 -- 172.21.15.60:0/56406504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5380ffe60 msgr2=0x7fd5381991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53659c700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5380ffe60 0x7fd5381991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53659c700 1 -- 172.21.15.60:0/56406504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 msgr2=0x7fd53819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53659c700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 0x7fd53819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53659c700 1 -- 172.21.15.60:0/56406504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009d00 con 0x7fd538100820 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53759e700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 0x7fd53819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53659c700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd538199700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c9b0 tx=0x7fd52800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528007b00 con 0x7fd538100820 2023-10-05T15:15:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53819e790 con 0x7fd538100820 2023-10-05T15:15:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd528007c60 con 0x7fd538100820 2023-10-05T15:15:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528018660 con 0x7fd538100820 2023-10-05T15:15:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.739+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5381a5ff0 con 0x7fd538100820 2023-10-05T15:15:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.740+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53804ebb0 con 0x7fd538100820 2023-10-05T15:15:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.742+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd528018880 con 0x7fd538100820 2023-10-05T15:15:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.742+0000 7fd51ffff700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5200a1510 0x7fd5200a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.743+0000 7fd536d9d700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5200a1510 0x7fd5200a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.743+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd5280cd440 con 0x7fd538100820 2023-10-05T15:15:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.743+0000 7fd536d9d700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5200a1510 0x7fd5200a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd52c005fd0 tx=0x7fd52c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:17.746+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd528096780 con 0x7fd538100820 2023-10-05T15:15:18.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.006+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd53819e920 con 0x7fd538100820 2023-10-05T15:15:18.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.011+0000 7fd51ffff700 1 -- 172.21.15.60:0/56406504 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260407 (secure 0 0 0) 0x7fd53819e920 con 0x7fd538100820 2023-10-05T15:15:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:18.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5200a1510 msgr2=0x7fd5200a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:18.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5200a1510 0x7fd5200a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd52c005fd0 tx=0x7fd52c005f60 comp rx=0 tx=0).stop 2023-10-05T15:15:18.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 msgr2=0x7fd538199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd538199700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c9b0 tx=0x7fd52800cd70 comp rx=0 tx=0).stop 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 shutdown_connections 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538105e70 0x7fd53819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5380ffe60 0x7fd5381991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5200a1510 0x7fd5200a39d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 --2- 172.21.15.60:0/56406504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd538100820 0x7fd538199700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 >> 172.21.15.60:0/56406504 conn(0x7fd538075e00 msgr2=0x7fd5380fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 shutdown_connections 2023-10-05T15:15:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:18.014+0000 7fd53d132700 1 -- 172.21.15.60:0/56406504 wait complete. 2023-10-05T15:15:18.393 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3043189857},{"type":"v1","addr":"172.21.15.60:6801","nonce":3043189857}]},"active_addr":"172.21.15.60:6801/3043189857","active_change":"2023-10-05T15:08:45.079451+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.60:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3221256091}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3001974532}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3008673646}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":303168486}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2450683278}]}]} 2023-10-05T15:15:18.399 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-05T15:15:18.400 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-05T15:15:18.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-05T15:15:18.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:18 smithi135 ceph-mon[103360]: pgmap v274: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.1 KiB/s wr, 21 op/s 2023-10-05T15:15:18.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:18 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/56406504' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-05T15:15:18.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:18 smithi060 ceph-mon[99238]: pgmap v274: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.1 KiB/s wr, 21 op/s 2023-10-05T15:15:18.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:18 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/56406504' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-05T15:15:18.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:18 smithi092 ceph-mon[102944]: pgmap v274: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.1 KiB/s wr, 21 op/s 2023-10-05T15:15:18.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:18 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/56406504' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-05T15:15:18.965 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:20.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 -- 172.21.15.60:0/2781216676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c0692c0 msgr2=0x7fc56c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:20.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 --2- 172.21.15.60:0/2781216676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c0692c0 0x7fc56c10d4d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc558009990 tx=0x7fc558009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 -- 172.21.15.60:0/2781216676 shutdown_connections 2023-10-05T15:15:20.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 --2- 172.21.15.60:0/2781216676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56c10da10 0x7fc56c10fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 --2- 172.21.15.60:0/2781216676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc56c0689a0 0x7fc56c068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 --2- 172.21.15.60:0/2781216676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c0692c0 0x7fc56c10d4d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 -- 172.21.15.60:0/2781216676 >> 172.21.15.60:0/2781216676 conn(0x7fc56c075e00 msgr2=0x7fc56c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 -- 172.21.15.60:0/2781216676 shutdown_connections 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.230+0000 7fc572b85700 1 -- 172.21.15.60:0/2781216676 wait complete. 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 Processor -- start 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 -- start start 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56c0689a0 0x7fc56c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc56c0692c0 0x7fc56c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 0x7fc56c19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c19e270 con 0x7fc56c10da10 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c19e3e0 con 0x7fc56c0692c0 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc572b85700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c19e5a0 con 0x7fc56c0689a0 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc571122700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 0x7fc56c19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc571122700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 0x7fc56c19dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36512/0 (socket says 172.21.15.60:36512) 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc571122700 1 -- 172.21.15.60:0/4262121167 learned_addr learned my addr 172.21.15.60:0/4262121167 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc570921700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56c0689a0 0x7fc56c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc56bfff700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc56c0692c0 0x7fc56c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc571122700 1 -- 172.21.15.60:0/4262121167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56c0689a0 msgr2=0x7fc56c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.231+0000 7fc571122700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56c0689a0 0x7fc56c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc571122700 1 -- 172.21.15.60:0/4262121167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc56c0692c0 msgr2=0x7fc56c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc571122700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc56c0692c0 0x7fc56c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc571122700 1 -- 172.21.15.60:0/4262121167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580095f0 con 0x7fc56c10da10 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc571122700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 0x7fc56c19dc60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc56400ada0 tx=0x7fc56400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400f070 con 0x7fc56c10da10 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc564007b30 con 0x7fc56c10da10 2023-10-05T15:15:20.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c19e880 con 0x7fc56c10da10 2023-10-05T15:15:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564005280 con 0x7fc56c10da10 2023-10-05T15:15:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.232+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c1a60e0 con 0x7fc56c10da10 2023-10-05T15:15:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.233+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c04ebb0 con 0x7fc56c10da10 2023-10-05T15:15:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.234+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc56400c8d0 con 0x7fc56c10da10 2023-10-05T15:15:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.235+0000 7fc569ffb700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc55c0a1510 0x7fc55c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.235+0000 7fc570921700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc55c0a1510 0x7fc55c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.235+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc5640cc5c0 con 0x7fc56c10da10 2023-10-05T15:15:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.235+0000 7fc570921700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc55c0a1510 0x7fc55c0a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc560005950 tx=0x7fc56000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:20.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.239+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc564095900 con 0x7fc56c10da10 2023-10-05T15:15:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.441+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc56c113210 con 0x7fc56c10da10 2023-10-05T15:15:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.442+0000 7fc569ffb700 1 -- 172.21.15.60:0/4262121167 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7fc564098f20 con 0x7fc56c10da10 2023-10-05T15:15:20.445 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:20.445 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.444+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc55c0a1510 msgr2=0x7fc55c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.444+0000 7fc572b85700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc55c0a1510 0x7fc55c0a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc560005950 tx=0x7fc56000b410 comp rx=0 tx=0).stop 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.444+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 msgr2=0x7fc56c19dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.444+0000 7fc572b85700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 0x7fc56c19dc60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc56400ada0 tx=0x7fc56400c330 comp rx=0 tx=0).stop 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 shutdown_connections 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc55c0a1510 0x7fc55c0a39d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56c10da10 0x7fc56c19dc60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56c0689a0 0x7fc56c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 --2- 172.21.15.60:0/4262121167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc56c0692c0 0x7fc56c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 >> 172.21.15.60:0/4262121167 conn(0x7fc56c075e00 msgr2=0x7fc56c10ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 shutdown_connections 2023-10-05T15:15:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:20.445+0000 7fc572b85700 1 -- 172.21.15.60:0/4262121167 wait complete. 2023-10-05T15:15:20.600 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:20 smithi060 ceph-mon[99238]: pgmap v275: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2023-10-05T15:15:20.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:20 smithi092 ceph-mon[102944]: pgmap v275: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2023-10-05T15:15:20.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:20 smithi135 ceph-mon[103360]: pgmap v275: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 22 op/s 2023-10-05T15:15:20.933 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-05T15:15:20.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-05T15:15:21.499 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:21.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:21 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4262121167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:21 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4262121167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:21.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:21 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4262121167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:22.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:22 smithi060 ceph-mon[99238]: pgmap v276: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2023-10-05T15:15:22.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:22 smithi092 ceph-mon[102944]: pgmap v276: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2023-10-05T15:15:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 -- 172.21.15.60:0/1552667722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d10105ec0 msgr2=0x7f0d101062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 --2- 172.21.15.60:0/1552667722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d10105ec0 0x7f0d101062a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009990 tx=0x7f0d00009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 -- 172.21.15.60:0/1552667722 shutdown_connections 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 --2- 172.21.15.60:0/1552667722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d101007d0 0x7f0d1010cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 --2- 172.21.15.60:0/1552667722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d10105ec0 0x7f0d101062a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 --2- 172.21.15.60:0/1552667722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d100ffe10 0x7f0d10100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 -- 172.21.15.60:0/1552667722 >> 172.21.15.60:0/1552667722 conn(0x7f0d10076dc0 msgr2=0x7f0d100771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 -- 172.21.15.60:0/1552667722 shutdown_connections 2023-10-05T15:15:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.715+0000 7f0d151ec700 1 -- 172.21.15.60:0/1552667722 wait complete. 2023-10-05T15:15:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.716+0000 7f0d151ec700 1 Processor -- start 2023-10-05T15:15:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.716+0000 7f0d151ec700 1 -- start start 2023-10-05T15:15:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d151ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 0x7f0d10195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d151ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d101007d0 0x7f0d101963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d151ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d10105ec0 0x7f0d1019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d151ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1019ae40 con 0x7f0d100ffe10 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d151ec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1019afb0 con 0x7f0d101007d0 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d151ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1019b170 con 0x7f0d10105ec0 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 0x7f0d10195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 0x7f0d10195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36520/0 (socket says 172.21.15.60:36520) 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 -- 172.21.15.60:0/3313976123 learned_addr learned my addr 172.21.15.60:0/3313976123 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0f59e700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d10105ec0 0x7f0d1019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0e59c700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d101007d0 0x7f0d101963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 -- 172.21.15.60:0/3313976123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d10105ec0 msgr2=0x7f0d1019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d10105ec0 0x7f0d1019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 -- 172.21.15.60:0/3313976123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d101007d0 msgr2=0x7f0d101963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d101007d0 0x7f0d101963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 -- 172.21.15.60:0/3313976123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000095f0 con 0x7f0d100ffe10 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.717+0000 7f0d0ed9d700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 0x7f0d10195e80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0d000095c0 tx=0x7f0d0001a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.718+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0001f070 con 0x7f0d100ffe10 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.718+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1019b3f0 con 0x7f0d100ffe10 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.718+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d0000f460 con 0x7f0d100ffe10 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.718+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d10069400 con 0x7f0d100ffe10 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.718+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00025620 con 0x7f0d100ffe10 2023-10-05T15:15:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.719+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1004ebb0 con 0x7f0d100ffe10 2023-10-05T15:15:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.720+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0d00023070 con 0x7f0d100ffe10 2023-10-05T15:15:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.720+0000 7f0cf7fff700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0cf80a1510 0x7f0cf80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.721+0000 7f0d0e59c700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0cf80a1510 0x7f0cf80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.721+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0d000d0000 con 0x7f0d100ffe10 2023-10-05T15:15:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.721+0000 7f0d0e59c700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0cf80a1510 0x7f0cf80a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d04005950 tx=0x7f0d040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.724+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d00060100 con 0x7f0d100ffe10 2023-10-05T15:15:22.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:22 smithi135 ceph-mon[103360]: pgmap v276: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2023-10-05T15:15:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.925+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d1019b580 con 0x7f0d100ffe10 2023-10-05T15:15:22.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.926+0000 7f0cf7fff700 1 -- 172.21.15.60:0/3313976123 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23876 (secure 0 0 0) 0x7f0d000993a0 con 0x7f0d100ffe10 2023-10-05T15:15:22.928 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:22.928 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:14:52.659481+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:22.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0cf80a1510 msgr2=0x7f0cf80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:22.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0cf80a1510 0x7f0cf80a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d04005950 tx=0x7f0d040058e0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 msgr2=0x7f0d10195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:22.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 0x7f0d10195e80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0d000095c0 tx=0x7f0d0001a8c0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 shutdown_connections 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d10105ec0 0x7f0d1019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0cf80a1510 0x7f0cf80a39d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d100ffe10 0x7f0d10195e80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.928+0000 7f0d151ec700 1 --2- 172.21.15.60:0/3313976123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d101007d0 0x7f0d101963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.929+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 >> 172.21.15.60:0/3313976123 conn(0x7f0d10076dc0 msgr2=0x7f0d100fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.929+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 shutdown_connections 2023-10-05T15:15:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:22.929+0000 7f0d151ec700 1 -- 172.21.15.60:0/3313976123 wait complete. 2023-10-05T15:15:23.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-05T15:15:23.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-05T15:15:23.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-05T15:15:23.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-05T15:15:23.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-05T15:15:23.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-05T15:15:23.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-05T15:15:23.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-05T15:15:23.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-05T15:15:23.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-05T15:15:23.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-05T15:15:23.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-05T15:15:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:23 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3313976123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:23.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:23 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3313976123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:23.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:23 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3313976123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:15:24.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:24 smithi060 ceph-mon[99238]: pgmap v277: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 KiB/s wr, 18 op/s 2023-10-05T15:15:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:24 smithi092 ceph-mon[102944]: pgmap v277: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 KiB/s wr, 18 op/s 2023-10-05T15:15:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:24.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:24 smithi135 ceph-mon[103360]: pgmap v277: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 KiB/s wr, 18 op/s 2023-10-05T15:15:24.983 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:24.983 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:25.987 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:26.601 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:26 smithi060 ceph-mon[99238]: pgmap v278: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2023-10-05T15:15:26.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:26 smithi092 ceph-mon[102944]: pgmap v278: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2023-10-05T15:15:26.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:26 smithi135 ceph-mon[103360]: pgmap v278: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2023-10-05T15:15:26.977 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:27.375 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:28.606 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:28 smithi060 ceph-mon[99238]: pgmap v279: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2023-10-05T15:15:28.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:28 smithi092 ceph-mon[102944]: pgmap v279: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2023-10-05T15:15:28.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:28 smithi135 ceph-mon[103360]: pgmap v279: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2023-10-05T15:15:30.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 -- 172.21.15.60:0/1952218392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 msgr2=0x7f1894107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 --2- 172.21.15.60:0/1952218392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f1894107380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f18840099c0 tx=0x7f1884009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 -- 172.21.15.60:0/1952218392 shutdown_connections 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 --2- 172.21.15.60:0/1952218392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1894069340 0x7f189410dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 --2- 172.21.15.60:0/1952218392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f1894107380 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 --2- 172.21.15.60:0/1952218392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18940689a0 0x7f1894068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 -- 172.21.15.60:0/1952218392 >> 172.21.15.60:0/1952218392 conn(0x7f1894075e00 msgr2=0x7f1894076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 -- 172.21.15.60:0/1952218392 shutdown_connections 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.220+0000 7f1899fd7700 1 -- 172.21.15.60:0/1952218392 wait complete. 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 Processor -- start 2023-10-05T15:15:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 -- start start 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18940689a0 0x7f1894196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1894069340 0x7f1894197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f189419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189419bfb0 con 0x7f1894106fa0 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189419c120 con 0x7f1894069340 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.221+0000 7f1899fd7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189419c2e0 con 0x7f18940689a0 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f189419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f189419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36552/0 (socket says 172.21.15.60:36552) 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 -- 172.21.15.60:0/3587645521 learned_addr learned my addr 172.21.15.60:0/3587645521 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1892ffd700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1894069340 0x7f1894197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f18937fe700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18940689a0 0x7f1894196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 -- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18940689a0 msgr2=0x7f1894196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18940689a0 0x7f1894196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 -- 172.21.15.60:0/3587645521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1894069340 msgr2=0x7f1894197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1894069340 0x7f1894197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 -- 172.21.15.60:0/3587645521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840095f0 con 0x7f1894106fa0 2023-10-05T15:15:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1893fff700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f189419b9a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f188c00ef30 tx=0x7f188c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c018070 con 0x7f1894106fa0 2023-10-05T15:15:30.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189419c560 con 0x7f1894106fa0 2023-10-05T15:15:30.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f188c00f040 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00cd00 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.222+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18941a3e20 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.224+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f189404ebb0 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.224+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f188c003a00 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.225+0000 7f1890ff9700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f18800a1510 0x7f18800a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.225+0000 7f18937fe700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f18800a1510 0x7f18800a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.225+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f188c0ccb40 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.225+0000 7f1890ff9700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] conn(0x7f18800ac090 0x7f18800ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.225+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 --> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18800aeba0 con 0x7f18800ac090 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.225+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f188c0d12c0 con 0x7f1894106fa0 2023-10-05T15:15:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.226+0000 7f18937fe700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f18800a1510 0x7f18800a39d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1884000c00 tx=0x7f1884019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.226+0000 7f1892ffd700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] conn(0x7f18800ac090 0x7f18800ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.226+0000 7f1892ffd700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] conn(0x7f18800ac090 0x7f18800ae4d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.227+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== osd.2 v2:172.21.15.135:6800/391606832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f18800aeba0 con 0x7f18800ac090 2023-10-05T15:15:30.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.243+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 --> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1894111140 con 0x7f18800ac090 2023-10-05T15:15:30.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1890ff9700 1 -- 172.21.15.60:0/3587645521 <== osd.2 v2:172.21.15.135:6800/391606832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f187c004830 con 0x7f18800ac090 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] conn(0x7f18800ac090 msgr2=0x7f18800ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1899fd7700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] conn(0x7f18800ac090 0x7f18800ae4d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f18800a1510 msgr2=0x7f18800a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1899fd7700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f18800a1510 0x7f18800a39d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1884000c00 tx=0x7f1884019040 comp rx=0 tx=0).stop 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 msgr2=0x7f189419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.244+0000 7f1899fd7700 1 --2- 172.21.15.60:0/3587645521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894106fa0 0x7f189419b9a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f188c00ef30 tx=0x7f188c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.245+0000 7f1893fff700 1 -- 172.21.15.60:0/3587645521 reap_dead start 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.245+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 shutdown_connections 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.245+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 >> 172.21.15.60:0/3587645521 conn(0x7f1894075e00 msgr2=0x7f18940febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:30.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.245+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 shutdown_connections 2023-10-05T15:15:30.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.245+0000 7f1899fd7700 1 -- 172.21.15.60:0/3587645521 wait complete. 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 -- 172.21.15.60:0/1298152345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1020b0 msgr2=0x7f590c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 --2- 172.21.15.60:0/1298152345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1020b0 0x7f590c102490 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5900009990 tx=0x7f5900009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 -- 172.21.15.60:0/1298152345 shutdown_connections 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 --2- 172.21.15.60:0/1298152345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f590c10b4e0 0x7f590c10d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 --2- 172.21.15.60:0/1298152345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1020b0 0x7f590c102490 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 --2- 172.21.15.60:0/1298152345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c1029d0 0x7f590c10aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 -- 172.21.15.60:0/1298152345 >> 172.21.15.60:0/1298152345 conn(0x7f590c0fb920 msgr2=0x7f590c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 -- 172.21.15.60:0/1298152345 shutdown_connections 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.545+0000 7f591309f700 1 -- 172.21.15.60:0/1298152345 wait complete. 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.546+0000 7f591309f700 1 Processor -- start 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.546+0000 7f591309f700 1 -- start start 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c1020b0 0x7f590c197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1029d0 0x7f590c197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f590c10b4e0 0x7f590c19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19c000 con 0x7f590c1029d0 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19c170 con 0x7f590c10b4e0 2023-10-05T15:15:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19c330 con 0x7f590c1020b0 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1029d0 0x7f590c197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1029d0 0x7f590c197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36534/0 (socket says 172.21.15.60:36534) 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 -- 172.21.15.60:0/694686107 learned_addr learned my addr 172.21.15.60:0/694686107 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591163c700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f590c10b4e0 0x7f590c19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f5910e3b700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c1020b0 0x7f590c197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 -- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c1020b0 msgr2=0x7f590c197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c1020b0 0x7f590c197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 -- 172.21.15.60:0/694686107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f590c10b4e0 msgr2=0x7f590c19b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f590c10b4e0 0x7f590c19b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 -- 172.21.15.60:0/694686107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59000095f0 con 0x7f590c1029d0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f5910e3b700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c1020b0 0x7f590c197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591163c700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f590c10b4e0 0x7f590c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f590bfff700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1029d0 0x7f590c197580 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f58f800d750 tx=0x7f58f800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80098d0 con 0x7f590c1029d0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f8010460 con 0x7f590c1029d0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c19c610 con 0x7f590c1029d0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.547+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f800f620 con 0x7f590c1029d0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.548+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c1a3e70 con 0x7f590c1029d0 2023-10-05T15:15:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.549+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f590c111120 con 0x7f590c1029d0 2023-10-05T15:15:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.550+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f58f80108d0 con 0x7f590c1029d0 2023-10-05T15:15:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.550+0000 7f5909ffb700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f58fc0a1510 0x7f58fc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f5910e3b700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f58fc0a1510 0x7f58fc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f58f80ccb00 con 0x7f590c1029d0 2023-10-05T15:15:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f5909ffb700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] conn(0x7f58fc0ac090 0x7f58fc0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 --> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58fc0aeba0 con 0x7f58fc0ac090 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f80d12c0 con 0x7f590c1029d0 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f5910e3b700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f58fc0a1510 0x7f58fc0a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5900006010 tx=0x7f590000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.551+0000 7f591163c700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] conn(0x7f58fc0ac090 0x7f58fc0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.552+0000 7f591163c700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] conn(0x7f58fc0ac090 0x7f58fc0ae4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.553+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== osd.5 v2:172.21.15.135:6808/3143637698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f58fc0aeba0 con 0x7f58fc0ac090 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.572+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 --> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f590c04ebb0 con 0x7f58fc0ac090 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.572+0000 7f5909ffb700 1 -- 172.21.15.60:0/694686107 <== osd.5 v2:172.21.15.135:6808/3143637698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f590c04ebb0 con 0x7f58fc0ac090 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] conn(0x7f58fc0ac090 msgr2=0x7f58fc0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591309f700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] conn(0x7f58fc0ac090 0x7f58fc0ae4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f58fc0a1510 msgr2=0x7f58fc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591309f700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f58fc0a1510 0x7f58fc0a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5900006010 tx=0x7f590000b540 comp rx=0 tx=0).stop 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1029d0 msgr2=0x7f590c197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591309f700 1 --2- 172.21.15.60:0/694686107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c1029d0 0x7f590c197580 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f58f800d750 tx=0x7f58f800db10 comp rx=0 tx=0).stop 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.574+0000 7f591163c700 1 -- 172.21.15.60:0/694686107 reap_dead start 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.575+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 shutdown_connections 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.575+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 >> 172.21.15.60:0/694686107 conn(0x7f590c0fb920 msgr2=0x7f590c10d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.575+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 shutdown_connections 2023-10-05T15:15:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:29.575+0000 7f591309f700 1 -- 172.21.15.60:0/694686107 wait complete. 2023-10-05T15:15:30.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.324+0000 7fc7373be700 1 -- 172.21.15.60:0/3374989916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101180 msgr2=0x7fc730101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.324+0000 7fc7373be700 1 --2- 172.21.15.60:0/3374989916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101180 0x7fc730101560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc72800b0a0 tx=0x7fc72800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 -- 172.21.15.60:0/3374989916 shutdown_connections 2023-10-05T15:15:30.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 --2- 172.21.15.60:0/3374989916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730106260 0x7fc73010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 --2- 172.21.15.60:0/3374989916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101180 0x7fc730101560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 --2- 172.21.15.60:0/3374989916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc730101b30 0x7fc730105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 -- 172.21.15.60:0/3374989916 >> 172.21.15.60:0/3374989916 conn(0x7fc7300fc9d0 msgr2=0x7fc7300fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 -- 172.21.15.60:0/3374989916 shutdown_connections 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 -- 172.21.15.60:0/3374989916 wait complete. 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 Processor -- start 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.325+0000 7fc7373be700 1 -- start start 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc7373be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730101180 0x7fc730194f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc7373be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101b30 0x7fc730195460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc7373be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc730106260 0x7fc7301998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc7373be700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc730199ee0 con 0x7fc730101b30 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc7373be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73019a050 con 0x7fc730106260 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc7373be700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73019a210 con 0x7fc730101180 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730101180 0x7fc730194f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730101180 0x7fc730194f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:50094/0 (socket says 172.21.15.60:50094) 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 -- 172.21.15.60:0/1277604323 learned_addr learned my addr 172.21.15.60:0/1277604323 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73595b700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc730106260 0x7fc7301998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc734959700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101b30 0x7fc730195460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 -- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc730106260 msgr2=0x7fc7301998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc730106260 0x7fc7301998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 -- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101b30 msgr2=0x7fc730195460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc730101b30 0x7fc730195460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.326+0000 7fc73515a700 1 -- 172.21.15.60:0/1277604323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009d00 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.327+0000 7fc73515a700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730101180 0x7fc730194f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc7280062a0 tx=0x7fc72800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.327+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800e040 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.327+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73019a490 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.327+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc728007930 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.327+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72801b6c0 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.327+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7301a1d50 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.328+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc73019a760 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.330+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc72801d470 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.331+0000 7fc7227fc700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc71c0a1510 0x7fc71c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.331+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc7280ce9b0 con 0x7fc730101180 2023-10-05T15:15:30.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.331+0000 7fc734959700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc71c0a1510 0x7fc71c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.331+0000 7fc7227fc700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] conn(0x7fc71c0abf60 0x7fc71c0ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.331+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 --> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc71c0aea70 con 0x7fc71c0abf60 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.331+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7280cedc0 con 0x7fc730101180 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.332+0000 7fc73595b700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] conn(0x7fc71c0abf60 0x7fc71c0ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.332+0000 7fc734959700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc71c0a1510 0x7fc71c0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc730196540 tx=0x7fc72c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.332+0000 7fc73595b700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] conn(0x7fc71c0abf60 0x7fc71c0ae3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.333+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== osd.7 v2:172.21.15.92:6816/784886390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc71c0aea70 con 0x7fc71c0abf60 2023-10-05T15:15:30.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.352+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 --> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc73010f010 con 0x7fc71c0abf60 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.352+0000 7fc7227fc700 1 -- 172.21.15.60:0/1277604323 <== osd.7 v2:172.21.15.92:6816/784886390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc724004830 con 0x7fc71c0abf60 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] conn(0x7fc71c0abf60 msgr2=0x7fc71c0ae3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] conn(0x7fc71c0abf60 0x7fc71c0ae3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc71c0a1510 msgr2=0x7fc71c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc71c0a1510 0x7fc71c0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc730196540 tx=0x7fc72c009260 comp rx=0 tx=0).stop 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730101180 msgr2=0x7fc730194f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 --2- 172.21.15.60:0/1277604323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc730101180 0x7fc730194f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc7280062a0 tx=0x7fc72800bd60 comp rx=0 tx=0).stop 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc73595b700 1 -- 172.21.15.60:0/1277604323 reap_dead start 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 shutdown_connections 2023-10-05T15:15:30.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 >> 172.21.15.60:0/1277604323 conn(0x7fc7300fc9d0 msgr2=0x7fc7300fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:30.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 shutdown_connections 2023-10-05T15:15:30.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:30.353+0000 7fc7373be700 1 -- 172.21.15.60:0/1277604323 wait complete. 2023-10-05T15:15:30.607 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:30 smithi060 ceph-mon[99238]: pgmap v280: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-05T15:15:30.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:30 smithi092 ceph-mon[102944]: pgmap v280: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-05T15:15:30.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:30 smithi135 ceph-mon[103360]: pgmap v280: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-05T15:15:31.192 INFO:teuthology.orchestra.run.smithi060.stdout:223338299428 2023-10-05T15:15:31.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-05T15:15:31.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 -- 172.21.15.60:0/2089580326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c101940 msgr2=0x7f960c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 --2- 172.21.15.60:0/2089580326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c101940 0x7f960c10ddb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f960400b0d0 tx=0x7f960400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 -- 172.21.15.60:0/2089580326 shutdown_connections 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 --2- 172.21.15.60:0/2089580326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c101940 0x7f960c10ddb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 --2- 172.21.15.60:0/2089580326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f960c106f90 0x7f960c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 --2- 172.21.15.60:0/2089580326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c100f80 0x7f960c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 -- 172.21.15.60:0/2089580326 >> 172.21.15.60:0/2089580326 conn(0x7f960c0780a0 msgr2=0x7f960c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 -- 172.21.15.60:0/2089580326 shutdown_connections 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.874+0000 7f9610849700 1 -- 172.21.15.60:0/2089580326 wait complete. 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.875+0000 7f9610849700 1 Processor -- start 2023-10-05T15:15:31.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.875+0000 7f9610849700 1 -- start start 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9610849700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c100f80 0x7f960c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9610849700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c101940 0x7f960c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9610849700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f960c106f90 0x7f960c073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9610849700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1a5560 con 0x7f960c100f80 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9610849700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1a56d0 con 0x7f960c101940 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9610849700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1a5890 con 0x7f960c106f90 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c100f80 0x7f960c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c100f80 0x7f960c0731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36578/0 (socket says 172.21.15.60:36578) 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 -- 172.21.15.60:0/4227153896 learned_addr learned my addr 172.21.15.60:0/4227153896 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9609d9b700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c101940 0x7f960c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:31.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960ad9d700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f960c106f90 0x7f960c073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 -- 172.21.15.60:0/4227153896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f960c106f90 msgr2=0x7f960c073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f960c106f90 0x7f960c073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 -- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c101940 msgr2=0x7f960c0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c101940 0x7f960c0736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 -- 172.21.15.60:0/4227153896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009d00 con 0x7f960c100f80 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f9609d9b700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c101940 0x7f960c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.876+0000 7f960a59c700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c100f80 0x7f960c0731b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00d980 tx=0x7f95fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.877+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00bb60 con 0x7f960c100f80 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.877+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f95fc007640 con 0x7f960c100f80 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.877+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c1a5b70 con 0x7f960c100f80 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.877+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc004e90 con 0x7f960c100f80 2023-10-05T15:15:31.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.877+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c1a60c0 con 0x7f960c100f80 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.878+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f960c111090 con 0x7f960c100f80 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.879+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f95fc00bcc0 con 0x7f960c100f80 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f95fb7fe700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f95f40a1590 0x7f95f40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f9609d9b700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f95f40a1590 0x7f95f40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f95fc0cd4a0 con 0x7f960c100f80 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f95fb7fe700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] conn(0x7f95f40abfa0 0x7f95f40ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 --> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95f40aeab0 con 0x7f95f40abfa0 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95fc0cd8b0 con 0x7f960c100f80 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f9609d9b700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f95f40a1590 0x7f95f40a3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f960c0749a0 tx=0x7f9600009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.880+0000 7f960ad9d700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] conn(0x7f95f40abfa0 0x7f95f40ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.881+0000 7f960ad9d700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] conn(0x7f95f40abfa0 0x7f95f40ae3e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.882+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== osd.4 v2:172.21.15.92:6808/3732185580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f95f40aeab0 con 0x7f95f40abfa0 2023-10-05T15:15:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.898+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 --> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f960c04ebb0 con 0x7f95f40abfa0 2023-10-05T15:15:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.899+0000 7f95fb7fe700 1 -- 172.21.15.60:0/4227153896 <== osd.4 v2:172.21.15.92:6808/3732185580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f960c04ebb0 con 0x7f95f40abfa0 2023-10-05T15:15:31.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.899+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] conn(0x7f95f40abfa0 msgr2=0x7f95f40ae3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:31.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.899+0000 7f9610849700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] conn(0x7f95f40abfa0 0x7f95f40ae3e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:31.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f95f40a1590 msgr2=0x7f95f40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:31.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f95f40a1590 0x7f95f40a3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f960c0749a0 tx=0x7f9600009260 comp rx=0 tx=0).stop 2023-10-05T15:15:31.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c100f80 msgr2=0x7f960c0731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:31.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 --2- 172.21.15.60:0/4227153896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f960c100f80 0x7f960c0731b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00d980 tx=0x7f95fc00dd40 comp rx=0 tx=0).stop 2023-10-05T15:15:31.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f960ad9d700 1 -- 172.21.15.60:0/4227153896 reap_dead start 2023-10-05T15:15:31.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 shutdown_connections 2023-10-05T15:15:31.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 >> 172.21.15.60:0/4227153896 conn(0x7f960c0780a0 msgr2=0x7f960c0ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:31.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 shutdown_connections 2023-10-05T15:15:31.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.900+0000 7f9610849700 1 -- 172.21.15.60:0/4227153896 wait complete. 2023-10-05T15:15:31.991 INFO:teuthology.orchestra.run.smithi060.stdout:167503724589 2023-10-05T15:15:31.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-05T15:15:32.261 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:32 smithi060 ceph-mon[99238]: pgmap v281: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-10-05T15:15:32.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:32 smithi135 ceph-mon[103360]: pgmap v281: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-10-05T15:15:32.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:32 smithi092 ceph-mon[102944]: pgmap v281: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-10-05T15:15:32.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 -- 172.21.15.60:0/3027755085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 msgr2=0x7f594c106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 --2- 172.21.15.60:0/3027755085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c106250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f59400099c0 tx=0x7f5940009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 -- 172.21.15.60:0/3027755085 shutdown_connections 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 --2- 172.21.15.60:0/3027755085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c100820 0x7f594c10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 --2- 172.21.15.60:0/3027755085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c106250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 --2- 172.21.15.60:0/3027755085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f594c0ffe60 0x7f594c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 -- 172.21.15.60:0/3027755085 >> 172.21.15.60:0/3027755085 conn(0x7f594c075e00 msgr2=0x7f594c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 -- 172.21.15.60:0/3027755085 shutdown_connections 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 -- 172.21.15.60:0/3027755085 wait complete. 2023-10-05T15:15:32.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.929+0000 7f59514e8700 1 Processor -- start 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 -- start start 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c0ffe60 0x7f594c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f594c100820 0x7f594c197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c19bfe0 con 0x7f594c105e70 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c19c150 con 0x7f594c0ffe60 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f59514e8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c19c310 con 0x7f594c100820 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36598/0 (socket says 172.21.15.60:36598) 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 -- 172.21.15.60:0/2614382396 learned_addr learned my addr 172.21.15.60:0/2614382396 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:32.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594affd700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c0ffe60 0x7f594c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594a7fc700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f594c100820 0x7f594c197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 -- 172.21.15.60:0/2614382396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f594c100820 msgr2=0x7f594c197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f594c100820 0x7f594c197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 -- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c0ffe60 msgr2=0x7f594c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c0ffe60 0x7f594c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 -- 172.21.15.60:0/2614382396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400095f0 con 0x7f594c105e70 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594a7fc700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f594c100820 0x7f594c197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.930+0000 7f594b7fe700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c19b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f594400ef30 tx=0x7f594400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.931+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944018070 con 0x7f594c105e70 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.931+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f594400f040 con 0x7f594c105e70 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.931+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c19c590 con 0x7f594c105e70 2023-10-05T15:15:32.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.931+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944003dc0 con 0x7f594c105e70 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.931+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c1a3e50 con 0x7f594c105e70 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.931+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f594c110000 con 0x7f594c105e70 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.933+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f594400caa0 con 0x7f594c105e70 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.933+0000 7f5933fff700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f59340a1590 0x7f59340a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.933+0000 7f594affd700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f59340a1590 0x7f59340a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.933+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f59440cd5b0 con 0x7f594c105e70 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.934+0000 7f5933fff700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] conn(0x7f59340ac110 0x7f59340ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.934+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 --> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59340aec20 con 0x7f59340ac110 2023-10-05T15:15:32.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.934+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59440cd9c0 con 0x7f594c105e70 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.934+0000 7f594affd700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f59340a1590 0x7f59340a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5940009990 tx=0x7f594001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.934+0000 7f594a7fc700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] conn(0x7f59340ac110 0x7f59340ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.934+0000 7f594a7fc700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] conn(0x7f59340ac110 0x7f59340ae550 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.935+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== osd.10 v2:172.21.15.92:6824/2400346223 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f59340aec20 con 0x7f59340ac110 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.952+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 --> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f594c04ebb0 con 0x7f59340ac110 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f5933fff700 1 -- 172.21.15.60:0/2614382396 <== osd.10 v2:172.21.15.92:6824/2400346223 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f594c04ebb0 con 0x7f59340ac110 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] conn(0x7f59340ac110 msgr2=0x7f59340ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f59514e8700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] conn(0x7f59340ac110 0x7f59340ae550 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:32.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f59340a1590 msgr2=0x7f59340a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f59514e8700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f59340a1590 0x7f59340a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5940009990 tx=0x7f594001a040 comp rx=0 tx=0).stop 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 msgr2=0x7f594c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f59514e8700 1 --2- 172.21.15.60:0/2614382396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f594c105e70 0x7f594c19b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f594400ef30 tx=0x7f594400c450 comp rx=0 tx=0).stop 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.953+0000 7f594b7fe700 1 -- 172.21.15.60:0/2614382396 reap_dead start 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.954+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 shutdown_connections 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.954+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 >> 172.21.15.60:0/2614382396 conn(0x7f594c075e00 msgr2=0x7f594c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.954+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 shutdown_connections 2023-10-05T15:15:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:31.954+0000 7f59514e8700 1 -- 172.21.15.60:0/2614382396 wait complete. 2023-10-05T15:15:33.056 INFO:teuthology.orchestra.run.smithi060.stdout:146028888114 2023-10-05T15:15:33.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-05T15:15:33.454 INFO:teuthology.orchestra.run.smithi060.stdout:309237645337 2023-10-05T15:15:33.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-05T15:15:33.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 -- 172.21.15.60:0/2162507844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb0105360 msgr2=0x7f7eb010cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 --2- 172.21.15.60:0/2162507844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb0105360 0x7f7eb010cf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800b0a0 tx=0x7f7ea800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 -- 172.21.15.60:0/2162507844 shutdown_connections 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 --2- 172.21.15.60:0/2162507844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb0105360 0x7f7eb010cf30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 --2- 172.21.15.60:0/2162507844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb01007a0 0x7f7eb0100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 --2- 172.21.15.60:0/2162507844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eb0101150 0x7f7eb0104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 -- 172.21.15.60:0/2162507844 >> 172.21.15.60:0/2162507844 conn(0x7f7eb0076360 msgr2=0x7f7eb00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 -- 172.21.15.60:0/2162507844 shutdown_connections 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.379+0000 7f7eb799d700 1 -- 172.21.15.60:0/2162507844 wait complete. 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 Processor -- start 2023-10-05T15:15:33.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 -- start start 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb01007a0 0x7f7eb0197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eb0101150 0x7f7eb01977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0105360 0x7f7eb019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019c220 con 0x7f7eb01007a0 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019c390 con 0x7f7eb0105360 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb799d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019c550 con 0x7f7eb0101150 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb5739700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb01007a0 0x7f7eb0197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb5739700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb01007a0 0x7f7eb0197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36624/0 (socket says 172.21.15.60:36624) 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb5739700 1 -- 172.21.15.60:0/1463026330 learned_addr learned my addr 172.21.15.60:0/1463026330 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.380+0000 7f7eb5f3a700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0105360 0x7f7eb019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb4f38700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eb0101150 0x7f7eb01977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb5739700 1 -- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eb0101150 msgr2=0x7f7eb01977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb5739700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eb0101150 0x7f7eb01977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb5739700 1 -- 172.21.15.60:0/1463026330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0105360 msgr2=0x7f7eb019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb5739700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0105360 0x7f7eb019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb5739700 1 -- 172.21.15.60:0/1463026330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea8009d00 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb5739700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb01007a0 0x7f7eb0197260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000c9b0 tx=0x7f7ea000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0007b00 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ea000ce50 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb019c830 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0018660 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.381+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb01a4090 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.382+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7eb0110260 con 0x7f7eb01007a0 2023-10-05T15:15:33.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.383+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7ea000f450 con 0x7f7eb01007a0 2023-10-05T15:15:33.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7ea67fc700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e9c0a1510 0x7f7e9c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7eb4f38700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e9c0a1510 0x7f7e9c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7ea00cd440 con 0x7f7eb01007a0 2023-10-05T15:15:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7ea67fc700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] conn(0x7f7e9c0ac090 0x7f7e9c0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 --> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e9c0aeba0 con 0x7f7e9c0ac090 2023-10-05T15:15:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ea00cd7b0 con 0x7f7eb01007a0 2023-10-05T15:15:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7eb4f38700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e9c0a1510 0x7f7e9c0a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0198880 tx=0x7f7eac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.384+0000 7f7eb5f3a700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] conn(0x7f7e9c0ac090 0x7f7e9c0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.385+0000 7f7eb5f3a700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] conn(0x7f7e9c0ac090 0x7f7e9c0ae4d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.386+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== osd.8 v2:172.21.15.135:6816/2545710917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7e9c0aeba0 con 0x7f7e9c0ac090 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.404+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 --> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7eb004ebb0 con 0x7f7e9c0ac090 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.404+0000 7f7ea67fc700 1 -- 172.21.15.60:0/1463026330 <== osd.8 v2:172.21.15.135:6816/2545710917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7eb004ebb0 con 0x7f7e9c0ac090 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] conn(0x7f7e9c0ac090 msgr2=0x7f7e9c0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] conn(0x7f7e9c0ac090 0x7f7e9c0ae4d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e9c0a1510 msgr2=0x7f7e9c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e9c0a1510 0x7f7e9c0a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0198880 tx=0x7f7eac00b410 comp rx=0 tx=0).stop 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb01007a0 msgr2=0x7f7eb0197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 --2- 172.21.15.60:0/1463026330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eb01007a0 0x7f7eb0197260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000c9b0 tx=0x7f7ea000ccc0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb5f3a700 1 -- 172.21.15.60:0/1463026330 reap_dead start 2023-10-05T15:15:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 shutdown_connections 2023-10-05T15:15:33.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 >> 172.21.15.60:0/1463026330 conn(0x7f7eb0076360 msgr2=0x7f7eb00fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:33.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 shutdown_connections 2023-10-05T15:15:33.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.405+0000 7f7eb799d700 1 -- 172.21.15.60:0/1463026330 wait complete. 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 -- 172.21.15.60:0/249620026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e40ffe60 msgr2=0x7fc3e41002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 --2- 172.21.15.60:0/249620026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e40ffe60 0x7fc3e41002e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80099c0 tx=0x7fc3d8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 -- 172.21.15.60:0/249620026 shutdown_connections 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 --2- 172.21.15.60:0/249620026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e4100820 0x7fc3e410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 --2- 172.21.15.60:0/249620026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e4105e70 0x7fc3e4106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 --2- 172.21.15.60:0/249620026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e40ffe60 0x7fc3e41002e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 -- 172.21.15.60:0/249620026 >> 172.21.15.60:0/249620026 conn(0x7fc3e4075e00 msgr2=0x7fc3e4076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:33.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 -- 172.21.15.60:0/249620026 shutdown_connections 2023-10-05T15:15:33.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 -- 172.21.15.60:0/249620026 wait complete. 2023-10-05T15:15:33.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.733+0000 7fc3e9885700 1 Processor -- start 2023-10-05T15:15:33.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 -- start start 2023-10-05T15:15:33.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e40ffe60 0x7fc3e4196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e4100820 0x7fc3e41974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e4105e70 0x7fc3e419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e419bf70 con 0x7fc3e4105e70 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e419c0e0 con 0x7fc3e40ffe60 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e9885700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e419c2a0 con 0x7fc3e4100820 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e4105e70 0x7fc3e419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e4105e70 0x7fc3e419b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36642/0 (socket says 172.21.15.60:36642) 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 -- 172.21.15.60:0/1419168712 learned_addr learned my addr 172.21.15.60:0/1419168712 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e2ffd700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e40ffe60 0x7fc3e4196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e27fc700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e4100820 0x7fc3e41974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 -- 172.21.15.60:0/1419168712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e4100820 msgr2=0x7fc3e41974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e4100820 0x7fc3e41974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 -- 172.21.15.60:0/1419168712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e40ffe60 msgr2=0x7fc3e4196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e40ffe60 0x7fc3e4196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.734+0000 7fc3e37fe700 1 -- 172.21.15.60:0/1419168712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80095f0 con 0x7fc3e4105e70 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e37fe700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e4105e70 0x7fc3e419b960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00b970 tx=0x7fc3dc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00d860 con 0x7fc3e4105e70 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e419c580 con 0x7fc3e4105e70 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3dc00de80 con 0x7fc3e4105e70 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc017400 con 0x7fc3e4105e70 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e41a3de0 con 0x7fc3e4105e70 2023-10-05T15:15:33.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.735+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3e404ebb0 con 0x7fc3e4105e70 2023-10-05T15:15:33.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.737+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc3dc00e630 con 0x7fc3e4105e70 2023-10-05T15:15:33.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e8883700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc3cc0a1510 0x7fc3cc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e2ffd700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc3cc0a1510 0x7fc3cc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc3dc006e40 con 0x7fc3e4105e70 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e8883700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] conn(0x7fc3cc0ac090 0x7fc3cc0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 --> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3cc0aeba0 con 0x7fc3cc0ac090 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3dc0cd310 con 0x7fc3e4105e70 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e27fc700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] conn(0x7fc3cc0ac090 0x7fc3cc0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e2ffd700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc3cc0a1510 0x7fc3cc0a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400ac50 tx=0x7fc3d400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.738+0000 7fc3e27fc700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] conn(0x7fc3cc0ac090 0x7fc3cc0ae4d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:33.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.739+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== osd.0 v2:172.21.15.60:6802/3848725098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc3cc0aeba0 con 0x7fc3cc0ac090 2023-10-05T15:15:33.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.755+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 --> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3e41100d0 con 0x7fc3cc0ac090 2023-10-05T15:15:33.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e8883700 1 -- 172.21.15.60:0/1419168712 <== osd.0 v2:172.21.15.60:6802/3848725098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3d801e040 con 0x7fc3cc0ac090 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] conn(0x7fc3cc0ac090 msgr2=0x7fc3cc0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] conn(0x7fc3cc0ac090 0x7fc3cc0ae4d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc3cc0a1510 msgr2=0x7fc3cc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc3cc0a1510 0x7fc3cc0a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400ac50 tx=0x7fc3d400a380 comp rx=0 tx=0).stop 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e4105e70 msgr2=0x7fc3e419b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 --2- 172.21.15.60:0/1419168712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e4105e70 0x7fc3e419b960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00b970 tx=0x7fc3dc00bc80 comp rx=0 tx=0).stop 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e37fe700 1 -- 172.21.15.60:0/1419168712 reap_dead start 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 shutdown_connections 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 >> 172.21.15.60:0/1419168712 conn(0x7fc3e4075e00 msgr2=0x7fc3e4103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 shutdown_connections 2023-10-05T15:15:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.756+0000 7fc3e9885700 1 -- 172.21.15.60:0/1419168712 wait complete. 2023-10-05T15:15:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 -- 172.21.15.60:0/796255523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101b30 msgr2=0x7f4be0105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 --2- 172.21.15.60:0/796255523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101b30 0x7f4be0105b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009990 tx=0x7f4bd4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 -- 172.21.15.60:0/796255523 shutdown_connections 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 --2- 172.21.15.60:0/796255523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be0106260 0x7f4be010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 --2- 172.21.15.60:0/796255523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be0101180 0x7f4be0101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 --2- 172.21.15.60:0/796255523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101b30 0x7f4be0105b80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 -- 172.21.15.60:0/796255523 >> 172.21.15.60:0/796255523 conn(0x7f4be00fc9d0 msgr2=0x7f4be00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 -- 172.21.15.60:0/796255523 shutdown_connections 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.341+0000 7f4be576c700 1 -- 172.21.15.60:0/796255523 wait complete. 2023-10-05T15:15:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 Processor -- start 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 -- start start 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101180 0x7f4be0196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be0101b30 0x7f4be01974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be0106260 0x7f4be019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be019bf30 con 0x7f4be0101180 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be019c0a0 con 0x7f4be0106260 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4be576c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be019c260 con 0x7f4be0101b30 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101180 0x7f4be0196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101180 0x7f4be0196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36608/0 (socket says 172.21.15.60:36608) 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 -- 172.21.15.60:0/3065565507 learned_addr learned my addr 172.21.15.60:0/3065565507 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bde7fc700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be0101b30 0x7f4be01974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdf7fe700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be0106260 0x7f4be019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 -- 172.21.15.60:0/3065565507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be0101b30 msgr2=0x7f4be01974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be0101b30 0x7f4be01974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 -- 172.21.15.60:0/3065565507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be0106260 msgr2=0x7f4be019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be0106260 0x7f4be019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.342+0000 7f4bdeffd700 1 -- 172.21.15.60:0/3065565507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd40095f0 con 0x7f4be0101180 2023-10-05T15:15:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4bdf7fe700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be0106260 0x7f4be019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4bdeffd700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101180 0x7f4be0196f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000d950 tx=0x7f4bd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0009940 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be019c540 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bd0010460 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000f620 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.343+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00732b0 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.344+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4be004ebb0 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.345+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4bd00108d0 con 0x7f4be0101180 2023-10-05T15:15:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bc7fff700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4bc80a1510 0x7f4bc80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4bd00cd510 con 0x7f4be0101180 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bde7fc700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4bc80a1510 0x7f4bc80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bc7fff700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] conn(0x7f4bc80ac090 0x7f4bc80ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 --> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bc80aeba0 con 0x7f4bc80ac090 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bd00cd920 con 0x7f4be0101180 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bdf7fe700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] conn(0x7f4bc80ac090 0x7f4bc80ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bde7fc700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4bc80a1510 0x7f4bc80a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4be0198590 tx=0x7f4bd4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.346+0000 7f4bdf7fe700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] conn(0x7f4bc80ac090 0x7f4bc80ae4d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.347+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== osd.6 v2:172.21.15.60:6818/2234761108 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4bc80aeba0 con 0x7f4bc80ac090 2023-10-05T15:15:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.364+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 --> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4be0111150 con 0x7f4bc80ac090 2023-10-05T15:15:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4bc7fff700 1 -- 172.21.15.60:0/3065565507 <== osd.6 v2:172.21.15.60:6818/2234761108 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4bd8007c40 con 0x7f4bc80ac090 2023-10-05T15:15:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] conn(0x7f4bc80ac090 msgr2=0x7f4bc80ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] conn(0x7f4bc80ac090 0x7f4bc80ae4d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4bc80a1510 msgr2=0x7f4bc80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4bc80a1510 0x7f4bc80a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4be0198590 tx=0x7f4bd4005fd0 comp rx=0 tx=0).stop 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101180 msgr2=0x7f4be0196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 --2- 172.21.15.60:0/3065565507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4be0101180 0x7f4be0196f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000d950 tx=0x7f4bd000dc60 comp rx=0 tx=0).stop 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4bdf7fe700 1 -- 172.21.15.60:0/3065565507 reap_dead start 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 shutdown_connections 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 >> 172.21.15.60:0/3065565507 conn(0x7f4be00fc9d0 msgr2=0x7f4be00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 shutdown_connections 2023-10-05T15:15:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:33.365+0000 7f4be576c700 1 -- 172.21.15.60:0/3065565507 wait complete. 2023-10-05T15:15:34.527 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:34 smithi060 ceph-mon[99238]: pgmap v282: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-05T15:15:34.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:34 smithi135 ceph-mon[103360]: pgmap v282: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-05T15:15:34.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:34 smithi092 ceph-mon[102944]: pgmap v282: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-05T15:15:35.331 INFO:teuthology.orchestra.run.smithi060.stdout:34359738436 2023-10-05T15:15:35.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-05T15:15:35.438 INFO:teuthology.orchestra.run.smithi060.stdout:77309411387 2023-10-05T15:15:35.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-05T15:15:35.476 INFO:teuthology.orchestra.run.smithi060.stdout:201863462953 2023-10-05T15:15:35.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-05T15:15:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 -- 172.21.15.60:0/2713508127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640695b0 msgr2=0x7fbd64105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 --2- 172.21.15.60:0/2713508127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640695b0 0x7fbd64105b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009990 tx=0x7fbd4c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 -- 172.21.15.60:0/2713508127 shutdown_connections 2023-10-05T15:15:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 --2- 172.21.15.60:0/2713508127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd641062b0 0x7fbd6410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 --2- 172.21.15.60:0/2713508127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd64068c00 0x7fbd64068fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 --2- 172.21.15.60:0/2713508127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640695b0 0x7fbd64105b80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 -- 172.21.15.60:0/2713508127 >> 172.21.15.60:0/2713508127 conn(0x7fbd64075e00 msgr2=0x7fbd64076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 -- 172.21.15.60:0/2713508127 shutdown_connections 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.830+0000 7fbd69243700 1 -- 172.21.15.60:0/2713508127 wait complete. 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.831+0000 7fbd69243700 1 Processor -- start 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.831+0000 7fbd69243700 1 -- start start 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.831+0000 7fbd69243700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd64068c00 0x7fbd64196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd640695b0 0x7fbd64197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd641062b0 0x7fbd6419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6419bfb0 con 0x7fbd64068c00 2023-10-05T15:15:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6419c120 con 0x7fbd641062b0 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6419c2e0 con 0x7fbd640695b0 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd64068c00 0x7fbd64196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd64068c00 0x7fbd64196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36652/0 (socket says 172.21.15.60:36652) 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 -- 172.21.15.60:0/2773343903 learned_addr learned my addr 172.21.15.60:0/2773343903 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd6359e700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd641062b0 0x7fbd6419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd6259c700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd640695b0 0x7fbd64197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 -- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd640695b0 msgr2=0x7fbd64197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd640695b0 0x7fbd64197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 -- 172.21.15.60:0/2773343903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd641062b0 msgr2=0x7fbd6419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd641062b0 0x7fbd6419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 -- 172.21.15.60:0/2773343903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0095f0 con 0x7fbd64068c00 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd62d9d700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd64068c00 0x7fbd64196ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbd54007f10 tx=0x7fbd5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400ddd0 con 0x7fbd64068c00 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd5400f040 con 0x7fbd64068c00 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6419c5c0 con 0x7fbd64068c00 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54004530 con 0x7fbd64068c00 2023-10-05T15:15:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.832+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd641a3e20 con 0x7fbd64068c00 2023-10-05T15:15:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.833+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd6404ebb0 con 0x7fbd64068c00 2023-10-05T15:15:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.834+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fbd54004ad0 con 0x7fbd64068c00 2023-10-05T15:15:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.835+0000 7fbd5bfff700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbd500a1510 0x7fbd500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.835+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbd540cd880 con 0x7fbd64068c00 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.835+0000 7fbd6259c700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbd500a1510 0x7fbd500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.835+0000 7fbd5bfff700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] conn(0x7fbd500ac090 0x7fbd500ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.835+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 --> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd500aeba0 con 0x7fbd500ac090 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.835+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd540cdc90 con 0x7fbd64068c00 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.836+0000 7fbd6359e700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] conn(0x7fbd500ac090 0x7fbd500ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.836+0000 7fbd6259c700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbd500a1510 0x7fbd500a39d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd64198610 tx=0x7fbd4c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:35.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.836+0000 7fbd6359e700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] conn(0x7fbd500ac090 0x7fbd500ae4d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.837+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== osd.11 v2:172.21.15.135:6824/2696703622 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbd500aeba0 con 0x7fbd500ac090 2023-10-05T15:15:35.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.854+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 --> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd64111150 con 0x7fbd500ac090 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd5bfff700 1 -- 172.21.15.60:0/2773343903 <== osd.11 v2:172.21.15.135:6824/2696703622 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbd5c009930 con 0x7fbd500ac090 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] conn(0x7fbd500ac090 msgr2=0x7fbd500ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] conn(0x7fbd500ac090 0x7fbd500ae4d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbd500a1510 msgr2=0x7fbd500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fbd500a1510 0x7fbd500a39d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd64198610 tx=0x7fbd4c00b260 comp rx=0 tx=0).stop 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd64068c00 msgr2=0x7fbd64196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 --2- 172.21.15.60:0/2773343903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd64068c00 0x7fbd64196ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbd54007f10 tx=0x7fbd5400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:35.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd6359e700 1 -- 172.21.15.60:0/2773343903 reap_dead start 2023-10-05T15:15:35.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 shutdown_connections 2023-10-05T15:15:35.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 >> 172.21.15.60:0/2773343903 conn(0x7fbd64075e00 msgr2=0x7fbd640fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:35.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 shutdown_connections 2023-10-05T15:15:35.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:35.855+0000 7fbd69243700 1 -- 172.21.15.60:0/2773343903 wait complete. 2023-10-05T15:15:36.170 INFO:teuthology.orchestra.run.smithi060.stdout:253403070496 2023-10-05T15:15:36.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-05T15:15:36.520 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:36 smithi060 ceph-mon[99238]: pgmap v283: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-05T15:15:36.520 INFO:teuthology.orchestra.run.smithi060.stdout:339302416405 2023-10-05T15:15:36.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-05T15:15:36.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:36 smithi135 ceph-mon[103360]: pgmap v283: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-05T15:15:36.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:36 smithi092 ceph-mon[102944]: pgmap v283: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-05T15:15:36.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/591391306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4106240 msgr2=0x7fb0d410de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/591391306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4106240 0x7fb0d410de10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00b0a0 tx=0x7fb0cc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/591391306 shutdown_connections 2023-10-05T15:15:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/591391306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4106240 0x7fb0d410de10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/591391306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d40ff670 0x7fb0d40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/591391306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d4100020 0x7fb0d4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/591391306 >> 172.21.15.60:0/591391306 conn(0x7fb0d4076360 msgr2=0x7fb0d40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/591391306 shutdown_connections 2023-10-05T15:15:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.890+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/591391306 wait complete. 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 Processor -- start 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 -- start start 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40ff670 0x7fb0d41005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4100020 0x7fb0d4100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d4106240 0x7fb0d41010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d41a5550 con 0x7fb0d4100020 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d41a56c0 con 0x7fb0d4106240 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.891+0000 7fb0d8e8c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d41a5880 con 0x7fb0d40ff670 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4100020 0x7fb0d4100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4100020 0x7fb0d4100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36686/0 (socket says 172.21.15.60:36686) 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 -- 172.21.15.60:0/3870325689 learned_addr learned my addr 172.21.15.60:0/3870325689 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d2d9d700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d4106240 0x7fb0d41010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d259c700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40ff670 0x7fb0d41005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 -- 172.21.15.60:0/3870325689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40ff670 msgr2=0x7fb0d41005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40ff670 0x7fb0d41005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 -- 172.21.15.60:0/3870325689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d4106240 msgr2=0x7fb0d41010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d4106240 0x7fb0d41010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 -- 172.21.15.60:0/3870325689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009d00 con 0x7fb0d4100020 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d1d9b700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4100020 0x7fb0d4100b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800e970 tx=0x7fb0c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8009790 con 0x7fb0d4100020 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d41a5b60 con 0x7fb0d4100020 2023-10-05T15:15:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb0c800c7e0 con 0x7fb0d4100020 2023-10-05T15:15:36.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.892+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80054e0 con 0x7fb0d4100020 2023-10-05T15:15:36.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.893+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d41a60b0 con 0x7fb0d4100020 2023-10-05T15:15:36.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.893+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0d4111180 con 0x7fb0d4100020 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.895+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb0c800c950 con 0x7fb0d4100020 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0c37fe700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0bc0a1510 0x7fb0bc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb0c8014070 con 0x7fb0d4100020 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0d259c700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0bc0a1510 0x7fb0bc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0c37fe700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] conn(0x7fb0bc0ac090 0x7fb0bc0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 --> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0bc0aeba0 con 0x7fb0bc0ac090 2023-10-05T15:15:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0c80cd880 con 0x7fb0d4100020 2023-10-05T15:15:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0d2d9d700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] conn(0x7fb0bc0ac090 0x7fb0bc0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.896+0000 7fb0d259c700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0bc0a1510 0x7fb0bc0a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009c60 tx=0x7fb0c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.897+0000 7fb0d2d9d700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] conn(0x7fb0bc0ac090 0x7fb0bc0ae4d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.898+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== osd.9 v2:172.21.15.60:6826/2673223699 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb0bc0aeba0 con 0x7fb0bc0ac090 2023-10-05T15:15:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.919+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 --> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0d404ebb0 con 0x7fb0bc0ac090 2023-10-05T15:15:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0c37fe700 1 -- 172.21.15.60:0/3870325689 <== osd.9 v2:172.21.15.60:6826/2673223699 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb0d404ebb0 con 0x7fb0bc0ac090 2023-10-05T15:15:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] conn(0x7fb0bc0ac090 msgr2=0x7fb0bc0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] conn(0x7fb0bc0ac090 0x7fb0bc0ae4d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0bc0a1510 msgr2=0x7fb0bc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0bc0a1510 0x7fb0bc0a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009c60 tx=0x7fb0c4009260 comp rx=0 tx=0).stop 2023-10-05T15:15:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4100020 msgr2=0x7fb0d4100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d8e8c700 1 --2- 172.21.15.60:0/3870325689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0d4100020 0x7fb0d4100b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800e970 tx=0x7fb0c800ec80 comp rx=0 tx=0).stop 2023-10-05T15:15:36.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.920+0000 7fb0d2d9d700 1 -- 172.21.15.60:0/3870325689 reap_dead start 2023-10-05T15:15:36.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.921+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 shutdown_connections 2023-10-05T15:15:36.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.921+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 >> 172.21.15.60:0/3870325689 conn(0x7fb0d4076360 msgr2=0x7fb0d4104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:36.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.921+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 shutdown_connections 2023-10-05T15:15:36.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.921+0000 7fb0d8e8c700 1 -- 172.21.15.60:0/3870325689 wait complete. 2023-10-05T15:15:36.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 -- 172.21.15.60:0/3445049429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 msgr2=0x7f232c1037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 --2- 172.21.15.60:0/3445049429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c1037b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f231c009990 tx=0x7f231c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 -- 172.21.15.60:0/3445049429 shutdown_connections 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 --2- 172.21.15.60:0/3445049429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c1084b0 0x7f232c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 --2- 172.21.15.60:0/3445049429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c1037b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 --2- 172.21.15.60:0/3445049429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c103d80 0x7f232c107dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 -- 172.21.15.60:0/3445049429 >> 172.21.15.60:0/3445049429 conn(0x7f232c0fec60 msgr2=0x7f232c101080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 -- 172.21.15.60:0/3445049429 shutdown_connections 2023-10-05T15:15:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.959+0000 7f2330f67700 1 -- 172.21.15.60:0/3445049429 wait complete. 2023-10-05T15:15:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.960+0000 7f2330f67700 1 Processor -- start 2023-10-05T15:15:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.960+0000 7f2330f67700 1 -- start start 2023-10-05T15:15:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2330f67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2330f67700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c103d80 0x7f232c10e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2330f67700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c1084b0 0x7f232c10e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2330f67700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1a99f0 con 0x7f232c1033d0 2023-10-05T15:15:36.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2330f67700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1a9b30 con 0x7f232c1084b0 2023-10-05T15:15:36.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2330f67700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1a9c70 con 0x7f232c103d80 2023-10-05T15:15:36.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36700/0 (socket says 172.21.15.60:36700) 2023-10-05T15:15:36.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 -- 172.21.15.60:0/1476771026 learned_addr learned my addr 172.21.15.60:0/1476771026 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232ad9d700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c1084b0 0x7f232c10e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2329d9b700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c103d80 0x7f232c10e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 -- 172.21.15.60:0/1476771026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c103d80 msgr2=0x7f232c10e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c103d80 0x7f232c10e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 -- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c1084b0 msgr2=0x7f232c10e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c1084b0 0x7f232c10e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 -- 172.21.15.60:0/1476771026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0095f0 con 0x7f232c1033d0 2023-10-05T15:15:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f2329d9b700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c103d80 0x7f232c10e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.961+0000 7f232a59c700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c110040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f231c0059d0 tx=0x7f231c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.962+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c01d070 con 0x7f232c1033d0 2023-10-05T15:15:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.962+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f231c022470 con 0x7f232c1033d0 2023-10-05T15:15:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.962+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c1a9e70 con 0x7f232c1033d0 2023-10-05T15:15:36.968 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:36.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.962+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c017650 con 0x7f232c1033d0 2023-10-05T15:15:36.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.962+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c1aa280 con 0x7f232c1033d0 2023-10-05T15:15:36.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.963+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f232c076230 con 0x7f232c1033d0 2023-10-05T15:15:36.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.964+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f231c0225e0 con 0x7f232c1033d0 2023-10-05T15:15:36.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.964+0000 7f231b7fe700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f23140a1510 0x7f23140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f231c0ce710 con 0x7f232c1033d0 2023-10-05T15:15:36.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f2329d9b700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f23140a1510 0x7f23140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f231b7fe700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] conn(0x7f23140ac090 0x7f23140ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 --> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23140aeba0 con 0x7f23140ac090 2023-10-05T15:15:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f231c0ceb20 con 0x7f232c1033d0 2023-10-05T15:15:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f232ad9d700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] conn(0x7f23140ac090 0x7f23140ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.965+0000 7f2329d9b700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f23140a1510 0x7f23140a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f232c10f8b0 tx=0x7f232000b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.966+0000 7f232ad9d700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] conn(0x7f23140ac090 0x7f23140ae4d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.966+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== osd.1 v2:172.21.15.92:6800/502814453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f23140aeba0 con 0x7f23140ac090 2023-10-05T15:15:36.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 -- 172.21.15.60:0/3483940000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 msgr2=0x7fddf8105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3483940000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf8105b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009990 tx=0x7fdde8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 -- 172.21.15.60:0/3483940000 shutdown_connections 2023-10-05T15:15:36.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3483940000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf8106240 0x7fddf810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3483940000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddf80ff670 0x7fddf80ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3483940000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf8105b60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 -- 172.21.15.60:0/3483940000 >> 172.21.15.60:0/3483940000 conn(0x7fddf8076360 msgr2=0x7fddf80fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 -- 172.21.15.60:0/3483940000 shutdown_connections 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.854+0000 7fddff8a4700 1 -- 172.21.15.60:0/3483940000 wait complete. 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 Processor -- start 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 -- start start 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddf80ff670 0x7fddf8196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf8106240 0x7fddf819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819bf70 con 0x7fddf8100020 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819c0e0 con 0x7fddf80ff670 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddff8a4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819c2a0 con 0x7fddf8106240 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddfce3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddfce3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf81974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36670/0 (socket says 172.21.15.60:36670) 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddfce3f700 1 -- 172.21.15.60:0/3499731672 learned_addr learned my addr 172.21.15.60:0/3499731672 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddfd640700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddf80ff670 0x7fddf8196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.855+0000 7fddfde41700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf8106240 0x7fddf819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfce3f700 1 -- 172.21.15.60:0/3499731672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf8106240 msgr2=0x7fddf819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfce3f700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf8106240 0x7fddf819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfce3f700 1 -- 172.21.15.60:0/3499731672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddf80ff670 msgr2=0x7fddf8196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfce3f700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddf80ff670 0x7fddf8196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfce3f700 1 -- 172.21.15.60:0/3499731672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80095f0 con 0x7fddf8100020 2023-10-05T15:15:36.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfd640700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddf80ff670 0x7fddf8196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddfce3f700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf81974f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdde80098e0 tx=0x7fdde800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde801d070 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf819c520 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdde8005510 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004c80 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.856+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf81006f0 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.857+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fddf81110f0 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdde800fc10 con 0x7fddf8100020 2023-10-05T15:15:36.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddee7fc700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdde40a1510 0x7fdde40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdde80ce780 con 0x7fddf8100020 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddfd640700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdde40a1510 0x7fdde40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddee7fc700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] conn(0x7fdde40ac090 0x7fdde40ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 --> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdde40aeba0 con 0x7fdde40ac090 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.859+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde80ceb90 con 0x7fddf8100020 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.860+0000 7fddfde41700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] conn(0x7fdde40ac090 0x7fdde40ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.860+0000 7fddfd640700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdde40a1510 0x7fdde40a39d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fddf4005950 tx=0x7fddf40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.860+0000 7fddfde41700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] conn(0x7fdde40ac090 0x7fdde40ae4d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:36.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.861+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== osd.3 v2:172.21.15.60:6810/4586473 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdde40aeba0 con 0x7fdde40ac090 2023-10-05T15:15:36.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.877+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 --> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fddf804ebb0 con 0x7fdde40ac090 2023-10-05T15:15:36.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.878+0000 7fddee7fc700 1 -- 172.21.15.60:0/3499731672 <== osd.3 v2:172.21.15.60:6810/4586473 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fddf804ebb0 con 0x7fdde40ac090 2023-10-05T15:15:36.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.879+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] conn(0x7fdde40ac090 msgr2=0x7fdde40ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.879+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] conn(0x7fdde40ac090 0x7fdde40ae4d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdde40a1510 msgr2=0x7fdde40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdde40a1510 0x7fdde40a39d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fddf4005950 tx=0x7fddf40058e0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 msgr2=0x7fddf81974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 --2- 172.21.15.60:0/3499731672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8100020 0x7fddf81974f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdde80098e0 tx=0x7fdde800f720 comp rx=0 tx=0).stop 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddfde41700 1 -- 172.21.15.60:0/3499731672 reap_dead start 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 shutdown_connections 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 >> 172.21.15.60:0/3499731672 conn(0x7fddf8076360 msgr2=0x7fddf81041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 shutdown_connections 2023-10-05T15:15:36.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.882+0000 7fddff8a4700 1 -- 172.21.15.60:0/3499731672 wait complete. 2023-10-05T15:15:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.984+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 --> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f232c04ebb0 con 0x7f23140ac090 2023-10-05T15:15:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.985+0000 7f231b7fe700 1 -- 172.21.15.60:0/1476771026 <== osd.1 v2:172.21.15.92:6800/502814453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f232c04ebb0 con 0x7f23140ac090 2023-10-05T15:15:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] conn(0x7f23140ac090 msgr2=0x7f23140ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] conn(0x7f23140ac090 0x7f23140ae4d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f23140a1510 msgr2=0x7f23140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f23140a1510 0x7f23140a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f232c10f8b0 tx=0x7f232000b2c0 comp rx=0 tx=0).stop 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 msgr2=0x7f232c110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 --2- 172.21.15.60:0/1476771026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f232c1033d0 0x7f232c110040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f231c0059d0 tx=0x7f231c00f710 comp rx=0 tx=0).stop 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f232ad9d700 1 -- 172.21.15.60:0/1476771026 reap_dead start 2023-10-05T15:15:36.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 shutdown_connections 2023-10-05T15:15:36.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 >> 172.21.15.60:0/1476771026 conn(0x7f232c0fec60 msgr2=0x7f232c0788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:36.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 shutdown_connections 2023-10-05T15:15:36.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:36.986+0000 7f2330f67700 1 -- 172.21.15.60:0/1476771026 wait complete. 2023-10-05T15:15:37.542 INFO:teuthology.orchestra.run.smithi060.stdout:287762808861 2023-10-05T15:15:37.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-05T15:15:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:37.869 INFO:teuthology.orchestra.run.smithi060.stdout:111669149751 2023-10-05T15:15:37.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-05T15:15:37.875 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:37.886 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:38.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:38 smithi060 ceph-mon[99238]: pgmap v284: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-05T15:15:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:38 smithi135 ceph-mon[103360]: pgmap v284: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-05T15:15:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:38 smithi092 ceph-mon[102944]: pgmap v284: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-05T15:15:39.123 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 -- 172.21.15.60:0/1999887715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518100a30 msgr2=0x7fc518104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 --2- 172.21.15.60:0/1999887715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518100a30 0x7fc518104a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc514009990 tx=0x7fc514009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 -- 172.21.15.60:0/1999887715 shutdown_connections 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 --2- 172.21.15.60:0/1999887715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc518105160 0x7fc51810cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 --2- 172.21.15.60:0/1999887715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100080 0x7fc518100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 --2- 172.21.15.60:0/1999887715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518100a30 0x7fc518104a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 -- 172.21.15.60:0/1999887715 >> 172.21.15.60:0/1999887715 conn(0x7fc5180fb8d0 msgr2=0x7fc5180fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 -- 172.21.15.60:0/1999887715 shutdown_connections 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.824+0000 7fc51f862700 1 -- 172.21.15.60:0/1999887715 wait complete. 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 Processor -- start 2023-10-05T15:15:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 -- start start 2023-10-05T15:15:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc518100080 0x7fc518197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 0x7fc518197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518105160 0x7fc51819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51819bfe0 con 0x7fc518100a30 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51819c150 con 0x7fc518105160 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51f862700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51819c310 con 0x7fc518100080 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 0x7fc518197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 0x7fc518197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36718/0 (socket says 172.21.15.60:36718) 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 -- 172.21.15.60:0/3678278399 learned_addr learned my addr 172.21.15.60:0/3678278399 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51ddff700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518105160 0x7fc51819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51d5fe700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc518100080 0x7fc518197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 -- 172.21.15.60:0/3678278399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc518100080 msgr2=0x7fc518197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc518100080 0x7fc518197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 -- 172.21.15.60:0/3678278399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518105160 msgr2=0x7fc51819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518105160 0x7fc51819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.825+0000 7fc51cdfd700 1 -- 172.21.15.60:0/3678278399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140095f0 con 0x7fc518100a30 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.826+0000 7fc51cdfd700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 0x7fc518197560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.826+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51401d070 con 0x7fc518100a30 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.826+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51819c590 con 0x7fc518100a30 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.826+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc514022470 con 0x7fc518100a30 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.826+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514017650 con 0x7fc518100a30 2023-10-05T15:15:39.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.826+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5181a3e50 con 0x7fc518100a30 2023-10-05T15:15:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.827+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51804ebb0 con 0x7fc518100a30 2023-10-05T15:15:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.828+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc514022870 con 0x7fc518100a30 2023-10-05T15:15:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.828+0000 7fc50e7fc700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5040a1510 0x7fc5040a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.828+0000 7fc51d5fe700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5040a1510 0x7fc5040a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.828+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc5140ce340 con 0x7fc518100a30 2023-10-05T15:15:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.829+0000 7fc51d5fe700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5040a1510 0x7fc5040a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc510009380 tx=0x7fc51000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:39.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:39.833+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc51405d100 con 0x7fc518100a30 2023-10-05T15:15:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.040+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fc51810fd50 con 0x7fc518100a30 2023-10-05T15:15:40.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.041+0000 7fc50e7fc700 1 -- 172.21.15.60:0/3678278399 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fc5140976e0 con 0x7fc518100a30 2023-10-05T15:15:40.043 INFO:teuthology.orchestra.run.smithi060.stdout:309237645338 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5040a1510 msgr2=0x7fc5040a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5040a1510 0x7fc5040a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc510009380 tx=0x7fc51000b040 comp rx=0 tx=0).stop 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 msgr2=0x7fc518197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 0x7fc518197560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514009580 comp rx=0 tx=0).stop 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 shutdown_connections 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc518105160 0x7fc51819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc518100080 0x7fc518197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc5040a1510 0x7fc5040a39d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 --2- 172.21.15.60:0/3678278399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc518100a30 0x7fc518197560 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 >> 172.21.15.60:0/3678278399 conn(0x7fc5180fb8d0 msgr2=0x7fc518103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 shutdown_connections 2023-10-05T15:15:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.043+0000 7fc51f862700 1 -- 172.21.15.60:0/3678278399 wait complete. 2023-10-05T15:15:40.453 INFO:teuthology.orchestra.run.smithi060.stdout:55834574912 2023-10-05T15:15:40.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-05T15:15:40.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:40 smithi060 ceph-mon[99238]: pgmap v285: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-05T15:15:40.522 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:40 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3678278399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-05T15:15:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:40 smithi135 ceph-mon[103360]: pgmap v285: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-05T15:15:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:40 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3678278399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-05T15:15:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:40 smithi092 ceph-mon[102944]: pgmap v285: 129 pgs: 129 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-05T15:15:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:40 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3678278399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-05T15:15:40.852 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645337 got 309237645338 for osd.10 2023-10-05T15:15:40.853 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:40.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.861+0000 7fec1d517700 1 -- 172.21.15.60:0/693255953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18100820 msgr2=0x7fec1810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:40.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.861+0000 7fec1d517700 1 --2- 172.21.15.60:0/693255953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18100820 0x7fec1810cc90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec1000b0d0 tx=0x7fec1000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 -- 172.21.15.60:0/693255953 shutdown_connections 2023-10-05T15:15:40.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 --2- 172.21.15.60:0/693255953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18100820 0x7fec1810cc90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 --2- 172.21.15.60:0/693255953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18105e70 0x7fec18106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 --2- 172.21.15.60:0/693255953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec180ffe60 0x7fec181002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 -- 172.21.15.60:0/693255953 >> 172.21.15.60:0/693255953 conn(0x7fec18075e00 msgr2=0x7fec18076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 -- 172.21.15.60:0/693255953 shutdown_connections 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.862+0000 7fec1d517700 1 -- 172.21.15.60:0/693255953 wait complete. 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 Processor -- start 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 -- start start 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec180ffe60 0x7fec18196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100820 0x7fec18196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 0x7fec1819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1819afc0 con 0x7fec18105e70 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1819b130 con 0x7fec18100820 2023-10-05T15:15:40.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec1d517700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1819b2f0 con 0x7fec180ffe60 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 0x7fec1819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec167fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100820 0x7fec18196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 0x7fec1819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36730/0 (socket says 172.21.15.60:36730) 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.863+0000 7fec177fe700 1 -- 172.21.15.60:0/2617737835 learned_addr learned my addr 172.21.15.60:0/2617737835 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec16ffd700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec180ffe60 0x7fec18196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec167fc700 1 -- 172.21.15.60:0/2617737835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec180ffe60 msgr2=0x7fec18196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec167fc700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec180ffe60 0x7fec18196050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec167fc700 1 -- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 msgr2=0x7fec1819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec167fc700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 0x7fec1819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec167fc700 1 -- 172.21.15.60:0/2617737835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10009d00 con 0x7fec18100820 2023-10-05T15:15:40.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec177fe700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 0x7fec1819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec167fc700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100820 0x7fec18196590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e9f0 tx=0x7fec0c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c004220 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1819b5d0 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec0c004cf0 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00ce70 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.864+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec18068b70 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.866+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1819b7f0 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.867+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fec0c004750 con 0x7fec18100820 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.867+0000 7febfffff700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fec000a1510 0x7fec000a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:40.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.868+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fec0c014070 con 0x7fec18100820 2023-10-05T15:15:40.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.868+0000 7fec16ffd700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fec000a1510 0x7fec000a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:40.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.868+0000 7fec16ffd700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fec000a1510 0x7fec000a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec08009be0 tx=0x7fec08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:40.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:40.873+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec0c096240 con 0x7fec18100820 2023-10-05T15:15:40.993 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.093+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fec1804ebb0 con 0x7fec18100820 2023-10-05T15:15:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.093+0000 7febfffff700 1 -- 172.21.15.60:0/2617737835 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec0c004e60 con 0x7fec18100820 2023-10-05T15:15:41.095 INFO:teuthology.orchestra.run.smithi060.stdout:167503724591 2023-10-05T15:15:41.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.095+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fec000a1510 msgr2=0x7fec000a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:41.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.095+0000 7fec1d517700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fec000a1510 0x7fec000a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec08009be0 tx=0x7fec08009260 comp rx=0 tx=0).stop 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.095+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100820 msgr2=0x7fec18196590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.095+0000 7fec1d517700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100820 0x7fec18196590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e9f0 tx=0x7fec0c00ed00 comp rx=0 tx=0).stop 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 shutdown_connections 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fec000a1510 0x7fec000a39d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec18105e70 0x7fec1819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec180ffe60 0x7fec18196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 --2- 172.21.15.60:0/2617737835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100820 0x7fec18196590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 >> 172.21.15.60:0/2617737835 conn(0x7fec18075e00 msgr2=0x7fec180fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 shutdown_connections 2023-10-05T15:15:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:41.096+0000 7fec1d517700 1 -- 172.21.15.60:0/2617737835 wait complete. 2023-10-05T15:15:41.980 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:42.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724589 got 167503724591 for osd.5 2023-10-05T15:15:42.004 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1907674561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd518068c00 msgr2=0x7fd518068fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1907674561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd518068c00 0x7fd518068fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd508009990 tx=0x7fd508009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1907674561 shutdown_connections 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1907674561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5181062b0 0x7fd51810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1907674561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd518068c00 0x7fd518068fe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1907674561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1907674561 >> 172.21.15.60:0/1907674561 conn(0x7fd518075e00 msgr2=0x7fd518076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1907674561 shutdown_connections 2023-10-05T15:15:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1907674561 wait complete. 2023-10-05T15:15:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 Processor -- start 2023-10-05T15:15:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.144+0000 7fd51e8bd700 1 -- start start 2023-10-05T15:15:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51e8bd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd518068c00 0x7fd5180fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51e8bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51e8bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5181062b0 0x7fd5181009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51e8bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181a5490 con 0x7fd5181062b0 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51e8bd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181a5600 con 0x7fd5180695b0 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51e8bd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181a57c0 con 0x7fd518068c00 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:50166/0 (socket says 172.21.15.60:50166) 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd5177fe700 1 -- 172.21.15.60:0/1565943054 learned_addr learned my addr 172.21.15.60:0/1565943054 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd517fff700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd518068c00 0x7fd5180fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd51ce5a700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5181062b0 0x7fd5181009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.145+0000 7fd5177fe700 1 -- 172.21.15.60:0/1565943054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd518068c00 msgr2=0x7fd5180fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5177fe700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd518068c00 0x7fd5180fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5177fe700 1 -- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5181062b0 msgr2=0x7fd5181009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5177fe700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5181062b0 0x7fd5181009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5177fe700 1 -- 172.21.15.60:0/1565943054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080095f0 con 0x7fd5180695b0 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd517fff700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd518068c00 0x7fd5180fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5177fe700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518100470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00d950 tx=0x7fd50c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00f890 con 0x7fd5180695b0 2023-10-05T15:15:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5181a5aa0 con 0x7fd5180695b0 2023-10-05T15:15:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd50c010460 con 0x7fd5180695b0 2023-10-05T15:15:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00e610 con 0x7fd5180695b0 2023-10-05T15:15:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.146+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5181a5fa0 con 0x7fd5180695b0 2023-10-05T15:15:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.147+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51804ebb0 con 0x7fd5180695b0 2023-10-05T15:15:42.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.149+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd50c0105d0 con 0x7fd5180695b0 2023-10-05T15:15:42.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.150+0000 7fd5157fa700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5000a1510 0x7fd5000a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.150+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd50c0ccb20 con 0x7fd5180695b0 2023-10-05T15:15:42.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.150+0000 7fd517fff700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5000a1510 0x7fd5000a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.150+0000 7fd517fff700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5000a1510 0x7fd5000a39d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd50800b5c0 tx=0x7fd508005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:42.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.153+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd50c095e30 con 0x7fd5180695b0 2023-10-05T15:15:42.182 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:42 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2617737835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-05T15:15:42.182 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:42 smithi060 ceph-mon[99238]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:15:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:42 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2617737835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-05T15:15:42.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:42 smithi135 ceph-mon[103360]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:15:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.360+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd518111050 con 0x7fd5180695b0 2023-10-05T15:15:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.361+0000 7fd5157fa700 1 -- 172.21.15.60:0/1565943054 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd50c017090 con 0x7fd5180695b0 2023-10-05T15:15:42.363 INFO:teuthology.orchestra.run.smithi060.stdout:146028888116 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5000a1510 msgr2=0x7fd5000a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5000a1510 0x7fd5000a39d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd50800b5c0 tx=0x7fd508005fd0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 msgr2=0x7fd518100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518100470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00d950 tx=0x7fd50c00dc60 comp rx=0 tx=0).stop 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 shutdown_connections 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd5000a1510 0x7fd5000a39d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5181062b0 0x7fd5181009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd518068c00 0x7fd5180fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 --2- 172.21.15.60:0/1565943054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5180695b0 0x7fd518100470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 >> 172.21.15.60:0/1565943054 conn(0x7fd518075e00 msgr2=0x7fd5180fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:42.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 shutdown_connections 2023-10-05T15:15:42.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.363+0000 7fd51e8bd700 1 -- 172.21.15.60:0/1565943054 wait complete. 2023-10-05T15:15:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:42 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2617737835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-05T15:15:42.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:42 smithi092 ceph-mon[102944]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:15:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 -- 172.21.15.60:0/3206978547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0101b30 msgr2=0x7f69b0105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 --2- 172.21.15.60:0/3206978547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0101b30 0x7f69b0105b80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f699c009990 tx=0x7f699c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 -- 172.21.15.60:0/3206978547 shutdown_connections 2023-10-05T15:15:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 --2- 172.21.15.60:0/3206978547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0106260 0x7f69b010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 --2- 172.21.15.60:0/3206978547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101180 0x7f69b0101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 --2- 172.21.15.60:0/3206978547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0101b30 0x7f69b0105b80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.577+0000 7f69b6e95700 1 -- 172.21.15.60:0/3206978547 >> 172.21.15.60:0/3206978547 conn(0x7f69b00fc9d0 msgr2=0x7f69b00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 -- 172.21.15.60:0/3206978547 shutdown_connections 2023-10-05T15:15:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 -- 172.21.15.60:0/3206978547 wait complete. 2023-10-05T15:15:42.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 Processor -- start 2023-10-05T15:15:42.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 -- start start 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0101180 0x7f69b01970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101b30 0x7f69b0197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 0x7f69b019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b019c080 con 0x7f69b0106260 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b019c1f0 con 0x7f69b0101180 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.578+0000 7f69b6e95700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b019c3b0 con 0x7f69b0101b30 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 0x7f69b019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 0x7f69b019ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36760/0 (socket says 172.21.15.60:36760) 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 -- 172.21.15.60:0/2076264435 learned_addr learned my addr 172.21.15.60:0/2076264435 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b4c31700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0101180 0x7f69b01970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69affff700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101b30 0x7f69b0197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 -- 172.21.15.60:0/2076264435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101b30 msgr2=0x7f69b0197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101b30 0x7f69b0197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 -- 172.21.15.60:0/2076264435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0101180 msgr2=0x7f69b01970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0101180 0x7f69b01970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 -- 172.21.15.60:0/2076264435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c0095f0 con 0x7f69b0106260 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b4c31700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0101180 0x7f69b01970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69affff700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101b30 0x7f69b0197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b5432700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 0x7f69b019ba70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f69a800ada0 tx=0x7f69a800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a800f070 con 0x7f69b0106260 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b019c690 con 0x7f69b0106260 2023-10-05T15:15:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69a8007b30 con 0x7f69b0106260 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8005440 con 0x7f69b0106260 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.579+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b01a3ef0 con 0x7f69b0106260 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.580+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b004ebb0 con 0x7f69b0106260 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.581+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f69a8004ad0 con 0x7f69b0106260 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.582+0000 7f69adffb700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f69a00a1510 0x7f69a00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.582+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f69a80cc700 con 0x7f69b0106260 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.582+0000 7f69b4c31700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f69a00a1510 0x7f69a00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.582+0000 7f69b4c31700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f69a00a1510 0x7f69a00a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69a40099d0 tx=0x7f69a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:42.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.587+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f69a8095aa0 con 0x7f69b0106260 2023-10-05T15:15:42.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.802+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f69b0110f70 con 0x7f69b0106260 2023-10-05T15:15:42.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.803+0000 7f69adffb700 1 -- 172.21.15.60:0/2076264435 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69a80990c0 con 0x7f69b0106260 2023-10-05T15:15:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:223338299431 2023-10-05T15:15:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f69a00a1510 msgr2=0x7f69a00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f69a00a1510 0x7f69a00a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69a40099d0 tx=0x7f69a4008040 comp rx=0 tx=0).stop 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 msgr2=0x7f69b019ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 0x7f69b019ba70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f69a800ada0 tx=0x7f69a800c330 comp rx=0 tx=0).stop 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 shutdown_connections 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f69a00a1510 0x7f69a00a39d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69b0106260 0x7f69b019ba70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69b0101180 0x7f69b01970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 --2- 172.21.15.60:0/2076264435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b0101b30 0x7f69b0197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 >> 172.21.15.60:0/2076264435 conn(0x7f69b00fc9d0 msgr2=0x7f69b0104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 shutdown_connections 2023-10-05T15:15:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:42.805+0000 7f69b6e95700 1 -- 172.21.15.60:0/2076264435 wait complete. 2023-10-05T15:15:42.867 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:43 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1565943054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-05T15:15:43.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:43 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2076264435' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-05T15:15:43.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:43 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1565943054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-05T15:15:43.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:43 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2076264435' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-05T15:15:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:43 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1565943054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-05T15:15:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:43 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2076264435' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-05T15:15:43.461 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888114 got 146028888116 for osd.4 2023-10-05T15:15:43.461 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:43.583 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299428 got 223338299431 for osd.7 2023-10-05T15:15:43.584 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 -- 172.21.15.60:0/3895643985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 msgr2=0x7f0240068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 --2- 172.21.15.60:0/3895643985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f0240068e20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f02340099c0 tx=0x7f0234009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 -- 172.21.15.60:0/3895643985 shutdown_connections 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 --2- 172.21.15.60:0/3895643985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0240069360 0x7f024010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 --2- 172.21.15.60:0/3895643985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240106f90 0x7f0240107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 --2- 172.21.15.60:0/3895643985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f0240068e20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 -- 172.21.15.60:0/3895643985 >> 172.21.15.60:0/3895643985 conn(0x7f0240075e00 msgr2=0x7f0240076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 -- 172.21.15.60:0/3895643985 shutdown_connections 2023-10-05T15:15:43.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 -- 172.21.15.60:0/3895643985 wait complete. 2023-10-05T15:15:43.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.908+0000 7f0245fe5700 1 Processor -- start 2023-10-05T15:15:43.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 -- start start 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f02400fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240069360 0x7f0240100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0240106f90 0x7f02401009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02401a99a0 con 0x7f02400689a0 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02401a9ae0 con 0x7f0240069360 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f0245fe5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02401a9c20 con 0x7f0240106f90 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f02400fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f02400fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36768/0 (socket says 172.21.15.60:36768) 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 -- 172.21.15.60:0/758884294 learned_addr learned my addr 172.21.15.60:0/758884294 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023effd700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240069360 0x7f0240100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023ffff700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0240106f90 0x7f02401009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:43.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 -- 172.21.15.60:0/758884294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0240106f90 msgr2=0x7f02401009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0240106f90 0x7f02401009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 -- 172.21.15.60:0/758884294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240069360 msgr2=0x7f0240100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240069360 0x7f0240100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.909+0000 7f023f7fe700 1 -- 172.21.15.60:0/758884294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340095f0 con 0x7f02400689a0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.910+0000 7f023f7fe700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f02400fff30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f023000d980 tx=0x7f023000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.910+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300098d0 con 0x7f02400689a0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.910+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02401a9f00 con 0x7f02400689a0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.910+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0230010460 con 0x7f02400689a0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.910+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02401aa320 con 0x7f02400689a0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.910+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023000f620 con 0x7f02400689a0 2023-10-05T15:15:43.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.911+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c005320 con 0x7f02400689a0 2023-10-05T15:15:43.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.912+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0230009a30 con 0x7f02400689a0 2023-10-05T15:15:43.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.913+0000 7f023cff9700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f02280a1510 0x7f02280a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:43.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.913+0000 7f023effd700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f02280a1510 0x7f02280a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:43.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.913+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f02300cd110 con 0x7f02400689a0 2023-10-05T15:15:43.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.914+0000 7f023effd700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f02280a1510 0x7f02280a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c00 tx=0x7f0234005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:43.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:43.916+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0230096420 con 0x7f02400689a0 2023-10-05T15:15:44.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:44 smithi060 ceph-mon[99238]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-05T15:15:44.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.143+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f022c0058a0 con 0x7f02400689a0 2023-10-05T15:15:44.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.144+0000 7f023cff9700 1 -- 172.21.15.60:0/758884294 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0230020090 con 0x7f02400689a0 2023-10-05T15:15:44.146 INFO:teuthology.orchestra.run.smithi060.stdout:34359738438 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f02280a1510 msgr2=0x7f02280a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f02280a1510 0x7f02280a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c00 tx=0x7f0234005900 comp rx=0 tx=0).stop 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 msgr2=0x7f02400fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f02400fff30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f023000d980 tx=0x7f023000dc90 comp rx=0 tx=0).stop 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 shutdown_connections 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0240106f90 0x7f02401009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f02280a1510 0x7f02280a39d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02400689a0 0x7f02400fff30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 --2- 172.21.15.60:0/758884294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240069360 0x7f0240100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 >> 172.21.15.60:0/758884294 conn(0x7f0240075e00 msgr2=0x7f02400fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 shutdown_connections 2023-10-05T15:15:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:44.146+0000 7f0245fe5700 1 -- 172.21.15.60:0/758884294 wait complete. 2023-10-05T15:15:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:44 smithi135 ceph-mon[103360]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-05T15:15:44.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:44 smithi092 ceph-mon[102944]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-05T15:15:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:45.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738436 got 34359738438 for osd.0 2023-10-05T15:15:45.219 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:45.328 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:45 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/758884294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-05T15:15:45.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:45 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/758884294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-05T15:15:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:45 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/758884294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 -- 172.21.15.60:0/148681453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fff60 msgr2=0x7f756010c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 --2- 172.21.15.60:0/148681453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fff60 0x7f756010c420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f755800b0d0 tx=0x7f755800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 -- 172.21.15.60:0/148681453 shutdown_connections 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 --2- 172.21.15.60:0/148681453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fff60 0x7f756010c420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 --2- 172.21.15.60:0/148681453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560105650 0x7f7560105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 --2- 172.21.15.60:0/148681453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75600ff5a0 0x7f75600ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 -- 172.21.15.60:0/148681453 >> 172.21.15.60:0/148681453 conn(0x7f7560076360 msgr2=0x7f75600fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.615+0000 7f756835f700 1 -- 172.21.15.60:0/148681453 shutdown_connections 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 -- 172.21.15.60:0/148681453 wait complete. 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 Processor -- start 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 -- start start 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 0x7f7560101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75600fff60 0x7f7560101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7560105650 0x7f7560101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75601a54a0 con 0x7f75600ff5a0 2023-10-05T15:15:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75601a5610 con 0x7f75600fff60 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f756835f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75601a57d0 con 0x7f7560105650 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f75660fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 0x7f7560101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f75660fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 0x7f7560101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36782/0 (socket says 172.21.15.60:36782) 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.616+0000 7f75660fb700 1 -- 172.21.15.60:0/806641037 learned_addr learned my addr 172.21.15.60:0/806641037 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75658fa700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75600fff60 0x7f7560101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75660fb700 1 -- 172.21.15.60:0/806641037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7560105650 msgr2=0x7f7560101cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75660fb700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7560105650 0x7f7560101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75660fb700 1 -- 172.21.15.60:0/806641037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75600fff60 msgr2=0x7f7560101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75660fb700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75600fff60 0x7f7560101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75660fb700 1 -- 172.21.15.60:0/806641037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558009d00 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75660fb700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 0x7f7560101210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f755c00d950 tx=0x7f755c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c009b40 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f755c009ca0 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75601a5ab0 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00f620 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.617+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75601a6000 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.618+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756004ebb0 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.620+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f755c010460 con 0x7f75600ff5a0 2023-10-05T15:15:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.621+0000 7f75537fe700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f754c0a1590 0x7f754c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.621+0000 7f75658fa700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f754c0a1590 0x7f754c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.621+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f755c0cd370 con 0x7f75600ff5a0 2023-10-05T15:15:45.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.621+0000 7f75658fa700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f754c0a1590 0x7f754c0a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7554005950 tx=0x7f75540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:45.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.624+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f755c096680 con 0x7f75600ff5a0 2023-10-05T15:15:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 -- 172.21.15.60:0/311916224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce000730e0 msgr2=0x7fce000734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 --2- 172.21.15.60:0/311916224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce000730e0 0x7fce000734c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009990 tx=0x7fcdfc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 -- 172.21.15.60:0/311916224 shutdown_connections 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 --2- 172.21.15.60:0/311916224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce0010d930 0x7fce0010fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 --2- 172.21.15.60:0/311916224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce000730e0 0x7fce000734c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 --2- 172.21.15.60:0/311916224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce00073a00 0x7fce0010d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 -- 172.21.15.60:0/311916224 >> 172.21.15.60:0/311916224 conn(0x7fce000780a0 msgr2=0x7fce000784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 -- 172.21.15.60:0/311916224 shutdown_connections 2023-10-05T15:15:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 -- 172.21.15.60:0/311916224 wait complete. 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 Processor -- start 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.837+0000 7fce079e9700 1 -- start start 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce079e9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce000730e0 0x7fce00199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce079e9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce00073a00 0x7fce001996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce079e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 0x7fce0019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce079e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0019e140 con 0x7fce0010d930 2023-10-05T15:15:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce079e9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0019e2b0 con 0x7fce000730e0 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce079e9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0019e470 con 0x7fce00073a00 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 0x7fce0019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 0x7fce0019db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36800/0 (socket says 172.21.15.60:36800) 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05785700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce000730e0 0x7fce00199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 -- 172.21.15.60:0/285465560 learned_addr learned my addr 172.21.15.60:0/285465560 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce04f84700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce00073a00 0x7fce001996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 -- 172.21.15.60:0/285465560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce00073a00 msgr2=0x7fce001996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce00073a00 0x7fce001996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 -- 172.21.15.60:0/285465560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce000730e0 msgr2=0x7fce00199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce000730e0 0x7fce00199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 -- 172.21.15.60:0/285465560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0095f0 con 0x7fce0010d930 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fce05f86700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 0x7fce0019db30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800cc30 tx=0x7fcdf800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.838+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800ab70 con 0x7fce0010d930 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.839+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0019e750 con 0x7fce0010d930 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.839+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdf800acd0 con 0x7fce0010d930 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.839+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80115e0 con 0x7fce0010d930 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.839+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce001a5fb0 con 0x7fce0010d930 2023-10-05T15:15:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.839+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0004ebb0 con 0x7fce0010d930 2023-10-05T15:15:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.841+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fcdf8012420 con 0x7fce0010d930 2023-10-05T15:15:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.841+0000 7fcdf67fc700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcdec0a1510 0x7fcdec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.842+0000 7fce05785700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcdec0a1510 0x7fcdec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.842+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcdf80cd600 con 0x7fce0010d930 2023-10-05T15:15:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.842+0000 7fce05785700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcdec0a1510 0x7fcdec0a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00b5c0 tx=0x7fcdfc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:45.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.845+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcdf8096a20 con 0x7fce0010d930 2023-10-05T15:15:45.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.846+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f756010f6a0 con 0x7f75600ff5a0 2023-10-05T15:15:45.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.846+0000 7f75537fe700 1 -- 172.21.15.60:0/806641037 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f755c020020 con 0x7f75600ff5a0 2023-10-05T15:15:45.848 INFO:teuthology.orchestra.run.smithi060.stdout:77309411389 2023-10-05T15:15:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f754c0a1590 msgr2=0x7f754c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f754c0a1590 0x7f754c0a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7554005950 tx=0x7f75540058e0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 msgr2=0x7f7560101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 0x7f7560101210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f755c00d950 tx=0x7f755c00dd10 comp rx=0 tx=0).stop 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 shutdown_connections 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7560105650 0x7f7560101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f754c0a1590 0x7f754c0a3a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600ff5a0 0x7f7560101210 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 --2- 172.21.15.60:0/806641037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75600fff60 0x7f7560101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 >> 172.21.15.60:0/806641037 conn(0x7f7560076360 msgr2=0x7f75600fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 shutdown_connections 2023-10-05T15:15:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.848+0000 7f756835f700 1 -- 172.21.15.60:0/806641037 wait complete. 2023-10-05T15:15:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 -- 172.21.15.60:0/701774447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 msgr2=0x7f54f0105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 --2- 172.21.15.60:0/701774447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0105b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009990 tx=0x7f54e4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 -- 172.21.15.60:0/701774447 shutdown_connections 2023-10-05T15:15:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 --2- 172.21.15.60:0/701774447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 0x7f54f010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 --2- 172.21.15.60:0/701774447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f0101180 0x7f54f0101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 --2- 172.21.15.60:0/701774447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0105b80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 -- 172.21.15.60:0/701774447 >> 172.21.15.60:0/701774447 conn(0x7f54f00fc9d0 msgr2=0x7f54f00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 -- 172.21.15.60:0/701774447 shutdown_connections 2023-10-05T15:15:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 -- 172.21.15.60:0/701774447 wait complete. 2023-10-05T15:15:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.993+0000 7f54f58b3700 1 Processor -- start 2023-10-05T15:15:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 -- start start 2023-10-05T15:15:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f0101180 0x7f54f0197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 0x7f54f019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f019bfd0 con 0x7f54f0101b30 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f019c140 con 0x7f54f0101180 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54f58b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f019c300 con 0x7f54f0106260 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54ee7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54ee7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36810/0 (socket says 172.21.15.60:36810) 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54ee7fc700 1 -- 172.21.15.60:0/1288585413 learned_addr learned my addr 172.21.15.60:0/1288585413 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54ef7fe700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 0x7f54f019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.994+0000 7f54eeffd700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f0101180 0x7f54f0197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ee7fc700 1 -- 172.21.15.60:0/1288585413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 msgr2=0x7f54f019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ee7fc700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 0x7f54f019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ee7fc700 1 -- 172.21.15.60:0/1288585413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f0101180 msgr2=0x7f54f0197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ee7fc700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f0101180 0x7f54f0197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ee7fc700 1 -- 172.21.15.60:0/1288585413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40095f0 con 0x7f54f0101b30 2023-10-05T15:15:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ef7fe700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 0x7f54f019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:15:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.995+0000 7f54ee7fc700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0197550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f54e400b2e0 tx=0x7f54e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.996+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e401d070 con 0x7f54f0101b30 2023-10-05T15:15:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.996+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54e4005030 con 0x7f54f0101b30 2023-10-05T15:15:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.996+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4004a40 con 0x7f54f0101b30 2023-10-05T15:15:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.996+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f019c580 con 0x7f54f0101b30 2023-10-05T15:15:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.996+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f01a3e40 con 0x7f54f0101b30 2023-10-05T15:15:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.997+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f004ebb0 con 0x7f54f0101b30 2023-10-05T15:15:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:45.999+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f54e4005430 con 0x7f54f0101b30 2023-10-05T15:15:46.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.000+0000 7f54f48b1700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54d80a1660 0x7f54d80a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:46.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.000+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f54e40ce340 con 0x7f54f0101b30 2023-10-05T15:15:46.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.000+0000 7f54eeffd700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54d80a1660 0x7f54d80a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:46.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.000+0000 7f54eeffd700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54d80a1660 0x7f54d80a3b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009c60 tx=0x7f54e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:46.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.002+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f54e4097760 con 0x7f54f0101b30 2023-10-05T15:15:46.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.070+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fce0019a4e0 con 0x7fce0010d930 2023-10-05T15:15:46.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.070+0000 7fcdf67fc700 1 -- 172.21.15.60:0/285465560 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdf809a040 con 0x7fce0010d930 2023-10-05T15:15:46.072 INFO:teuthology.orchestra.run.smithi060.stdout:253403070498 2023-10-05T15:15:46.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcdec0a1510 msgr2=0x7fcdec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:46.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcdec0a1510 0x7fcdec0a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00b5c0 tx=0x7fcdfc005fd0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 msgr2=0x7fce0019db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 0x7fce0019db30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800cc30 tx=0x7fcdf800cf40 comp rx=0 tx=0).stop 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 shutdown_connections 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcdec0a1510 0x7fcdec0a39d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce0010d930 0x7fce0019db30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce000730e0 0x7fce00199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 --2- 172.21.15.60:0/285465560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce00073a00 0x7fce001996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.072+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 >> 172.21.15.60:0/285465560 conn(0x7fce000780a0 msgr2=0x7fce000fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.073+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 shutdown_connections 2023-10-05T15:15:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.073+0000 7fce079e9700 1 -- 172.21.15.60:0/285465560 wait complete. 2023-10-05T15:15:46.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: pgmap v288: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:15:46.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:46 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/806641037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-05T15:15:46.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.229+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f54f0198370 con 0x7f54f0101b30 2023-10-05T15:15:46.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.229+0000 7f54f48b1700 1 -- 172.21.15.60:0/1288585413 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54e4026020 con 0x7f54f0101b30 2023-10-05T15:15:46.232 INFO:teuthology.orchestra.run.smithi060.stdout:201863462955 2023-10-05T15:15:46.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54d80a1660 msgr2=0x7f54d80a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:46.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54d80a1660 0x7f54d80a3b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009c60 tx=0x7f54e0009260 comp rx=0 tx=0).stop 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 msgr2=0x7f54f0197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0197550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f54e400b2e0 tx=0x7f54e4004730 comp rx=0 tx=0).stop 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 shutdown_connections 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f0106260 0x7f54f019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f0101180 0x7f54f0197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54d80a1660 0x7f54d80a3b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 --2- 172.21.15.60:0/1288585413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f0101b30 0x7f54f0197550 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 >> 172.21.15.60:0/1288585413 conn(0x7f54f00fc9d0 msgr2=0x7f54f00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 shutdown_connections 2023-10-05T15:15:46.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:46.232+0000 7f54f58b3700 1 -- 172.21.15.60:0/1288585413 wait complete. 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-10-05T15:15:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]: dispatch 2023-10-05T15:15:46.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-05T15:15:46.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-05T15:15:46.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: pgmap v288: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:15:46.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:46 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/806641037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-05T15:15:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-05T15:15:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-10-05T15:15:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: pgmap v288: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:15:46.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:46 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/806641037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-05T15:15:47.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411387 got 77309411389 for osd.2 2023-10-05T15:15:47.066 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]': finished 2023-10-05T15:15:47.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-05T15:15:47.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-05T15:15:47.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: osdmap e89: 12 total, 12 up, 12 in 2023-10-05T15:15:47.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/285465560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-05T15:15:47.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:47 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1288585413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-05T15:15:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: osdmap e89: 12 total, 12 up, 12 in 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/285465560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-05T15:15:47.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:47 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1288585413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-05T15:15:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-05T15:15:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-10-05T15:15:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: osdmap e89: 12 total, 12 up, 12 in 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/285465560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-05T15:15:47.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:47 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1288585413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-05T15:15:47.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070496 got 253403070498 for osd.8 2023-10-05T15:15:47.585 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:47.966 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462955 for osd.6 2023-10-05T15:15:47.966 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:48.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:48 smithi135 ceph-mon[103360]: osdmap e90: 12 total, 12 up, 12 in 2023-10-05T15:15:48.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:48 smithi135 ceph-mon[103360]: pgmap v291: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:15:48.390 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:48 smithi060 ceph-mon[99238]: osdmap e90: 12 total, 12 up, 12 in 2023-10-05T15:15:48.390 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:48 smithi060 ceph-mon[99238]: pgmap v291: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:15:48.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:48 smithi092 ceph-mon[102944]: osdmap e90: 12 total, 12 up, 12 in 2023-10-05T15:15:48.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:48 smithi092 ceph-mon[102944]: pgmap v291: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:15:48.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 -- 172.21.15.60:0/2480976067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0100820 msgr2=0x7f35b010cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 --2- 172.21.15.60:0/2480976067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0100820 0x7f35b010cc90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35a800b0d0 tx=0x7f35a800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 -- 172.21.15.60:0/2480976067 shutdown_connections 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 --2- 172.21.15.60:0/2480976067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0100820 0x7f35b010cc90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 --2- 172.21.15.60:0/2480976067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b0105e70 0x7f35b0106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 --2- 172.21.15.60:0/2480976067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35b00ffe60 0x7f35b01002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 -- 172.21.15.60:0/2480976067 >> 172.21.15.60:0/2480976067 conn(0x7f35b0075e00 msgr2=0x7f35b0076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 -- 172.21.15.60:0/2480976067 shutdown_connections 2023-10-05T15:15:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.903+0000 7f35b7360700 1 -- 172.21.15.60:0/2480976067 wait complete. 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 Processor -- start 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 -- start start 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b00ffe60 0x7f35b01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35b0100820 0x7f35b0197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 0x7f35b019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b019c0a0 con 0x7f35b0105e70 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b019c210 con 0x7f35b0100820 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b7360700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b019c3d0 con 0x7f35b00ffe60 2023-10-05T15:15:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.904+0000 7f35b58fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 0x7f35b019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 0x7f35b019ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36826/0 (socket says 172.21.15.60:36826) 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 -- 172.21.15.60:0/374658789 learned_addr learned my addr 172.21.15.60:0/374658789 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b48fb700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35b0100820 0x7f35b0197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b50fc700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b00ffe60 0x7f35b01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 -- 172.21.15.60:0/374658789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b00ffe60 msgr2=0x7f35b01970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b00ffe60 0x7f35b01970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 -- 172.21.15.60:0/374658789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35b0100820 msgr2=0x7f35b0197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35b0100820 0x7f35b0197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 -- 172.21.15.60:0/374658789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8009d00 con 0x7f35b0105e70 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b58fd700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 0x7f35b019ba90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f35a8007870 tx=0x7f35a80078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a800e040 con 0x7f35b0105e70 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35a8003e10 con 0x7f35b0105e70 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b019c650 con 0x7f35b0105e70 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a801ba10 con 0x7f35b0105e70 2023-10-05T15:15:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.905+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b01a3f10 con 0x7f35b0105e70 2023-10-05T15:15:48.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.906+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b004ebb0 con 0x7f35b0105e70 2023-10-05T15:15:48.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.907+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f35a801bb70 con 0x7f35b0105e70 2023-10-05T15:15:48.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.908+0000 7f35a27fc700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f359c0a1590 0x7f359c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:48.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.908+0000 7f35b50fc700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f359c0a1590 0x7f359c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.908+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f35a80ceba0 con 0x7f35b0105e70 2023-10-05T15:15:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.908+0000 7f35b50fc700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f359c0a1590 0x7f359c0a3a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009a10 tx=0x7f35a4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:48.911+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35a8097e30 con 0x7f35b0105e70 2023-10-05T15:15:49.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.120+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f35b010fe50 con 0x7f35b0105e70 2023-10-05T15:15:49.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.121+0000 7f35a27fc700 1 -- 172.21.15.60:0/374658789 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35a809b450 con 0x7f35b0105e70 2023-10-05T15:15:49.123 INFO:teuthology.orchestra.run.smithi060.stdout:287762808863 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f359c0a1590 msgr2=0x7f359c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f359c0a1590 0x7f359c0a3a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009a10 tx=0x7f35a4009190 comp rx=0 tx=0).stop 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 msgr2=0x7f35b019ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 0x7f35b019ba90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f35a8007870 tx=0x7f35a80078a0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 shutdown_connections 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f359c0a1590 0x7f359c0a3a50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b0105e70 0x7f35b019ba90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b00ffe60 0x7f35b01970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 --2- 172.21.15.60:0/374658789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35b0100820 0x7f35b0197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 >> 172.21.15.60:0/374658789 conn(0x7f35b0075e00 msgr2=0x7f35b0103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 shutdown_connections 2023-10-05T15:15:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.123+0000 7f35b7360700 1 -- 172.21.15.60:0/374658789 wait complete. 2023-10-05T15:15:49.239 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:49 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/374658789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-05T15:15:49.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:49 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/374658789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-05T15:15:49.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 -- 172.21.15.60:0/4266594776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 msgr2=0x7f8e34105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 --2- 172.21.15.60:0/4266594776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34105b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009990 tx=0x7f8e28009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 -- 172.21.15.60:0/4266594776 shutdown_connections 2023-10-05T15:15:49.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 --2- 172.21.15.60:0/4266594776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34106250 0x7f8e3410de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 --2- 172.21.15.60:0/4266594776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101170 0x7f8e34101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 --2- 172.21.15.60:0/4266594776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34105b70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 -- 172.21.15.60:0/4266594776 >> 172.21.15.60:0/4266594776 conn(0x7f8e340fc9a0 msgr2=0x7f8e340fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 -- 172.21.15.60:0/4266594776 shutdown_connections 2023-10-05T15:15:49.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 -- 172.21.15.60:0/4266594776 wait complete. 2023-10-05T15:15:49.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.464+0000 7f8e395dc700 1 Processor -- start 2023-10-05T15:15:49.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 -- start start 2023-10-05T15:15:49.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34101170 0x7f8e34196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34106250 0x7f8e3419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3419bf80 con 0x7f8e34101b20 2023-10-05T15:15:49.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3419c0f0 con 0x7f8e34106250 2023-10-05T15:15:49.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e395dc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3419c2b0 con 0x7f8e34101170 2023-10-05T15:15:49.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e327fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e327fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36838/0 (socket says 172.21.15.60:36838) 2023-10-05T15:15:49.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e327fc700 1 -- 172.21.15.60:0/2423026541 learned_addr learned my addr 172.21.15.60:0/2423026541 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:49.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e337fe700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34106250 0x7f8e3419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.465+0000 7f8e32ffd700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34101170 0x7f8e34196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e327fc700 1 -- 172.21.15.60:0/2423026541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34101170 msgr2=0x7f8e34196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e327fc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34101170 0x7f8e34196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e327fc700 1 -- 172.21.15.60:0/2423026541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34106250 msgr2=0x7f8e3419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e327fc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34106250 0x7f8e3419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e327fc700 1 -- 172.21.15.60:0/2423026541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280095f0 con 0x7f8e34101b20 2023-10-05T15:15:49.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e32ffd700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34101170 0x7f8e34196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:49.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e327fc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34197500 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e28000c00 tx=0x7f8e28005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:49.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2801d070 con 0x7f8e34101b20 2023-10-05T15:15:49.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e28021410 con 0x7f8e34101b20 2023-10-05T15:15:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3419c530 con 0x7f8e34101b20 2023-10-05T15:15:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28017650 con 0x7f8e34101b20 2023-10-05T15:15:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.466+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e341a3df0 con 0x7f8e34101b20 2023-10-05T15:15:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.467+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3404ebb0 con 0x7f8e34101b20 2023-10-05T15:15:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.469+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f8e28021580 con 0x7f8e34101b20 2023-10-05T15:15:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.470+0000 7f8e1bfff700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8e1c0a1590 0x7f8e1c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.470+0000 7f8e32ffd700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8e1c0a1590 0x7f8e1c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.471+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f8e280cec20 con 0x7f8e34101b20 2023-10-05T15:15:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.471+0000 7f8e32ffd700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8e1c0a1590 0x7f8e1c0a3a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009cb0 tx=0x7f8e24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.473+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e28097eb0 con 0x7f8e34101b20 2023-10-05T15:15:49.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 -- 172.21.15.60:0/3933295869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 msgr2=0x7fd1ec10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/3933295869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec10ddb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400b0d0 tx=0x7fd1e400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 -- 172.21.15.60:0/3933295869 shutdown_connections 2023-10-05T15:15:49.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/3933295869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec10ddb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/3933295869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 0x7fd1ec107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/3933295869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1ec100f80 0x7fd1ec101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 -- 172.21.15.60:0/3933295869 >> 172.21.15.60:0/3933295869 conn(0x7fd1ec0780a0 msgr2=0x7fd1ec0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 -- 172.21.15.60:0/3933295869 shutdown_connections 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 -- 172.21.15.60:0/3933295869 wait complete. 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 Processor -- start 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.505+0000 7fd1f37ef700 1 -- start start 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f37ef700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1ec100f80 0x7fd1ec199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f37ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f37ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 0x7fd1ec19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f37ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec19e270 con 0x7fd1ec101940 2023-10-05T15:15:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f37ef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec19e3e0 con 0x7fd1ec106f90 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f37ef700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec19e5a0 con 0x7fd1ec100f80 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36852/0 (socket says 172.21.15.60:36852) 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 -- 172.21.15.60:0/1695845390 learned_addr learned my addr 172.21.15.60:0/1695845390 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f158b700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1ec100f80 0x7fd1ec199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f1d8c700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 0x7fd1ec19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 -- 172.21.15.60:0/1695845390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1ec100f80 msgr2=0x7fd1ec199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1ec100f80 0x7fd1ec199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 -- 172.21.15.60:0/1695845390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 msgr2=0x7fd1ec19dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 0x7fd1ec19dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 -- 172.21.15.60:0/1695845390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e4009d00 con 0x7fd1ec101940 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f1d8c700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 0x7fd1ec19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.506+0000 7fd1f0d8a700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec199840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00d980 tx=0x7fd1dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.507+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc004220 con 0x7fd1ec101940 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.507+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec19e880 con 0x7fd1ec101940 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.507+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1dc007640 con 0x7fd1ec101940 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.507+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc005610 con 0x7fd1ec101940 2023-10-05T15:15:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.507+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec1a60e0 con 0x7fd1ec101940 2023-10-05T15:15:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.508+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec04ebb0 con 0x7fd1ec101940 2023-10-05T15:15:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.509+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd1dc004750 con 0x7fd1ec101940 2023-10-05T15:15:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.510+0000 7fd1e27fc700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd1d80a1510 0x7fd1d80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.510+0000 7fd1f158b700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd1d80a1510 0x7fd1d80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.510+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fd1dc0cd000 con 0x7fd1ec101940 2023-10-05T15:15:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.510+0000 7fd1f158b700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd1d80a1510 0x7fd1d80a39d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009be0 tx=0x7fd1e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.514+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd1dc100100 con 0x7fd1ec101940 2023-10-05T15:15:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:49 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/374658789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-05T15:15:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.692+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f8e34198320 con 0x7f8e34101b20 2023-10-05T15:15:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.693+0000 7f8e1bfff700 1 -- 172.21.15.60:0/2423026541 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f8e2809b4d0 con 0x7f8e34101b20 2023-10-05T15:15:49.695 INFO:teuthology.orchestra.run.smithi060.stdout:339302416408 2023-10-05T15:15:49.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8e1c0a1590 msgr2=0x7f8e1c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8e1c0a1590 0x7f8e1c0a3a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009cb0 tx=0x7f8e24009260 comp rx=0 tx=0).stop 2023-10-05T15:15:49.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 msgr2=0x7f8e34197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34197500 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e28000c00 tx=0x7f8e28005740 comp rx=0 tx=0).stop 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 shutdown_connections 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34106250 0x7f8e3419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e34101170 0x7f8e34196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f8e1c0a1590 0x7f8e1c0a3a50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 --2- 172.21.15.60:0/2423026541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e34101b20 0x7f8e34197500 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 >> 172.21.15.60:0/2423026541 conn(0x7f8e340fc9a0 msgr2=0x7f8e340fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 shutdown_connections 2023-10-05T15:15:49.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.695+0000 7f8e395dc700 1 -- 172.21.15.60:0/2423026541 wait complete. 2023-10-05T15:15:49.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.734+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd1ec19a610 con 0x7fd1ec101940 2023-10-05T15:15:49.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.734+0000 7fd1e27fc700 1 -- 172.21.15.60:0/1695845390 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1dc016020 con 0x7fd1ec101940 2023-10-05T15:15:49.737 INFO:teuthology.orchestra.run.smithi060.stdout:55834574914 2023-10-05T15:15:49.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd1d80a1510 msgr2=0x7fd1d80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd1d80a1510 0x7fd1d80a39d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009be0 tx=0x7fd1e8009260 comp rx=0 tx=0).stop 2023-10-05T15:15:49.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 msgr2=0x7fd1ec199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec199840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00d980 tx=0x7fd1dc00dc90 comp rx=0 tx=0).stop 2023-10-05T15:15:49.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 shutdown_connections 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ec106f90 0x7fd1ec19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1ec100f80 0x7fd1ec199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd1d80a1510 0x7fd1d80a39d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 --2- 172.21.15.60:0/1695845390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec101940 0x7fd1ec199840 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 >> 172.21.15.60:0/1695845390 conn(0x7fd1ec0780a0 msgr2=0x7fd1ec10c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 shutdown_connections 2023-10-05T15:15:49.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.736+0000 7fd1f37ef700 1 -- 172.21.15.60:0/1695845390 wait complete. 2023-10-05T15:15:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 -- 172.21.15.60:0/646180768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 msgr2=0x7fb1ec10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/646180768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec10c4e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400b0d0 tx=0x7fb1e400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 -- 172.21.15.60:0/646180768 shutdown_connections 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/646180768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec10c4e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/646180768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1ec0ffad0 0x7fb1ec0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/646180768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec100480 0x7fb1ec104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.740+0000 7fb1f3f69700 1 -- 172.21.15.60:0/646180768 >> 172.21.15.60:0/646180768 conn(0x7fb1ec0750a0 msgr2=0x7fb1ec0754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 -- 172.21.15.60:0/646180768 shutdown_connections 2023-10-05T15:15:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 -- 172.21.15.60:0/646180768 wait complete. 2023-10-05T15:15:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 Processor -- start 2023-10-05T15:15:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 -- start start 2023-10-05T15:15:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1ec0ffad0 0x7fb1ec197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec100480 0x7fb1ec197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19bfe0 con 0x7fb1ec104960 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.741+0000 7fb1f3f69700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19c150 con 0x7fb1ec100480 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f3f69700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19c310 con 0x7fb1ec0ffad0 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36868/0 (socket says 172.21.15.60:36868) 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 -- 172.21.15.60:0/2435371127 learned_addr learned my addr 172.21.15.60:0/2435371127 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f1504700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec100480 0x7fb1ec197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f1d05700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1ec0ffad0 0x7fb1ec197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 -- 172.21.15.60:0/2435371127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1ec0ffad0 msgr2=0x7fb1ec197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1ec0ffad0 0x7fb1ec197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 -- 172.21.15.60:0/2435371127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec100480 msgr2=0x7fb1ec197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec100480 0x7fb1ec197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 -- 172.21.15.60:0/2435371127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009d00 con 0x7fb1ec104960 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f2506700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec19b9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4004c80 tx=0x7fb1e4004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400e040 con 0x7fb1ec104960 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec19c590 con 0x7fb1ec104960 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1e400be60 con 0x7fb1ec104960 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40052a0 con 0x7fb1ec104960 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.742+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec1a3e50 con 0x7fb1ec104960 2023-10-05T15:15:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.744+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec19c800 con 0x7fb1ec104960 2023-10-05T15:15:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.745+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb1e4005400 con 0x7fb1ec104960 2023-10-05T15:15:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.746+0000 7fb1e2ffd700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb1d80a1510 0x7fb1d80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.746+0000 7fb1f1d05700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb1d80a1510 0x7fb1d80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.746+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fb1e40ce7f0 con 0x7fb1ec104960 2023-10-05T15:15:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.747+0000 7fb1f1d05700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb1d80a1510 0x7fb1d80a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8005fd0 tx=0x7fb1e8005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.751+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb1e4097a80 con 0x7fb1ec104960 2023-10-05T15:15:49.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.969+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1ec10ece0 con 0x7fb1ec104960 2023-10-05T15:15:49.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.969+0000 7fb1e2ffd700 1 -- 172.21.15.60:0/2435371127 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1e409b0a0 con 0x7fb1ec104960 2023-10-05T15:15:49.971 INFO:teuthology.orchestra.run.smithi060.stdout:111669149753 2023-10-05T15:15:49.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.971+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb1d80a1510 msgr2=0x7fb1d80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.971+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb1d80a1510 0x7fb1d80a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8005fd0 tx=0x7fb1e8005e50 comp rx=0 tx=0).stop 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.971+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 msgr2=0x7fb1ec19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.971+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec19b9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4004c80 tx=0x7fb1e4004cb0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 shutdown_connections 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb1d80a1510 0x7fb1d80a39d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1ec104960 0x7fb1ec19b9d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1ec0ffad0 0x7fb1ec197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 --2- 172.21.15.60:0/2435371127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1ec100480 0x7fb1ec197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 >> 172.21.15.60:0/2435371127 conn(0x7fb1ec0750a0 msgr2=0x7fb1ec103180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 shutdown_connections 2023-10-05T15:15:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:49.972+0000 7fb1f3f69700 1 -- 172.21.15.60:0/2435371127 wait complete. 2023-10-05T15:15:50.276 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808861 got 287762808863 for osd.9 2023-10-05T15:15:50.277 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:50.409 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:50 smithi060 ceph-mon[99238]: pgmap v292: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:50.409 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:50 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2423026541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-05T15:15:50.409 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:50 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1695845390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-05T15:15:50.409 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:50 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2435371127' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-05T15:15:50.536 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149751 got 111669149753 for osd.3 2023-10-05T15:15:50.537 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:50.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:50 smithi135 ceph-mon[103360]: pgmap v292: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:50 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2423026541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-05T15:15:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:50 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1695845390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-05T15:15:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:50 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2435371127' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-05T15:15:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:50 smithi092 ceph-mon[102944]: pgmap v292: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:50 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2423026541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-05T15:15:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:50 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1695845390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-05T15:15:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:50 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2435371127' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-05T15:15:50.760 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416405 got 339302416408 for osd.11 2023-10-05T15:15:50.761 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:50.965 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574912 got 55834574914 for osd.1 2023-10-05T15:15:50.966 DEBUG:teuthology.parallel:result is None 2023-10-05T15:15:50.966 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-05T15:15:50.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-05T15:15:51.546 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:51 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:15:51.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:51 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:15:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:51 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:15:52.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:52 smithi060 ceph-mon[99238]: pgmap v293: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:52.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:52 smithi135 ceph-mon[103360]: pgmap v293: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:52 smithi092 ceph-mon[102944]: pgmap v293: 129 pgs: 4 peering, 125 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 -- 172.21.15.60:0/3854659515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030105e70 msgr2=0x7fb030106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 --2- 172.21.15.60:0/3854659515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030105e70 0x7fb030106250 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb0240099c0 tx=0x7fb024009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 -- 172.21.15.60:0/3854659515 shutdown_connections 2023-10-05T15:15:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 --2- 172.21.15.60:0/3854659515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb030100820 0x7fb03010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 --2- 172.21.15.60:0/3854659515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030105e70 0x7fb030106250 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:52.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 --2- 172.21.15.60:0/3854659515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0300ffe60 0x7fb0301002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:52.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 -- 172.21.15.60:0/3854659515 >> 172.21.15.60:0/3854659515 conn(0x7fb030075e00 msgr2=0x7fb030076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:52.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 -- 172.21.15.60:0/3854659515 shutdown_connections 2023-10-05T15:15:52.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.974+0000 7fb036eba700 1 -- 172.21.15.60:0/3854659515 wait complete. 2023-10-05T15:15:52.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 Processor -- start 2023-10-05T15:15:52.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 -- start start 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0300ffe60 0x7fb030196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 0x7fb030197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb030105e70 0x7fb03019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03019bf10 con 0x7fb030100820 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03019c080 con 0x7fb030105e70 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb036eba700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03019c240 con 0x7fb0300ffe60 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb02ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 0x7fb030197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb02ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 0x7fb030197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36878/0 (socket says 172.21.15.60:36878) 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb02ffff700 1 -- 172.21.15.60:0/3637923973 learned_addr learned my addr 172.21.15.60:0/3637923973 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb034c56700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0300ffe60 0x7fb030196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.975+0000 7fb035457700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb030105e70 0x7fb03019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02ffff700 1 -- 172.21.15.60:0/3637923973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0300ffe60 msgr2=0x7fb030196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02ffff700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0300ffe60 0x7fb030196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02ffff700 1 -- 172.21.15.60:0/3637923973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb030105e70 msgr2=0x7fb03019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02ffff700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb030105e70 0x7fb03019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02ffff700 1 -- 172.21.15.60:0/3637923973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240095f0 con 0x7fb030100820 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02ffff700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 0x7fb030197490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00e9a0 tx=0x7fb01c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c009790 con 0x7fb030100820 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb01c010430 con 0x7fb030100820 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03019c520 con 0x7fb030100820 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c018680 con 0x7fb030100820 2023-10-05T15:15:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.976+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0301a3d80 con 0x7fb030100820 2023-10-05T15:15:52.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.977+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03004ebb0 con 0x7fb030100820 2023-10-05T15:15:52.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.978+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb01c0105a0 con 0x7fb030100820 2023-10-05T15:15:52.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.979+0000 7fb02dffb700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0200a1510 0x7fb0200a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.979+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fb01c014070 con 0x7fb030100820 2023-10-05T15:15:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.979+0000 7fb034c56700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0200a1510 0x7fb0200a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.980+0000 7fb034c56700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0200a1510 0x7fb0200a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb024009990 tx=0x7fb024005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:52.983+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb01c096730 con 0x7fb030100820 2023-10-05T15:15:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.205+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb03010fef0 con 0x7fb0200a1510 2023-10-05T15:15:53.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.221+0000 7fb02dffb700 1 -- 172.21.15.60:0/3637923973 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426144 (secure 0 0 0) 0x7fb03010fef0 con 0x7fb0200a1510 2023-10-05T15:15:53.227 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:53.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0200a1510 msgr2=0x7fb0200a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:53.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0200a1510 0x7fb0200a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb024009990 tx=0x7fb024005fb0 comp rx=0 tx=0).stop 2023-10-05T15:15:53.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 msgr2=0x7fb030197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 0x7fb030197490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00e9a0 tx=0x7fb01c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:15:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 shutdown_connections 2023-10-05T15:15:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb030105e70 0x7fb03019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0300ffe60 0x7fb030196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb0200a1510 0x7fb0200a39d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 --2- 172.21.15.60:0/3637923973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030100820 0x7fb030197490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:53.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 >> 172.21.15.60:0/3637923973 conn(0x7fb030075e00 msgr2=0x7fb030068a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:53.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 shutdown_connections 2023-10-05T15:15:53.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:53.224+0000 7fb036eba700 1 -- 172.21.15.60:0/3637923973 wait complete. 2023-10-05T15:15:53.234 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:15:53.626 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2023-10-05T15:15:53.175965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656415,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":571,"num_read_kb":408,"num_write":417,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338240,"kb_used_data":13964,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603584,"statfs":{"total":1151940427776,"available":1151594070016,"internally_reserved":0,"allocated":14299136,"data_stored":7832747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002010"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063611+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:15:46.063611+0000","last_peered":"2023-10-05T15:15:46.063611+0000","last_clean":"2023-10-05T15:15:46.063611+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:15:46.063611+0000","last_undegraded":"2023-10-05T15:15:46.063611+0000","last_fullsized":"2023-10-05T15:15:46.063611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064219+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:15:46.064219+0000","last_peered":"2023-10-05T15:15:46.064219+0000","last_clean":"2023-10-05T15:15:46.064219+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:15:46.064219+0000","last_undegraded":"2023-10-05T15:15:46.064219+0000","last_fullsized":"2023-10-05T15:15:46.064219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063889+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:15:46.063889+0000","last_peered":"2023-10-05T15:15:46.063889+0000","last_clean":"2023-10-05T15:15:46.063889+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:15:46.063889+0000","last_undegraded":"2023-10-05T15:15:46.063889+0000","last_fullsized":"2023-10-05T15:15:46.063889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061113+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:15:46.061113+0000","last_peered":"2023-10-05T15:15:46.061113+0000","last_clean":"2023-10-05T15:15:46.061113+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:15:46.061113+0000","last_undegraded":"2023-10-05T15:15:46.061113+0000","last_fullsized":"2023-10-05T15:15:46.061113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063947+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:15:46.063947+0000","last_peered":"2023-10-05T15:15:46.063947+0000","last_clean":"2023-10-05T15:15:46.063947+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:15:46.063947+0000","last_undegraded":"2023-10-05T15:15:46.063947+0000","last_fullsized":"2023-10-05T15:15:46.063947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063401+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:15:46.063401+0000","last_peered":"2023-10-05T15:15:46.063401+0000","last_clean":"2023-10-05T15:15:46.063401+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:15:46.063401+0000","last_undegraded":"2023-10-05T15:15:46.063401+0000","last_fullsized":"2023-10-05T15:15:46.063401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057735+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:15:46.057735+0000","last_peered":"2023-10-05T15:15:46.057735+0000","last_clean":"2023-10-05T15:15:46.057735+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:15:46.057735+0000","last_undegraded":"2023-10-05T15:15:46.057735+0000","last_fullsized":"2023-10-05T15:15:46.057735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065184+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:15:46.065184+0000","last_peered":"2023-10-05T15:15:46.065184+0000","last_clean":"2023-10-05T15:15:46.065184+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:15:46.065184+0000","last_undegraded":"2023-10-05T15:15:46.065184+0000","last_fullsized":"2023-10-05T15:15:46.065184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.068095+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:15:46.068095+0000","last_peered":"2023-10-05T15:15:46.068095+0000","last_clean":"2023-10-05T15:15:46.068095+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:15:46.068095+0000","last_undegraded":"2023-10-05T15:15:46.068095+0000","last_fullsized":"2023-10-05T15:15:46.068095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063810+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:15:46.063810+0000","last_peered":"2023-10-05T15:15:46.063810+0000","last_clean":"2023-10-05T15:15:46.063810+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:15:46.063810+0000","last_undegraded":"2023-10-05T15:15:46.063810+0000","last_fullsized":"2023-10-05T15:15:46.063810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058082+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:15:46.058082+0000","last_peered":"2023-10-05T15:15:46.058082+0000","last_clean":"2023-10-05T15:15:46.058082+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:15:46.058082+0000","last_undegraded":"2023-10-05T15:15:46.058082+0000","last_fullsized":"2023-10-05T15:15:46.058082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.090842+0000","last_change":"2023-10-05T15:15:47.090497+0000","last_active":"2023-10-05T15:15:47.090842+0000","last_peered":"2023-10-05T15:15:47.090842+0000","last_clean":"2023-10-05T15:15:47.090842+0000","last_became_active":"2023-10-05T15:15:47.090160+0000","last_became_peered":"2023-10-05T15:15:47.090160+0000","last_unstale":"2023-10-05T15:15:47.090842+0000","last_undegraded":"2023-10-05T15:15:47.090842+0000","last_fullsized":"2023-10-05T15:15:47.090842+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:15.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063660+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:15:46.063660+0000","last_peered":"2023-10-05T15:15:46.063660+0000","last_clean":"2023-10-05T15:15:46.063660+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:15:46.063660+0000","last_undegraded":"2023-10-05T15:15:46.063660+0000","last_fullsized":"2023-10-05T15:15:46.063660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062510+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:15:46.062510+0000","last_peered":"2023-10-05T15:15:46.062510+0000","last_clean":"2023-10-05T15:15:46.062510+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:15:46.062510+0000","last_undegraded":"2023-10-05T15:15:46.062510+0000","last_fullsized":"2023-10-05T15:15:46.062510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062644+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:15:46.062644+0000","last_peered":"2023-10-05T15:15:46.062644+0000","last_clean":"2023-10-05T15:15:46.062644+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:15:46.062644+0000","last_undegraded":"2023-10-05T15:15:46.062644+0000","last_fullsized":"2023-10-05T15:15:46.062644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067382+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:15:46.067382+0000","last_peered":"2023-10-05T15:15:46.067382+0000","last_clean":"2023-10-05T15:15:46.067382+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:15:46.067382+0000","last_undegraded":"2023-10-05T15:15:46.067382+0000","last_fullsized":"2023-10-05T15:15:46.067382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063591+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:15:46.063591+0000","last_peered":"2023-10-05T15:15:46.063591+0000","last_clean":"2023-10-05T15:15:46.063591+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:15:46.063591+0000","last_undegraded":"2023-10-05T15:15:46.063591+0000","last_fullsized":"2023-10-05T15:15:46.063591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058796+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:15:46.058796+0000","last_peered":"2023-10-05T15:15:46.058796+0000","last_clean":"2023-10-05T15:15:46.058796+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:15:46.058796+0000","last_undegraded":"2023-10-05T15:15:46.058796+0000","last_fullsized":"2023-10-05T15:15:46.058796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057776+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:15:46.057776+0000","last_peered":"2023-10-05T15:15:46.057776+0000","last_clean":"2023-10-05T15:15:46.057776+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:15:46.057776+0000","last_undegraded":"2023-10-05T15:15:46.057776+0000","last_fullsized":"2023-10-05T15:15:46.057776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057151+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:15:46.057151+0000","last_peered":"2023-10-05T15:15:46.057151+0000","last_clean":"2023-10-05T15:15:46.057151+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:15:46.057151+0000","last_undegraded":"2023-10-05T15:15:46.057151+0000","last_fullsized":"2023-10-05T15:15:46.057151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":72,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:48.087246+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:15:48.087246+0000","last_peered":"2023-10-05T15:15:48.087246+0000","last_clean":"2023-10-05T15:15:48.087246+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:15:48.087246+0000","last_undegraded":"2023-10-05T15:15:48.087246+0000","last_fullsized":"2023-10-05T15:15:48.087246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066757+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:15:46.066757+0000","last_peered":"2023-10-05T15:15:46.066757+0000","last_clean":"2023-10-05T15:15:46.066757+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:15:46.066757+0000","last_undegraded":"2023-10-05T15:15:46.066757+0000","last_fullsized":"2023-10-05T15:15:46.066757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060005+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:15:46.060005+0000","last_peered":"2023-10-05T15:15:46.060005+0000","last_clean":"2023-10-05T15:15:46.060005+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:15:46.060005+0000","last_undegraded":"2023-10-05T15:15:46.060005+0000","last_fullsized":"2023-10-05T15:15:46.060005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066765+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:15:46.066765+0000","last_peered":"2023-10-05T15:15:46.066765+0000","last_clean":"2023-10-05T15:15:46.066765+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:15:46.066765+0000","last_undegraded":"2023-10-05T15:15:46.066765+0000","last_fullsized":"2023-10-05T15:15:46.066765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064682+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:15:46.064682+0000","last_peered":"2023-10-05T15:15:46.064682+0000","last_clean":"2023-10-05T15:15:46.064682+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:15:46.064682+0000","last_undegraded":"2023-10-05T15:15:46.064682+0000","last_fullsized":"2023-10-05T15:15:46.064682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060966+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:15:46.060966+0000","last_peered":"2023-10-05T15:15:46.060966+0000","last_clean":"2023-10-05T15:15:46.060966+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:15:46.060966+0000","last_undegraded":"2023-10-05T15:15:46.060966+0000","last_fullsized":"2023-10-05T15:15:46.060966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064382+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:15:46.064382+0000","last_peered":"2023-10-05T15:15:46.064382+0000","last_clean":"2023-10-05T15:15:46.064382+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:15:46.064382+0000","last_undegraded":"2023-10-05T15:15:46.064382+0000","last_fullsized":"2023-10-05T15:15:46.064382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067707+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:15:46.067707+0000","last_peered":"2023-10-05T15:15:46.067707+0000","last_clean":"2023-10-05T15:15:46.067707+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:15:46.067707+0000","last_undegraded":"2023-10-05T15:15:46.067707+0000","last_fullsized":"2023-10-05T15:15:46.067707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060253+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:15:46.060253+0000","last_peered":"2023-10-05T15:15:46.060253+0000","last_clean":"2023-10-05T15:15:46.060253+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:15:46.060253+0000","last_undegraded":"2023-10-05T15:15:46.060253+0000","last_fullsized":"2023-10-05T15:15:46.060253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064078+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:15:46.064078+0000","last_peered":"2023-10-05T15:15:46.064078+0000","last_clean":"2023-10-05T15:15:46.064078+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:15:46.064078+0000","last_undegraded":"2023-10-05T15:15:46.064078+0000","last_fullsized":"2023-10-05T15:15:46.064078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062278+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:15:46.062278+0000","last_peered":"2023-10-05T15:15:46.062278+0000","last_clean":"2023-10-05T15:15:46.062278+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:15:46.062278+0000","last_undegraded":"2023-10-05T15:15:46.062278+0000","last_fullsized":"2023-10-05T15:15:46.062278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057601+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:15:46.057601+0000","last_peered":"2023-10-05T15:15:46.057601+0000","last_clean":"2023-10-05T15:15:46.057601+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:15:46.057601+0000","last_undegraded":"2023-10-05T15:15:46.057601+0000","last_fullsized":"2023-10-05T15:15:46.057601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.092824+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:15:47.092824+0000","last_peered":"2023-10-05T15:15:47.092824+0000","last_clean":"2023-10-05T15:15:47.092824+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:15:47.092824+0000","last_undegraded":"2023-10-05T15:15:47.092824+0000","last_fullsized":"2023-10-05T15:15:47.092824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.088761+0000","last_change":"2023-10-05T15:15:47.088761+0000","last_active":"2023-10-05T15:15:47.088761+0000","last_peered":"2023-10-05T15:15:47.088761+0000","last_clean":"2023-10-05T15:15:47.088761+0000","last_became_active":"2023-10-05T15:15:47.088438+0000","last_became_peered":"2023-10-05T15:15:47.088438+0000","last_unstale":"2023-10-05T15:15:47.088761+0000","last_undegraded":"2023-10-05T15:15:47.088761+0000","last_fullsized":"2023-10-05T15:15:47.088761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:22.419833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057415+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:15:46.057415+0000","last_peered":"2023-10-05T15:15:46.057415+0000","last_clean":"2023-10-05T15:15:46.057415+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:15:46.057415+0000","last_undegraded":"2023-10-05T15:15:46.057415+0000","last_fullsized":"2023-10-05T15:15:46.057415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063306+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:46.063306+0000","last_peered":"2023-10-05T15:15:46.063306+0000","last_clean":"2023-10-05T15:15:46.063306+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:46.063306+0000","last_undegraded":"2023-10-05T15:15:46.063306+0000","last_fullsized":"2023-10-05T15:15:46.063306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061680+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:15:46.061680+0000","last_peered":"2023-10-05T15:15:46.061680+0000","last_clean":"2023-10-05T15:15:46.061680+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:15:46.061680+0000","last_undegraded":"2023-10-05T15:15:46.061680+0000","last_fullsized":"2023-10-05T15:15:46.061680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063486+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:15:46.063486+0000","last_peered":"2023-10-05T15:15:46.063486+0000","last_clean":"2023-10-05T15:15:46.063486+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:15:46.063486+0000","last_undegraded":"2023-10-05T15:15:46.063486+0000","last_fullsized":"2023-10-05T15:15:46.063486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062727+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:46.062727+0000","last_peered":"2023-10-05T15:15:46.062727+0000","last_clean":"2023-10-05T15:15:46.062727+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:46.062727+0000","last_undegraded":"2023-10-05T15:15:46.062727+0000","last_fullsized":"2023-10-05T15:15:46.062727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065137+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:15:46.065137+0000","last_peered":"2023-10-05T15:15:46.065137+0000","last_clean":"2023-10-05T15:15:46.065137+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:15:46.065137+0000","last_undegraded":"2023-10-05T15:15:46.065137+0000","last_fullsized":"2023-10-05T15:15:46.065137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064063+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:15:46.064063+0000","last_peered":"2023-10-05T15:15:46.064063+0000","last_clean":"2023-10-05T15:15:46.064063+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:15:46.064063+0000","last_undegraded":"2023-10-05T15:15:46.064063+0000","last_fullsized":"2023-10-05T15:15:46.064063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060854+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:15:46.060854+0000","last_peered":"2023-10-05T15:15:46.060854+0000","last_clean":"2023-10-05T15:15:46.060854+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:15:46.060854+0000","last_undegraded":"2023-10-05T15:15:46.060854+0000","last_fullsized":"2023-10-05T15:15:46.060854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057402+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:15:46.057402+0000","last_peered":"2023-10-05T15:15:46.057402+0000","last_clean":"2023-10-05T15:15:46.057402+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:15:46.057402+0000","last_undegraded":"2023-10-05T15:15:46.057402+0000","last_fullsized":"2023-10-05T15:15:46.057402+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064833+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:15:46.064833+0000","last_peered":"2023-10-05T15:15:46.064833+0000","last_clean":"2023-10-05T15:15:46.064833+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:15:46.064833+0000","last_undegraded":"2023-10-05T15:15:46.064833+0000","last_fullsized":"2023-10-05T15:15:46.064833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:50.094453+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:15:50.094453+0000","last_peered":"2023-10-05T15:15:50.094453+0000","last_clean":"2023-10-05T15:15:50.094453+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:15:50.094453+0000","last_undegraded":"2023-10-05T15:15:50.094453+0000","last_fullsized":"2023-10-05T15:15:50.094453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.068043+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:15:46.068043+0000","last_peered":"2023-10-05T15:15:46.068043+0000","last_clean":"2023-10-05T15:15:46.068043+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:15:46.068043+0000","last_undegraded":"2023-10-05T15:15:46.068043+0000","last_fullsized":"2023-10-05T15:15:46.068043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057080+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:15:46.057080+0000","last_peered":"2023-10-05T15:15:46.057080+0000","last_clean":"2023-10-05T15:15:46.057080+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:15:46.057080+0000","last_undegraded":"2023-10-05T15:15:46.057080+0000","last_fullsized":"2023-10-05T15:15:46.057080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058014+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:46.058014+0000","last_peered":"2023-10-05T15:15:46.058014+0000","last_clean":"2023-10-05T15:15:46.058014+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:46.058014+0000","last_undegraded":"2023-10-05T15:15:46.058014+0000","last_fullsized":"2023-10-05T15:15:46.058014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064576+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:15:46.064576+0000","last_peered":"2023-10-05T15:15:46.064576+0000","last_clean":"2023-10-05T15:15:46.064576+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:15:46.064576+0000","last_undegraded":"2023-10-05T15:15:46.064576+0000","last_fullsized":"2023-10-05T15:15:46.064576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060826+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:15:46.060826+0000","last_peered":"2023-10-05T15:15:46.060826+0000","last_clean":"2023-10-05T15:15:46.060826+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:15:46.060826+0000","last_undegraded":"2023-10-05T15:15:46.060826+0000","last_fullsized":"2023-10-05T15:15:46.060826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061383+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:15:46.061383+0000","last_peered":"2023-10-05T15:15:46.061383+0000","last_clean":"2023-10-05T15:15:46.061383+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:15:46.061383+0000","last_undegraded":"2023-10-05T15:15:46.061383+0000","last_fullsized":"2023-10-05T15:15:46.061383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067923+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:15:46.067923+0000","last_peered":"2023-10-05T15:15:46.067923+0000","last_clean":"2023-10-05T15:15:46.067923+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:15:46.067923+0000","last_undegraded":"2023-10-05T15:15:46.067923+0000","last_fullsized":"2023-10-05T15:15:46.067923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057315+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:15:46.057315+0000","last_peered":"2023-10-05T15:15:46.057315+0000","last_clean":"2023-10-05T15:15:46.057315+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:15:46.057315+0000","last_undegraded":"2023-10-05T15:15:46.057315+0000","last_fullsized":"2023-10-05T15:15:46.057315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'33","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:50.106099+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:15:50.106099+0000","last_peered":"2023-10-05T15:15:50.106099+0000","last_clean":"2023-10-05T15:15:50.106099+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:15:50.106099+0000","last_undegraded":"2023-10-05T15:15:50.106099+0000","last_fullsized":"2023-10-05T15:15:50.106099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58599,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":100,"num_write":35,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064091+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:15:46.064091+0000","last_peered":"2023-10-05T15:15:46.064091+0000","last_clean":"2023-10-05T15:15:46.064091+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:15:46.064091+0000","last_undegraded":"2023-10-05T15:15:46.064091+0000","last_fullsized":"2023-10-05T15:15:46.064091+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062190+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:15:46.062190+0000","last_peered":"2023-10-05T15:15:46.062190+0000","last_clean":"2023-10-05T15:15:46.062190+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:15:46.062190+0000","last_undegraded":"2023-10-05T15:15:46.062190+0000","last_fullsized":"2023-10-05T15:15:46.062190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057412+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:46.057412+0000","last_peered":"2023-10-05T15:15:46.057412+0000","last_clean":"2023-10-05T15:15:46.057412+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:46.057412+0000","last_undegraded":"2023-10-05T15:15:46.057412+0000","last_fullsized":"2023-10-05T15:15:46.057412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064921+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:15:46.064921+0000","last_peered":"2023-10-05T15:15:46.064921+0000","last_clean":"2023-10-05T15:15:46.064921+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:15:46.064921+0000","last_undegraded":"2023-10-05T15:15:46.064921+0000","last_fullsized":"2023-10-05T15:15:46.064921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062770+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:15:46.062770+0000","last_peered":"2023-10-05T15:15:46.062770+0000","last_clean":"2023-10-05T15:15:46.062770+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:15:46.062770+0000","last_undegraded":"2023-10-05T15:15:46.062770+0000","last_fullsized":"2023-10-05T15:15:46.062770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062773+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:46.062773+0000","last_peered":"2023-10-05T15:15:46.062773+0000","last_clean":"2023-10-05T15:15:46.062773+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:46.062773+0000","last_undegraded":"2023-10-05T15:15:46.062773+0000","last_fullsized":"2023-10-05T15:15:46.062773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058532+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:15:46.058532+0000","last_peered":"2023-10-05T15:15:46.058532+0000","last_clean":"2023-10-05T15:15:46.058532+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:15:46.058532+0000","last_undegraded":"2023-10-05T15:15:46.058532+0000","last_fullsized":"2023-10-05T15:15:46.058532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.103509+0000","last_change":"2023-10-05T15:15:47.103509+0000","last_active":"2023-10-05T15:15:47.103509+0000","last_peered":"2023-10-05T15:15:47.103509+0000","last_clean":"2023-10-05T15:15:47.103509+0000","last_became_active":"2023-10-05T15:15:47.103150+0000","last_became_peered":"2023-10-05T15:15:47.103150+0000","last_unstale":"2023-10-05T15:15:47.103509+0000","last_undegraded":"2023-10-05T15:15:47.103509+0000","last_fullsized":"2023-10-05T15:15:47.103509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:59.848397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:51.094851+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:15:51.094851+0000","last_peered":"2023-10-05T15:15:51.094851+0000","last_clean":"2023-10-05T15:15:51.094851+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:15:51.094851+0000","last_undegraded":"2023-10-05T15:15:51.094851+0000","last_fullsized":"2023-10-05T15:15:51.094851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057834+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:15:46.057834+0000","last_peered":"2023-10-05T15:15:46.057834+0000","last_clean":"2023-10-05T15:15:46.057834+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:15:46.057834+0000","last_undegraded":"2023-10-05T15:15:46.057834+0000","last_fullsized":"2023-10-05T15:15:46.057834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066044+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:15:46.066044+0000","last_peered":"2023-10-05T15:15:46.066044+0000","last_clean":"2023-10-05T15:15:46.066044+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:15:46.066044+0000","last_undegraded":"2023-10-05T15:15:46.066044+0000","last_fullsized":"2023-10-05T15:15:46.066044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060708+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:15:46.060708+0000","last_peered":"2023-10-05T15:15:46.060708+0000","last_clean":"2023-10-05T15:15:46.060708+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:15:46.060708+0000","last_undegraded":"2023-10-05T15:15:46.060708+0000","last_fullsized":"2023-10-05T15:15:46.060708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062586+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:15:46.062586+0000","last_peered":"2023-10-05T15:15:46.062586+0000","last_clean":"2023-10-05T15:15:46.062586+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:15:46.062586+0000","last_undegraded":"2023-10-05T15:15:46.062586+0000","last_fullsized":"2023-10-05T15:15:46.062586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062593+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:15:46.062593+0000","last_peered":"2023-10-05T15:15:46.062593+0000","last_clean":"2023-10-05T15:15:46.062593+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:15:46.062593+0000","last_undegraded":"2023-10-05T15:15:46.062593+0000","last_fullsized":"2023-10-05T15:15:46.062593+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064299+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:15:46.064299+0000","last_peered":"2023-10-05T15:15:46.064299+0000","last_clean":"2023-10-05T15:15:46.064299+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:15:46.064299+0000","last_undegraded":"2023-10-05T15:15:46.064299+0000","last_fullsized":"2023-10-05T15:15:46.064299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063269+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:15:46.063269+0000","last_peered":"2023-10-05T15:15:46.063269+0000","last_clean":"2023-10-05T15:15:46.063269+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:15:46.063269+0000","last_undegraded":"2023-10-05T15:15:46.063269+0000","last_fullsized":"2023-10-05T15:15:46.063269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063976+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:15:46.063976+0000","last_peered":"2023-10-05T15:15:46.063976+0000","last_clean":"2023-10-05T15:15:46.063976+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:15:46.063976+0000","last_undegraded":"2023-10-05T15:15:46.063976+0000","last_fullsized":"2023-10-05T15:15:46.063976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058304+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:15:46.058304+0000","last_peered":"2023-10-05T15:15:46.058304+0000","last_clean":"2023-10-05T15:15:46.058304+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:15:46.058304+0000","last_undegraded":"2023-10-05T15:15:46.058304+0000","last_fullsized":"2023-10-05T15:15:46.058304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063589+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:15:46.063589+0000","last_peered":"2023-10-05T15:15:46.063589+0000","last_clean":"2023-10-05T15:15:46.063589+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:15:46.063589+0000","last_undegraded":"2023-10-05T15:15:46.063589+0000","last_fullsized":"2023-10-05T15:15:46.063589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063886+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:15:46.063886+0000","last_peered":"2023-10-05T15:15:46.063886+0000","last_clean":"2023-10-05T15:15:46.063886+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:15:46.063886+0000","last_undegraded":"2023-10-05T15:15:46.063886+0000","last_fullsized":"2023-10-05T15:15:46.063886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:49.089453+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:15:49.089453+0000","last_peered":"2023-10-05T15:15:49.089453+0000","last_clean":"2023-10-05T15:15:49.089453+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:15:49.089453+0000","last_undegraded":"2023-10-05T15:15:49.089453+0000","last_fullsized":"2023-10-05T15:15:49.089453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063457+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:15:46.063457+0000","last_peered":"2023-10-05T15:15:46.063457+0000","last_clean":"2023-10-05T15:15:46.063457+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:15:46.063457+0000","last_undegraded":"2023-10-05T15:15:46.063457+0000","last_fullsized":"2023-10-05T15:15:46.063457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065857+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:15:46.065857+0000","last_peered":"2023-10-05T15:15:46.065857+0000","last_clean":"2023-10-05T15:15:46.065857+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:15:46.065857+0000","last_undegraded":"2023-10-05T15:15:46.065857+0000","last_fullsized":"2023-10-05T15:15:46.065857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061174+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:15:46.061174+0000","last_peered":"2023-10-05T15:15:46.061174+0000","last_clean":"2023-10-05T15:15:46.061174+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:15:46.061174+0000","last_undegraded":"2023-10-05T15:15:46.061174+0000","last_fullsized":"2023-10-05T15:15:46.061174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:49.090843+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:15:49.090843+0000","last_peered":"2023-10-05T15:15:49.090843+0000","last_clean":"2023-10-05T15:15:49.090843+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:15:49.090843+0000","last_undegraded":"2023-10-05T15:15:49.090843+0000","last_fullsized":"2023-10-05T15:15:49.090843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058004+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:15:46.058004+0000","last_peered":"2023-10-05T15:15:46.058004+0000","last_clean":"2023-10-05T15:15:46.058004+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:15:46.058004+0000","last_undegraded":"2023-10-05T15:15:46.058004+0000","last_fullsized":"2023-10-05T15:15:46.058004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.094374+0000","last_change":"2023-10-05T15:15:47.094134+0000","last_active":"2023-10-05T15:15:47.094374+0000","last_peered":"2023-10-05T15:15:47.094374+0000","last_clean":"2023-10-05T15:15:47.094374+0000","last_became_active":"2023-10-05T15:15:47.093826+0000","last_became_peered":"2023-10-05T15:15:47.093826+0000","last_unstale":"2023-10-05T15:15:47.094374+0000","last_undegraded":"2023-10-05T15:15:47.094374+0000","last_fullsized":"2023-10-05T15:15:47.094374+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:16:26.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060721+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:46.060721+0000","last_peered":"2023-10-05T15:15:46.060721+0000","last_clean":"2023-10-05T15:15:46.060721+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:46.060721+0000","last_undegraded":"2023-10-05T15:15:46.060721+0000","last_fullsized":"2023-10-05T15:15:46.060721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057603+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:15:46.057603+0000","last_peered":"2023-10-05T15:15:46.057603+0000","last_clean":"2023-10-05T15:15:46.057603+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:15:46.057603+0000","last_undegraded":"2023-10-05T15:15:46.057603+0000","last_fullsized":"2023-10-05T15:15:46.057603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.089429+0000","last_change":"2023-10-05T15:15:47.089429+0000","last_active":"2023-10-05T15:15:47.089429+0000","last_peered":"2023-10-05T15:15:47.089429+0000","last_clean":"2023-10-05T15:15:47.089429+0000","last_became_active":"2023-10-05T15:15:47.088950+0000","last_became_peered":"2023-10-05T15:15:47.088950+0000","last_unstale":"2023-10-05T15:15:47.089429+0000","last_undegraded":"2023-10-05T15:15:47.089429+0000","last_fullsized":"2023-10-05T15:15:47.089429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:36:14.592094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062546+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:15:46.062546+0000","last_peered":"2023-10-05T15:15:46.062546+0000","last_clean":"2023-10-05T15:15:46.062546+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:15:46.062546+0000","last_undegraded":"2023-10-05T15:15:46.062546+0000","last_fullsized":"2023-10-05T15:15:46.062546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057731+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:46.057731+0000","last_peered":"2023-10-05T15:15:46.057731+0000","last_clean":"2023-10-05T15:15:46.057731+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:46.057731+0000","last_undegraded":"2023-10-05T15:15:46.057731+0000","last_fullsized":"2023-10-05T15:15:46.057731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062666+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:15:46.062666+0000","last_peered":"2023-10-05T15:15:46.062666+0000","last_clean":"2023-10-05T15:15:46.062666+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:15:46.062666+0000","last_undegraded":"2023-10-05T15:15:46.062666+0000","last_fullsized":"2023-10-05T15:15:46.062666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064250+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:15:46.064250+0000","last_peered":"2023-10-05T15:15:46.064250+0000","last_clean":"2023-10-05T15:15:46.064250+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:15:46.064250+0000","last_undegraded":"2023-10-05T15:15:46.064250+0000","last_fullsized":"2023-10-05T15:15:46.064250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064028+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:15:46.064028+0000","last_peered":"2023-10-05T15:15:46.064028+0000","last_clean":"2023-10-05T15:15:46.064028+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:15:46.064028+0000","last_undegraded":"2023-10-05T15:15:46.064028+0000","last_fullsized":"2023-10-05T15:15:46.064028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065067+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:15:46.065067+0000","last_peered":"2023-10-05T15:15:46.065067+0000","last_clean":"2023-10-05T15:15:46.065067+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:15:46.065067+0000","last_undegraded":"2023-10-05T15:15:46.065067+0000","last_fullsized":"2023-10-05T15:15:46.065067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058698+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:15:46.058698+0000","last_peered":"2023-10-05T15:15:46.058698+0000","last_clean":"2023-10-05T15:15:46.058698+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:15:46.058698+0000","last_undegraded":"2023-10-05T15:15:46.058698+0000","last_fullsized":"2023-10-05T15:15:46.058698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067703+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:15:46.067703+0000","last_peered":"2023-10-05T15:15:46.067703+0000","last_clean":"2023-10-05T15:15:46.067703+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:15:46.067703+0000","last_undegraded":"2023-10-05T15:15:46.067703+0000","last_fullsized":"2023-10-05T15:15:46.067703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057131+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:15:46.057131+0000","last_peered":"2023-10-05T15:15:46.057131+0000","last_clean":"2023-10-05T15:15:46.057131+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:15:46.057131+0000","last_undegraded":"2023-10-05T15:15:46.057131+0000","last_fullsized":"2023-10-05T15:15:46.057131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060702+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:46.060702+0000","last_peered":"2023-10-05T15:15:46.060702+0000","last_clean":"2023-10-05T15:15:46.060702+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:46.060702+0000","last_undegraded":"2023-10-05T15:15:46.060702+0000","last_fullsized":"2023-10-05T15:15:46.060702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064143+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:15:46.064143+0000","last_peered":"2023-10-05T15:15:46.064143+0000","last_clean":"2023-10-05T15:15:46.064143+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:15:46.064143+0000","last_undegraded":"2023-10-05T15:15:46.064143+0000","last_fullsized":"2023-10-05T15:15:46.064143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060211+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:15:46.060211+0000","last_peered":"2023-10-05T15:15:46.060211+0000","last_clean":"2023-10-05T15:15:46.060211+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:15:46.060211+0000","last_undegraded":"2023-10-05T15:15:46.060211+0000","last_fullsized":"2023-10-05T15:15:46.060211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067424+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:46.067424+0000","last_peered":"2023-10-05T15:15:46.067424+0000","last_clean":"2023-10-05T15:15:46.067424+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:46.067424+0000","last_undegraded":"2023-10-05T15:15:46.067424+0000","last_fullsized":"2023-10-05T15:15:46.067424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060744+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:15:46.060744+0000","last_peered":"2023-10-05T15:15:46.060744+0000","last_clean":"2023-10-05T15:15:46.060744+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:15:46.060744+0000","last_undegraded":"2023-10-05T15:15:46.060744+0000","last_fullsized":"2023-10-05T15:15:46.060744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058609+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:15:46.058609+0000","last_peered":"2023-10-05T15:15:46.058609+0000","last_clean":"2023-10-05T15:15:46.058609+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:15:46.058609+0000","last_undegraded":"2023-10-05T15:15:46.058609+0000","last_fullsized":"2023-10-05T15:15:46.058609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064579+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:46.064579+0000","last_peered":"2023-10-05T15:15:46.064579+0000","last_clean":"2023-10-05T15:15:46.064579+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:46.064579+0000","last_undegraded":"2023-10-05T15:15:46.064579+0000","last_fullsized":"2023-10-05T15:15:46.064579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062282+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:15:46.062282+0000","last_peered":"2023-10-05T15:15:46.062282+0000","last_clean":"2023-10-05T15:15:46.062282+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:15:46.062282+0000","last_undegraded":"2023-10-05T15:15:46.062282+0000","last_fullsized":"2023-10-05T15:15:46.062282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.095591+0000","last_change":"2023-10-05T15:15:47.095591+0000","last_active":"2023-10-05T15:15:47.095591+0000","last_peered":"2023-10-05T15:15:47.095591+0000","last_clean":"2023-10-05T15:15:47.095591+0000","last_became_active":"2023-10-05T15:15:47.090503+0000","last_became_peered":"2023-10-05T15:15:47.090503+0000","last_unstale":"2023-10-05T15:15:47.095591+0000","last_undegraded":"2023-10-05T15:15:47.095591+0000","last_fullsized":"2023-10-05T15:15:47.095591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:35.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057335+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:15:46.057335+0000","last_peered":"2023-10-05T15:15:46.057335+0000","last_clean":"2023-10-05T15:15:46.057335+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:15:46.057335+0000","last_undegraded":"2023-10-05T15:15:46.057335+0000","last_fullsized":"2023-10-05T15:15:46.057335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064854+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:15:46.064854+0000","last_peered":"2023-10-05T15:15:46.064854+0000","last_clean":"2023-10-05T15:15:46.064854+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:15:46.064854+0000","last_undegraded":"2023-10-05T15:15:46.064854+0000","last_fullsized":"2023-10-05T15:15:46.064854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060452+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:15:46.060452+0000","last_peered":"2023-10-05T15:15:46.060452+0000","last_clean":"2023-10-05T15:15:46.060452+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:15:46.060452+0000","last_undegraded":"2023-10-05T15:15:46.060452+0000","last_fullsized":"2023-10-05T15:15:46.060452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063970+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:15:46.063970+0000","last_peered":"2023-10-05T15:15:46.063970+0000","last_clean":"2023-10-05T15:15:46.063970+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:15:46.063970+0000","last_undegraded":"2023-10-05T15:15:46.063970+0000","last_fullsized":"2023-10-05T15:15:46.063970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057900+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:15:46.057900+0000","last_peered":"2023-10-05T15:15:46.057900+0000","last_clean":"2023-10-05T15:15:46.057900+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:15:46.057900+0000","last_undegraded":"2023-10-05T15:15:46.057900+0000","last_fullsized":"2023-10-05T15:15:46.057900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067523+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:15:46.067523+0000","last_peered":"2023-10-05T15:15:46.067523+0000","last_clean":"2023-10-05T15:15:46.067523+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:15:46.067523+0000","last_undegraded":"2023-10-05T15:15:46.067523+0000","last_fullsized":"2023-10-05T15:15:46.067523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:48.091632+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:15:48.091632+0000","last_peered":"2023-10-05T15:15:48.091632+0000","last_clean":"2023-10-05T15:15:48.091632+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:15:48.091632+0000","last_undegraded":"2023-10-05T15:15:48.091632+0000","last_fullsized":"2023-10-05T15:15:48.091632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058151+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:15:46.058151+0000","last_peered":"2023-10-05T15:15:46.058151+0000","last_clean":"2023-10-05T15:15:46.058151+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:15:46.058151+0000","last_undegraded":"2023-10-05T15:15:46.058151+0000","last_fullsized":"2023-10-05T15:15:46.058151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063292+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:15:46.063292+0000","last_peered":"2023-10-05T15:15:46.063292+0000","last_clean":"2023-10-05T15:15:46.063292+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:15:46.063292+0000","last_undegraded":"2023-10-05T15:15:46.063292+0000","last_fullsized":"2023-10-05T15:15:46.063292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061487+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:15:46.061487+0000","last_peered":"2023-10-05T15:15:46.061487+0000","last_clean":"2023-10-05T15:15:46.061487+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:15:46.061487+0000","last_undegraded":"2023-10-05T15:15:46.061487+0000","last_fullsized":"2023-10-05T15:15:46.061487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058564+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:15:46.058564+0000","last_peered":"2023-10-05T15:15:46.058564+0000","last_clean":"2023-10-05T15:15:46.058564+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:15:46.058564+0000","last_undegraded":"2023-10-05T15:15:46.058564+0000","last_fullsized":"2023-10-05T15:15:46.058564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060696+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:15:46.060696+0000","last_peered":"2023-10-05T15:15:46.060696+0000","last_clean":"2023-10-05T15:15:46.060696+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:15:46.060696+0000","last_undegraded":"2023-10-05T15:15:46.060696+0000","last_fullsized":"2023-10-05T15:15:46.060696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065946+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:46.065946+0000","last_peered":"2023-10-05T15:15:46.065946+0000","last_clean":"2023-10-05T15:15:46.065946+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:46.065946+0000","last_undegraded":"2023-10-05T15:15:46.065946+0000","last_fullsized":"2023-10-05T15:15:46.065946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058260+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:15:46.058260+0000","last_peered":"2023-10-05T15:15:46.058260+0000","last_clean":"2023-10-05T15:15:46.058260+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:15:46.058260+0000","last_undegraded":"2023-10-05T15:15:46.058260+0000","last_fullsized":"2023-10-05T15:15:46.058260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062338+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:15:46.062338+0000","last_peered":"2023-10-05T15:15:46.062338+0000","last_clean":"2023-10-05T15:15:46.062338+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:15:46.062338+0000","last_undegraded":"2023-10-05T15:15:46.062338+0000","last_fullsized":"2023-10-05T15:15:46.062338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.094198+0000","last_change":"2023-10-05T15:15:47.094198+0000","last_active":"2023-10-05T15:15:47.094198+0000","last_peered":"2023-10-05T15:15:47.094198+0000","last_clean":"2023-10-05T15:15:47.094198+0000","last_became_active":"2023-10-05T15:15:47.093766+0000","last_became_peered":"2023-10-05T15:15:47.093766+0000","last_unstale":"2023-10-05T15:15:47.094198+0000","last_undegraded":"2023-10-05T15:15:47.094198+0000","last_fullsized":"2023-10-05T15:15:47.094198+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:48:59.949643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057207+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:15:46.057207+0000","last_peered":"2023-10-05T15:15:46.057207+0000","last_clean":"2023-10-05T15:15:46.057207+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:15:46.057207+0000","last_undegraded":"2023-10-05T15:15:46.057207+0000","last_fullsized":"2023-10-05T15:15:46.057207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.088923+0000","last_change":"2023-10-05T15:15:47.088923+0000","last_active":"2023-10-05T15:15:47.088923+0000","last_peered":"2023-10-05T15:15:47.088923+0000","last_clean":"2023-10-05T15:15:47.088923+0000","last_became_active":"2023-10-05T15:15:47.088562+0000","last_became_peered":"2023-10-05T15:15:47.088562+0000","last_unstale":"2023-10-05T15:15:47.088923+0000","last_undegraded":"2023-10-05T15:15:47.088923+0000","last_fullsized":"2023-10-05T15:15:47.088923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:25.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064107+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:15:46.064107+0000","last_peered":"2023-10-05T15:15:46.064107+0000","last_clean":"2023-10-05T15:15:46.064107+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:15:46.064107+0000","last_undegraded":"2023-10-05T15:15:46.064107+0000","last_fullsized":"2023-10-05T15:15:46.064107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.065363+0000","last_change":"2023-10-05T15:15:47.065363+0000","last_active":"2023-10-05T15:15:47.065363+0000","last_peered":"2023-10-05T15:15:47.065363+0000","last_clean":"2023-10-05T15:15:47.065363+0000","last_became_active":"2023-10-05T15:15:47.064990+0000","last_became_peered":"2023-10-05T15:15:47.064990+0000","last_unstale":"2023-10-05T15:15:47.065363+0000","last_undegraded":"2023-10-05T15:15:47.065363+0000","last_fullsized":"2023-10-05T15:15:47.065363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:31.355817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057856+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:15:46.057856+0000","last_peered":"2023-10-05T15:15:46.057856+0000","last_clean":"2023-10-05T15:15:46.057856+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:15:46.057856+0000","last_undegraded":"2023-10-05T15:15:46.057856+0000","last_fullsized":"2023-10-05T15:15:46.057856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067816+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:15:46.067816+0000","last_peered":"2023-10-05T15:15:46.067816+0000","last_clean":"2023-10-05T15:15:46.067816+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:15:46.067816+0000","last_undegraded":"2023-10-05T15:15:46.067816+0000","last_fullsized":"2023-10-05T15:15:46.067816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060959+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:15:46.060959+0000","last_peered":"2023-10-05T15:15:46.060959+0000","last_clean":"2023-10-05T15:15:46.060959+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:15:46.060959+0000","last_undegraded":"2023-10-05T15:15:46.060959+0000","last_fullsized":"2023-10-05T15:15:46.060959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064667+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:15:46.064667+0000","last_peered":"2023-10-05T15:15:46.064667+0000","last_clean":"2023-10-05T15:15:46.064667+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:15:46.064667+0000","last_undegraded":"2023-10-05T15:15:46.064667+0000","last_fullsized":"2023-10-05T15:15:46.064667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.068128+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:15:46.068128+0000","last_peered":"2023-10-05T15:15:46.068128+0000","last_clean":"2023-10-05T15:15:46.068128+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:15:46.068128+0000","last_undegraded":"2023-10-05T15:15:46.068128+0000","last_fullsized":"2023-10-05T15:15:46.068128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063520+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:15:46.063520+0000","last_peered":"2023-10-05T15:15:46.063520+0000","last_clean":"2023-10-05T15:15:46.063520+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:15:46.063520+0000","last_undegraded":"2023-10-05T15:15:46.063520+0000","last_fullsized":"2023-10-05T15:15:46.063520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062902+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:15:46.062902+0000","last_peered":"2023-10-05T15:15:46.062902+0000","last_clean":"2023-10-05T15:15:46.062902+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:15:46.062902+0000","last_undegraded":"2023-10-05T15:15:46.062902+0000","last_fullsized":"2023-10-05T15:15:46.062902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65801,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":435,"num_read_kb":289,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416409,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":491395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.435}]},{"osd":1,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.375}]},{"osd":6,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65500000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.55500000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.69399999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1140965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.748}]},{"osd":3,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69199999999999995,"5min":1.335,"15min":1.335},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79200000000000004,"5min":0.874,"15min":0.874},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91800000000000004,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0009999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79000000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96199999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67400000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.76600000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":491325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65900000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.88900000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82899999999999996,"5min":1.216,"15min":1.216},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.66300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.93600000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.432}]},{"osd":4,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65000000000000002,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":1.141,"15min":1.141},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.02,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.82099999999999995,"15min":0.84699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65000000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78300000000000003,"5min":1.327,"15min":1.327},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.78900000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.745}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":491703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.443,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.69499999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.0170000000000003,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.755}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.82999999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69099999999999995,"15min":0.67800000000000005},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.80000000000000004,"15min":0.73999999999999999},"min":{"1min":0.58099999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":6.4809999999999999,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.81200000000000006}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.65400000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.73199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0109999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.85899999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88200000000000001}]}]},{"osd":7,"up_from":52,"seq":223338299433,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1630208,"data_stored":1088589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.5}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.749}]},{"osd":9,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61199999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77300000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":486829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.23,"15min":1.23},"last":0.433},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.308},{"interface":"front","average":{"1min":0.499,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.0960000000000001,"5min":1.147,"15min":1.147},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97299999999999998,"5min":1.296,"15min":1.296},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.264,"15min":1.264},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.242,"15min":1.242},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84999999999999998,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79500000000000004,"15min":0.81699999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":1.181,"15min":1.181},"last":0.55100000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.77100000000000002,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":1.323,"15min":1.323},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.44,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89600000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.40799999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.64700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0629999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":546185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91600000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.59099999999999997,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.0960000000000001,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":0.38},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.627,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.1180000000000003,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59899999999999998,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95399999999999996,"5min":0.995,"15min":0.995},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.68999999999999995,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.66000000000000003,"15min":0.63500000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.3010000000000002,"5min":5.3010000000000002,"15min":5.3010000000000002},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93300000000000005,"5min":1.038,"15min":1.038},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.56799999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95899999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.876,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.44400000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.79700000000000004,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.6630000000000003,"5min":4.6630000000000003,"15min":4.6630000000000003},"last":0.61499999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.46000000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":488012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.69799999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":11.119999999999999,"5min":11.119999999999999,"15min":11.119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55200000000000005,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.52300000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.86699999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.64100000000000001,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.048,"5min":11.048,"15min":11.048},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.117,"15min":1.117},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55500000000000005,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.89000000000000001,"15min":0.86099999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":6.3150000000000004,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":0.77400000000000002,"15min":0.70799999999999996},"min":{"1min":0.40999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":11.151999999999999,"5min":11.151999999999999,"15min":11.151999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.751,"15min":0.745},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.78900000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.749}]},{"osd":11,"last update":"Thu Oct 5 15:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69999999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":547068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":1.623,"15min":1.623},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.753,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.503},"min":{"1min":0.47499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.497}]},{"osd":3,"last update":"Thu Oct 5 15:15:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81399999999999995,"5min":1.639,"15min":1.639},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77100000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.32400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.373},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.379},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.67600000000000005,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.8639999999999999,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Oct 5 15:15:25 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.79900000000000004,"15min":0.748},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":8.3019999999999996,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.80200000000000005,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.2780000000000005,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.70099999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.78400000000000003}]},{"osd":11,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.747}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":486206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.36299999999999999},"min":{"1min":0.28499999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58699999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:15:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.84099999999999997,"5min":1.097,"15min":1.097},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.48899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.73999999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79500000000000004,"5min":1.087,"15min":1.087},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76300000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":1.097,"15min":1.097},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63800000000000001,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":1.149,"15min":1.149},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.746,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57899999999999996,"5min":1.04,"15min":1.04},"last":0.374}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94799999999999995,"5min":1.044,"15min":1.044},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.75700000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.76400000000000001,"15min":0.79800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":1.605,"15min":1.605},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72899999999999998,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.47699999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67500000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":491020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.379},"min":{"1min":0.317,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.127},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.94399999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89700000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56899999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75900000000000001,"5min":0.87,"15min":0.87},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60999999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.014},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.002}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.623},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.59499999999999997}]}]},{"osd":5,"up_from":39,"seq":167503724593,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1634304,"data_stored":1083450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58099999999999996,"15min":0.55500000000000005},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42699999999999999,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.434,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.44600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92100000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.028,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.675,"15min":1.675},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.46100000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.81100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2849999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8759999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.73799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:15:53.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-05T15:15:54.211 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:54.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:53 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:53 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:54.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:53 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.061 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: pgmap v294: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:55.061 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:55.061 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.061 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.061 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:15:55.061 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:15:55.062 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:54 smithi060 ceph-mon[99238]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: pgmap v294: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:15:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:15:55.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:54 smithi135 ceph-mon[103360]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: pgmap v294: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:15:55.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:55.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:15:55.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:15:55.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:54 smithi092 ceph-mon[102944]: from='mgr.14152 172.21.15.60:0/339159533' entity='mgr.x' 2023-10-05T15:15:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 -- 172.21.15.60:0/1071071761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c105e70 msgr2=0x7f183c106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 --2- 172.21.15.60:0/1071071761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c105e70 0x7f183c106250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f18300099c0 tx=0x7f1830009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 -- 172.21.15.60:0/1071071761 shutdown_connections 2023-10-05T15:15:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 --2- 172.21.15.60:0/1071071761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c100820 0x7f183c10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 --2- 172.21.15.60:0/1071071761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c105e70 0x7f183c106250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 --2- 172.21.15.60:0/1071071761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c0ffe60 0x7f183c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 -- 172.21.15.60:0/1071071761 >> 172.21.15.60:0/1071071761 conn(0x7f183c075e00 msgr2=0x7f183c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 -- 172.21.15.60:0/1071071761 shutdown_connections 2023-10-05T15:15:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.558+0000 7f184314b700 1 -- 172.21.15.60:0/1071071761 wait complete. 2023-10-05T15:15:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 Processor -- start 2023-10-05T15:15:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 -- start start 2023-10-05T15:15:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c0ffe60 0x7f183c1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 0x7f183c197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c105e70 0x7f183c19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c19c080 con 0x7f183c100820 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c19c1f0 con 0x7f183c0ffe60 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f184314b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c19c3b0 con 0x7f183c105e70 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f183bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 0x7f183c197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f183bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 0x7f183c197600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36890/0 (socket says 172.21.15.60:36890) 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f183bfff700 1 -- 172.21.15.60:0/3763997842 learned_addr learned my addr 172.21.15.60:0/3763997842 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f18416e8700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c105e70 0x7f183c19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.559+0000 7f1840ee7700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c0ffe60 0x7f183c1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f183bfff700 1 -- 172.21.15.60:0/3763997842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c105e70 msgr2=0x7f183c19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f183bfff700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c105e70 0x7f183c19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f183bfff700 1 -- 172.21.15.60:0/3763997842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c0ffe60 msgr2=0x7f183c1970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f183bfff700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c0ffe60 0x7f183c1970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f183bfff700 1 -- 172.21.15.60:0/3763997842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300095f0 con 0x7f183c100820 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f183bfff700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 0x7f183c197600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f182800b530 tx=0x7f182800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828011830 con 0x7f183c100820 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1828011e50 con 0x7f183c100820 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800f2e0 con 0x7f183c100820 2023-10-05T15:15:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c19c690 con 0x7f183c100820 2023-10-05T15:15:55.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.560+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c1a3ef0 con 0x7f183c100820 2023-10-05T15:15:55.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.561+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c04ebb0 con 0x7f183c100820 2023-10-05T15:15:55.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.562+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f18280105a0 con 0x7f183c100820 2023-10-05T15:15:55.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.563+0000 7f1839ffb700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f182c0a1510 0x7f182c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.563+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f18280cca90 con 0x7f183c100820 2023-10-05T15:15:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.563+0000 7f1840ee7700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f182c0a1510 0x7f182c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.563+0000 7f1840ee7700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f182c0a1510 0x7f182c0a39d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1830006010 tx=0x7f1830009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:55.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.567+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1828095d40 con 0x7f183c100820 2023-10-05T15:15:55.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.760+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f183c0008d0 con 0x7f182c0a1510 2023-10-05T15:15:55.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.775+0000 7f1839ffb700 1 -- 172.21.15.60:0/3763997842 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426469 (secure 0 0 0) 0x7f183c0008d0 con 0x7f182c0a1510 2023-10-05T15:15:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:55.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.778+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f182c0a1510 msgr2=0x7f182c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:55.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.778+0000 7f184314b700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f182c0a1510 0x7f182c0a39d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1830006010 tx=0x7f1830009f10 comp rx=0 tx=0).stop 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.778+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 msgr2=0x7f183c197600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.778+0000 7f184314b700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 0x7f183c197600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f182800b530 tx=0x7f182800b840 comp rx=0 tx=0).stop 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 shutdown_connections 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f183c105e70 0x7f183c19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c0ffe60 0x7f183c1970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f182c0a1510 0x7f182c0a39d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 --2- 172.21.15.60:0/3763997842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f183c100820 0x7f183c197600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 >> 172.21.15.60:0/3763997842 conn(0x7f183c075e00 msgr2=0x7f183c0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 shutdown_connections 2023-10-05T15:15:55.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:55.779+0000 7f184314b700 1 -- 172.21.15.60:0/3763997842 wait complete. 2023-10-05T15:15:55.787 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:15:56.171 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-10-05T15:15:55.176590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656415,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":586,"num_read_kb":413,"num_write":417,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338240,"kb_used_data":13964,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603584,"statfs":{"total":1151940427776,"available":1151594070016,"internally_reserved":0,"allocated":14299136,"data_stored":7832747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.120943"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063611+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:15:46.063611+0000","last_peered":"2023-10-05T15:15:46.063611+0000","last_clean":"2023-10-05T15:15:46.063611+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:15:46.063611+0000","last_undegraded":"2023-10-05T15:15:46.063611+0000","last_fullsized":"2023-10-05T15:15:46.063611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064219+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:15:46.064219+0000","last_peered":"2023-10-05T15:15:46.064219+0000","last_clean":"2023-10-05T15:15:46.064219+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:15:46.064219+0000","last_undegraded":"2023-10-05T15:15:46.064219+0000","last_fullsized":"2023-10-05T15:15:46.064219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063889+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:15:46.063889+0000","last_peered":"2023-10-05T15:15:46.063889+0000","last_clean":"2023-10-05T15:15:46.063889+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:15:46.063889+0000","last_undegraded":"2023-10-05T15:15:46.063889+0000","last_fullsized":"2023-10-05T15:15:46.063889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061113+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:15:46.061113+0000","last_peered":"2023-10-05T15:15:46.061113+0000","last_clean":"2023-10-05T15:15:46.061113+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:15:46.061113+0000","last_undegraded":"2023-10-05T15:15:46.061113+0000","last_fullsized":"2023-10-05T15:15:46.061113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063947+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:15:46.063947+0000","last_peered":"2023-10-05T15:15:46.063947+0000","last_clean":"2023-10-05T15:15:46.063947+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:15:46.063947+0000","last_undegraded":"2023-10-05T15:15:46.063947+0000","last_fullsized":"2023-10-05T15:15:46.063947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063401+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:15:46.063401+0000","last_peered":"2023-10-05T15:15:46.063401+0000","last_clean":"2023-10-05T15:15:46.063401+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:15:46.063401+0000","last_undegraded":"2023-10-05T15:15:46.063401+0000","last_fullsized":"2023-10-05T15:15:46.063401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057735+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:15:46.057735+0000","last_peered":"2023-10-05T15:15:46.057735+0000","last_clean":"2023-10-05T15:15:46.057735+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:15:46.057735+0000","last_undegraded":"2023-10-05T15:15:46.057735+0000","last_fullsized":"2023-10-05T15:15:46.057735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065184+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:15:46.065184+0000","last_peered":"2023-10-05T15:15:46.065184+0000","last_clean":"2023-10-05T15:15:46.065184+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:15:46.065184+0000","last_undegraded":"2023-10-05T15:15:46.065184+0000","last_fullsized":"2023-10-05T15:15:46.065184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.068095+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:15:46.068095+0000","last_peered":"2023-10-05T15:15:46.068095+0000","last_clean":"2023-10-05T15:15:46.068095+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:15:46.068095+0000","last_undegraded":"2023-10-05T15:15:46.068095+0000","last_fullsized":"2023-10-05T15:15:46.068095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063810+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:15:46.063810+0000","last_peered":"2023-10-05T15:15:46.063810+0000","last_clean":"2023-10-05T15:15:46.063810+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:15:46.063810+0000","last_undegraded":"2023-10-05T15:15:46.063810+0000","last_fullsized":"2023-10-05T15:15:46.063810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058082+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:15:46.058082+0000","last_peered":"2023-10-05T15:15:46.058082+0000","last_clean":"2023-10-05T15:15:46.058082+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:15:46.058082+0000","last_undegraded":"2023-10-05T15:15:46.058082+0000","last_fullsized":"2023-10-05T15:15:46.058082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.090842+0000","last_change":"2023-10-05T15:15:47.090497+0000","last_active":"2023-10-05T15:15:47.090842+0000","last_peered":"2023-10-05T15:15:47.090842+0000","last_clean":"2023-10-05T15:15:47.090842+0000","last_became_active":"2023-10-05T15:15:47.090160+0000","last_became_peered":"2023-10-05T15:15:47.090160+0000","last_unstale":"2023-10-05T15:15:47.090842+0000","last_undegraded":"2023-10-05T15:15:47.090842+0000","last_fullsized":"2023-10-05T15:15:47.090842+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:15.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063660+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:15:46.063660+0000","last_peered":"2023-10-05T15:15:46.063660+0000","last_clean":"2023-10-05T15:15:46.063660+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:15:46.063660+0000","last_undegraded":"2023-10-05T15:15:46.063660+0000","last_fullsized":"2023-10-05T15:15:46.063660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062510+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:15:46.062510+0000","last_peered":"2023-10-05T15:15:46.062510+0000","last_clean":"2023-10-05T15:15:46.062510+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:15:46.062510+0000","last_undegraded":"2023-10-05T15:15:46.062510+0000","last_fullsized":"2023-10-05T15:15:46.062510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062644+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:15:46.062644+0000","last_peered":"2023-10-05T15:15:46.062644+0000","last_clean":"2023-10-05T15:15:46.062644+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:15:46.062644+0000","last_undegraded":"2023-10-05T15:15:46.062644+0000","last_fullsized":"2023-10-05T15:15:46.062644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067382+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:15:46.067382+0000","last_peered":"2023-10-05T15:15:46.067382+0000","last_clean":"2023-10-05T15:15:46.067382+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:15:46.067382+0000","last_undegraded":"2023-10-05T15:15:46.067382+0000","last_fullsized":"2023-10-05T15:15:46.067382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063591+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:15:46.063591+0000","last_peered":"2023-10-05T15:15:46.063591+0000","last_clean":"2023-10-05T15:15:46.063591+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:15:46.063591+0000","last_undegraded":"2023-10-05T15:15:46.063591+0000","last_fullsized":"2023-10-05T15:15:46.063591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058796+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:15:46.058796+0000","last_peered":"2023-10-05T15:15:46.058796+0000","last_clean":"2023-10-05T15:15:46.058796+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:15:46.058796+0000","last_undegraded":"2023-10-05T15:15:46.058796+0000","last_fullsized":"2023-10-05T15:15:46.058796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057776+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:15:46.057776+0000","last_peered":"2023-10-05T15:15:46.057776+0000","last_clean":"2023-10-05T15:15:46.057776+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:15:46.057776+0000","last_undegraded":"2023-10-05T15:15:46.057776+0000","last_fullsized":"2023-10-05T15:15:46.057776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057151+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:15:46.057151+0000","last_peered":"2023-10-05T15:15:46.057151+0000","last_clean":"2023-10-05T15:15:46.057151+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:15:46.057151+0000","last_undegraded":"2023-10-05T15:15:46.057151+0000","last_fullsized":"2023-10-05T15:15:46.057151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":77,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:53.094063+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:15:53.094063+0000","last_peered":"2023-10-05T15:15:53.094063+0000","last_clean":"2023-10-05T15:15:53.094063+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:15:53.094063+0000","last_undegraded":"2023-10-05T15:15:53.094063+0000","last_fullsized":"2023-10-05T15:15:53.094063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066757+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:15:46.066757+0000","last_peered":"2023-10-05T15:15:46.066757+0000","last_clean":"2023-10-05T15:15:46.066757+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:15:46.066757+0000","last_undegraded":"2023-10-05T15:15:46.066757+0000","last_fullsized":"2023-10-05T15:15:46.066757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060005+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:15:46.060005+0000","last_peered":"2023-10-05T15:15:46.060005+0000","last_clean":"2023-10-05T15:15:46.060005+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:15:46.060005+0000","last_undegraded":"2023-10-05T15:15:46.060005+0000","last_fullsized":"2023-10-05T15:15:46.060005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066765+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:15:46.066765+0000","last_peered":"2023-10-05T15:15:46.066765+0000","last_clean":"2023-10-05T15:15:46.066765+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:15:46.066765+0000","last_undegraded":"2023-10-05T15:15:46.066765+0000","last_fullsized":"2023-10-05T15:15:46.066765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064682+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:15:46.064682+0000","last_peered":"2023-10-05T15:15:46.064682+0000","last_clean":"2023-10-05T15:15:46.064682+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:15:46.064682+0000","last_undegraded":"2023-10-05T15:15:46.064682+0000","last_fullsized":"2023-10-05T15:15:46.064682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060966+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:15:46.060966+0000","last_peered":"2023-10-05T15:15:46.060966+0000","last_clean":"2023-10-05T15:15:46.060966+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:15:46.060966+0000","last_undegraded":"2023-10-05T15:15:46.060966+0000","last_fullsized":"2023-10-05T15:15:46.060966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064382+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:15:46.064382+0000","last_peered":"2023-10-05T15:15:46.064382+0000","last_clean":"2023-10-05T15:15:46.064382+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:15:46.064382+0000","last_undegraded":"2023-10-05T15:15:46.064382+0000","last_fullsized":"2023-10-05T15:15:46.064382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067707+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:15:46.067707+0000","last_peered":"2023-10-05T15:15:46.067707+0000","last_clean":"2023-10-05T15:15:46.067707+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:15:46.067707+0000","last_undegraded":"2023-10-05T15:15:46.067707+0000","last_fullsized":"2023-10-05T15:15:46.067707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060253+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:15:46.060253+0000","last_peered":"2023-10-05T15:15:46.060253+0000","last_clean":"2023-10-05T15:15:46.060253+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:15:46.060253+0000","last_undegraded":"2023-10-05T15:15:46.060253+0000","last_fullsized":"2023-10-05T15:15:46.060253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064078+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:15:46.064078+0000","last_peered":"2023-10-05T15:15:46.064078+0000","last_clean":"2023-10-05T15:15:46.064078+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:15:46.064078+0000","last_undegraded":"2023-10-05T15:15:46.064078+0000","last_fullsized":"2023-10-05T15:15:46.064078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062278+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:15:46.062278+0000","last_peered":"2023-10-05T15:15:46.062278+0000","last_clean":"2023-10-05T15:15:46.062278+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:15:46.062278+0000","last_undegraded":"2023-10-05T15:15:46.062278+0000","last_fullsized":"2023-10-05T15:15:46.062278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057601+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:15:46.057601+0000","last_peered":"2023-10-05T15:15:46.057601+0000","last_clean":"2023-10-05T15:15:46.057601+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:15:46.057601+0000","last_undegraded":"2023-10-05T15:15:46.057601+0000","last_fullsized":"2023-10-05T15:15:46.057601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:52.098746+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:15:52.098746+0000","last_peered":"2023-10-05T15:15:52.098746+0000","last_clean":"2023-10-05T15:15:52.098746+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:15:52.098746+0000","last_undegraded":"2023-10-05T15:15:52.098746+0000","last_fullsized":"2023-10-05T15:15:52.098746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.088761+0000","last_change":"2023-10-05T15:15:47.088761+0000","last_active":"2023-10-05T15:15:47.088761+0000","last_peered":"2023-10-05T15:15:47.088761+0000","last_clean":"2023-10-05T15:15:47.088761+0000","last_became_active":"2023-10-05T15:15:47.088438+0000","last_became_peered":"2023-10-05T15:15:47.088438+0000","last_unstale":"2023-10-05T15:15:47.088761+0000","last_undegraded":"2023-10-05T15:15:47.088761+0000","last_fullsized":"2023-10-05T15:15:47.088761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:22.419833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057415+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:15:46.057415+0000","last_peered":"2023-10-05T15:15:46.057415+0000","last_clean":"2023-10-05T15:15:46.057415+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:15:46.057415+0000","last_undegraded":"2023-10-05T15:15:46.057415+0000","last_fullsized":"2023-10-05T15:15:46.057415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063306+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:46.063306+0000","last_peered":"2023-10-05T15:15:46.063306+0000","last_clean":"2023-10-05T15:15:46.063306+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:46.063306+0000","last_undegraded":"2023-10-05T15:15:46.063306+0000","last_fullsized":"2023-10-05T15:15:46.063306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061680+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:15:46.061680+0000","last_peered":"2023-10-05T15:15:46.061680+0000","last_clean":"2023-10-05T15:15:46.061680+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:15:46.061680+0000","last_undegraded":"2023-10-05T15:15:46.061680+0000","last_fullsized":"2023-10-05T15:15:46.061680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063486+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:15:46.063486+0000","last_peered":"2023-10-05T15:15:46.063486+0000","last_clean":"2023-10-05T15:15:46.063486+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:15:46.063486+0000","last_undegraded":"2023-10-05T15:15:46.063486+0000","last_fullsized":"2023-10-05T15:15:46.063486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062727+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:46.062727+0000","last_peered":"2023-10-05T15:15:46.062727+0000","last_clean":"2023-10-05T15:15:46.062727+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:46.062727+0000","last_undegraded":"2023-10-05T15:15:46.062727+0000","last_fullsized":"2023-10-05T15:15:46.062727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065137+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:15:46.065137+0000","last_peered":"2023-10-05T15:15:46.065137+0000","last_clean":"2023-10-05T15:15:46.065137+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:15:46.065137+0000","last_undegraded":"2023-10-05T15:15:46.065137+0000","last_fullsized":"2023-10-05T15:15:46.065137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064063+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:15:46.064063+0000","last_peered":"2023-10-05T15:15:46.064063+0000","last_clean":"2023-10-05T15:15:46.064063+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:15:46.064063+0000","last_undegraded":"2023-10-05T15:15:46.064063+0000","last_fullsized":"2023-10-05T15:15:46.064063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060854+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:15:46.060854+0000","last_peered":"2023-10-05T15:15:46.060854+0000","last_clean":"2023-10-05T15:15:46.060854+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:15:46.060854+0000","last_undegraded":"2023-10-05T15:15:46.060854+0000","last_fullsized":"2023-10-05T15:15:46.060854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057402+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:15:46.057402+0000","last_peered":"2023-10-05T15:15:46.057402+0000","last_clean":"2023-10-05T15:15:46.057402+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:15:46.057402+0000","last_undegraded":"2023-10-05T15:15:46.057402+0000","last_fullsized":"2023-10-05T15:15:46.057402+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064833+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:15:46.064833+0000","last_peered":"2023-10-05T15:15:46.064833+0000","last_clean":"2023-10-05T15:15:46.064833+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:15:46.064833+0000","last_undegraded":"2023-10-05T15:15:46.064833+0000","last_fullsized":"2023-10-05T15:15:46.064833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:50.094453+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:15:50.094453+0000","last_peered":"2023-10-05T15:15:50.094453+0000","last_clean":"2023-10-05T15:15:50.094453+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:15:50.094453+0000","last_undegraded":"2023-10-05T15:15:50.094453+0000","last_fullsized":"2023-10-05T15:15:50.094453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.068043+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:15:46.068043+0000","last_peered":"2023-10-05T15:15:46.068043+0000","last_clean":"2023-10-05T15:15:46.068043+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:15:46.068043+0000","last_undegraded":"2023-10-05T15:15:46.068043+0000","last_fullsized":"2023-10-05T15:15:46.068043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057080+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:15:46.057080+0000","last_peered":"2023-10-05T15:15:46.057080+0000","last_clean":"2023-10-05T15:15:46.057080+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:15:46.057080+0000","last_undegraded":"2023-10-05T15:15:46.057080+0000","last_fullsized":"2023-10-05T15:15:46.057080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058014+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:46.058014+0000","last_peered":"2023-10-05T15:15:46.058014+0000","last_clean":"2023-10-05T15:15:46.058014+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:46.058014+0000","last_undegraded":"2023-10-05T15:15:46.058014+0000","last_fullsized":"2023-10-05T15:15:46.058014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064576+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:15:46.064576+0000","last_peered":"2023-10-05T15:15:46.064576+0000","last_clean":"2023-10-05T15:15:46.064576+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:15:46.064576+0000","last_undegraded":"2023-10-05T15:15:46.064576+0000","last_fullsized":"2023-10-05T15:15:46.064576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060826+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:15:46.060826+0000","last_peered":"2023-10-05T15:15:46.060826+0000","last_clean":"2023-10-05T15:15:46.060826+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:15:46.060826+0000","last_undegraded":"2023-10-05T15:15:46.060826+0000","last_fullsized":"2023-10-05T15:15:46.060826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061383+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:15:46.061383+0000","last_peered":"2023-10-05T15:15:46.061383+0000","last_clean":"2023-10-05T15:15:46.061383+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:15:46.061383+0000","last_undegraded":"2023-10-05T15:15:46.061383+0000","last_fullsized":"2023-10-05T15:15:46.061383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067923+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:15:46.067923+0000","last_peered":"2023-10-05T15:15:46.067923+0000","last_clean":"2023-10-05T15:15:46.067923+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:15:46.067923+0000","last_undegraded":"2023-10-05T15:15:46.067923+0000","last_fullsized":"2023-10-05T15:15:46.067923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057315+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:15:46.057315+0000","last_peered":"2023-10-05T15:15:46.057315+0000","last_clean":"2023-10-05T15:15:46.057315+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:15:46.057315+0000","last_undegraded":"2023-10-05T15:15:46.057315+0000","last_fullsized":"2023-10-05T15:15:46.057315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'33","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:50.106099+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:15:50.106099+0000","last_peered":"2023-10-05T15:15:50.106099+0000","last_clean":"2023-10-05T15:15:50.106099+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:15:50.106099+0000","last_undegraded":"2023-10-05T15:15:50.106099+0000","last_fullsized":"2023-10-05T15:15:50.106099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58599,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":100,"num_write":35,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064091+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:15:46.064091+0000","last_peered":"2023-10-05T15:15:46.064091+0000","last_clean":"2023-10-05T15:15:46.064091+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:15:46.064091+0000","last_undegraded":"2023-10-05T15:15:46.064091+0000","last_fullsized":"2023-10-05T15:15:46.064091+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062190+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:15:46.062190+0000","last_peered":"2023-10-05T15:15:46.062190+0000","last_clean":"2023-10-05T15:15:46.062190+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:15:46.062190+0000","last_undegraded":"2023-10-05T15:15:46.062190+0000","last_fullsized":"2023-10-05T15:15:46.062190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057412+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:46.057412+0000","last_peered":"2023-10-05T15:15:46.057412+0000","last_clean":"2023-10-05T15:15:46.057412+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:46.057412+0000","last_undegraded":"2023-10-05T15:15:46.057412+0000","last_fullsized":"2023-10-05T15:15:46.057412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064921+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:15:46.064921+0000","last_peered":"2023-10-05T15:15:46.064921+0000","last_clean":"2023-10-05T15:15:46.064921+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:15:46.064921+0000","last_undegraded":"2023-10-05T15:15:46.064921+0000","last_fullsized":"2023-10-05T15:15:46.064921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062770+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:15:46.062770+0000","last_peered":"2023-10-05T15:15:46.062770+0000","last_clean":"2023-10-05T15:15:46.062770+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:15:46.062770+0000","last_undegraded":"2023-10-05T15:15:46.062770+0000","last_fullsized":"2023-10-05T15:15:46.062770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062773+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:46.062773+0000","last_peered":"2023-10-05T15:15:46.062773+0000","last_clean":"2023-10-05T15:15:46.062773+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:46.062773+0000","last_undegraded":"2023-10-05T15:15:46.062773+0000","last_fullsized":"2023-10-05T15:15:46.062773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058532+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:15:46.058532+0000","last_peered":"2023-10-05T15:15:46.058532+0000","last_clean":"2023-10-05T15:15:46.058532+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:15:46.058532+0000","last_undegraded":"2023-10-05T15:15:46.058532+0000","last_fullsized":"2023-10-05T15:15:46.058532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.103509+0000","last_change":"2023-10-05T15:15:47.103509+0000","last_active":"2023-10-05T15:15:47.103509+0000","last_peered":"2023-10-05T15:15:47.103509+0000","last_clean":"2023-10-05T15:15:47.103509+0000","last_became_active":"2023-10-05T15:15:47.103150+0000","last_became_peered":"2023-10-05T15:15:47.103150+0000","last_unstale":"2023-10-05T15:15:47.103509+0000","last_undegraded":"2023-10-05T15:15:47.103509+0000","last_fullsized":"2023-10-05T15:15:47.103509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:59.848397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:51.094851+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:15:51.094851+0000","last_peered":"2023-10-05T15:15:51.094851+0000","last_clean":"2023-10-05T15:15:51.094851+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:15:51.094851+0000","last_undegraded":"2023-10-05T15:15:51.094851+0000","last_fullsized":"2023-10-05T15:15:51.094851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057834+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:15:46.057834+0000","last_peered":"2023-10-05T15:15:46.057834+0000","last_clean":"2023-10-05T15:15:46.057834+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:15:46.057834+0000","last_undegraded":"2023-10-05T15:15:46.057834+0000","last_fullsized":"2023-10-05T15:15:46.057834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066044+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:15:46.066044+0000","last_peered":"2023-10-05T15:15:46.066044+0000","last_clean":"2023-10-05T15:15:46.066044+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:15:46.066044+0000","last_undegraded":"2023-10-05T15:15:46.066044+0000","last_fullsized":"2023-10-05T15:15:46.066044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060708+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:15:46.060708+0000","last_peered":"2023-10-05T15:15:46.060708+0000","last_clean":"2023-10-05T15:15:46.060708+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:15:46.060708+0000","last_undegraded":"2023-10-05T15:15:46.060708+0000","last_fullsized":"2023-10-05T15:15:46.060708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062586+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:15:46.062586+0000","last_peered":"2023-10-05T15:15:46.062586+0000","last_clean":"2023-10-05T15:15:46.062586+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:15:46.062586+0000","last_undegraded":"2023-10-05T15:15:46.062586+0000","last_fullsized":"2023-10-05T15:15:46.062586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062593+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:15:46.062593+0000","last_peered":"2023-10-05T15:15:46.062593+0000","last_clean":"2023-10-05T15:15:46.062593+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:15:46.062593+0000","last_undegraded":"2023-10-05T15:15:46.062593+0000","last_fullsized":"2023-10-05T15:15:46.062593+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064299+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:15:46.064299+0000","last_peered":"2023-10-05T15:15:46.064299+0000","last_clean":"2023-10-05T15:15:46.064299+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:15:46.064299+0000","last_undegraded":"2023-10-05T15:15:46.064299+0000","last_fullsized":"2023-10-05T15:15:46.064299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063269+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:15:46.063269+0000","last_peered":"2023-10-05T15:15:46.063269+0000","last_clean":"2023-10-05T15:15:46.063269+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:15:46.063269+0000","last_undegraded":"2023-10-05T15:15:46.063269+0000","last_fullsized":"2023-10-05T15:15:46.063269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063976+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:15:46.063976+0000","last_peered":"2023-10-05T15:15:46.063976+0000","last_clean":"2023-10-05T15:15:46.063976+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:15:46.063976+0000","last_undegraded":"2023-10-05T15:15:46.063976+0000","last_fullsized":"2023-10-05T15:15:46.063976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058304+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:15:46.058304+0000","last_peered":"2023-10-05T15:15:46.058304+0000","last_clean":"2023-10-05T15:15:46.058304+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:15:46.058304+0000","last_undegraded":"2023-10-05T15:15:46.058304+0000","last_fullsized":"2023-10-05T15:15:46.058304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063589+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:15:46.063589+0000","last_peered":"2023-10-05T15:15:46.063589+0000","last_clean":"2023-10-05T15:15:46.063589+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:15:46.063589+0000","last_undegraded":"2023-10-05T15:15:46.063589+0000","last_fullsized":"2023-10-05T15:15:46.063589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063886+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:15:46.063886+0000","last_peered":"2023-10-05T15:15:46.063886+0000","last_clean":"2023-10-05T15:15:46.063886+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:15:46.063886+0000","last_undegraded":"2023-10-05T15:15:46.063886+0000","last_fullsized":"2023-10-05T15:15:46.063886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:49.089453+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:15:49.089453+0000","last_peered":"2023-10-05T15:15:49.089453+0000","last_clean":"2023-10-05T15:15:49.089453+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:15:49.089453+0000","last_undegraded":"2023-10-05T15:15:49.089453+0000","last_fullsized":"2023-10-05T15:15:49.089453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063457+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:15:46.063457+0000","last_peered":"2023-10-05T15:15:46.063457+0000","last_clean":"2023-10-05T15:15:46.063457+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:15:46.063457+0000","last_undegraded":"2023-10-05T15:15:46.063457+0000","last_fullsized":"2023-10-05T15:15:46.063457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065857+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:15:46.065857+0000","last_peered":"2023-10-05T15:15:46.065857+0000","last_clean":"2023-10-05T15:15:46.065857+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:15:46.065857+0000","last_undegraded":"2023-10-05T15:15:46.065857+0000","last_fullsized":"2023-10-05T15:15:46.065857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061174+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:15:46.061174+0000","last_peered":"2023-10-05T15:15:46.061174+0000","last_clean":"2023-10-05T15:15:46.061174+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:15:46.061174+0000","last_undegraded":"2023-10-05T15:15:46.061174+0000","last_fullsized":"2023-10-05T15:15:46.061174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:49.090843+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:15:49.090843+0000","last_peered":"2023-10-05T15:15:49.090843+0000","last_clean":"2023-10-05T15:15:49.090843+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:15:49.090843+0000","last_undegraded":"2023-10-05T15:15:49.090843+0000","last_fullsized":"2023-10-05T15:15:49.090843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058004+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:15:46.058004+0000","last_peered":"2023-10-05T15:15:46.058004+0000","last_clean":"2023-10-05T15:15:46.058004+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:15:46.058004+0000","last_undegraded":"2023-10-05T15:15:46.058004+0000","last_fullsized":"2023-10-05T15:15:46.058004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.094374+0000","last_change":"2023-10-05T15:15:47.094134+0000","last_active":"2023-10-05T15:15:47.094374+0000","last_peered":"2023-10-05T15:15:47.094374+0000","last_clean":"2023-10-05T15:15:47.094374+0000","last_became_active":"2023-10-05T15:15:47.093826+0000","last_became_peered":"2023-10-05T15:15:47.093826+0000","last_unstale":"2023-10-05T15:15:47.094374+0000","last_undegraded":"2023-10-05T15:15:47.094374+0000","last_fullsized":"2023-10-05T15:15:47.094374+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:16:26.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060721+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:46.060721+0000","last_peered":"2023-10-05T15:15:46.060721+0000","last_clean":"2023-10-05T15:15:46.060721+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:46.060721+0000","last_undegraded":"2023-10-05T15:15:46.060721+0000","last_fullsized":"2023-10-05T15:15:46.060721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057603+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:15:46.057603+0000","last_peered":"2023-10-05T15:15:46.057603+0000","last_clean":"2023-10-05T15:15:46.057603+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:15:46.057603+0000","last_undegraded":"2023-10-05T15:15:46.057603+0000","last_fullsized":"2023-10-05T15:15:46.057603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.089429+0000","last_change":"2023-10-05T15:15:47.089429+0000","last_active":"2023-10-05T15:15:47.089429+0000","last_peered":"2023-10-05T15:15:47.089429+0000","last_clean":"2023-10-05T15:15:47.089429+0000","last_became_active":"2023-10-05T15:15:47.088950+0000","last_became_peered":"2023-10-05T15:15:47.088950+0000","last_unstale":"2023-10-05T15:15:47.089429+0000","last_undegraded":"2023-10-05T15:15:47.089429+0000","last_fullsized":"2023-10-05T15:15:47.089429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:36:14.592094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062546+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:15:46.062546+0000","last_peered":"2023-10-05T15:15:46.062546+0000","last_clean":"2023-10-05T15:15:46.062546+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:15:46.062546+0000","last_undegraded":"2023-10-05T15:15:46.062546+0000","last_fullsized":"2023-10-05T15:15:46.062546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057731+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:46.057731+0000","last_peered":"2023-10-05T15:15:46.057731+0000","last_clean":"2023-10-05T15:15:46.057731+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:46.057731+0000","last_undegraded":"2023-10-05T15:15:46.057731+0000","last_fullsized":"2023-10-05T15:15:46.057731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062666+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:15:46.062666+0000","last_peered":"2023-10-05T15:15:46.062666+0000","last_clean":"2023-10-05T15:15:46.062666+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:15:46.062666+0000","last_undegraded":"2023-10-05T15:15:46.062666+0000","last_fullsized":"2023-10-05T15:15:46.062666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064250+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:15:46.064250+0000","last_peered":"2023-10-05T15:15:46.064250+0000","last_clean":"2023-10-05T15:15:46.064250+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:15:46.064250+0000","last_undegraded":"2023-10-05T15:15:46.064250+0000","last_fullsized":"2023-10-05T15:15:46.064250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064028+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:15:46.064028+0000","last_peered":"2023-10-05T15:15:46.064028+0000","last_clean":"2023-10-05T15:15:46.064028+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:15:46.064028+0000","last_undegraded":"2023-10-05T15:15:46.064028+0000","last_fullsized":"2023-10-05T15:15:46.064028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065067+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:15:46.065067+0000","last_peered":"2023-10-05T15:15:46.065067+0000","last_clean":"2023-10-05T15:15:46.065067+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:15:46.065067+0000","last_undegraded":"2023-10-05T15:15:46.065067+0000","last_fullsized":"2023-10-05T15:15:46.065067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058698+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:15:46.058698+0000","last_peered":"2023-10-05T15:15:46.058698+0000","last_clean":"2023-10-05T15:15:46.058698+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:15:46.058698+0000","last_undegraded":"2023-10-05T15:15:46.058698+0000","last_fullsized":"2023-10-05T15:15:46.058698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067703+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:15:46.067703+0000","last_peered":"2023-10-05T15:15:46.067703+0000","last_clean":"2023-10-05T15:15:46.067703+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:15:46.067703+0000","last_undegraded":"2023-10-05T15:15:46.067703+0000","last_fullsized":"2023-10-05T15:15:46.067703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057131+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:15:46.057131+0000","last_peered":"2023-10-05T15:15:46.057131+0000","last_clean":"2023-10-05T15:15:46.057131+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:15:46.057131+0000","last_undegraded":"2023-10-05T15:15:46.057131+0000","last_fullsized":"2023-10-05T15:15:46.057131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060702+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:46.060702+0000","last_peered":"2023-10-05T15:15:46.060702+0000","last_clean":"2023-10-05T15:15:46.060702+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:46.060702+0000","last_undegraded":"2023-10-05T15:15:46.060702+0000","last_fullsized":"2023-10-05T15:15:46.060702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064143+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:15:46.064143+0000","last_peered":"2023-10-05T15:15:46.064143+0000","last_clean":"2023-10-05T15:15:46.064143+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:15:46.064143+0000","last_undegraded":"2023-10-05T15:15:46.064143+0000","last_fullsized":"2023-10-05T15:15:46.064143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060211+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:15:46.060211+0000","last_peered":"2023-10-05T15:15:46.060211+0000","last_clean":"2023-10-05T15:15:46.060211+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:15:46.060211+0000","last_undegraded":"2023-10-05T15:15:46.060211+0000","last_fullsized":"2023-10-05T15:15:46.060211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067424+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:46.067424+0000","last_peered":"2023-10-05T15:15:46.067424+0000","last_clean":"2023-10-05T15:15:46.067424+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:46.067424+0000","last_undegraded":"2023-10-05T15:15:46.067424+0000","last_fullsized":"2023-10-05T15:15:46.067424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060744+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:15:46.060744+0000","last_peered":"2023-10-05T15:15:46.060744+0000","last_clean":"2023-10-05T15:15:46.060744+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:15:46.060744+0000","last_undegraded":"2023-10-05T15:15:46.060744+0000","last_fullsized":"2023-10-05T15:15:46.060744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058609+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:15:46.058609+0000","last_peered":"2023-10-05T15:15:46.058609+0000","last_clean":"2023-10-05T15:15:46.058609+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:15:46.058609+0000","last_undegraded":"2023-10-05T15:15:46.058609+0000","last_fullsized":"2023-10-05T15:15:46.058609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064579+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:46.064579+0000","last_peered":"2023-10-05T15:15:46.064579+0000","last_clean":"2023-10-05T15:15:46.064579+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:46.064579+0000","last_undegraded":"2023-10-05T15:15:46.064579+0000","last_fullsized":"2023-10-05T15:15:46.064579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062282+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:15:46.062282+0000","last_peered":"2023-10-05T15:15:46.062282+0000","last_clean":"2023-10-05T15:15:46.062282+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:15:46.062282+0000","last_undegraded":"2023-10-05T15:15:46.062282+0000","last_fullsized":"2023-10-05T15:15:46.062282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.095591+0000","last_change":"2023-10-05T15:15:47.095591+0000","last_active":"2023-10-05T15:15:47.095591+0000","last_peered":"2023-10-05T15:15:47.095591+0000","last_clean":"2023-10-05T15:15:47.095591+0000","last_became_active":"2023-10-05T15:15:47.090503+0000","last_became_peered":"2023-10-05T15:15:47.090503+0000","last_unstale":"2023-10-05T15:15:47.095591+0000","last_undegraded":"2023-10-05T15:15:47.095591+0000","last_fullsized":"2023-10-05T15:15:47.095591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:35.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057335+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:15:46.057335+0000","last_peered":"2023-10-05T15:15:46.057335+0000","last_clean":"2023-10-05T15:15:46.057335+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:15:46.057335+0000","last_undegraded":"2023-10-05T15:15:46.057335+0000","last_fullsized":"2023-10-05T15:15:46.057335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064854+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:15:46.064854+0000","last_peered":"2023-10-05T15:15:46.064854+0000","last_clean":"2023-10-05T15:15:46.064854+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:15:46.064854+0000","last_undegraded":"2023-10-05T15:15:46.064854+0000","last_fullsized":"2023-10-05T15:15:46.064854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060452+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:15:46.060452+0000","last_peered":"2023-10-05T15:15:46.060452+0000","last_clean":"2023-10-05T15:15:46.060452+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:15:46.060452+0000","last_undegraded":"2023-10-05T15:15:46.060452+0000","last_fullsized":"2023-10-05T15:15:46.060452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063970+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:15:46.063970+0000","last_peered":"2023-10-05T15:15:46.063970+0000","last_clean":"2023-10-05T15:15:46.063970+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:15:46.063970+0000","last_undegraded":"2023-10-05T15:15:46.063970+0000","last_fullsized":"2023-10-05T15:15:46.063970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057900+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:15:46.057900+0000","last_peered":"2023-10-05T15:15:46.057900+0000","last_clean":"2023-10-05T15:15:46.057900+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:15:46.057900+0000","last_undegraded":"2023-10-05T15:15:46.057900+0000","last_fullsized":"2023-10-05T15:15:46.057900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067523+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:15:46.067523+0000","last_peered":"2023-10-05T15:15:46.067523+0000","last_clean":"2023-10-05T15:15:46.067523+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:15:46.067523+0000","last_undegraded":"2023-10-05T15:15:46.067523+0000","last_fullsized":"2023-10-05T15:15:46.067523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:53.099036+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:15:53.099036+0000","last_peered":"2023-10-05T15:15:53.099036+0000","last_clean":"2023-10-05T15:15:53.099036+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:15:53.099036+0000","last_undegraded":"2023-10-05T15:15:53.099036+0000","last_fullsized":"2023-10-05T15:15:53.099036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058151+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:15:46.058151+0000","last_peered":"2023-10-05T15:15:46.058151+0000","last_clean":"2023-10-05T15:15:46.058151+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:15:46.058151+0000","last_undegraded":"2023-10-05T15:15:46.058151+0000","last_fullsized":"2023-10-05T15:15:46.058151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063292+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:15:46.063292+0000","last_peered":"2023-10-05T15:15:46.063292+0000","last_clean":"2023-10-05T15:15:46.063292+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:15:46.063292+0000","last_undegraded":"2023-10-05T15:15:46.063292+0000","last_fullsized":"2023-10-05T15:15:46.063292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061487+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:15:46.061487+0000","last_peered":"2023-10-05T15:15:46.061487+0000","last_clean":"2023-10-05T15:15:46.061487+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:15:46.061487+0000","last_undegraded":"2023-10-05T15:15:46.061487+0000","last_fullsized":"2023-10-05T15:15:46.061487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058564+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:15:46.058564+0000","last_peered":"2023-10-05T15:15:46.058564+0000","last_clean":"2023-10-05T15:15:46.058564+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:15:46.058564+0000","last_undegraded":"2023-10-05T15:15:46.058564+0000","last_fullsized":"2023-10-05T15:15:46.058564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060696+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:15:46.060696+0000","last_peered":"2023-10-05T15:15:46.060696+0000","last_clean":"2023-10-05T15:15:46.060696+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:15:46.060696+0000","last_undegraded":"2023-10-05T15:15:46.060696+0000","last_fullsized":"2023-10-05T15:15:46.060696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065946+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:46.065946+0000","last_peered":"2023-10-05T15:15:46.065946+0000","last_clean":"2023-10-05T15:15:46.065946+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:46.065946+0000","last_undegraded":"2023-10-05T15:15:46.065946+0000","last_fullsized":"2023-10-05T15:15:46.065946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058260+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:15:46.058260+0000","last_peered":"2023-10-05T15:15:46.058260+0000","last_clean":"2023-10-05T15:15:46.058260+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:15:46.058260+0000","last_undegraded":"2023-10-05T15:15:46.058260+0000","last_fullsized":"2023-10-05T15:15:46.058260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062338+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:15:46.062338+0000","last_peered":"2023-10-05T15:15:46.062338+0000","last_clean":"2023-10-05T15:15:46.062338+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:15:46.062338+0000","last_undegraded":"2023-10-05T15:15:46.062338+0000","last_fullsized":"2023-10-05T15:15:46.062338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.094198+0000","last_change":"2023-10-05T15:15:47.094198+0000","last_active":"2023-10-05T15:15:47.094198+0000","last_peered":"2023-10-05T15:15:47.094198+0000","last_clean":"2023-10-05T15:15:47.094198+0000","last_became_active":"2023-10-05T15:15:47.093766+0000","last_became_peered":"2023-10-05T15:15:47.093766+0000","last_unstale":"2023-10-05T15:15:47.094198+0000","last_undegraded":"2023-10-05T15:15:47.094198+0000","last_fullsized":"2023-10-05T15:15:47.094198+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:48:59.949643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057207+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:15:46.057207+0000","last_peered":"2023-10-05T15:15:46.057207+0000","last_clean":"2023-10-05T15:15:46.057207+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:15:46.057207+0000","last_undegraded":"2023-10-05T15:15:46.057207+0000","last_fullsized":"2023-10-05T15:15:46.057207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.088923+0000","last_change":"2023-10-05T15:15:47.088923+0000","last_active":"2023-10-05T15:15:47.088923+0000","last_peered":"2023-10-05T15:15:47.088923+0000","last_clean":"2023-10-05T15:15:47.088923+0000","last_became_active":"2023-10-05T15:15:47.088562+0000","last_became_peered":"2023-10-05T15:15:47.088562+0000","last_unstale":"2023-10-05T15:15:47.088923+0000","last_undegraded":"2023-10-05T15:15:47.088923+0000","last_fullsized":"2023-10-05T15:15:47.088923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:25.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064107+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:15:46.064107+0000","last_peered":"2023-10-05T15:15:46.064107+0000","last_clean":"2023-10-05T15:15:46.064107+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:15:46.064107+0000","last_undegraded":"2023-10-05T15:15:46.064107+0000","last_fullsized":"2023-10-05T15:15:46.064107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.065363+0000","last_change":"2023-10-05T15:15:47.065363+0000","last_active":"2023-10-05T15:15:47.065363+0000","last_peered":"2023-10-05T15:15:47.065363+0000","last_clean":"2023-10-05T15:15:47.065363+0000","last_became_active":"2023-10-05T15:15:47.064990+0000","last_became_peered":"2023-10-05T15:15:47.064990+0000","last_unstale":"2023-10-05T15:15:47.065363+0000","last_undegraded":"2023-10-05T15:15:47.065363+0000","last_fullsized":"2023-10-05T15:15:47.065363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:31.355817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057856+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:15:46.057856+0000","last_peered":"2023-10-05T15:15:46.057856+0000","last_clean":"2023-10-05T15:15:46.057856+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:15:46.057856+0000","last_undegraded":"2023-10-05T15:15:46.057856+0000","last_fullsized":"2023-10-05T15:15:46.057856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067816+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:15:46.067816+0000","last_peered":"2023-10-05T15:15:46.067816+0000","last_clean":"2023-10-05T15:15:46.067816+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:15:46.067816+0000","last_undegraded":"2023-10-05T15:15:46.067816+0000","last_fullsized":"2023-10-05T15:15:46.067816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060959+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:15:46.060959+0000","last_peered":"2023-10-05T15:15:46.060959+0000","last_clean":"2023-10-05T15:15:46.060959+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:15:46.060959+0000","last_undegraded":"2023-10-05T15:15:46.060959+0000","last_fullsized":"2023-10-05T15:15:46.060959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064667+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:15:46.064667+0000","last_peered":"2023-10-05T15:15:46.064667+0000","last_clean":"2023-10-05T15:15:46.064667+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:15:46.064667+0000","last_undegraded":"2023-10-05T15:15:46.064667+0000","last_fullsized":"2023-10-05T15:15:46.064667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.068128+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:15:46.068128+0000","last_peered":"2023-10-05T15:15:46.068128+0000","last_clean":"2023-10-05T15:15:46.068128+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:15:46.068128+0000","last_undegraded":"2023-10-05T15:15:46.068128+0000","last_fullsized":"2023-10-05T15:15:46.068128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063520+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:15:46.063520+0000","last_peered":"2023-10-05T15:15:46.063520+0000","last_clean":"2023-10-05T15:15:46.063520+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:15:46.063520+0000","last_undegraded":"2023-10-05T15:15:46.063520+0000","last_fullsized":"2023-10-05T15:15:46.063520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062902+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:15:46.062902+0000","last_peered":"2023-10-05T15:15:46.062902+0000","last_clean":"2023-10-05T15:15:46.062902+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:15:46.062902+0000","last_undegraded":"2023-10-05T15:15:46.062902+0000","last_fullsized":"2023-10-05T15:15:46.062902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65801,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":450,"num_read_kb":294,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416409,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":491395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.435}]},{"osd":1,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.375}]},{"osd":6,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65500000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.55500000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.69399999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1140965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.748}]},{"osd":3,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69199999999999995,"5min":1.335,"15min":1.335},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79200000000000004,"5min":0.874,"15min":0.874},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91800000000000004,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0009999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79000000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96199999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67400000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.76600000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808865,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":491325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65900000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.88900000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.624},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82899999999999996,"5min":1.216,"15min":1.216},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.66300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.93600000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.311}]},{"osd":4,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65000000000000002,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":1.141,"15min":1.141},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.503}]},{"osd":5,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.02,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.82099999999999995,"15min":0.84699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.49199999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78300000000000003,"5min":1.327,"15min":1.327},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.53600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.56999999999999995}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66400000000000003}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64500000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":491703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.443,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.69499999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.0170000000000003,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.755}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.82999999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69099999999999995,"15min":0.67800000000000005},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.80000000000000004,"15min":0.73999999999999999},"min":{"1min":0.58099999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":6.4809999999999999,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.81200000000000006}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.65400000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.73199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0109999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.85899999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88200000000000001}]}]},{"osd":7,"up_from":52,"seq":223338299433,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1630208,"data_stored":1088589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.5}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95199999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.749}]},{"osd":9,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61199999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77300000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":486829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.23,"15min":1.23},"last":0.433},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.308},{"interface":"front","average":{"1min":0.499,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.0960000000000001,"5min":1.147,"15min":1.147},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97299999999999998,"5min":1.296,"15min":1.296},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.264,"15min":1.264},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.242,"15min":1.242},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84999999999999998,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79500000000000004,"15min":0.81699999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":1.181,"15min":1.181},"last":0.55100000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.77100000000000002,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":1.323,"15min":1.323},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.44,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89600000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.40799999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.64700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0629999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":546185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91600000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.59099999999999997,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.0960000000000001,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":0.38},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.627,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.1180000000000003,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59899999999999998,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95399999999999996,"5min":0.995,"15min":0.995},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.68999999999999995,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.66000000000000003,"15min":0.63500000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.3010000000000002,"5min":5.3010000000000002,"15min":5.3010000000000002},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93300000000000005,"5min":1.038,"15min":1.038},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.56799999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95899999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.876,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.44400000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.79700000000000004,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.6630000000000003,"5min":4.6630000000000003,"15min":4.6630000000000003},"last":0.61499999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.46000000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":488012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.69799999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":11.119999999999999,"5min":11.119999999999999,"15min":11.119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55200000000000005,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.52300000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.86699999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.64100000000000001,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.048,"5min":11.048,"15min":11.048},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.117,"15min":1.117},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55500000000000005,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.89000000000000001,"15min":0.86099999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":6.3150000000000004,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":0.77400000000000002,"15min":0.70799999999999996},"min":{"1min":0.40999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":11.151999999999999,"5min":11.151999999999999,"15min":11.151999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.751,"15min":0.745},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.78900000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.749}]},{"osd":11,"last update":"Thu Oct 5 15:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69999999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":547068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":1.623,"15min":1.623},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.753,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.503},"min":{"1min":0.47499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:15:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81399999999999995,"5min":1.639,"15min":1.639},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.32400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.373},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.67600000000000005,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.8639999999999999,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69299999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.74399999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:15:25 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.79900000000000004,"15min":0.748},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":8.3019999999999996,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.80200000000000005,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.2780000000000005,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.68400000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.82099999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":486206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.36299999999999999},"min":{"1min":0.28499999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58699999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:15:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.84099999999999997,"5min":1.097,"15min":1.097},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.48899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.73999999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79500000000000004,"5min":1.087,"15min":1.087},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76300000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":1.097,"15min":1.097},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63800000000000001,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":1.149,"15min":1.149},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.746,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57899999999999996,"5min":1.04,"15min":1.04},"last":0.374}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94799999999999995,"5min":1.044,"15min":1.044},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.75700000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.76400000000000001,"15min":0.79800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":1.605,"15min":1.605},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72899999999999998,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.47699999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67500000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":491020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.379},"min":{"1min":0.317,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.127},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.94399999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89700000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56899999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75900000000000001,"5min":0.87,"15min":0.87},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60999999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.014},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.002}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.623},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.59499999999999997}]}]},{"osd":5,"up_from":39,"seq":167503724594,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1634304,"data_stored":1083450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58099999999999996,"15min":0.55500000000000005},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.375}]},{"osd":2,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42699999999999999,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.434,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.443}]},{"osd":4,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.44600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92100000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.028,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.496},{"interface":"front","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.675,"15min":1.675},"last":0.505}]},{"osd":8,"last update":"Thu Oct 5 15:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.42299999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46400000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2849999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8759999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:15:56.181 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-05T15:15:56.182 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-05T15:15:56.182 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-05T15:15:56.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-05T15:15:56.750 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:15:57.250 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:56 smithi060 ceph-mon[99238]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 13 B/s, 0 objects/s recovering 2023-10-05T15:15:57.250 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:56 smithi060 ceph-mon[99238]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:57.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:56 smithi135 ceph-mon[103360]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 13 B/s, 0 objects/s recovering 2023-10-05T15:15:57.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:56 smithi135 ceph-mon[103360]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:57.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:56 smithi092 ceph-mon[102944]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 13 B/s, 0 objects/s recovering 2023-10-05T15:15:57.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:56 smithi092 ceph-mon[102944]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:15:58.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.047+0000 7fe9fce52700 1 -- 172.21.15.60:0/1117060872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f8100820 msgr2=0x7fe9f810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.047+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1117060872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f8100820 0x7fe9f810cc90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000b0d0 tx=0x7fe9f000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 -- 172.21.15.60:0/1117060872 shutdown_connections 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1117060872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f8100820 0x7fe9f810cc90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1117060872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9f8105e70 0x7fe9f8106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1117060872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9f80ffe60 0x7fe9f81002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 -- 172.21.15.60:0/1117060872 >> 172.21.15.60:0/1117060872 conn(0x7fe9f8075e00 msgr2=0x7fe9f8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 -- 172.21.15.60:0/1117060872 shutdown_connections 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 -- 172.21.15.60:0/1117060872 wait complete. 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 Processor -- start 2023-10-05T15:15:58.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.048+0000 7fe9fce52700 1 -- start start 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9fce52700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 0x7fe9f8195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9fce52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9f8100820 0x7fe9f8196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9fce52700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9f8105e70 0x7fe9f81967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9fce52700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81a5590 con 0x7fe9f80ffe60 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9fce52700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81a5700 con 0x7fe9f8100820 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9fce52700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81a58c0 con 0x7fe9f8105e70 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 0x7fe9f8195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 0x7fe9f8195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36902/0 (socket says 172.21.15.60:36902) 2023-10-05T15:15:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 -- 172.21.15.60:0/1787154809 learned_addr learned my addr 172.21.15.60:0/1787154809 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f5d9b700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9f8100820 0x7fe9f8196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f6d9d700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9f8105e70 0x7fe9f81967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 -- 172.21.15.60:0/1787154809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9f8105e70 msgr2=0x7fe9f81967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9f8105e70 0x7fe9f81967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 -- 172.21.15.60:0/1787154809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9f8100820 msgr2=0x7fe9f8196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9f8100820 0x7fe9f8196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 -- 172.21.15.60:0/1787154809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f0009d00 con 0x7fe9f80ffe60 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.049+0000 7fe9f659c700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 0x7fe9f8195d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800b530 tx=0x7fe9e800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.050+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8011830 con 0x7fe9f80ffe60 2023-10-05T15:15:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.050+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9e8011e50 con 0x7fe9f80ffe60 2023-10-05T15:15:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.050+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800f2e0 con 0x7fe9f80ffe60 2023-10-05T15:15:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.050+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f81a5ba0 con 0x7fe9f80ffe60 2023-10-05T15:15:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.050+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f81a6050 con 0x7fe9f80ffe60 2023-10-05T15:15:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.051+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f804ebb0 con 0x7fe9f80ffe60 2023-10-05T15:15:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.052+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe9e80105a0 con 0x7fe9f80ffe60 2023-10-05T15:15:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.053+0000 7fe9ef7fe700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe9e40a1510 0x7fe9e40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.053+0000 7fe9f5d9b700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe9e40a1510 0x7fe9e40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.053+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fe9e80ccae0 con 0x7fe9f80ffe60 2023-10-05T15:15:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.053+0000 7fe9f5d9b700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe9e40a1510 0x7fe9e40a39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8069300 tx=0x7fe9e000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.057+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe9e8095d90 con 0x7fe9f80ffe60 2023-10-05T15:15:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.307+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe9f8068f90 con 0x7fe9f80ffe60 2023-10-05T15:15:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.307+0000 7fe9ef7fe700 1 -- 172.21.15.60:0/1787154809 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe9e80993b0 con 0x7fe9f80ffe60 2023-10-05T15:15:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:58.310 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-05T15:15:58.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.309+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe9e40a1510 msgr2=0x7fe9e40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.309+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe9e40a1510 0x7fe9e40a39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8069300 tx=0x7fe9e000b410 comp rx=0 tx=0).stop 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.309+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 msgr2=0x7fe9f8195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.309+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 0x7fe9f8195d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800b530 tx=0x7fe9e800b840 comp rx=0 tx=0).stop 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 shutdown_connections 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9f8105e70 0x7fe9f81967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe9e40a1510 0x7fe9e40a39d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9f80ffe60 0x7fe9f8195d50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 --2- 172.21.15.60:0/1787154809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9f8100820 0x7fe9f8196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 >> 172.21.15.60:0/1787154809 conn(0x7fe9f8075e00 msgr2=0x7fe9f8103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 shutdown_connections 2023-10-05T15:15:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.310+0000 7fe9fce52700 1 -- 172.21.15.60:0/1787154809 wait complete. 2023-10-05T15:15:58.719 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-05T15:15:58.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:15:58.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 -- 172.21.15.60:0/3836110567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac0ffdc0 msgr2=0x7fc9ac1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 --2- 172.21.15.60:0/3836110567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac0ffdc0 0x7fc9ac1001e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0099c0 tx=0x7fc99c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 -- 172.21.15.60:0/3836110567 shutdown_connections 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 --2- 172.21.15.60:0/3836110567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9ac101950 0x7fc9ac108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 --2- 172.21.15.60:0/3836110567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac0ffdc0 0x7fc9ac1001e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 --2- 172.21.15.60:0/3836110567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac100fb0 0x7fc9ac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 -- 172.21.15.60:0/3836110567 >> 172.21.15.60:0/3836110567 conn(0x7fc9ac0fb310 msgr2=0x7fc9ac0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 -- 172.21.15.60:0/3836110567 shutdown_connections 2023-10-05T15:15:58.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.847+0000 7fc9b2363700 1 -- 172.21.15.60:0/3836110567 wait complete. 2023-10-05T15:15:58.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 Processor -- start 2023-10-05T15:15:58.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 -- start start 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac0ffdc0 0x7fc9ac196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9ac100fb0 0x7fc9ac197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 0x7fc9ac19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac19e760 con 0x7fc9ac101950 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac19e8d0 con 0x7fc9ac0ffdc0 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b2363700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac19ea90 con 0x7fc9ac100fb0 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b0900700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 0x7fc9ac19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b0900700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 0x7fc9ac19e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36920/0 (socket says 172.21.15.60:36920) 2023-10-05T15:15:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.848+0000 7fc9b0900700 1 -- 172.21.15.60:0/703903204 learned_addr learned my addr 172.21.15.60:0/703903204 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9abfff700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac0ffdc0 0x7fc9ac196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9ab7fe700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9ac100fb0 0x7fc9ac197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b0900700 1 -- 172.21.15.60:0/703903204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9ac100fb0 msgr2=0x7fc9ac197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b0900700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9ac100fb0 0x7fc9ac197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b0900700 1 -- 172.21.15.60:0/703903204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac0ffdc0 msgr2=0x7fc9ac196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b0900700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac0ffdc0 0x7fc9ac196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b0900700 1 -- 172.21.15.60:0/703903204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0095f0 con 0x7fc9ac101950 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b0900700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 0x7fc9ac19e190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400b970 tx=0x7fc9a400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400d860 con 0x7fc9ac101950 2023-10-05T15:15:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9a400de80 con 0x7fc9ac101950 2023-10-05T15:15:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac19ed70 con 0x7fc9ac101950 2023-10-05T15:15:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4017400 con 0x7fc9ac101950 2023-10-05T15:15:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.849+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac19f1d0 con 0x7fc9ac101950 2023-10-05T15:15:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.850+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac10c8f0 con 0x7fc9ac101950 2023-10-05T15:15:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.851+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc9a400e630 con 0x7fc9ac101950 2023-10-05T15:15:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.852+0000 7fc9a97fa700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9940a15d0 0x7fc9940a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.852+0000 7fc9abfff700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9940a15d0 0x7fc9940a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.852+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fc9a4006e40 con 0x7fc9ac101950 2023-10-05T15:15:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.852+0000 7fc9abfff700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9940a15d0 0x7fc9940a3a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac1980f0 tx=0x7fc99c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:58.856+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9a4095f60 con 0x7fc9ac101950 2023-10-05T15:15:59.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.062+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9ac19f420 con 0x7fc9ac101950 2023-10-05T15:15:59.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.063+0000 7fc9a97fa700 1 -- 172.21.15.60:0/703903204 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7fc9a4099580 con 0x7fc9ac101950 2023-10-05T15:15:59.066 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:15:59.066 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:15:59.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9940a15d0 msgr2=0x7fc9940a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9940a15d0 0x7fc9940a3a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac1980f0 tx=0x7fc99c00b540 comp rx=0 tx=0).stop 2023-10-05T15:15:59.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 msgr2=0x7fc9ac19e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 0x7fc9ac19e190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400b970 tx=0x7fc9a400bc80 comp rx=0 tx=0).stop 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 shutdown_connections 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9940a15d0 0x7fc9940a3a90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9ac101950 0x7fc9ac19e190 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac0ffdc0 0x7fc9ac196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 --2- 172.21.15.60:0/703903204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9ac100fb0 0x7fc9ac197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 >> 172.21.15.60:0/703903204 conn(0x7fc9ac0fb310 msgr2=0x7fc9ac0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.065+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 shutdown_connections 2023-10-05T15:15:59.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.066+0000 7fc9b2363700 1 -- 172.21.15.60:0/703903204 wait complete. 2023-10-05T15:15:59.079 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:58 smithi060 ceph-mon[99238]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 12 B/s, 0 objects/s recovering 2023-10-05T15:15:59.079 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:58 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1787154809' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-05T15:15:59.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:15:59.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:15:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4108132397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 msgr2=0x7fdfa0103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4108132397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0103db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009990 tx=0x7fdf9c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4108132397 shutdown_connections 2023-10-05T15:15:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4108132397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 0x7fdfa0109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4108132397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0103db0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4108132397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 0x7fdfa01066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4108132397 >> 172.21.15.60:0/4108132397 conn(0x7fdfa00fb330 msgr2=0x7fdfa00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:59.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4108132397 shutdown_connections 2023-10-05T15:15:59.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.210+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4108132397 wait complete. 2023-10-05T15:15:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 Processor -- start 2023-10-05T15:15:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 -- start start 2023-10-05T15:15:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0101330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 0x7fdfa00ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 0x7fdfa00ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa0100650 con 0x7fdfa01019c0 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01007c0 con 0x7fdfa0106c20 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa82b8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01a0c20 con 0x7fdfa01042f0 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa6054700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0101330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa6054700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0101330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36930/0 (socket says 172.21.15.60:36930) 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.211+0000 7fdfa6054700 1 -- 172.21.15.60:0/4170528937 learned_addr learned my addr 172.21.15.60:0/4170528937 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa5853700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 0x7fdfa00ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6855700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 0x7fdfa00ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6054700 1 -- 172.21.15.60:0/4170528937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 msgr2=0x7fdfa00ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6054700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 0x7fdfa00ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6054700 1 -- 172.21.15.60:0/4170528937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 msgr2=0x7fdfa00ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6054700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 0x7fdfa00ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6054700 1 -- 172.21.15.60:0/4170528937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0095f0 con 0x7fdfa01019c0 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6855700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 0x7fdfa00ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa5853700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 0x7fdfa00ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa6054700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0101330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c000c00 tx=0x7fdf9c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c01d070 con 0x7fdfa01019c0 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf9c00fc00 con 0x7fdfa01019c0 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa01a0ea0 con 0x7fdfa01019c0 2023-10-05T15:15:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c017650 con 0x7fdfa01019c0 2023-10-05T15:15:59.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.212+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa01a1270 con 0x7fdfa01019c0 2023-10-05T15:15:59.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.213+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa00fceb0 con 0x7fdfa01019c0 2023-10-05T15:15:59.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.214+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdf9c022470 con 0x7fdfa01019c0 2023-10-05T15:15:59.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.215+0000 7fdf937fe700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a1510 0x7fdf8c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.215+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fdf9c0ce760 con 0x7fdfa01019c0 2023-10-05T15:15:59.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.215+0000 7fdfa5853700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a1510 0x7fdf8c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.215+0000 7fdfa5853700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a1510 0x7fdf8c0a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf94005fd0 tx=0x7fdf94005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:59.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.218+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf9c097990 con 0x7fdfa01019c0 2023-10-05T15:15:59.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:58 smithi135 ceph-mon[103360]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 12 B/s, 0 objects/s recovering 2023-10-05T15:15:59.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:58 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1787154809' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-05T15:15:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.420+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfa002cf70 con 0x7fdfa01019c0 2023-10-05T15:15:59.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.421+0000 7fdf937fe700 1 -- 172.21.15.60:0/4170528937 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf9c09afb0 con 0x7fdfa01019c0 2023-10-05T15:15:59.423 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:15:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a1510 msgr2=0x7fdf8c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a1510 0x7fdf8c0a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf94005fd0 tx=0x7fdf94005dc0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 msgr2=0x7fdfa0101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0101330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c000c00 tx=0x7fdf9c00f710 comp rx=0 tx=0).stop 2023-10-05T15:15:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 shutdown_connections 2023-10-05T15:15:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0106c20 0x7fdfa00ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a1510 0x7fdf8c0a39d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa01019c0 0x7fdfa0101330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 --2- 172.21.15.60:0/4170528937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa01042f0 0x7fdfa00ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 >> 172.21.15.60:0/4170528937 conn(0x7fdfa00fb330 msgr2=0x7fdfa0102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 shutdown_connections 2023-10-05T15:15:59.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.423+0000 7fdfa82b8700 1 -- 172.21.15.60:0/4170528937 wait complete. 2023-10-05T15:15:59.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:58 smithi092 ceph-mon[102944]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 12 B/s, 0 objects/s recovering 2023-10-05T15:15:59.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:58 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1787154809' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-05T15:15:59.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 -- 172.21.15.60:0/2690612019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 msgr2=0x7f1390101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 --2- 172.21.15.60:0/2690612019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390101410 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f13840099c0 tx=0x7f1384009cd0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 -- 172.21.15.60:0/2690612019 shutdown_connections 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 --2- 172.21.15.60:0/2690612019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 0x7f1390108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 --2- 172.21.15.60:0/2690612019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13900ffdc0 0x7f13901001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 --2- 172.21.15.60:0/2690612019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390101410 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.567+0000 7f1395d17700 1 -- 172.21.15.60:0/2690612019 >> 172.21.15.60:0/2690612019 conn(0x7f13900fb330 msgr2=0x7f13900fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.568+0000 7f1395d17700 1 -- 172.21.15.60:0/2690612019 shutdown_connections 2023-10-05T15:15:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.568+0000 7f1395d17700 1 -- 172.21.15.60:0/2690612019 wait complete. 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.568+0000 7f1395d17700 1 Processor -- start 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.568+0000 7f1395d17700 1 -- start start 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.568+0000 7f1395d17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13900ffdc0 0x7f1390195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.568+0000 7f1395d17700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f1395d17700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 0x7f139019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f1395d17700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139019d690 con 0x7f1390100fb0 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f1395d17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139019d7d0 con 0x7f13900ffdc0 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f1395d17700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139019d960 con 0x7f1390101950 2023-10-05T15:15:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36946/0 (socket says 172.21.15.60:36946) 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 -- 172.21.15.60:0/2687592745 learned_addr learned my addr 172.21.15.60:0/2687592745 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138f7fe700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13900ffdc0 0x7f1390195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138ffff700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 0x7f139019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 -- 172.21.15.60:0/2687592745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 msgr2=0x7f139019d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 0x7f139019d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 -- 172.21.15.60:0/2687592745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13900ffdc0 msgr2=0x7f1390195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13900ffdc0 0x7f1390195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 -- 172.21.15.60:0/2687592745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840095f0 con 0x7f1390100fb0 2023-10-05T15:15:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138ffff700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 0x7f139019d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:15:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138effd700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390196050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1384000c00 tx=0x7f1384009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138401d070 con 0x7f1390100fb0 2023-10-05T15:15:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13840041e0 con 0x7f1390100fb0 2023-10-05T15:15:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139019dbe0 con 0x7f1390100fb0 2023-10-05T15:15:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400f460 con 0x7f1390100fb0 2023-10-05T15:15:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.569+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139019e000 con 0x7f1390100fb0 2023-10-05T15:15:59.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.570+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1390106d70 con 0x7f1390100fb0 2023-10-05T15:15:59.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.571+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1384022690 con 0x7f1390100fb0 2023-10-05T15:15:59.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.572+0000 7f138cff9700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f13780a1510 0x7f13780a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.572+0000 7f138f7fe700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f13780a1510 0x7f13780a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.572+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f13840ced70 con 0x7f1390100fb0 2023-10-05T15:15:59.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.572+0000 7f138f7fe700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f13780a1510 0x7f13780a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1390100e10 tx=0x7f138000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:59.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.575+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1384097fa0 con 0x7f1390100fb0 2023-10-05T15:15:59.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.777+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f139010b8e0 con 0x7f1390100fb0 2023-10-05T15:15:59.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.777+0000 7f138cff9700 1 -- 172.21.15.60:0/2687592745 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f138409b5c0 con 0x7f1390100fb0 2023-10-05T15:15:59.829 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:15:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f13780a1510 msgr2=0x7f13780a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f13780a1510 0x7f13780a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1390100e10 tx=0x7f138000b5b0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 msgr2=0x7f1390196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390196050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1384000c00 tx=0x7f1384009580 comp rx=0 tx=0).stop 2023-10-05T15:15:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 shutdown_connections 2023-10-05T15:15:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390101950 0x7f139019d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13900ffdc0 0x7f1390195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f13780a1510 0x7f13780a39d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 --2- 172.21.15.60:0/2687592745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1390100fb0 0x7f1390196050 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 >> 172.21.15.60:0/2687592745 conn(0x7f13900fb330 msgr2=0x7f13900fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:59.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 shutdown_connections 2023-10-05T15:15:59.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.779+0000 7f1395d17700 1 -- 172.21.15.60:0/2687592745 wait complete. 2023-10-05T15:15:59.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:15:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 -- 172.21.15.60:0/3425434569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25701019b0 msgr2=0x7f2570108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 --2- 172.21.15.60:0/3425434569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25701019b0 0x7f2570108240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f256800b0a0 tx=0x7f256800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 -- 172.21.15.60:0/3425434569 shutdown_connections 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 --2- 172.21.15.60:0/3425434569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25701019b0 0x7f2570108240 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 --2- 172.21.15.60:0/3425434569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25701002e0 0x7f2570100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 --2- 172.21.15.60:0/3425434569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2570100ff0 0x7f2570101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 -- 172.21.15.60:0/3425434569 >> 172.21.15.60:0/3425434569 conn(0x7f25700faab0 msgr2=0x7f25700fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 -- 172.21.15.60:0/3425434569 shutdown_connections 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.958+0000 7f2577f8e700 1 -- 172.21.15.60:0/3425434569 wait complete. 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 Processor -- start 2023-10-05T15:15:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 -- start start 2023-10-05T15:15:59.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25701002e0 0x7f2570195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 0x7f2570196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25701019b0 0x7f257019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257019d780 con 0x7f2570100ff0 2023-10-05T15:15:59.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257019d8f0 con 0x7f25701019b0 2023-10-05T15:15:59.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2577f8e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257019dab0 con 0x7f25701002e0 2023-10-05T15:15:59.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2575529700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 0x7f2570196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2575529700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 0x7f2570196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36960/0 (socket says 172.21.15.60:36960) 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2575529700 1 -- 172.21.15.60:0/218835680 learned_addr learned my addr 172.21.15.60:0/218835680 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.959+0000 7f2575d2a700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25701002e0 0x7f2570195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f257652b700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25701019b0 0x7f257019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2575529700 1 -- 172.21.15.60:0/218835680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25701002e0 msgr2=0x7f2570195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2575529700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25701002e0 0x7f2570195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2575529700 1 -- 172.21.15.60:0/218835680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25701019b0 msgr2=0x7f257019d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2575529700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25701019b0 0x7f257019d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2575529700 1 -- 172.21.15.60:0/218835680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568009d00 con 0x7f2570100ff0 2023-10-05T15:15:59.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f257652b700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25701019b0 0x7f257019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2575529700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 0x7f2570196180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f256400d980 tx=0x7f256400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564004020 con 0x7f2570100ff0 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2564009730 con 0x7f2570100ff0 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564003a80 con 0x7f2570100ff0 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257019dd90 con 0x7f2570100ff0 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.960+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257019e1e0 con 0x7f2570100ff0 2023-10-05T15:15:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.961+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257010b640 con 0x7f2570100ff0 2023-10-05T15:15:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.962+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f25640098a0 con 0x7f2570100ff0 2023-10-05T15:15:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.963+0000 7f2562ffd700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f255c0a1590 0x7f255c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:15:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.963+0000 7f2575d2a700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f255c0a1590 0x7f255c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:15:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.963+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f25640cce40 con 0x7f2570100ff0 2023-10-05T15:15:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.963+0000 7f2575d2a700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f255c0a1590 0x7f255c0a3a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2570197110 tx=0x7f256c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:15:59.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:15:59.967+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2564095fe0 con 0x7f2570100ff0 2023-10-05T15:16:00.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:59 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/703903204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:00.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:59 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4170528937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:00.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:15:59 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2687592745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.173+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2570106d00 con 0x7f2570100ff0 2023-10-05T15:16:00.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.173+0000 7f2562ffd700 1 -- 172.21.15.60:0/218835680 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2564099600 con 0x7f2570100ff0 2023-10-05T15:16:00.175 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f255c0a1590 msgr2=0x7f255c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f255c0a1590 0x7f255c0a3a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2570197110 tx=0x7f256c00b410 comp rx=0 tx=0).stop 2023-10-05T15:16:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 msgr2=0x7f2570196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 0x7f2570196180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f256400d980 tx=0x7f256400dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 shutdown_connections 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25701019b0 0x7f257019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25701002e0 0x7f2570195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f255c0a1590 0x7f255c0a3a50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 --2- 172.21.15.60:0/218835680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2570100ff0 0x7f2570196180 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 >> 172.21.15.60:0/218835680 conn(0x7f25700faab0 msgr2=0x7f25700fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 shutdown_connections 2023-10-05T15:16:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.175+0000 7f2577f8e700 1 -- 172.21.15.60:0/218835680 wait complete. 2023-10-05T15:16:00.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:00.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2404231912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec100ea0 msgr2=0x7f4aec1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2404231912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec100ea0 0x7f4aec1012c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009990 tx=0x7f4ae0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2404231912 shutdown_connections 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2404231912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aec102a40 0x7f4aec109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2404231912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec100ea0 0x7f4aec1012c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2404231912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aec102080 0x7f4aec102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2404231912 >> 172.21.15.60:0/2404231912 conn(0x7f4aec0fc460 msgr2=0x7f4aec0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2404231912 shutdown_connections 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2404231912 wait complete. 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 Processor -- start 2023-10-05T15:16:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.319+0000 7f4af2b5d700 1 -- start start 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aec100ea0 0x7f4aec196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 0x7f4aec197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aec102a40 0x7f4aec19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec19e6d0 con 0x7f4aec102080 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec19e810 con 0x7f4aec100ea0 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec19e9a0 con 0x7f4aec102a40 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 0x7f4aec197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 0x7f4aec197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36974/0 (socket says 172.21.15.60:36974) 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 -- 172.21.15.60:0/2644679397 learned_addr learned my addr 172.21.15.60:0/2644679397 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af08f9700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aec100ea0 0x7f4aec196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af10fa700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aec102a40 0x7f4aec19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 -- 172.21.15.60:0/2644679397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aec102a40 msgr2=0x7f4aec19e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aec102a40 0x7f4aec19e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 -- 172.21.15.60:0/2644679397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aec100ea0 msgr2=0x7f4aec196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aec100ea0 0x7f4aec196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 -- 172.21.15.60:0/2644679397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00095f0 con 0x7f4aec102080 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4aebfff700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 0x7f4aec197090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800d980 tx=0x7f4ad800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8004020 con 0x7f4aec102080 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec19ec80 con 0x7f4aec102080 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ad8009730 con 0x7f4aec102080 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.320+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8003a30 con 0x7f4aec102080 2023-10-05T15:16:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.321+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec19f190 con 0x7f4aec102080 2023-10-05T15:16:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.322+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec10c710 con 0x7f4aec102080 2023-10-05T15:16:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.323+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4ad80098a0 con 0x7f4aec102080 2023-10-05T15:16:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.323+0000 7f4ae9ffb700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4adc0a1510 0x7f4adc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.323+0000 7f4af08f9700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4adc0a1510 0x7f4adc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.323+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f4ad80cce50 con 0x7f4aec102080 2023-10-05T15:16:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.324+0000 7f4af08f9700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4adc0a1510 0x7f4adc0a39d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000b5c0 tx=0x7f4ae0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:00.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.327+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ad8096050 con 0x7f4aec102080 2023-10-05T15:16:00.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:59 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/703903204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:00.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:59 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4170528937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:00.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:15:59 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2687592745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:00.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:59 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/703903204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:00.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:59 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4170528937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:00.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:15:59 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2687592745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.526+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4aec107e40 con 0x7f4aec102080 2023-10-05T15:16:00.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.527+0000 7f4ae9ffb700 1 -- 172.21.15.60:0/2644679397 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ad8099670 con 0x7f4aec102080 2023-10-05T15:16:00.529 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4adc0a1510 msgr2=0x7f4adc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4adc0a1510 0x7f4adc0a39d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000b5c0 tx=0x7f4ae0005fd0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 msgr2=0x7f4aec197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 0x7f4aec197090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800d980 tx=0x7f4ad800dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 shutdown_connections 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aec102a40 0x7f4aec19e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aec100ea0 0x7f4aec196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f4adc0a1510 0x7f4adc0a39d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 --2- 172.21.15.60:0/2644679397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec102080 0x7f4aec197090 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 >> 172.21.15.60:0/2644679397 conn(0x7f4aec0fc460 msgr2=0x7f4aec0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 shutdown_connections 2023-10-05T15:16:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.529+0000 7f4af2b5d700 1 -- 172.21.15.60:0/2644679397 wait complete. 2023-10-05T15:16:00.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.667+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2635284461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4102060 msgr2=0x7f1ec41024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.667+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2635284461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4102060 0x7f1ec41024e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009990 tx=0x7f1eb4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.667+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2635284461 shutdown_connections 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.667+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2635284461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec4102a20 0x7f1ec4109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.667+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2635284461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec4100e80 0x7f1ec41012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.667+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2635284461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4102060 0x7f1ec41024e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2635284461 >> 172.21.15.60:0/2635284461 conn(0x7f1ec40fc420 msgr2=0x7f1ec40fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2635284461 shutdown_connections 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2635284461 wait complete. 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 Processor -- start 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- start start 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 0x7f1ec4196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec4102060 0x7f1ec41970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec4102a20 0x7f1ec419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec419e700 con 0x7f1ec4100e80 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec419e840 con 0x7f1ec4102a20 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1ecc2b6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec419e9d0 con 0x7f1ec4102060 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.668+0000 7f1eca052700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 0x7f1ec4196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 0x7f1ec4196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36986/0 (socket says 172.21.15.60:36986) 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 -- 172.21.15.60:0/2067282678 learned_addr learned my addr 172.21.15.60:0/2067282678 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca853700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec4102a20 0x7f1ec419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1ec9851700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec4102060 0x7f1ec41970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 -- 172.21.15.60:0/2067282678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec4102060 msgr2=0x7f1ec41970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec4102060 0x7f1ec41970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 -- 172.21.15.60:0/2067282678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec4102a20 msgr2=0x7f1ec419e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec4102a20 0x7f1ec419e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 -- 172.21.15.60:0/2067282678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40095f0 con 0x7f1ec4100e80 2023-10-05T15:16:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1eca052700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 0x7f1ec4196b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000d980 tx=0x7f1ec000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0004020 con 0x7f1ec4100e80 2023-10-05T15:16:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ec000f690 con 0x7f1ec4100e80 2023-10-05T15:16:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec419ecb0 con 0x7f1ec4100e80 2023-10-05T15:16:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0003a60 con 0x7f1ec4100e80 2023-10-05T15:16:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.669+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec419f1c0 con 0x7f1ec4100e80 2023-10-05T15:16:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.670+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec41084a0 con 0x7f1ec4100e80 2023-10-05T15:16:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.671+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1ec000fb00 con 0x7f1ec4100e80 2023-10-05T15:16:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.672+0000 7f1ebb7fe700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1eb00a15d0 0x7f1eb00a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.672+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1ec00cccb0 con 0x7f1ec4100e80 2023-10-05T15:16:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.672+0000 7f1ec9851700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1eb00a15d0 0x7f1eb00a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.672+0000 7f1ec9851700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1eb00a15d0 0x7f1eb00a3a90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400b5c0 tx=0x7f1eb4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.676+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ec0095eb0 con 0x7f1ec4100e80 2023-10-05T15:16:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.925+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ec410c6f0 con 0x7f1ec4100e80 2023-10-05T15:16:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.926+0000 7f1ebb7fe700 1 -- 172.21.15.60:0/2067282678 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7f1ec00994d0 con 0x7f1ec4100e80 2023-10-05T15:16:00.928 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:00.928 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1eb00a15d0 msgr2=0x7f1eb00a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1eb00a15d0 0x7f1eb00a3a90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400b5c0 tx=0x7f1eb4005fd0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 msgr2=0x7f1ec4196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 0x7f1ec4196b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000d980 tx=0x7f1ec000dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 shutdown_connections 2023-10-05T15:16:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec4102a20 0x7f1ec419e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1eb00a15d0 0x7f1eb00a3a90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec4100e80 0x7f1ec4196b80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 --2- 172.21.15.60:0/2067282678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec4102060 0x7f1ec41970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 >> 172.21.15.60:0/2067282678 conn(0x7f1ec40fc420 msgr2=0x7f1ec41055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 shutdown_connections 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:00.928+0000 7f1ecc2b6700 1 -- 172.21.15.60:0/2067282678 wait complete. 2023-10-05T15:16:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:00.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 -- 172.21.15.60:0/3561068072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c1014e0 msgr2=0x7f617c101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 --2- 172.21.15.60:0/3561068072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c1014e0 0x7f617c101900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f616c009990 tx=0x7f616c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 -- 172.21.15.60:0/3561068072 shutdown_connections 2023-10-05T15:16:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 --2- 172.21.15.60:0/3561068072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f617c1003b0 0x7f617c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 --2- 172.21.15.60:0/3561068072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c1014e0 0x7f617c101900 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 --2- 172.21.15.60:0/3561068072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f617c0ffa10 0x7f617c0ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 -- 172.21.15.60:0/3561068072 >> 172.21.15.60:0/3561068072 conn(0x7f617c0fb370 msgr2=0x7f617c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 -- 172.21.15.60:0/3561068072 shutdown_connections 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.068+0000 7f6182705700 1 -- 172.21.15.60:0/3561068072 wait complete. 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 Processor -- start 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 -- start start 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 0x7f617c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f617c1003b0 0x7f617c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f617c1014e0 0x7f617c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c19e870 con 0x7f617c0ffa10 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c19e9e0 con 0x7f617c1014e0 2023-10-05T15:16:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6182705700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c19eba0 con 0x7f617c1003b0 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 0x7f617c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 0x7f617c069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37000/0 (socket says 172.21.15.60:37000) 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 -- 172.21.15.60:0/1349580404 learned_addr learned my addr 172.21.15.60:0/1349580404 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f6180ca2700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f617c1014e0 0x7f617c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617b7fe700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f617c1003b0 0x7f617c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 -- 172.21.15.60:0/1349580404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f617c1003b0 msgr2=0x7f617c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f617c1003b0 0x7f617c19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 -- 172.21.15.60:0/1349580404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f617c1014e0 msgr2=0x7f617c19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f617c1014e0 0x7f617c19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.069+0000 7f617bfff700 1 -- 172.21.15.60:0/1349580404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0095f0 con 0x7f617c0ffa10 2023-10-05T15:16:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.070+0000 7f617bfff700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 0x7f617c069bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f616c00f730 tx=0x7f616c00f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.070+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c01d070 con 0x7f617c0ffa10 2023-10-05T15:16:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.070+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f616c004ca0 con 0x7f617c0ffa10 2023-10-05T15:16:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.070+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c19ee20 con 0x7f617c0ffa10 2023-10-05T15:16:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.070+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c005610 con 0x7f617c0ffa10 2023-10-05T15:16:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.070+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c19f190 con 0x7f617c0ffa10 2023-10-05T15:16:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.071+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c10b7c0 con 0x7f617c0ffa10 2023-10-05T15:16:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.072+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f616c00fc80 con 0x7f617c0ffa10 2023-10-05T15:16:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.072+0000 7f61797fa700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61640a1550 0x7f61640a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.073+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f616c0ce7d0 con 0x7f617c0ffa10 2023-10-05T15:16:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.073+0000 7f617b7fe700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61640a1550 0x7f61640a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.073+0000 7f617b7fe700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61640a1550 0x7f61640a3a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6170005fd0 tx=0x7f617000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.076+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f616c097a00 con 0x7f617c0ffa10 2023-10-05T15:16:01.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.279+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f617c106cb0 con 0x7f617c0ffa10 2023-10-05T15:16:01.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.280+0000 7f61797fa700 1 -- 172.21.15.60:0/1349580404 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f616c09b020 con 0x7f617c0ffa10 2023-10-05T15:16:01.286 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:01.286 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.282+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61640a1550 msgr2=0x7f61640a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.282+0000 7f6182705700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61640a1550 0x7f61640a3a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6170005fd0 tx=0x7f617000a560 comp rx=0 tx=0).stop 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.282+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 msgr2=0x7f617c069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.282+0000 7f6182705700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 0x7f617c069bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f616c00f730 tx=0x7f616c00f760 comp rx=0 tx=0).stop 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 shutdown_connections 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f617c1014e0 0x7f617c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61640a1550 0x7f61640a3a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f617c0ffa10 0x7f617c069bc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 --2- 172.21.15.60:0/1349580404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f617c1003b0 0x7f617c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 >> 172.21.15.60:0/1349580404 conn(0x7f617c0fb370 msgr2=0x7f617c0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 shutdown_connections 2023-10-05T15:16:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.283+0000 7f6182705700 1 -- 172.21.15.60:0/1349580404 wait complete. 2023-10-05T15:16:01.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:00 smithi060 ceph-mon[99238]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2023-10-05T15:16:01.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:00 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/218835680' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:01.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:00 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2644679397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:01.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:00 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2067282678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:01.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:16:01.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:16:01.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:00 smithi135 ceph-mon[103360]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2023-10-05T15:16:01.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:00 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/218835680' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:01.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:00 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2644679397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:01.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:00 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2067282678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:01.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:00 smithi092 ceph-mon[102944]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2023-10-05T15:16:01.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:00 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/218835680' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:01.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:00 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2644679397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:01.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:00 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2067282678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:01.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 -- 172.21.15.60:0/3842029645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 msgr2=0x7f80d81066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 --2- 172.21.15.60:0/3842029645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81066f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009990 tx=0x7f80d4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 -- 172.21.15.60:0/3842029645 shutdown_connections 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 --2- 172.21.15.60:0/3842029645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d8106c30 0x7f80d8109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 --2- 172.21.15.60:0/3842029645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d81019d0 0x7f80d8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 --2- 172.21.15.60:0/3842029645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81066f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 -- 172.21.15.60:0/3842029645 >> 172.21.15.60:0/3842029645 conn(0x7f80d80fb380 msgr2=0x7f80d80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 -- 172.21.15.60:0/3842029645 shutdown_connections 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.425+0000 7f80dff74700 1 -- 172.21.15.60:0/3842029645 wait complete. 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 Processor -- start 2023-10-05T15:16:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 -- start start 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d81019d0 0x7f80d8196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8106c30 0x7f80d819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d819e720 con 0x7f80d8104300 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d819e860 con 0x7f80d81019d0 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dff74700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d819e9f0 con 0x7f80d8106c30 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37016/0 (socket says 172.21.15.60:37016) 2023-10-05T15:16:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 -- 172.21.15.60:0/1606857984 learned_addr learned my addr 172.21.15.60:0/1606857984 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80de511700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8106c30 0x7f80d819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80ddd10700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d81019d0 0x7f80d8196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 -- 172.21.15.60:0/1606857984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8106c30 msgr2=0x7f80d819e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8106c30 0x7f80d819e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 -- 172.21.15.60:0/1606857984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d81019d0 msgr2=0x7f80d8196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d81019d0 0x7f80d8196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.426+0000 7f80dd50f700 1 -- 172.21.15.60:0/1606857984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d40095f0 con 0x7f80d8104300 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.427+0000 7f80dd50f700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81970e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80d40059d0 tx=0x7f80d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:01.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.427+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d401d070 con 0x7f80d8104300 2023-10-05T15:16:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.427+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80d400fc40 con 0x7f80d8104300 2023-10-05T15:16:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.427+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d819ec70 con 0x7f80d8104300 2023-10-05T15:16:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.427+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d40173f0 con 0x7f80d8104300 2023-10-05T15:16:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.427+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d819f090 con 0x7f80d8104300 2023-10-05T15:16:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.428+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80fcf00 con 0x7f80d8104300 2023-10-05T15:16:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.429+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f80d4022470 con 0x7f80d8104300 2023-10-05T15:16:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.430+0000 7f80ceffd700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f80c40a1510 0x7f80c40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.430+0000 7f80ddd10700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f80c40a1510 0x7f80c40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.430+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f80d40ce810 con 0x7f80d8104300 2023-10-05T15:16:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.430+0000 7f80ddd10700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f80c40a1510 0x7f80c40a39d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009bf0 tx=0x7f80c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.433+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80d4097aa0 con 0x7f80d8104300 2023-10-05T15:16:01.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.633+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80d802cf70 con 0x7f80d8104300 2023-10-05T15:16:01.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.633+0000 7f80ceffd700 1 -- 172.21.15.60:0/1606857984 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80d409b0c0 con 0x7f80d8104300 2023-10-05T15:16:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:16:01.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f80c40a1510 msgr2=0x7f80c40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f80c40a1510 0x7f80c40a39d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009bf0 tx=0x7f80c8009260 comp rx=0 tx=0).stop 2023-10-05T15:16:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 msgr2=0x7f80d81970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81970e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80d40059d0 tx=0x7f80d4004730 comp rx=0 tx=0).stop 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 shutdown_connections 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8106c30 0x7f80d819e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80d81019d0 0x7f80d8196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f80c40a1510 0x7f80c40a39d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 --2- 172.21.15.60:0/1606857984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80d8104300 0x7f80d81970e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.635+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 >> 172.21.15.60:0/1606857984 conn(0x7f80d80fb380 msgr2=0x7f80d8102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.636+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 shutdown_connections 2023-10-05T15:16:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.636+0000 7f80dff74700 1 -- 172.21.15.60:0/1606857984 wait complete. 2023-10-05T15:16:01.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:16:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.777+0000 7ff6bf235700 1 -- 172.21.15.60:0/441826617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 msgr2=0x7ff6b8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.777+0000 7ff6bf235700 1 --2- 172.21.15.60:0/441826617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8100480 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009990 tx=0x7ff6a4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- 172.21.15.60:0/441826617 shutdown_connections 2023-10-05T15:16:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 --2- 172.21.15.60:0/441826617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 0x7ff6b8108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 --2- 172.21.15.60:0/441826617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 0x7ff6b8101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 --2- 172.21.15.60:0/441826617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8100480 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- 172.21.15.60:0/441826617 >> 172.21.15.60:0/441826617 conn(0x7ff6b80faab0 msgr2=0x7ff6b80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- 172.21.15.60:0/441826617 shutdown_connections 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- 172.21.15.60:0/441826617 wait complete. 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 Processor -- start 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- start start 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 0x7ff6b8195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 0x7ff6b819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b819d5f0 con 0x7ff6b8100000 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b819d730 con 0x7ff6b81009c0 2023-10-05T15:16:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bf235700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b819d8c0 con 0x7ff6b8101440 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bcfd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bcfd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37028/0 (socket says 172.21.15.60:37028) 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.778+0000 7ff6bcfd1700 1 -- 172.21.15.60:0/3825561522 learned_addr learned my addr 172.21.15.60:0/3825561522 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6b7fff700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 0x7ff6b8195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bd7d2700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 0x7ff6b819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bcfd1700 1 -- 172.21.15.60:0/3825561522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 msgr2=0x7ff6b819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bcfd1700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 0x7ff6b819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bcfd1700 1 -- 172.21.15.60:0/3825561522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 msgr2=0x7ff6b8195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bcfd1700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 0x7ff6b8195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bcfd1700 1 -- 172.21.15.60:0/3825561522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40095f0 con 0x7ff6b8100000 2023-10-05T15:16:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bd7d2700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 0x7ff6b819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6b7fff700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 0x7ff6b8195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bcfd1700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8195a70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00d950 tx=0x7ff6ac00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac009b40 con 0x7ff6b8100000 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b819dba0 con 0x7ff6b8100000 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6ac009ca0 con 0x7ff6b8100000 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00f620 con 0x7ff6b8100000 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.779+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b819e0b0 con 0x7ff6b8100000 2023-10-05T15:16:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.780+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b8106da0 con 0x7ff6b8100000 2023-10-05T15:16:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.781+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff6ac010460 con 0x7ff6b8100000 2023-10-05T15:16:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.782+0000 7ff6b5ffb700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6a80a1510 0x7ff6a80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.782+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7ff6ac0cd570 con 0x7ff6b8100000 2023-10-05T15:16:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.782+0000 7ff6b7fff700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6a80a1510 0x7ff6a80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.783+0000 7ff6b7fff700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6a80a1510 0x7ff6a80a39d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4006010 tx=0x7ff6a400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.786+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff6ac096710 con 0x7ff6b8100000 2023-10-05T15:16:01.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.988+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6b802cf70 con 0x7ff6b8100000 2023-10-05T15:16:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.989+0000 7ff6b5ffb700 1 -- 172.21.15.60:0/3825561522 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6ac099d30 con 0x7ff6b8100000 2023-10-05T15:16:01.991 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6a80a1510 msgr2=0x7ff6a80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6a80a1510 0x7ff6a80a39d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4006010 tx=0x7ff6a400b540 comp rx=0 tx=0).stop 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 msgr2=0x7ff6b8195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8195a70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00d950 tx=0x7ff6ac00dd10 comp rx=0 tx=0).stop 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 shutdown_connections 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b8101440 0x7ff6b819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff6a80a1510 0x7ff6a80a39d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6b8100000 0x7ff6b8195a70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 --2- 172.21.15.60:0/3825561522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6b81009c0 0x7ff6b8195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 >> 172.21.15.60:0/3825561522 conn(0x7ff6b80faab0 msgr2=0x7ff6b80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.991+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 shutdown_connections 2023-10-05T15:16:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:01.992+0000 7ff6bf235700 1 -- 172.21.15.60:0/3825561522 wait complete. 2023-10-05T15:16:02.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:16:02.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 -- 172.21.15.60:0/1665611899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102b10 msgr2=0x7fd64c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 --2- 172.21.15.60:0/1665611899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102b10 0x7fd64c1093c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd644009990 tx=0x7fd644009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 -- 172.21.15.60:0/1665611899 shutdown_connections 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 --2- 172.21.15.60:0/1665611899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102b10 0x7fd64c1093c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 --2- 172.21.15.60:0/1665611899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd64c0ff1a0 0x7fd64c0ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 --2- 172.21.15.60:0/1665611899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c102170 0x7fd64c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 -- 172.21.15.60:0/1665611899 >> 172.21.15.60:0/1665611899 conn(0x7fd64c0faad0 msgr2=0x7fd64c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 -- 172.21.15.60:0/1665611899 shutdown_connections 2023-10-05T15:16:02.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.136+0000 7fd653ca4700 1 -- 172.21.15.60:0/1665611899 wait complete. 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 Processor -- start 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 -- start start 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c0ff1a0 0x7fd64c196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 0x7fd64c197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd64c102b10 0x7fd64c19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c19e6b0 con 0x7fd64c102170 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c19e7f0 con 0x7fd64c102b10 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd653ca4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c19e980 con 0x7fd64c0ff1a0 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 0x7fd64c197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 0x7fd64c197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37044/0 (socket says 172.21.15.60:37044) 2023-10-05T15:16:02.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 -- 172.21.15.60:0/181603026 learned_addr learned my addr 172.21.15.60:0/181603026 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd651a40700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c0ff1a0 0x7fd64c196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd652241700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd64c102b10 0x7fd64c19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 -- 172.21.15.60:0/181603026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c0ff1a0 msgr2=0x7fd64c196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c0ff1a0 0x7fd64c196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 -- 172.21.15.60:0/181603026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd64c102b10 msgr2=0x7fd64c19e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd64c102b10 0x7fd64c19e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 -- 172.21.15.60:0/181603026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440095f0 con 0x7fd64c102170 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd651a40700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c0ff1a0 0x7fd64c196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.137+0000 7fd65123f700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 0x7fd64c197070 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd64000d950 tx=0x7fd64000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.138+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640009b40 con 0x7fd64c102170 2023-10-05T15:16:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.138+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c19ec60 con 0x7fd64c102170 2023-10-05T15:16:02.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.138+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd640009ca0 con 0x7fd64c102170 2023-10-05T15:16:02.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.138+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64000f620 con 0x7fd64c102170 2023-10-05T15:16:02.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.138+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c19f170 con 0x7fd64c102170 2023-10-05T15:16:02.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.139+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c10c6e0 con 0x7fd64c102170 2023-10-05T15:16:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.140+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd640010460 con 0x7fd64c102170 2023-10-05T15:16:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.140+0000 7fd64affd700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6340a1510 0x7fd6340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.140+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fd6400cd530 con 0x7fd64c102170 2023-10-05T15:16:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.141+0000 7fd651a40700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6340a1510 0x7fd6340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.141+0000 7fd651a40700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6340a1510 0x7fd6340a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd64c068ff0 tx=0x7fd63c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.144+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd640096730 con 0x7fd64c102170 2023-10-05T15:16:02.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:02 smithi135 ceph-mon[103360]: pgmap v298: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:16:02.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1349580404' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:02.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1606857984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:02.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:02 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3825561522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:02.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.344+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd64c107e60 con 0x7fd64c102170 2023-10-05T15:16:02.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.345+0000 7fd64affd700 1 -- 172.21.15.60:0/181603026 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd640016020 con 0x7fd64c102170 2023-10-05T15:16:02.347 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6340a1510 msgr2=0x7fd6340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6340a1510 0x7fd6340a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd64c068ff0 tx=0x7fd63c00b040 comp rx=0 tx=0).stop 2023-10-05T15:16:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 msgr2=0x7fd64c197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 0x7fd64c197070 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd64000d950 tx=0x7fd64000dd10 comp rx=0 tx=0).stop 2023-10-05T15:16:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 shutdown_connections 2023-10-05T15:16:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd64c102b10 0x7fd64c19e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd64c0ff1a0 0x7fd64c196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fd6340a1510 0x7fd6340a39d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 --2- 172.21.15.60:0/181603026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd64c102170 0x7fd64c197070 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 >> 172.21.15.60:0/181603026 conn(0x7fd64c0faad0 msgr2=0x7fd64c0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 shutdown_connections 2023-10-05T15:16:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.347+0000 7fd653ca4700 1 -- 172.21.15.60:0/181603026 wait complete. 2023-10-05T15:16:02.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:02 smithi060 ceph-mon[99238]: pgmap v298: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:16:02.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1349580404' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:02.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1606857984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:02.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:02 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3825561522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:02.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:02.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:02 smithi092 ceph-mon[102944]: pgmap v298: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:16:02.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1349580404' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:02.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1606857984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:02.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:02 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3825561522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:02.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 -- 172.21.15.60:0/440182094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0780ffe00 msgr2=0x7fe078100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 --2- 172.21.15.60:0/440182094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0780ffe00 0x7fe078100220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe0680099c0 tx=0x7fe068009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 -- 172.21.15.60:0/440182094 shutdown_connections 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 --2- 172.21.15.60:0/440182094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078101990 0x7fe078108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 --2- 172.21.15.60:0/440182094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0780ffe00 0x7fe078100220 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 --2- 172.21.15.60:0/440182094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078100ff0 0x7fe078101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 -- 172.21.15.60:0/440182094 >> 172.21.15.60:0/440182094 conn(0x7fe0780fb3b0 msgr2=0x7fe0780fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 -- 172.21.15.60:0/440182094 shutdown_connections 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 -- 172.21.15.60:0/440182094 wait complete. 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 Processor -- start 2023-10-05T15:16:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.489+0000 7fe07e606700 1 -- start start 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0780ffe00 0x7fe078196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078100ff0 0x7fe0781971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 0x7fe07819e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07819e7c0 con 0x7fe078101990 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07819e930 con 0x7fe078100ff0 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07819eaf0 con 0x7fe0780ffe00 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 0x7fe07819e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 0x7fe07819e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37060/0 (socket says 172.21.15.60:37060) 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 -- 172.21.15.60:0/1491509939 learned_addr learned my addr 172.21.15.60:0/1491509939 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe077fff700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0780ffe00 0x7fe078196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe0777fe700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078100ff0 0x7fe0781971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 -- 172.21.15.60:0/1491509939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0780ffe00 msgr2=0x7fe078196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0780ffe00 0x7fe078196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 -- 172.21.15.60:0/1491509939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078100ff0 msgr2=0x7fe0781971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078100ff0 0x7fe0781971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 -- 172.21.15.60:0/1491509939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680095f0 con 0x7fe078101990 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe077fff700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0780ffe00 0x7fe078196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe0777fe700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078100ff0 0x7fe0781971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07cba3700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 0x7fe07819e1f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe070007ee0 tx=0x7fe07000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070017070 con 0x7fe078101990 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe07000f040 con 0x7fe078101990 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.490+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07819edd0 con 0x7fe078101990 2023-10-05T15:16:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.491+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070005740 con 0x7fe078101990 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.491+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07819f1d0 con 0x7fe078101990 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.491+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07810b610 con 0x7fe078101990 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.493+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe0700058a0 con 0x7fe078101990 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.493+0000 7fe0757fa700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0640a1510 0x7fe0640a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.493+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fe0700cc9a0 con 0x7fe078101990 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.493+0000 7fe077fff700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0640a1510 0x7fe0640a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.494+0000 7fe077fff700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0640a1510 0x7fe0640a39d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe068006010 tx=0x7fe068000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.498+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe070095ba0 con 0x7fe078101990 2023-10-05T15:16:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.703+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe07819f430 con 0x7fe078101990 2023-10-05T15:16:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.703+0000 7fe0757fa700 1 -- 172.21.15.60:0/1491509939 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe0700991c0 con 0x7fe078101990 2023-10-05T15:16:02.705 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.705+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0640a1510 msgr2=0x7fe0640a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.705+0000 7fe07e606700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0640a1510 0x7fe0640a39d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe068006010 tx=0x7fe068000bc0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.705+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 msgr2=0x7fe07819e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.705+0000 7fe07e606700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 0x7fe07819e1f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe070007ee0 tx=0x7fe07000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 shutdown_connections 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0640a1510 0x7fe0640a39d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078101990 0x7fe07819e1f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0780ffe00 0x7fe078196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 --2- 172.21.15.60:0/1491509939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe078100ff0 0x7fe0781971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 >> 172.21.15.60:0/1491509939 conn(0x7fe0780fb3b0 msgr2=0x7fe078069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 shutdown_connections 2023-10-05T15:16:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.706+0000 7fe07e606700 1 -- 172.21.15.60:0/1491509939 wait complete. 2023-10-05T15:16:02.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 -- 172.21.15.60:0/2860739012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 msgr2=0x7fc440108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 --2- 172.21.15.60:0/2860739012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440108200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc43800b0d0 tx=0x7fc43800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 -- 172.21.15.60:0/2860739012 shutdown_connections 2023-10-05T15:16:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 --2- 172.21.15.60:0/2860739012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440108200 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 --2- 172.21.15.60:0/2860739012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4400ffdc0 0x7fc4401001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 --2- 172.21.15.60:0/2860739012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc440100fb0 0x7fc440101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.844+0000 7fc4478bb700 1 -- 172.21.15.60:0/2860739012 >> 172.21.15.60:0/2860739012 conn(0x7fc4400fb310 msgr2=0x7fc4400fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 -- 172.21.15.60:0/2860739012 shutdown_connections 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 -- 172.21.15.60:0/2860739012 wait complete. 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 Processor -- start 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 -- start start 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4400ffdc0 0x7fc4401945a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc440100fb0 0x7fc440194ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440191130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4401918d0 con 0x7fc440101950 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc440191a40 con 0x7fc4400ffdc0 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.845+0000 7fc4478bb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc440191c00 con 0x7fc440100fb0 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445657700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4400ffdc0 0x7fc4401945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440191130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445657700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4400ffdc0 0x7fc4401945a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:50492/0 (socket says 172.21.15.60:50492) 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445657700 1 -- 172.21.15.60:0/1264704168 learned_addr learned my addr 172.21.15.60:0/1264704168 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc444e56700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc440100fb0 0x7fc440194ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 -- 172.21.15.60:0/1264704168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc440100fb0 msgr2=0x7fc440194ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc440100fb0 0x7fc440194ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 -- 172.21.15.60:0/1264704168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4400ffdc0 msgr2=0x7fc4401945a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4400ffdc0 0x7fc4401945a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 -- 172.21.15.60:0/1264704168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009d00 con 0x7fc440101950 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc445e58700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440191130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc43800b820 tx=0x7fc4380094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800e040 con 0x7fc440101950 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc438012dc0 con 0x7fc440101950 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4401a5370 con 0x7fc440101950 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43801de90 con 0x7fc440101950 2023-10-05T15:16:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.846+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4401a57f0 con 0x7fc440101950 2023-10-05T15:16:02.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.847+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44010b5e0 con 0x7fc440101950 2023-10-05T15:16:02.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.848+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc43801d580 con 0x7fc440101950 2023-10-05T15:16:02.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.849+0000 7fc4367fc700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc42c0a15d0 0x7fc42c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:02.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.849+0000 7fc445657700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc42c0a15d0 0x7fc42c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:02.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.849+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fc4380cef50 con 0x7fc440101950 2023-10-05T15:16:02.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.849+0000 7fc445657700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc42c0a15d0 0x7fc42c0a3a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00ac60 tx=0x7fc43c00a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:02.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:02.853+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc4380981e0 con 0x7fc440101950 2023-10-05T15:16:03.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.108+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4401a5980 con 0x7fc440101950 2023-10-05T15:16:03.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.108+0000 7fc4367fc700 1 -- 172.21.15.60:0/1264704168 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7fc43809b800 con 0x7fc440101950 2023-10-05T15:16:03.111 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:03.111 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc42c0a15d0 msgr2=0x7fc42c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc42c0a15d0 0x7fc42c0a3a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00ac60 tx=0x7fc43c00a3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 msgr2=0x7fc440191130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440191130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc43800b820 tx=0x7fc4380094c0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 shutdown_connections 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc42c0a15d0 0x7fc42c0a3a90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc440101950 0x7fc440191130 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4400ffdc0 0x7fc4401945a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.110+0000 7fc4478bb700 1 --2- 172.21.15.60:0/1264704168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc440100fb0 0x7fc440194ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.111+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 >> 172.21.15.60:0/1264704168 conn(0x7fc4400fb310 msgr2=0x7fc440068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:03.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.111+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 shutdown_connections 2023-10-05T15:16:03.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.111+0000 7fc4478bb700 1 -- 172.21.15.60:0/1264704168 wait complete. 2023-10-05T15:16:03.114 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:03.125 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/4068412409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 msgr2=0x7fdfa0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/4068412409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa0101420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdf940099c0 tx=0x7fdf94009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/4068412409 shutdown_connections 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/4068412409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa0101960 0x7fdfa0108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/4068412409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa00ffdd0 0x7fdfa01001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/4068412409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa0101420 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/4068412409 >> 172.21.15.60:0/4068412409 conn(0x7fdfa00fb300 msgr2=0x7fdfa00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/4068412409 shutdown_connections 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.249+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/4068412409 wait complete. 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 Processor -- start 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 -- start start 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa00ffdd0 0x7fdfa0069c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa0101960 0x7fdfa019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa019e690 con 0x7fdfa0100fc0 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa019e800 con 0x7fdfa00ffdd0 2023-10-05T15:16:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa7dd9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa019e9c0 con 0x7fdfa0101960 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37086/0 (socket says 172.21.15.60:37086) 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5b75700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa00ffdd0 0x7fdfa0069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 -- 172.21.15.60:0/584206838 learned_addr learned my addr 172.21.15.60:0/584206838 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa6376700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa0101960 0x7fdfa019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 -- 172.21.15.60:0/584206838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa0101960 msgr2=0x7fdfa019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa0101960 0x7fdfa019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 -- 172.21.15.60:0/584206838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa00ffdd0 msgr2=0x7fdfa0069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa00ffdd0 0x7fdfa0069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.250+0000 7fdfa5374700 1 -- 172.21.15.60:0/584206838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940095f0 con 0x7fdfa0100fc0 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.251+0000 7fdfa5374700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa019b870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009fd0 tx=0x7fdf9400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.251+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9401d070 con 0x7fdfa0100fc0 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.251+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf94005030 con 0x7fdfa0100fc0 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.251+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94004b30 con 0x7fdfa0100fc0 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.251+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa019ec40 con 0x7fdfa0100fc0 2023-10-05T15:16:03.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.251+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa019f060 con 0x7fdfa0100fc0 2023-10-05T15:16:03.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.252+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa010b650 con 0x7fdfa0100fc0 2023-10-05T15:16:03.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.253+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdf94004cd0 con 0x7fdfa0100fc0 2023-10-05T15:16:03.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.253+0000 7fdf92ffd700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a15d0 0x7fdf8c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.254+0000 7fdfa5b75700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a15d0 0x7fdf8c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.254+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fdf940cdfe0 con 0x7fdfa0100fc0 2023-10-05T15:16:03.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.254+0000 7fdfa5b75700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a15d0 0x7fdf8c0a3a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0100e20 tx=0x7fdf9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:03.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.258+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf94097210 con 0x7fdfa0100fc0 2023-10-05T15:16:03.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:03 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/181603026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:03.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:03 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1491509939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:03.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:03 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/181603026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:03.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:03 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1491509939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:03.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:03 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/181603026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:03.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:03 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1491509939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.461+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfa0106cd0 con 0x7fdfa0100fc0 2023-10-05T15:16:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.462+0000 7fdf92ffd700 1 -- 172.21.15.60:0/584206838 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7fdf9409a830 con 0x7fdfa0100fc0 2023-10-05T15:16:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:03.465 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a15d0 msgr2=0x7fdf8c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a15d0 0x7fdf8c0a3a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0100e20 tx=0x7fdf9c00b410 comp rx=0 tx=0).stop 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 msgr2=0x7fdfa019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa019b870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009fd0 tx=0x7fdf9400f690 comp rx=0 tx=0).stop 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 shutdown_connections 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa0101960 0x7fdfa019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa00ffdd0 0x7fdfa0069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fdf8c0a15d0 0x7fdf8c0a3a90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 --2- 172.21.15.60:0/584206838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfa0100fc0 0x7fdfa019b870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 >> 172.21.15.60:0/584206838 conn(0x7fdfa00fb300 msgr2=0x7fdfa00fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 shutdown_connections 2023-10-05T15:16:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.465+0000 7fdfa7dd9700 1 -- 172.21.15.60:0/584206838 wait complete. 2023-10-05T15:16:03.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 -- 172.21.15.60:0/3494489557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 msgr2=0x7f3bc8101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/3494489557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc8101720 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009990 tx=0x7f3bc4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 -- 172.21.15.60:0/3494489557 shutdown_connections 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/3494489557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc8100910 0x7f3bc8108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/3494489557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc8101720 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/3494489557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 0x7f3bc81003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 -- 172.21.15.60:0/3494489557 >> 172.21.15.60:0/3494489557 conn(0x7f3bc80faac0 msgr2=0x7f3bc80fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 -- 172.21.15.60:0/3494489557 shutdown_connections 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.603+0000 7f3bcf3df700 1 -- 172.21.15.60:0/3494489557 wait complete. 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 Processor -- start 2023-10-05T15:16:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 -- start start 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 0x7f3bc8196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc8100910 0x7f3bc8197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc819e740 con 0x7f3bc8101300 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc819e880 con 0x7f3bc8100910 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcf3df700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc819ea10 con 0x7f3bc80fff50 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcd97c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcd97c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc819e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37102/0 (socket says 172.21.15.60:37102) 2023-10-05T15:16:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.604+0000 7f3bcd97c700 1 -- 172.21.15.60:0/671100215 learned_addr learned my addr 172.21.15.60:0/671100215 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd17b700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 0x7f3bc8196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcc97a700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc8100910 0x7f3bc8197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd97c700 1 -- 172.21.15.60:0/671100215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 msgr2=0x7f3bc8196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd97c700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 0x7f3bc8196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd97c700 1 -- 172.21.15.60:0/671100215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc8100910 msgr2=0x7f3bc8197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd97c700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc8100910 0x7f3bc8197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd97c700 1 -- 172.21.15.60:0/671100215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40095f0 con 0x7f3bc8101300 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd17b700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 0x7f3bc8196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcd97c700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc819e170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007ee0 tx=0x7f3bc000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0017070 con 0x7f3bc8101300 2023-10-05T15:16:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bc000f040 con 0x7f3bc8101300 2023-10-05T15:16:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc819ecf0 con 0x7f3bc8101300 2023-10-05T15:16:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0005740 con 0x7f3bc8101300 2023-10-05T15:16:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.605+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc819f1b0 con 0x7f3bc8101300 2023-10-05T15:16:03.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.606+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc81073c0 con 0x7f3bc8101300 2023-10-05T15:16:03.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.608+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3bc00058a0 con 0x7f3bc8101300 2023-10-05T15:16:03.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.608+0000 7f3bba7fc700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3bb40a15d0 0x7f3bb40a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:03.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.608+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f3bc00cd060 con 0x7f3bc8101300 2023-10-05T15:16:03.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.608+0000 7f3bcd17b700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3bb40a15d0 0x7f3bb40a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:03.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.609+0000 7f3bcd17b700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3bb40a15d0 0x7f3bb40a3a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006010 tx=0x7f3bc400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:03.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.612+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3bc0096260 con 0x7f3bc8101300 2023-10-05T15:16:03.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.858+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bc810c950 con 0x7f3bc8101300 2023-10-05T15:16:03.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.858+0000 7f3bba7fc700 1 -- 172.21.15.60:0/671100215 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7f3bc0099880 con 0x7f3bc8101300 2023-10-05T15:16:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:03.861 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.860+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3bb40a15d0 msgr2=0x7f3bb40a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.860+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3bb40a15d0 0x7f3bb40a3a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006010 tx=0x7f3bc400b540 comp rx=0 tx=0).stop 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 msgr2=0x7f3bc819e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc819e170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007ee0 tx=0x7f3bc000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 shutdown_connections 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f3bb40a15d0 0x7f3bb40a3a90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc8101300 0x7f3bc819e170 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc80fff50 0x7f3bc8196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 --2- 172.21.15.60:0/671100215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc8100910 0x7f3bc8197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 >> 172.21.15.60:0/671100215 conn(0x7f3bc80faac0 msgr2=0x7f3bc8104500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 shutdown_connections 2023-10-05T15:16:03.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:03.861+0000 7f3bcf3df700 1 -- 172.21.15.60:0/671100215 wait complete. 2023-10-05T15:16:03.864 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:03.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-05T15:14:47.613338+0000', 'modified': '2023-10-05T15:15:11.025418+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24533, 'mds_1': 24496, 'mds_2': 24488, 'mds_3': 24472, 'mds_4': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/1500527837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1500527837}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1500527837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6841/1110694579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6840', 'nonce': 1110694579}, {'type': 'v1', 'addr': '172.21.15.60:6841', 'nonce': 1110694579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/3118655820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3118655820}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 3118655820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6833/1259260250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 1259260250}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 1259260250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/4284373269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 4284373269}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 4284373269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.92:6835/2553924574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 2553924574}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2553924574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.135:6837/2461370959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 2461370959}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2461370959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.92:6837/1596160002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 1596160002}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 1596160002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.135:6839/1073230370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1073230370}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1073230370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6839/3541269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3541269}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3541269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-05T15:16:03.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-05T15:16:03.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-05T15:16:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 -- 172.21.15.60:0/1413554320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1019b0 msgr2=0x7efdcc108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 --2- 172.21.15.60:0/1413554320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1019b0 0x7efdcc108240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efdc400b0a0 tx=0x7efdc400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 -- 172.21.15.60:0/1413554320 shutdown_connections 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 --2- 172.21.15.60:0/1413554320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1019b0 0x7efdcc108240 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 --2- 172.21.15.60:0/1413554320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1002e0 0x7efdcc100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 --2- 172.21.15.60:0/1413554320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdcc100ff0 0x7efdcc101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 -- 172.21.15.60:0/1413554320 >> 172.21.15.60:0/1413554320 conn(0x7efdcc0faab0 msgr2=0x7efdcc0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 -- 172.21.15.60:0/1413554320 shutdown_connections 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 -- 172.21.15.60:0/1413554320 wait complete. 2023-10-05T15:16:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.001+0000 7efdd344c700 1 Processor -- start 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 -- start start 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 0x7efdcc0ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdcc100ff0 0x7efdcc19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1019b0 0x7efdcc19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19e810 con 0x7efdcc1002e0 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19e980 con 0x7efdcc100ff0 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd344c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19eb40 con 0x7efdcc1019b0 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 0x7efdcc0ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 0x7efdcc0ffa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37112/0 (socket says 172.21.15.60:37112) 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 -- 172.21.15.60:0/245981036 learned_addr learned my addr 172.21.15.60:0/245981036 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd09e7700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdcc100ff0 0x7efdcc19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd19e9700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1019b0 0x7efdcc19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 -- 172.21.15.60:0/245981036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1019b0 msgr2=0x7efdcc19e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1019b0 0x7efdcc19e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 -- 172.21.15.60:0/245981036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdcc100ff0 msgr2=0x7efdcc19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdcc100ff0 0x7efdcc19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 -- 172.21.15.60:0/245981036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4009d00 con 0x7efdcc1002e0 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd19e9700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1019b0 0x7efdcc19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdd11e8700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 0x7efdcc0ffa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efdc800e970 tx=0x7efdc800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.002+0000 7efdc27fc700 1 -- 172.21.15.60:0/245981036 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8009790 con 0x7efdcc1002e0 2023-10-05T15:16:04.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.003+0000 7efdc27fc700 1 -- 172.21.15.60:0/245981036 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdc80044e0 con 0x7efdcc1002e0 2023-10-05T15:16:04.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.003+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc19ee20 con 0x7efdcc1002e0 2023-10-05T15:16:04.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.003+0000 7efdc27fc700 1 -- 172.21.15.60:0/245981036 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8003e30 con 0x7efdcc1002e0 2023-10-05T15:16:04.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.003+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc19f240 con 0x7efdcc1002e0 2023-10-05T15:16:04.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.005+0000 7efdc27fc700 1 -- 172.21.15.60:0/245981036 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7efdc8004000 con 0x7efdcc1002e0 2023-10-05T15:16:04.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.005+0000 7efdc27fc700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efdb80a1510 0x7efdb80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.005+0000 7efdd09e7700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efdb80a1510 0x7efdb80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.005+0000 7efdc27fc700 1 -- 172.21.15.60:0/245981036 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efdc8014070 con 0x7efdcc1002e0 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.006+0000 7efdd09e7700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efdb80a1510 0x7efdb80a39d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdcc100000 tx=0x7efdbc00bef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.006+0000 7efddf636b80 1 Processor -- start 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.006+0000 7efddf636b80 1 -- start start 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.006+0000 7efddf636b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75210 0x55c95fc75630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.006+0000 7efddf636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc76430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.006+0000 7efddf636b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 0x55c95fc76e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efddf636b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fbdd410 con 0x55c95fc76a10 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efddf636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fbcebd0 con 0x55c95fc75b70 2023-10-05T15:16:04.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efddf636b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fbcc4f0 con 0x55c95fc75210 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 0x55c95fc76e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 0x55c95fc76e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37124/0 (socket says 172.21.15.60:37124) 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 -- 172.21.15.60:0/3468748226 learned_addr learned my addr 172.21.15.60:0/3468748226 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd09e7700 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc76430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd11e8700 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75210 0x55c95fc75630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 -- 172.21.15.60:0/3468748226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75210 msgr2=0x55c95fc75630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75210 0x55c95fc75630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 -- 172.21.15.60:0/3468748226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 msgr2=0x55c95fc76430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc76430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 -- 172.21.15.60:0/3468748226 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c95f9f2d90 con 0x55c95fc76a10 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdd19e9700 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 0x55c95fc76e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009c80 tx=0x7efdc40092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176b04390818bd26 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdb77fe700 1 -- 172.21.15.60:0/3468748226 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc400e040 con 0x55c95fc76a10 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdb77fe700 1 -- 172.21.15.60:0/3468748226 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdc400ba50 con 0x55c95fc76a10 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.007+0000 7efdb77fe700 1 -- 172.21.15.60:0/3468748226 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc401d6d0 con 0x55c95fc76a10 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 -- 172.21.15.60:0/3468748226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 msgr2=0x55c95fc76e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 0x55c95fc76e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009c80 tx=0x7efdc40092e0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 -- 172.21.15.60:0/3468748226 shutdown_connections 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc76a10 0x55c95fc76e90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75210 0x55c95fc75630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 --2- 172.21.15.60:0/3468748226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc76430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 -- 172.21.15.60:0/3468748226 >> 172.21.15.60:0/3468748226 conn(0x55c95fbe9210 msgr2=0x55c95fc700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 -- 172.21.15.60:0/3468748226 shutdown_connections 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 -- 172.21.15.60:0/3468748226 wait complete. 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.008+0000 7efddf636b80 1 -- start start 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 Processor -- start 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc7f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc76a10 0x55c95fc864b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fbc7de0 con 0x55c95fc75210 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fb646c0 con 0x55c95fc75b70 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fb64360 con 0x55c95fc76a10 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efddf636b80 10 client.0 _ll_register_callbacks cb 0x55c95f9c17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd09e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc7f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37126/0 (socket says 172.21.15.60:37126) 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd11e8700 1 -- 172.21.15.60:0/1306789732 learned_addr learned my addr 172.21.15.60:0/1306789732 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd19e9700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc76a10 0x55c95fc864b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd11e8700 1 -- 172.21.15.60:0/1306789732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc76a10 msgr2=0x55c95fc864b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd11e8700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc76a10 0x55c95fc864b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.009+0000 7efdd11e8700 1 -- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 msgr2=0x55c95fc7f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdd11e8700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc7f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdd11e8700 1 -- 172.21.15.60:0/1306789732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc108b70 con 0x55c95fc75210 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdd09e7700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc7f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdd11e8700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7ef30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efdc80960c0 tx=0x7efdc8099d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceedec23909fd182 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdb4ff9700 1 -- 172.21.15.60:0/1306789732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc809e490 con 0x55c95fc75210 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdb4ff9700 1 -- 172.21.15.60:0/1306789732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efdc80a26d0 con 0x55c95fc75210 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c95fc67ec0 con 0x55c95fc75210 2023-10-05T15:16:04.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdb4ff9700 1 -- 172.21.15.60:0/1306789732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdc800cbd0 con 0x55c95fc75210 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 10 client.15186 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c95f9dbc10 con 0x55c95fc75210 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdb4ff9700 1 -- 172.21.15.60:0/1306789732 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c95fc67ec0 con 0x55c95fc75210 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efdb4ff9700 1 -- 172.21.15.60:0/1306789732 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efdc809e150 con 0x55c95fc75210 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 10 client.15186 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 10 client.15186 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 20 client.15186 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fc8ab50 0x55c95fc89660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 4 client.15186 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.010+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c95fbc0dc0 con 0x55c95fc8ab50 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.011+0000 7efdd09e7700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fc8ab50 0x55c95fc89660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.011+0000 7efdb4ff9700 10 client.15186 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.011+0000 7efdd09e7700 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fc8ab50 0x55c95fc89660 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=79026d143886c9cc server_cookie=338f772551715987 in_seq=0 out_seq=0 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efdb4ff9700 1 -- 172.21.15.60:0/1306789732 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c95fbc0dc0 con 0x55c95fc8ab50 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efdb4ff9700 10 client.15186 handle_command_reply: tid=0 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 client.15186 shutdown 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 msgr2=0x55c95fc7ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7ef30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efdc80960c0 tx=0x7efdc8099d70 comp rx=0 tx=0).stop 2023-10-05T15:16:04.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 shutdown_connections 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc76a10 0x55c95fc864b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fc8ab50 0x55c95fc89660 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7ef30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efdb4ff9700 0 client.15186 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 --2- 172.21.15.60:0/1306789732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc75b70 0x55c95fc7f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 >> 172.21.15.60:0/1306789732 conn(0x55c95fbe9210 msgr2=0x55c95fc6ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 shutdown_connections 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 1 -- 172.21.15.60:0/1306789732 wait complete. 2023-10-05T15:16:04.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.012+0000 7efddf636b80 20 client.15186 trim_cache size 0 max 16384 2023-10-05T15:16:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 Processor -- start 2023-10-05T15:16:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 -- start start 2023-10-05T15:16:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc86c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc86440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc7cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fa488d0 con 0x55c95fc75210 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fbc9070 con 0x55c95fc76a10 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efddf636b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fb6e4d0 con 0x55c95fc75b70 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc86c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc86c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37134/0 (socket says 172.21.15.60:37134) 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 -- 172.21.15.60:0/1574998441 learned_addr learned my addr 172.21.15.60:0/1574998441 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd09e7700 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc86440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 -- 172.21.15.60:0/1574998441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 msgr2=0x55c95fc86440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc86440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 -- 172.21.15.60:0/1574998441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 msgr2=0x55c95fc7cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd19e9700 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc7cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc7cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 -- 172.21.15.60:0/1574998441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c95fa19200 con 0x55c95fc75210 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd09e7700 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc86440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.030+0000 7efdd11e8700 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc86c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efdc809a2d0 tx=0x7efdc809a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293d1d23b194445c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efdb7fff700 1 -- 172.21.15.60:0/1574998441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc80caec0 con 0x55c95fc75210 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efdb7fff700 1 -- 172.21.15.60:0/1574998441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdc80cc040 con 0x55c95fc75210 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efdb7fff700 1 -- 172.21.15.60:0/1574998441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc80986e0 con 0x55c95fc75210 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 -- 172.21.15.60:0/1574998441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 msgr2=0x55c95fc86c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc86c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efdc809a2d0 tx=0x7efdc809a4c0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 -- 172.21.15.60:0/1574998441 shutdown_connections 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc7cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc86c80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 --2- 172.21.15.60:0/1574998441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc86440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 -- 172.21.15.60:0/1574998441 >> 172.21.15.60:0/1574998441 conn(0x55c95fbe9210 msgr2=0x55c95fc7dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 -- 172.21.15.60:0/1574998441 shutdown_connections 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.031+0000 7efddf636b80 1 -- 172.21.15.60:0/1574998441 wait complete. 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 -- start start 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 Processor -- start 2023-10-05T15:16:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc85410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc85a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fc86110 con 0x55c95fc75210 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fc86280 con 0x55c95fc76a10 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95fc86440 con 0x55c95fc75b70 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efddf636b80 10 client.0 _ll_register_callbacks cb 0x55c95f9c17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37140/0 (socket says 172.21.15.60:37140) 2023-10-05T15:16:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 -- 172.21.15.60:0/2580553937 learned_addr learned my addr 172.21.15.60:0/2580553937 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd09e7700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc85410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd19e9700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc85a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 -- 172.21.15.60:0/2580553937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 msgr2=0x55c95fc85410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc85410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 -- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 msgr2=0x55c95fc85a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc85a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.032+0000 7efdd11e8700 1 -- 172.21.15.60:0/2580553937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c95f9dbc10 con 0x55c95fc75210 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdd09e7700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc85410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdd19e9700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc85a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdd11e8700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7f460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efdc8098690 tx=0x7efdc8099cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814e8cd592c84665 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdb4ff9700 1 -- 172.21.15.60:0/2580553937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800cbd0 con 0x55c95fc75210 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdb4ff9700 1 -- 172.21.15.60:0/2580553937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efdc80cae20 con 0x55c95fc75210 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efdc400ba50 con 0x55c95fc75210 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdb4ff9700 1 -- 172.21.15.60:0/2580553937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdc80cd230 con 0x55c95fc75210 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 10 client.15192 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c95f9f1260 con 0x55c95fc75210 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdb4ff9700 1 -- 172.21.15.60:0/2580553937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdc8087080 con 0x55c95fc75210 2023-10-05T15:16:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efdb4ff9700 1 -- 172.21.15.60:0/2580553937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efdc80993c0 con 0x55c95fc75210 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 10 client.15192 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 10 client.15192 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 20 client.15192 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.033+0000 7efddf636b80 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fce29d0 0x55c95fcdf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 4 client.15192 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c95fbc0ae0 con 0x55c95fce29d0 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efdd09e7700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fce29d0 0x55c95fcdf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efdb4ff9700 10 client.15192 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efdd09e7700 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fce29d0 0x55c95fcdf1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=eb3a6329dfa2eb90 server_cookie=5c24f3b98b67c53c in_seq=0 out_seq=0 2023-10-05T15:16:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efdb4ff9700 1 -- 172.21.15.60:0/2580553937 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55c95fbc0ae0 con 0x55c95fce29d0 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efdb4ff9700 10 client.15192 handle_command_reply: tid=0 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 client.15192 shutdown 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 msgr2=0x55c95fc7f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7f460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efdc8098690 tx=0x7efdc8099cf0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 shutdown_connections 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95fc76a10 0x55c95fc85a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.034+0000 7efddf636b80 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55c95fce29d0 0x55c95fcdf1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efddf636b80 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c95fc75210 0x55c95fc7f460 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdb4ff9700 0 client.15192 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efddf636b80 1 --2- 172.21.15.60:0/2580553937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c95fc75b70 0x55c95fc85410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 >> 172.21.15.60:0/2580553937 conn(0x55c95fbe9210 msgr2=0x55c95fc7cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 shutdown_connections 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efddf636b80 1 -- 172.21.15.60:0/2580553937 wait complete. 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efddf636b80 20 client.15192 trim_cache size 0 max 16384 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 4, 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24461, 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 53.715558539, 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 97.220925323000003 2023-10-05T15:16:04.047 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efdb80a1510 msgr2=0x7efdb80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efdb80a1510 0x7efdb80a39d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdcc100000 tx=0x7efdbc00bef0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 msgr2=0x7efdcc0ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 0x7efdcc0ffa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efdc800e970 tx=0x7efdc800ed30 comp rx=0 tx=0).stop 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 shutdown_connections 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc1019b0 0x7efdcc19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efdb80a1510 0x7efdb80a39d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdcc1002e0 0x7efdcc0ffa00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 --2- 172.21.15.60:0/245981036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdcc100ff0 0x7efdcc19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 >> 172.21.15.60:0/245981036 conn(0x7efdcc0faab0 msgr2=0x7efdcc0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 shutdown_connections 2023-10-05T15:16:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.035+0000 7efdd344c700 1 -- 172.21.15.60:0/245981036 wait complete. 2023-10-05T15:16:04.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-05T15:16:04.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1264704168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:04 smithi060 ceph-mon[99238]: pgmap v299: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:16:04.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/584206838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:04 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/671100215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 -- 172.21.15.60:0/1494034676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91680ffdc0 msgr2=0x7f91681001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 --2- 172.21.15.60:0/1494034676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91680ffdc0 0x7f91681001e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f91640099c0 tx=0x7f9164009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 -- 172.21.15.60:0/1494034676 shutdown_connections 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 --2- 172.21.15.60:0/1494034676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9168101950 0x7f9168108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 --2- 172.21.15.60:0/1494034676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91680ffdc0 0x7f91681001e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 --2- 172.21.15.60:0/1494034676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9168100fb0 0x7f9168101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.176+0000 7f916f5cf700 1 -- 172.21.15.60:0/1494034676 >> 172.21.15.60:0/1494034676 conn(0x7f91680fb330 msgr2=0x7f91680fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 -- 172.21.15.60:0/1494034676 shutdown_connections 2023-10-05T15:16:04.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 -- 172.21.15.60:0/1494034676 wait complete. 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 Processor -- start 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 -- start start 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91680ffdc0 0x7f9168195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 0x7f9168196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9168101950 0x7f916819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916819d650 con 0x7f9168100fb0 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916819d790 con 0x7f9168101950 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916f5cf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916819d920 con 0x7f91680ffdc0 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.177+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 0x7f9168196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 0x7f9168196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37156/0 (socket says 172.21.15.60:37156) 2023-10-05T15:16:04.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 -- 172.21.15.60:0/849227236 learned_addr learned my addr 172.21.15.60:0/849227236 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916d36b700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91680ffdc0 0x7f9168195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916db6c700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9168101950 0x7f916819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 -- 172.21.15.60:0/849227236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91680ffdc0 msgr2=0x7f9168195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91680ffdc0 0x7f9168195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 -- 172.21.15.60:0/849227236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9168101950 msgr2=0x7f916819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9168101950 0x7f916819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 -- 172.21.15.60:0/849227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640095f0 con 0x7f9168100fb0 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916cb6a700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 0x7f9168196010 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f915800c920 tx=0x7f915800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f915e7fc700 1 -- 172.21.15.60:0/849227236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158004a30 con 0x7f9168100fb0 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916819dc00 con 0x7f9168100fb0 2023-10-05T15:16:04.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f915e7fc700 1 -- 172.21.15.60:0/849227236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91580054e0 con 0x7f9168100fb0 2023-10-05T15:16:04.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f915e7fc700 1 -- 172.21.15.60:0/849227236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158007c10 con 0x7f9168100fb0 2023-10-05T15:16:04.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.178+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916819e110 con 0x7f9168100fb0 2023-10-05T15:16:04.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.180+0000 7f915e7fc700 1 -- 172.21.15.60:0/849227236 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f9158005000 con 0x7f9168100fb0 2023-10-05T15:16:04.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.181+0000 7f915e7fc700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f91540a1510 0x7f91540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.181+0000 7f915e7fc700 1 -- 172.21.15.60:0/849227236 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f91580cd0e0 con 0x7f9168100fb0 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.181+0000 7f916d36b700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f91540a1510 0x7f91540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.181+0000 7f916d36b700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f91540a1510 0x7f91540a39d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9164009f50 tx=0x7f916400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 Processor -- start 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 -- start start 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd01840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd02640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbc67410 con 0x55cbcbd02c20 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbc58bd0 con 0x55cbcbd01d80 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.182+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbc564f0 con 0x55cbcbd01420 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916db6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd02640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916db6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37166/0 (socket says 172.21.15.60:37166) 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916db6c700 1 -- 172.21.15.60:0/242855117 learned_addr learned my addr 172.21.15.60:0/242855117 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916d36b700 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd01840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 -- 172.21.15.60:0/242855117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 msgr2=0x55cbcbd01840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd01840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 -- 172.21.15.60:0/242855117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 msgr2=0x55cbcbd030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 -- 172.21.15.60:0/242855117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbcba7cd90 con 0x55cbcbd01d80 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916db6c700 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f916cb6a700 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd02640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91580ca730 tx=0x7f9158099910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ddf0baa45a508 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f91537fe700 1 -- 172.21.15.60:0/242855117 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915809e090 con 0x55cbcbd01d80 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f91537fe700 1 -- 172.21.15.60:0/242855117 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91580a22d0 con 0x55cbcbd01d80 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.183+0000 7f91537fe700 1 -- 172.21.15.60:0/242855117 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580ca980 con 0x55cbcbd01d80 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 -- 172.21.15.60:0/242855117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 msgr2=0x55cbcbd02640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd02640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91580ca730 tx=0x7f9158099910 comp rx=0 tx=0).stop 2023-10-05T15:16:04.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 -- 172.21.15.60:0/242855117 shutdown_connections 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd01840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/242855117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd02640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 -- 172.21.15.60:0/242855117 >> 172.21.15.60:0/242855117 conn(0x55cbcbc73210 msgr2=0x55cbcbcfa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 -- 172.21.15.60:0/242855117 shutdown_connections 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.184+0000 7f917b7b9b80 1 -- 172.21.15.60:0/242855117 wait complete. 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 -- start start 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 Processor -- start 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd02c20 0x55cbcbd12730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbc51de0 con 0x55cbcbd01d80 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbbee6c0 con 0x55cbcbd02c20 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbbee360 con 0x55cbcbd01420 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f917b7b9b80 10 client.0 _ll_register_callbacks cb 0x55cbcba4b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37170/0 (socket says 172.21.15.60:37170) 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f916cb6a700 1 -- 172.21.15.60:0/2668746435 learned_addr learned my addr 172.21.15.60:0/2668746435 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.185+0000 7f916db6c700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd02c20 0x55cbcbd12730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916d36b700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916cb6a700 1 -- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 msgr2=0x55cbcbd0b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916cb6a700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916cb6a700 1 -- 172.21.15.60:0/2668746435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd02c20 msgr2=0x55cbcbd12730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916cb6a700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd02c20 0x55cbcbd12730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916cb6a700 1 -- 172.21.15.60:0/2668746435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9160003c50 con 0x55cbcbd01d80 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f916cb6a700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0b6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9158099c40 tx=0x7f9158000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb6fa4122f760c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f9150ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f9150ff9700 1 -- 172.21.15.60:0/2668746435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158004b90 con 0x55cbcbd01d80 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbcbcf1ec0 con 0x55cbcbd01d80 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f9150ff9700 1 -- 172.21.15.60:0/2668746435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f91580ca980 con 0x55cbcbd01d80 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f9150ff9700 1 -- 172.21.15.60:0/2668746435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f915809a1a0 con 0x55cbcbd01d80 2023-10-05T15:16:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f917b7b9b80 10 client.15204 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f916819e110 con 0x55cbcbd01d80 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.186+0000 7f9150ff9700 1 -- 172.21.15.60:0/2668746435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cbcbcf1ec0 con 0x55cbcbd01d80 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f9150ff9700 1 -- 172.21.15.60:0/2668746435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f91580add20 con 0x55cbcbd01d80 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f917b7b9b80 10 client.15204 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f917b7b9b80 10 client.15204 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f917b7b9b80 20 client.15204 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd16930 0x55cbcbd15660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f917b7b9b80 4 client.15204 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbcbc4adc0 con 0x55cbcbd16930 2023-10-05T15:16:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f916d36b700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd16930 0x55cbcbd15660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f916d36b700 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd16930 0x55cbcbd15660 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2a9dcb4d90a61bea server_cookie=6e1881815d5c6d1c in_seq=0 out_seq=0 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.187+0000 7f9150ff9700 10 client.15204 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f9150ff9700 1 -- 172.21.15.60:0/2668746435 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cbcbc4adc0 con 0x55cbcbd16930 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f9150ff9700 10 client.15204 handle_command_reply: tid=0 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 client.15204 shutdown 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 msgr2=0x55cbcbd0b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0b6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9158099c40 tx=0x7f9158000bc0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 shutdown_connections 2023-10-05T15:16:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd16930 0x55cbcbd15660 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd02c20 0x55cbcbd12730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f9150ff9700 0 client.15204 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/2668746435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0b6f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 >> 172.21.15.60:0/2668746435 conn(0x55cbcbc73210 msgr2=0x55cbcbcf9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 shutdown_connections 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.188+0000 7f917b7b9b80 1 -- 172.21.15.60:0/2668746435 wait complete. 2023-10-05T15:16:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.189+0000 7f917b7b9b80 20 client.15204 trim_cache size 0 max 16384 2023-10-05T15:16:04.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.206+0000 7f917b7b9b80 1 Processor -- start 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.206+0000 7f917b7b9b80 1 -- start start 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.206+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01420 0x55cbcbcf9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.206+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd126f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd02c20 0x55cbcbd09e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbad28d0 con 0x55cbcbd01d80 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbc4adc0 con 0x55cbcbd01420 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbcf9290 con 0x55cbcbd02c20 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37178/0 (socket says 172.21.15.60:37178) 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 -- 172.21.15.60:0/1209812311 learned_addr learned my addr 172.21.15.60:0/1209812311 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916d36b700 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01420 0x55cbcbcf9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916db6c700 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd02c20 0x55cbcbd09e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 -- 172.21.15.60:0/1209812311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd02c20 msgr2=0x55cbcbd09e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd02c20 0x55cbcbd09e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 -- 172.21.15.60:0/1209812311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01420 msgr2=0x55cbcbcf9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01420 0x55cbcbcf9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 -- 172.21.15.60:0/1209812311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbcba65c10 con 0x55cbcbd01d80 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f916cb6a700 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd126f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9158099ed0 tx=0x7f9158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ff5f659da5f1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f9153fff700 1 -- 172.21.15.60:0/1209812311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915809e110 con 0x55cbcbd01d80 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f9153fff700 1 -- 172.21.15.60:0/1209812311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91580998a0 con 0x55cbcbd01d80 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.207+0000 7f9153fff700 1 -- 172.21.15.60:0/1209812311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158004b90 con 0x55cbcbd01d80 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 -- 172.21.15.60:0/1209812311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 msgr2=0x55cbcbd126f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd126f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9158099ed0 tx=0x7f9158004750 comp rx=0 tx=0).stop 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 -- 172.21.15.60:0/1209812311 shutdown_connections 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd02c20 0x55cbcbd09e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01420 0x55cbcbcf9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/1209812311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd01d80 0x55cbcbd126f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 -- 172.21.15.60:0/1209812311 >> 172.21.15.60:0/1209812311 conn(0x55cbcbc73210 msgr2=0x55cbcbd1f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 -- 172.21.15.60:0/1209812311 shutdown_connections 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 -- 172.21.15.60:0/1209812311 wait complete. 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 -- start start 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.208+0000 7f917b7b9b80 1 Processor -- start 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd11e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbd123a0 con 0x55cbcbd02c20 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbd12510 con 0x55cbcbd01d80 2023-10-05T15:16:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbcbd126d0 con 0x55cbcbd01420 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 10 client.0 _ll_register_callbacks cb 0x7f9160003a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd11e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd11e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37186/0 (socket says 172.21.15.60:37186) 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 -- 172.21.15.60:0/3253525366 learned_addr learned my addr 172.21.15.60:0/3253525366 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916cb6a700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916d36b700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 -- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 msgr2=0x55cbcbd0e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 -- 172.21.15.60:0/3253525366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 msgr2=0x55cbcbd0ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 -- 172.21.15.60:0/3253525366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916819e110 con 0x55cbcbd02c20 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f916db6c700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd11e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9160003c20 tx=0x7f91600077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6a5811b7cfbd83 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f9150ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f9150ff9700 1 -- 172.21.15.60:0/3253525366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160004db0 con 0x55cbcbd02c20 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f9150ff9700 1 -- 172.21.15.60:0/3253525366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f9160018630 con 0x55cbcbd02c20 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.209+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91580a22d0 con 0x55cbcbd02c20 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f9150ff9700 1 -- 172.21.15.60:0/3253525366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9160007e60 con 0x55cbcbd02c20 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 10 client.15210 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cbcbaa3200 con 0x55cbcbd02c20 2023-10-05T15:16:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f9150ff9700 1 -- 172.21.15.60:0/3253525366 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91580a22d0 con 0x55cbcbd02c20 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f9150ff9700 1 -- 172.21.15.60:0/3253525366 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9160020a30 con 0x55cbcbd02c20 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 10 client.15210 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 10 client.15210 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 20 client.15210 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd6f100 0x55cbcbd6b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 4 client.15210 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cbcbc4aae0 con 0x55cbcbd6f100 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.210+0000 7f916d36b700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd6f100 0x55cbcbd6b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f916d36b700 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd6f100 0x55cbcbd6b5a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e684dd169f8e2a98 server_cookie=3256d5bafc792ffd in_seq=0 out_seq=0 2023-10-05T15:16:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f9150ff9700 10 client.15210 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f9150ff9700 1 -- 172.21.15.60:0/3253525366 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cbcbc4aae0 con 0x55cbcbd6f100 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f9150ff9700 10 client.15210 handle_command_reply: tid=0 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 client.15210 shutdown 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 msgr2=0x55cbcbd11e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd11e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9160003c20 tx=0x7f91600077d0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 shutdown_connections 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55cbcbd6f100 0x55cbcbd6b5a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbcbd02c20 0x55cbcbd11e60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cbcbd01420 0x55cbcbd0e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f9150ff9700 0 client.15210 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:04.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 --2- 172.21.15.60:0/3253525366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbcbd01d80 0x55cbcbd0ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 >> 172.21.15.60:0/3253525366 conn(0x55cbcbc73210 msgr2=0x55cbcbd15660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 shutdown_connections 2023-10-05T15:16:04.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 1 -- 172.21.15.60:0/3253525366 wait complete. 2023-10-05T15:16:04.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.211+0000 7f917b7b9b80 20 client.15210 trim_cache size 0 max 16384 2023-10-05T15:16:04.222 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 3, 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24472, 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 54.902271898000002, 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:04.223 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 92.856277614000007 2023-10-05T15:16:04.224 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:04.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f91540a1510 msgr2=0x7f91540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f91540a1510 0x7f91540a39d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9164009f50 tx=0x7f916400b540 comp rx=0 tx=0).stop 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 msgr2=0x7f9168196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 0x7f9168196010 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f915800c920 tx=0x7f915800cc30 comp rx=0 tx=0).stop 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 shutdown_connections 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9168101950 0x7f916819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91680ffdc0 0x7f9168195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f91540a1510 0x7f91540a39d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 --2- 172.21.15.60:0/849227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9168100fb0 0x7f9168196010 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 >> 172.21.15.60:0/849227236 conn(0x7f91680fb330 msgr2=0x7f91680fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 shutdown_connections 2023-10-05T15:16:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.212+0000 7f916f5cf700 1 -- 172.21.15.60:0/849227236 wait complete. 2023-10-05T15:16:04.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-05T15:16:04.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1264704168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:04 smithi135 ceph-mon[103360]: pgmap v299: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:16:04.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/584206838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:04 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/671100215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.353+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/4149328511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 msgr2=0x7f0f64101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.353+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/4149328511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f64101410 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0f500099c0 tx=0x7f0f50009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.353+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/4149328511 shutdown_connections 2023-10-05T15:16:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.353+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/4149328511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 0x7f0f64108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/4149328511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f640ffdc0 0x7f0f641001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/4149328511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f64101410 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/4149328511 >> 172.21.15.60:0/4149328511 conn(0x7f0f640fb330 msgr2=0x7f0f640fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/4149328511 shutdown_connections 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/4149328511 wait complete. 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 Processor -- start 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- start start 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f640ffdc0 0x7f0f64068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f6419ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 0x7f0f641a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641a09c0 con 0x7f0f64100fb0 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641a0b30 con 0x7f0f64101950 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f6ae1c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641a0cf0 con 0x7f0f640ffdc0 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f6419ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f6419ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37198/0 (socket says 172.21.15.60:37198) 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.354+0000 7f0f63fff700 1 -- 172.21.15.60:0/767741130 learned_addr learned my addr 172.21.15.60:0/767741130 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f640ffdc0 0x7f0f64068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f693b9700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 0x7f0f641a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f63fff700 1 -- 172.21.15.60:0/767741130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f640ffdc0 msgr2=0x7f0f64068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f63fff700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f640ffdc0 0x7f0f64068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f63fff700 1 -- 172.21.15.60:0/767741130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 msgr2=0x7f0f641a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f63fff700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 0x7f0f641a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f63fff700 1 -- 172.21.15.60:0/767741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500095f0 con 0x7f0f64100fb0 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f693b9700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 0x7f0f641a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f63fff700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f6419ddc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009990 tx=0x7f0f50003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f61ffb700 1 -- 172.21.15.60:0/767741130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5001d070 con 0x7f0f64100fb0 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f61ffb700 1 -- 172.21.15.60:0/767741130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f50004640 con 0x7f0f64100fb0 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f641a0f70 con 0x7f0f64100fb0 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f61ffb700 1 -- 172.21.15.60:0/767741130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000f460 con 0x7f0f64100fb0 2023-10-05T15:16:04.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.355+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f641a1390 con 0x7f0f64100fb0 2023-10-05T15:16:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.357+0000 7f0f61ffb700 1 -- 172.21.15.60:0/767741130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0f50022470 con 0x7f0f64100fb0 2023-10-05T15:16:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.358+0000 7f0f61ffb700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0f540a1510 0x7f0f540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.358+0000 7f0f61ffb700 1 -- 172.21.15.60:0/767741130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0f500ce7f0 con 0x7f0f64100fb0 2023-10-05T15:16:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.358+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0f540a1510 0x7f0f540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0f540a1510 0x7f0f540a39d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006fd0 tx=0x7f0f58008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 Processor -- start 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 -- start start 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488a210 0x56519488a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 0x56519488b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519488be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651947f2410 con 0x56519488ab70 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651947e3bd0 con 0x56519488a210 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f77006b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651947e14f0 con 0x56519488ba10 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 0x56519488b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 0x56519488b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37206/0 (socket says 172.21.15.60:37206) 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.359+0000 7f0f63fff700 1 -- 172.21.15.60:0/2704522788 learned_addr learned my addr 172.21.15.60:0/2704522788 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488a210 0x56519488a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f693b9700 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519488be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f63fff700 1 -- 172.21.15.60:0/2704522788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 msgr2=0x56519488be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519488be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f63fff700 1 -- 172.21.15.60:0/2704522788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488a210 msgr2=0x56519488a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488a210 0x56519488a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f63fff700 1 -- 172.21.15.60:0/2704522788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565194607d90 con 0x56519488ab70 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488a210 0x56519488a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 0x56519488b430 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f50006010 tx=0x7f0f500059a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53501b6e1369f7f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f4effd700 1 -- 172.21.15.60:0/2704522788 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5009f9b0 con 0x56519488ab70 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f4effd700 1 -- 172.21.15.60:0/2704522788 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f500a3b60 con 0x56519488ab70 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.360+0000 7f0f4effd700 1 -- 172.21.15.60:0/2704522788 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5009afb0 con 0x56519488ab70 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 -- 172.21.15.60:0/2704522788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 msgr2=0x56519488b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 0x56519488b430 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f50006010 tx=0x7f0f500059a0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 -- 172.21.15.60:0/2704522788 shutdown_connections 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519488be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488a210 0x56519488a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2704522788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ab70 0x56519488b430 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 -- 172.21.15.60:0/2704522788 >> 172.21.15.60:0/2704522788 conn(0x5651947fe210 msgr2=0x5651948850f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 -- 172.21.15.60:0/2704522788 shutdown_connections 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 -- 172.21.15.60:0/2704522788 wait complete. 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 -- start start 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.361+0000 7f0f77006b80 1 Processor -- start 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194893bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x5651948940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519489b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651947dcde0 con 0x56519488a210 2023-10-05T15:16:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651947796c0 con 0x56519488ab70 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x565194779360 con 0x56519488ba10 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 10 client.0 _ll_register_callbacks cb 0x5651945d67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194893bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194893bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37210/0 (socket says 172.21.15.60:37210) 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 -- 172.21.15.60:0/2789347190 learned_addr learned my addr 172.21.15.60:0/2789347190 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f693b9700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519489b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x5651948940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 -- 172.21.15.60:0/2789347190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 msgr2=0x56519489b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519489b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 -- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 msgr2=0x5651948940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x5651948940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 -- 172.21.15.60:0/2789347190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f641a1390 con 0x56519488a210 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x5651948940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194893bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800dcf0 tx=0x7f0f58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec3dc1cbe41ef99 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f43fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f43fff700 1 -- 172.21.15.60:0/2789347190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58014c50 con 0x56519488a210 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f43fff700 1 -- 172.21.15.60:0/2789347190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0f58014db0 con 0x56519488a210 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.362+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56519487cec0 con 0x56519488a210 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f43fff700 1 -- 172.21.15.60:0/2789347190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f58020420 con 0x56519488a210 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 10 client.15222 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5651945f0c10 con 0x56519488a210 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f43fff700 1 -- 172.21.15.60:0/2789347190 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56519487cec0 con 0x56519488a210 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f43fff700 1 -- 172.21.15.60:0/2789347190 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0f58012640 con 0x56519488a210 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 10 client.15222 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 10 client.15222 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 20 client.15222 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x56519489f840 0x56519489e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 4 client.15222 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651947d5dc0 con 0x56519489f840 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.363+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x56519489f840 0x56519489e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.364+0000 7f0f43fff700 10 client.15222 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.364+0000 7f0f63fff700 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x56519489f840 0x56519489e280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91ad70f1dcf0dced server_cookie=b2f7bfc082bfb3e9 in_seq=0 out_seq=0 2023-10-05T15:16:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.364+0000 7f0f43fff700 1 -- 172.21.15.60:0/2789347190 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651947d5dc0 con 0x56519489f840 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.364+0000 7f0f43fff700 10 client.15222 handle_command_reply: tid=0 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 client.15222 shutdown 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 msgr2=0x565194893bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194893bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800dcf0 tx=0x7f0f58004750 comp rx=0 tx=0).stop 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 shutdown_connections 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x56519489f840 0x56519489e280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ba10 0x56519489b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f43fff700 0 client.15222 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194893bb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 --2- 172.21.15.60:0/2789347190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x5651948940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 >> 172.21.15.60:0/2789347190 conn(0x5651947fe210 msgr2=0x565194884f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 shutdown_connections 2023-10-05T15:16:04.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 1 -- 172.21.15.60:0/2789347190 wait complete. 2023-10-05T15:16:04.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.365+0000 7f0f77006b80 20 client.15222 trim_cache size 0 max 16384 2023-10-05T15:16:04.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 Processor -- start 2023-10-05T15:16:04.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 -- start start 2023-10-05T15:16:04.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488a210 0x565194892820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x56519489b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 0x56519488e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519465d8d0 con 0x56519488ba10 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519489ce20 con 0x56519488ab70 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f77006b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x565194894da0 con 0x56519488a210 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 0x56519488e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 0x56519488e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37222/0 (socket says 172.21.15.60:37222) 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 -- 172.21.15.60:0/1412415777 learned_addr learned my addr 172.21.15.60:0/1412415777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f63fff700 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x56519489b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488a210 0x565194892820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 -- 172.21.15.60:0/1412415777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488a210 msgr2=0x565194892820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488a210 0x565194892820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 -- 172.21.15.60:0/1412415777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 msgr2=0x56519489b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x56519489b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.383+0000 7f0f693b9700 1 -- 172.21.15.60:0/1412415777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519462e200 con 0x56519488ba10 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f693b9700 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 0x56519488e8e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c007ea0 tx=0x7f0f5c0086d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea82c505b4a286c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f4f7fe700 1 -- 172.21.15.60:0/1412415777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c008cf0 con 0x56519488ba10 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f4f7fe700 1 -- 172.21.15.60:0/1412415777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f5c008e50 con 0x56519488ba10 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f4f7fe700 1 -- 172.21.15.60:0/1412415777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0148c0 con 0x56519488ba10 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 -- 172.21.15.60:0/1412415777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 msgr2=0x56519488e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 0x56519488e8e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c007ea0 tx=0x7f0f5c0086d0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 -- 172.21.15.60:0/1412415777 shutdown_connections 2023-10-05T15:16:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488ba10 0x56519488e8e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488a210 0x565194892820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 --2- 172.21.15.60:0/1412415777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ab70 0x56519489b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 -- 172.21.15.60:0/1412415777 >> 172.21.15.60:0/1412415777 conn(0x5651947fe210 msgr2=0x5651948a81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 -- 172.21.15.60:0/1412415777 shutdown_connections 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.384+0000 7f0f77006b80 1 -- 172.21.15.60:0/1412415777 wait complete. 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 -- start start 2023-10-05T15:16:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 Processor -- start 2023-10-05T15:16:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194895450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ab70 0x565194895990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ba10 0x56519489a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519489af00 con 0x56519488a210 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519489b070 con 0x56519488ba10 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519489b230 con 0x56519488ab70 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f68bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194895450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f77006b80 10 client.0 _ll_register_callbacks cb 0x7f0f5800d620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f68bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194895450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37224/0 (socket says 172.21.15.60:37224) 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.385+0000 7f0f68bb8700 1 -- 172.21.15.60:0/4121779987 learned_addr learned my addr 172.21.15.60:0/4121779987 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f693b9700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ba10 0x56519489a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f63fff700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ab70 0x565194895990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f68bb8700 1 -- 172.21.15.60:0/4121779987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ab70 msgr2=0x565194895990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ab70 0x565194895990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f68bb8700 1 -- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ba10 msgr2=0x56519489a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ba10 0x56519489a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f68bb8700 1 -- 172.21.15.60:0/4121779987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c010040 con 0x56519488a210 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f68bb8700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194895450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0f580048a0 tx=0x7f0f58012da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77124da6c934004 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f43fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f43fff700 1 -- 172.21.15.60:0/4121779987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58014cb0 con 0x56519488a210 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f500a3b60 con 0x56519488a210 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f43fff700 1 -- 172.21.15.60:0/4121779987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0f58014e10 con 0x56519488a210 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f43fff700 1 -- 172.21.15.60:0/4121779987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f580123e0 con 0x56519488a210 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f77006b80 10 client.15228 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x565194606260 con 0x56519488a210 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.386+0000 7f0f43fff700 1 -- 172.21.15.60:0/4121779987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f500a3b60 con 0x56519488a210 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f43fff700 1 -- 172.21.15.60:0/4121779987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0f58020cc0 con 0x56519488a210 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f77006b80 10 client.15228 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f77006b80 10 client.15228 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f77006b80 20 client.15228 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f77006b80 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5651948f8140 0x5651948f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f77006b80 4 client.15228 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651947d5ae0 con 0x5651948f8140 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f63fff700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5651948f8140 0x5651948f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f43fff700 10 client.15228 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.387+0000 7f0f63fff700 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5651948f8140 0x5651948f4580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61580c9f31eaaf0e server_cookie=358bb343f71e57e1 in_seq=0 out_seq=0 2023-10-05T15:16:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f43fff700 1 -- 172.21.15.60:0/4121779987 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5651947d5ae0 con 0x5651948f8140 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f43fff700 10 client.15228 handle_command_reply: tid=0 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 client.15228 shutdown 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 msgr2=0x565194895450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194895450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0f580048a0 tx=0x7f0f58012da0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 shutdown_connections 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5651948f8140 0x5651948f4580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56519488ba10 0x56519489a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f43fff700 0 client.15228 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56519488a210 0x565194895450 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 --2- 172.21.15.60:0/4121779987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56519488ab70 0x565194895990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 >> 172.21.15.60:0/4121779987 conn(0x5651947fe210 msgr2=0x565194892820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 shutdown_connections 2023-10-05T15:16:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 1 -- 172.21.15.60:0/4121779987 wait complete. 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f77006b80 20 client.15228 trim_cache size 0 max 16384 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24488, 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 56.090250099000002, 2023-10-05T15:16:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 90.793316629000003 2023-10-05T15:16:04.398 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0f540a1510 msgr2=0x7f0f540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0f540a1510 0x7f0f540a39d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006fd0 tx=0x7f0f58008040 comp rx=0 tx=0).stop 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 msgr2=0x7f0f6419ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.388+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f6419ddc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009990 tx=0x7f0f50003ba0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 shutdown_connections 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f64101950 0x7f0f641a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f640ffdc0 0x7f0f64068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0f540a1510 0x7f0f540a39d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 --2- 172.21.15.60:0/767741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f64100fb0 0x7f0f6419ddc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 >> 172.21.15.60:0/767741130 conn(0x7f0f640fb330 msgr2=0x7f0f640fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 shutdown_connections 2023-10-05T15:16:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.389+0000 7f0f6ae1c700 1 -- 172.21.15.60:0/767741130 wait complete. 2023-10-05T15:16:04.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-05T15:16:04.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1264704168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:04 smithi092 ceph-mon[102944]: pgmap v299: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:16:04.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/584206838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:04 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/671100215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 -- 172.21.15.60:0/3963166877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340ffdc0 msgr2=0x7f20341001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 --2- 172.21.15.60:0/3963166877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340ffdc0 0x7f20341001e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f201c0099c0 tx=0x7f201c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 -- 172.21.15.60:0/3963166877 shutdown_connections 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 --2- 172.21.15.60:0/3963166877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034101950 0x7f2034108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 --2- 172.21.15.60:0/3963166877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340ffdc0 0x7f20341001e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 --2- 172.21.15.60:0/3963166877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2034100fb0 0x7f2034101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 -- 172.21.15.60:0/3963166877 >> 172.21.15.60:0/3963166877 conn(0x7f20340fb330 msgr2=0x7f20340fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 -- 172.21.15.60:0/3963166877 shutdown_connections 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 -- 172.21.15.60:0/3963166877 wait complete. 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.527+0000 7f203940e700 1 Processor -- start 2023-10-05T15:16:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 -- start start 2023-10-05T15:16:04.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340ffdc0 0x7f2034195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 0x7f2034196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034101950 0x7f203419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203419d640 con 0x7f2034100fb0 2023-10-05T15:16:04.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203419d780 con 0x7f2034101950 2023-10-05T15:16:04.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f203940e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203419d910 con 0x7f20340ffdc0 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 0x7f2034196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 0x7f2034196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37240/0 (socket says 172.21.15.60:37240) 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 -- 172.21.15.60:0/4216425321 learned_addr learned my addr 172.21.15.60:0/4216425321 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20337fe700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034101950 0x7f203419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f2032ffd700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340ffdc0 0x7f2034195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 -- 172.21.15.60:0/4216425321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340ffdc0 msgr2=0x7f2034195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340ffdc0 0x7f2034195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 -- 172.21.15.60:0/4216425321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034101950 msgr2=0x7f203419d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034101950 0x7f203419d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.528+0000 7f20327fc700 1 -- 172.21.15.60:0/4216425321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0095f0 con 0x7f2034100fb0 2023-10-05T15:16:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.529+0000 7f20327fc700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 0x7f2034196000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f202400d950 tx=0x7f202400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.529+0000 7f202bfff700 1 -- 172.21.15.60:0/4216425321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400f890 con 0x7f2034100fb0 2023-10-05T15:16:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.529+0000 7f202bfff700 1 -- 172.21.15.60:0/4216425321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2024010460 con 0x7f2034100fb0 2023-10-05T15:16:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.529+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203419dbf0 con 0x7f2034100fb0 2023-10-05T15:16:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.529+0000 7f202bfff700 1 -- 172.21.15.60:0/4216425321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400e610 con 0x7f2034100fb0 2023-10-05T15:16:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.529+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203419e100 con 0x7f2034100fb0 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.531+0000 7f202bfff700 1 -- 172.21.15.60:0/4216425321 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f20240108d0 con 0x7f2034100fb0 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.532+0000 7f202bfff700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f20200a1510 0x7f20200a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.532+0000 7f202bfff700 1 -- 172.21.15.60:0/4216425321 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f20240ccf10 con 0x7f2034100fb0 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.532+0000 7f2032ffd700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f20200a1510 0x7f20200a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.532+0000 7f2032ffd700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f20200a1510 0x7f20200a39d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f201c009990 tx=0x7f201c0051e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.532+0000 7f20455f8b80 1 Processor -- start 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.532+0000 7f20455f8b80 1 -- start start 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 0x555af6008630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af6009430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20455f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5f70410 con 0x555af6009a10 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20455f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5f61bd0 con 0x555af6008210 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20455f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5f5f4f0 con 0x555af6008b70 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f2032ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 0x555af6008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f2032ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 0x555af6008630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:50668/0 (socket says 172.21.15.60:50668) 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6009e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37250/0 (socket says 172.21.15.60:37250) 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f2032ffd700 1 -- 172.21.15.60:0/4111857425 learned_addr learned my addr 172.21.15.60:0/4111857425 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20327fc700 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af6009430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 -- 172.21.15.60:0/4111857425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 msgr2=0x555af6009430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af6009430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 -- 172.21.15.60:0/4111857425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 msgr2=0x555af6008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 0x555af6008630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 -- 172.21.15.60:0/4111857425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af5d85d90 con 0x555af6009a10 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f2032ffd700 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 0x555af6008630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.533+0000 7f20337fe700 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6009e90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f202c003f20 tx=0x7f202c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca03068471390f81 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20297fa700 1 -- 172.21.15.60:0/4111857425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c019070 con 0x555af6009a10 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20297fa700 1 -- 172.21.15.60:0/4111857425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f202c00f040 con 0x555af6009a10 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20297fa700 1 -- 172.21.15.60:0/4111857425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c0079a0 con 0x555af6009a10 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 -- 172.21.15.60:0/4111857425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 msgr2=0x555af6009e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6009e90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f202c003f20 tx=0x7f202c009ba0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 -- 172.21.15.60:0/4111857425 shutdown_connections 2023-10-05T15:16:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6009e90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008210 0x555af6008630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 --2- 172.21.15.60:0/4111857425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af6009430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.534+0000 7f20455f8b80 1 -- 172.21.15.60:0/4111857425 >> 172.21.15.60:0/4111857425 conn(0x555af5f7c210 msgr2=0x555af60030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 -- 172.21.15.60:0/4111857425 shutdown_connections 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 -- 172.21.15.60:0/4111857425 wait complete. 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 -- start start 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 Processor -- start 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6011fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6012500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5f5ade0 con 0x555af6009a10 2023-10-05T15:16:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5ef76c0 con 0x555af6008b70 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5ef7360 con 0x555af6008210 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.535+0000 7f20455f8b80 10 client.0 _ll_register_callbacks cb 0x555af5d547b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20327fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6012500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37256/0 (socket says 172.21.15.60:37256) 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 -- 172.21.15.60:0/269522374 learned_addr learned my addr 172.21.15.60:0/269522374 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f2032ffd700 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6011fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 -- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 msgr2=0x555af6011fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6011fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 -- 172.21.15.60:0/269522374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 msgr2=0x555af6012500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6012500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 -- 172.21.15.60:0/269522374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2034108b50 con 0x555af6009a10 2023-10-05T15:16:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20337fe700 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019540 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f202c000f80 tx=0x7f202c004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c362ad40f931b0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f201a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f201a7fc700 1 -- 172.21.15.60:0/269522374 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c019040 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f201a7fc700 1 -- 172.21.15.60:0/269522374 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f202c007b30 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555af5ffaec0 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f201a7fc700 1 -- 172.21.15.60:0/269522374 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f202c007d10 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20455f8b80 10 client.15240 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.536+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f202c003b50 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f201a7fc700 1 -- 172.21.15.60:0/269522374 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555af5ffaec0 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f201a7fc700 1 -- 172.21.15.60:0/269522374 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f202c01f570 con 0x555af6009a10 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f20455f8b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f20455f8b80 10 client.15240 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f20455f8b80 20 client.15240 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f20455f8b80 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af601db20 0x555af601c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f20455f8b80 4 client.15240 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555af5f53dc0 con 0x555af601db20 2023-10-05T15:16:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.537+0000 7f2032ffd700 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af601db20 0x555af601c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.538+0000 7f2032ffd700 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af601db20 0x555af601c5e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ef3bef72d3048a2 server_cookie=7d0812be45eeaf10 in_seq=0 out_seq=0 2023-10-05T15:16:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.538+0000 7f201a7fc700 10 client.15240 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f201a7fc700 1 -- 172.21.15.60:0/269522374 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555af5f53dc0 con 0x555af601db20 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f201a7fc700 10 client.15240 handle_command_reply: tid=0 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 client.15240 shutdown 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 msgr2=0x555af6019540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019540 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f202c000f80 tx=0x7f202c004840 comp rx=0 tx=0).stop 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 shutdown_connections 2023-10-05T15:16:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af601db20 0x555af601c5e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019540 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6011fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 --2- 172.21.15.60:0/269522374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6012500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f201a7fc700 0 client.15240 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 >> 172.21.15.60:0/269522374 conn(0x555af5f7c210 msgr2=0x555af6002f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 shutdown_connections 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 1 -- 172.21.15.60:0/269522374 wait complete. 2023-10-05T15:16:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.539+0000 7f20455f8b80 20 client.15240 trim_cache size 0 max 16384 2023-10-05T15:16:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 Processor -- start 2023-10-05T15:16:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 -- start start 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 0x555af6002f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af60194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6009a10 0x555af600fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5ddb8d0 con 0x555af6008210 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5f56ed0 con 0x555af6009a10 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20455f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af5f014d0 con 0x555af6008b70 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 0x555af6002f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 0x555af6002f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37260/0 (socket says 172.21.15.60:37260) 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 -- 172.21.15.60:0/339319912 learned_addr learned my addr 172.21.15.60:0/339319912 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20337fe700 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6009a10 0x555af600fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 -- 172.21.15.60:0/339319912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 msgr2=0x555af60194d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20327fc700 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af60194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af60194d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 -- 172.21.15.60:0/339319912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6009a10 msgr2=0x555af600fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6009a10 0x555af600fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f2032ffd700 1 -- 172.21.15.60:0/339319912 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af5d6ec10 con 0x555af6008210 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.557+0000 7f20337fe700 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6009a10 0x555af600fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f2032ffd700 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 0x555af6002f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f201c0095c0 tx=0x7f201c01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec6fb2cf8475b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f2029ffb700 1 -- 172.21.15.60:0/339319912 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00bbf0 con 0x555af6008210 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f2029ffb700 1 -- 172.21.15.60:0/339319912 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f201c01e040 con 0x555af6008210 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f2029ffb700 1 -- 172.21.15.60:0/339319912 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c003c90 con 0x555af6008210 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f20455f8b80 1 -- 172.21.15.60:0/339319912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 msgr2=0x555af6002f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f20455f8b80 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 0x555af6002f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f201c0095c0 tx=0x7f201c01a050 comp rx=0 tx=0).stop 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f20455f8b80 1 -- 172.21.15.60:0/339319912 shutdown_connections 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f20455f8b80 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6009a10 0x555af600fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f20455f8b80 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6008210 0x555af6002f00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.558+0000 7f20455f8b80 1 --2- 172.21.15.60:0/339319912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008b70 0x555af60194d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- 172.21.15.60:0/339319912 >> 172.21.15.60:0/339319912 conn(0x555af5f7c210 msgr2=0x555af6026480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- 172.21.15.60:0/339319912 shutdown_connections 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- 172.21.15.60:0/339319912 wait complete. 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- start start 2023-10-05T15:16:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 Processor -- start 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6013af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6014030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af60195a0 con 0x555af6009a10 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af6019710 con 0x555af6008b70 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af60198d0 con 0x555af6008210 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20455f8b80 10 client.0 _ll_register_callbacks cb 0x7f201c009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37270/0 (socket says 172.21.15.60:37270) 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 -- 172.21.15.60:0/3459770402 learned_addr learned my addr 172.21.15.60:0/3459770402 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f2032ffd700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6013af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20327fc700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 -- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 msgr2=0x555af6013af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6013af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 -- 172.21.15.60:0/3459770402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 msgr2=0x555af6014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.559+0000 7f20337fe700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6014030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20337fe700 1 -- 172.21.15.60:0/3459770402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c035a90 con 0x555af6009a10 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20327fc700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6014030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f2032ffd700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6013af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20337fe700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f202c002230 tx=0x7f202c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf11072691982984 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f201a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f201a7fc700 1 -- 172.21.15.60:0/3459770402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c019030 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f201a7fc700 1 -- 172.21.15.60:0/3459770402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f202c01f650 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f202c00f040 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f201a7fc700 1 -- 172.21.15.60:0/3459770402 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f202c007930 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 10 client.15246 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555af5dac200 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f201a7fc700 1 -- 172.21.15.60:0/3459770402 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f202c00f040 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f201a7fc700 1 -- 172.21.15.60:0/3459770402 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f202c0159b0 con 0x555af6009a10 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 10 client.15246 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 20 client.15246 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af6076360 0x555af60727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 4 client.15246 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.560+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555af5f53ae0 con 0x555af6076360 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f2032ffd700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af6076360 0x555af60727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f201a7fc700 10 client.15246 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f2032ffd700 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af6076360 0x555af60727c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a015d26af0fe03ae server_cookie=4ee20a09787b1ac2 in_seq=0 out_seq=0 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f201a7fc700 1 -- 172.21.15.60:0/3459770402 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555af5f53ae0 con 0x555af6076360 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f201a7fc700 10 client.15246 handle_command_reply: tid=0 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 client.15246 shutdown 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 msgr2=0x555af6019060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f202c002230 tx=0x7f202c009340 comp rx=0 tx=0).stop 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 shutdown_connections 2023-10-05T15:16:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555af6076360 0x555af60727c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555af6009a10 0x555af6019060 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555af6008210 0x555af6013af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.561+0000 7f20455f8b80 1 --2- 172.21.15.60:0/3459770402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555af6008b70 0x555af6014030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f201a7fc700 0 client.15246 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 >> 172.21.15.60:0/3459770402 conn(0x555af5f7c210 msgr2=0x555af600fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 shutdown_connections 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f20455f8b80 1 -- 172.21.15.60:0/3459770402 wait complete. 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f20455f8b80 20 client.15246 trim_cache size 0 max 16384 2023-10-05T15:16:04.571 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24496, 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 57.271149901000001, 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:04.572 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 88.657027369999994 2023-10-05T15:16:04.573 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:04.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f20200a1510 msgr2=0x7f20200a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f20200a1510 0x7f20200a39d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f201c009990 tx=0x7f201c0051e0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 msgr2=0x7f2034196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 0x7f2034196000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f202400d950 tx=0x7f202400dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 shutdown_connections 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034101950 0x7f203419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340ffdc0 0x7f2034195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f20200a1510 0x7f20200a39d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 --2- 172.21.15.60:0/4216425321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2034100fb0 0x7f2034196000 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 >> 172.21.15.60:0/4216425321 conn(0x7f20340fb330 msgr2=0x7f20340fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 shutdown_connections 2023-10-05T15:16:04.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.562+0000 7f203940e700 1 -- 172.21.15.60:0/4216425321 wait complete. 2023-10-05T15:16:04.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-05T15:16:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 -- 172.21.15.60:0/4263005270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb8101950 msgr2=0x7f2cb8108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 --2- 172.21.15.60:0/4263005270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb8101950 0x7f2cb8108270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000b0a0 tx=0x7f2cb000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 -- 172.21.15.60:0/4263005270 shutdown_connections 2023-10-05T15:16:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 --2- 172.21.15.60:0/4263005270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb8101950 0x7f2cb8108270 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 --2- 172.21.15.60:0/4263005270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 --2- 172.21.15.60:0/4263005270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cb8100f90 0x7f2cb8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 -- 172.21.15.60:0/4263005270 >> 172.21.15.60:0/4263005270 conn(0x7f2cb80fb3b0 msgr2=0x7f2cb80fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 -- 172.21.15.60:0/4263005270 shutdown_connections 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.701+0000 7f2cbe334700 1 -- 172.21.15.60:0/4263005270 wait complete. 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 Processor -- start 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 -- start start 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8100f90 0x7f2cb8197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cb8101950 0x7f2cb819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb819e850 con 0x7f2cb80ffe40 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb819e9c0 con 0x7f2cb8100f90 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbe334700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb819eb80 con 0x7f2cb8101950 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37280/0 (socket says 172.21.15.60:37280) 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 -- 172.21.15.60:0/90297157 learned_addr learned my addr 172.21.15.60:0/90297157 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cb8101950 0x7f2cb819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8100f90 0x7f2cb8197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 -- 172.21.15.60:0/90297157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cb8101950 msgr2=0x7f2cb819e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cb8101950 0x7f2cb819e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 -- 172.21.15.60:0/90297157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8100f90 msgr2=0x7f2cb8197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.702+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8100f90 0x7f2cb8197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cb7fff700 1 -- 172.21.15.60:0/90297157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009d00 con 0x7f2cb80ffe40 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8196d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800d980 tx=0x7f2ca800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cb57fa700 1 -- 172.21.15.60:0/90297157 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004220 con 0x7f2cb80ffe40 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cb57fa700 1 -- 172.21.15.60:0/90297157 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca8007640 con 0x7f2cb80ffe40 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb819ee60 con 0x7f2cb80ffe40 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cb57fa700 1 -- 172.21.15.60:0/90297157 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8005610 con 0x7f2cb80ffe40 2023-10-05T15:16:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.703+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb819f280 con 0x7f2cb80ffe40 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.705+0000 7f2cb57fa700 1 -- 172.21.15.60:0/90297157 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2ca8004750 con 0x7f2cb80ffe40 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.706+0000 7f2cb57fa700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ca00a1510 0x7f2ca00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.706+0000 7f2cb57fa700 1 -- 172.21.15.60:0/90297157 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2ca80cd090 con 0x7f2cb80ffe40 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.706+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ca00a1510 0x7f2ca00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.706+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ca00a1510 0x7f2ca00a39d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cac005950 tx=0x7f2cac005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 Processor -- start 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 -- start start 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697ea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36974d410 con 0x55c3697e9620 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36973ebd0 con 0x55c3697eae20 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36973c4f0 con 0x55c3697e9f80 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37290/0 (socket says 172.21.15.60:37290) 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 -- 172.21.15.60:0/3625375824 learned_addr learned my addr 172.21.15.60:0/3625375824 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 -- 172.21.15.60:0/3625375824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 msgr2=0x55c3697ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697ea840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 -- 172.21.15.60:0/3625375824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 msgr2=0x55c3697eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 -- 172.21.15.60:0/3625375824 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369562d90 con 0x55c3697e9620 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.707+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697e9a40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80a1db0 tx=0x7f2ca809a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae037b0214f65443 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2c9e7fc700 1 -- 172.21.15.60:0/3625375824 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80a22e0 con 0x55c3697e9620 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2c9e7fc700 1 -- 172.21.15.60:0/3625375824 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca80982f0 con 0x55c3697e9620 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2c9e7fc700 1 -- 172.21.15.60:0/3625375824 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80a1e50 con 0x55c3697e9620 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 -- 172.21.15.60:0/3625375824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 msgr2=0x55c3697e9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697e9a40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80a1db0 tx=0x7f2ca809a720 comp rx=0 tx=0).stop 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 -- 172.21.15.60:0/3625375824 shutdown_connections 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697e9a40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/3625375824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 -- 172.21.15.60:0/3625375824 >> 172.21.15.60:0/3625375824 conn(0x55c369759210 msgr2=0x55c3697e00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 -- 172.21.15.60:0/3625375824 shutdown_connections 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.708+0000 7f2cca51eb80 1 -- 172.21.15.60:0/3625375824 wait complete. 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 -- start start 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 Processor -- start 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369737de0 con 0x55c3697e9620 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3696d46c0 con 0x55c3697eae20 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3696d4360 con 0x55c3697e9f80 2023-10-05T15:16:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cca51eb80 10 client.0 _ll_register_callbacks cb 0x55c3695317b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37294/0 (socket says 172.21.15.60:37294) 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cb7fff700 1 -- 172.21.15.60:0/81544555 learned_addr learned my addr 172.21.15.60:0/81544555 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.709+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cb7fff700 1 -- 172.21.15.60:0/81544555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 msgr2=0x55c3697f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cb7fff700 1 -- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 msgr2=0x55c3697fa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cb7fff700 1 -- 172.21.15.60:0/81544555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb819f280 con 0x55c3697e9620 2023-10-05T15:16:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f3440 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000c00 tx=0x7f2ca8096290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b94d2c42107d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2c977fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2c977fe700 1 -- 172.21.15.60:0/81544555 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80a22e0 con 0x55c3697e9620 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2c977fe700 1 -- 172.21.15.60:0/81544555 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2ca80994b0 con 0x55c3697e9620 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3697d7ec0 con 0x55c3697e9620 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2c977fe700 1 -- 172.21.15.60:0/81544555 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca8099670 con 0x55c3697e9620 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 10 client.15258 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c36954bc10 con 0x55c3697e9620 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2c977fe700 1 -- 172.21.15.60:0/81544555 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c3697d7ec0 con 0x55c3697e9620 2023-10-05T15:16:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2c977fe700 1 -- 172.21.15.60:0/81544555 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ca805fd20 con 0x55c3697e9620 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 10 client.15258 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 10 client.15258 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 20 client.15258 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c3697feaa0 0x55c3697fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 4 client.15258 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.710+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c369730dc0 con 0x55c3697feaa0 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.711+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c3697feaa0 0x55c3697fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.711+0000 7f2c977fe700 10 client.15258 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.711+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c3697feaa0 0x55c3697fd8f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea8b8c3b35215c2 server_cookie=19d86377b37384da in_seq=0 out_seq=0 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2c977fe700 1 -- 172.21.15.60:0/81544555 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c369730dc0 con 0x55c3697feaa0 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2c977fe700 10 client.15258 handle_command_reply: tid=0 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 client.15258 shutdown 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 msgr2=0x55c3697f3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f3440 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000c00 tx=0x7f2ca8096290 comp rx=0 tx=0).stop 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 shutdown_connections 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c3697feaa0 0x55c3697fd8f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f3440 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/81544555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2c977fe700 0 client.15258 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 >> 172.21.15.60:0/81544555 conn(0x55c369759210 msgr2=0x55c3697dff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 shutdown_connections 2023-10-05T15:16:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 1 -- 172.21.15.60:0/81544555 wait complete. 2023-10-05T15:16:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.712+0000 7f2cca51eb80 20 client.15258 trim_cache size 0 max 16384 2023-10-05T15:16:04.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 Processor -- start 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 -- start start 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697fa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3695b88d0 con 0x55c3697e9620 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3697f4340 con 0x55c3697eae20 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3697da540 con 0x55c3697e9f80 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697dff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37302/0 (socket says 172.21.15.60:37302) 2023-10-05T15:16:04.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 -- 172.21.15.60:0/521441174 learned_addr learned my addr 172.21.15.60:0/521441174 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 -- 172.21.15.60:0/521441174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 msgr2=0x55c3697fa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 -- 172.21.15.60:0/521441174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 msgr2=0x55c3697fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 -- 172.21.15.60:0/521441174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369589200 con 0x55c3697e9620 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.730+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697dff00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80982a0 tx=0x7f2ca809a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9547f1cd778a7292 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2c9effd700 1 -- 172.21.15.60:0/521441174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80ca990 con 0x55c3697e9620 2023-10-05T15:16:04.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2c9effd700 1 -- 172.21.15.60:0/521441174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca80a22e0 con 0x55c3697e9620 2023-10-05T15:16:04.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2c9effd700 1 -- 172.21.15.60:0/521441174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80a20b0 con 0x55c3697e9620 2023-10-05T15:16:04.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 -- 172.21.15.60:0/521441174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 msgr2=0x55c3697dff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697dff00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80982a0 tx=0x7f2ca809a720 comp rx=0 tx=0).stop 2023-10-05T15:16:04.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 -- 172.21.15.60:0/521441174 shutdown_connections 2023-10-05T15:16:04.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697dff00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/521441174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697fa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 -- 172.21.15.60:0/521441174 >> 172.21.15.60:0/521441174 conn(0x55c369759210 msgr2=0x55c3697deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 -- 172.21.15.60:0/521441174 shutdown_connections 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.731+0000 7f2cca51eb80 1 -- 172.21.15.60:0/521441174 wait complete. 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 -- start start 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 Processor -- start 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3697fa3a0 con 0x55c3697e9620 2023-10-05T15:16:04.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3697fa510 con 0x55c3697eae20 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3697fa6d0 con 0x55c3697e9f80 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cca51eb80 10 client.0 _ll_register_callbacks cb 0x7f2ca8099980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37308/0 (socket says 172.21.15.60:37308) 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.732+0000 7f2cb7fff700 1 -- 172.21.15.60:0/4239922655 learned_addr learned my addr 172.21.15.60:0/4239922655 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb7fff700 1 -- 172.21.15.60:0/4239922655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 msgr2=0x55c3697f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb7fff700 1 -- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 msgr2=0x55c3697f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb7fff700 1 -- 172.21.15.60:0/4239922655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c36954bc10 con 0x55c3697e9620 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cbc8d1700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cb7fff700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f6e40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8098f20 tx=0x7f2ca8099bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb6a0b257071f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2c977fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2c977fe700 1 -- 172.21.15.60:0/4239922655 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8099640 con 0x55c3697e9620 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2c977fe700 1 -- 172.21.15.60:0/4239922655 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2ca8094b60 con 0x55c3697e9620 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ca80982f0 con 0x55c3697e9620 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2c977fe700 1 -- 172.21.15.60:0/4239922655 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca8099260 con 0x55c3697e9620 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cca51eb80 10 client.15264 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c369561260 con 0x55c3697e9620 2023-10-05T15:16:04.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2c977fe700 1 -- 172.21.15.60:0/4239922655 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca80982f0 con 0x55c3697e9620 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2c977fe700 1 -- 172.21.15.60:0/4239922655 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ca809a1b0 con 0x55c3697e9620 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.733+0000 7f2cca51eb80 10 client.15264 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cca51eb80 10 client.15264 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cca51eb80 20 client.15264 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c369856990 0x55c369852eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cca51eb80 4 client.15264 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c369730ae0 con 0x55c369856990 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c369856990 0x55c369852eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2c977fe700 10 client.15264 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cb77fe700 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c369856990 0x55c369852eb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74caadbf7980f7e6 server_cookie=69ec280076bd868a in_seq=0 out_seq=0 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2c977fe700 1 -- 172.21.15.60:0/4239922655 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c369730ae0 con 0x55c369856990 2023-10-05T15:16:04.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2c977fe700 10 client.15264 handle_command_reply: tid=0 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.734+0000 7f2cca51eb80 1 client.15264 shutdown 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 msgr2=0x55c3697f6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f6e40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8098f20 tx=0x7f2ca8099bc0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 shutdown_connections 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c369856990 0x55c369852eb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3697eae20 0x55c3697f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3697e9620 0x55c3697f6e40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 --2- 172.21.15.60:0/4239922655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3697e9f80 0x55c3697f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2c977fe700 0 client.15264 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 >> 172.21.15.60:0/4239922655 conn(0x55c369759210 msgr2=0x55c3697dfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 shutdown_connections 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 1 -- 172.21.15.60:0/4239922655 wait complete. 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cca51eb80 20 client.15264 trim_cache size 0 max 16384 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24533, 2023-10-05T15:16:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 76.537143447999995, 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 82.083813910000003 2023-10-05T15:16:04.746 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:04.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ca00a1510 msgr2=0x7f2ca00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ca00a1510 0x7f2ca00a39d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cac005950 tx=0x7f2cac005c70 comp rx=0 tx=0).stop 2023-10-05T15:16:04.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 msgr2=0x7f2cb8196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:04.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8196d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800d980 tx=0x7f2ca800dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 shutdown_connections 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cb8101950 0x7f2cb819e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2ca00a1510 0x7f2ca00a39d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80ffe40 0x7f2cb8196d10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 --2- 172.21.15.60:0/90297157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8100f90 0x7f2cb8197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 >> 172.21.15.60:0/90297157 conn(0x7f2cb80fb3b0 msgr2=0x7f2cb80692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 shutdown_connections 2023-10-05T15:16:04.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:04.735+0000 7f2cbe334700 1 -- 172.21.15.60:0/90297157 wait complete. 2023-10-05T15:16:04.749 INFO:tasks.cephadm:Setup complete, yielding 2023-10-05T15:16:04.750 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-05T15:16:04.759 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:16:04.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-05T15:16:05.322 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:06.486 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:06 smithi060 ceph-mon[99238]: pgmap v300: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:16:06.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:06 smithi135 ceph-mon[103360]: pgmap v300: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:16:06.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:06 smithi092 ceph-mon[102944]: pgmap v300: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:16:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/1330042294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40ffe70 msgr2=0x7fe0e4100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/1330042294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40ffe70 0x7fe0e4100290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009990 tx=0x7fe0d8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/1330042294 shutdown_connections 2023-10-05T15:16:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/1330042294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e4101990 0x7fe0e41082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/1330042294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40ffe70 0x7fe0e4100290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/1330042294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e4100fd0 0x7fe0e4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/1330042294 >> 172.21.15.60:0/1330042294 conn(0x7fe0e40fb3f0 msgr2=0x7fe0e40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/1330042294 shutdown_connections 2023-10-05T15:16:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.677+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/1330042294 wait complete. 2023-10-05T15:16:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 Processor -- start 2023-10-05T15:16:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 -- start start 2023-10-05T15:16:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40ffe70 0x7fe0e4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 0x7fe0e419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e4101990 0x7fe0e419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e419e780 con 0x7fe0e4100fd0 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e419e8f0 con 0x7fe0e4101990 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0eb3f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e419eab0 con 0x7fe0e40ffe70 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0e8990700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 0x7fe0e419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0e8990700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 0x7fe0e419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37322/0 (socket says 172.21.15.60:37322) 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.678+0000 7fe0e8990700 1 -- 172.21.15.60:0/3869022194 learned_addr learned my addr 172.21.15.60:0/3869022194 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e9191700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40ffe70 0x7fe0e4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e9992700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e4101990 0x7fe0e419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e8990700 1 -- 172.21.15.60:0/3869022194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40ffe70 msgr2=0x7fe0e4069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e8990700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40ffe70 0x7fe0e4069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e8990700 1 -- 172.21.15.60:0/3869022194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e4101990 msgr2=0x7fe0e419dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e8990700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e4101990 0x7fe0e419dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e8990700 1 -- 172.21.15.60:0/3869022194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80095f0 con 0x7fe0e4100fd0 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0e8990700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 0x7fe0e419b9a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000d950 tx=0x7fe0e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0009940 con 0x7fe0e4100fd0 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0e0010460 con 0x7fe0e4100fd0 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e419ed90 con 0x7fe0e4100fd0 2023-10-05T15:16:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e419f250 con 0x7fe0e4100fd0 2023-10-05T15:16:06.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.679+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000f620 con 0x7fe0e4100fd0 2023-10-05T15:16:06.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.680+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e4107450 con 0x7fe0e4100fd0 2023-10-05T15:16:06.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.681+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe0e00108d0 con 0x7fe0e4100fd0 2023-10-05T15:16:06.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.682+0000 7fe0d67fc700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0d00a1590 0x7fe0d00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:06.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.682+0000 7fe0e9191700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0d00a1590 0x7fe0d00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:06.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.682+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fe0e00ccd20 con 0x7fe0e4100fd0 2023-10-05T15:16:06.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.683+0000 7fe0e9191700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0d00a1590 0x7fe0d00a3a50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800b5c0 tx=0x7fe0d8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:06.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.687+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe0e0095ec0 con 0x7fe0e4100fd0 2023-10-05T15:16:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.904+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e402d2b0 con 0x7fe0d00a1590 2023-10-05T15:16:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.905+0000 7fe0d67fc700 1 -- 172.21.15.60:0/3869022194 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe0e402d2b0 con 0x7fe0d00a1590 2023-10-05T15:16:06.907 INFO:teuthology.orchestra.run.smithi060.stdout:Backend: cephadm 2023-10-05T15:16:06.907 INFO:teuthology.orchestra.run.smithi060.stdout:Available: Yes 2023-10-05T15:16:06.907 INFO:teuthology.orchestra.run.smithi060.stdout:Paused: No 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0d00a1590 msgr2=0x7fe0d00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0d00a1590 0x7fe0d00a3a50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800b5c0 tx=0x7fe0d8005960 comp rx=0 tx=0).stop 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 msgr2=0x7fe0e419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 0x7fe0e419b9a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000d950 tx=0x7fe0e000dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 shutdown_connections 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e4101990 0x7fe0e419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40ffe70 0x7fe0e4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe0d00a1590 0x7fe0d00a3a50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 --2- 172.21.15.60:0/3869022194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e4100fd0 0x7fe0e419b9a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 >> 172.21.15.60:0/3869022194 conn(0x7fe0e40fb3f0 msgr2=0x7fe0e4104590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 shutdown_connections 2023-10-05T15:16:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:06.907+0000 7fe0eb3f5700 1 -- 172.21.15.60:0/3869022194 wait complete. 2023-10-05T15:16:07.497 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:07 smithi060 ceph-mon[99238]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:07.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-05T15:16:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:07 smithi135 ceph-mon[103360]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:07 smithi092 ceph-mon[102944]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:08.536 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:08 smithi060 ceph-mon[99238]: pgmap v301: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-05T15:16:08.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:08 smithi135 ceph-mon[103360]: pgmap v301: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-05T15:16:08.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:08 smithi092 ceph-mon[102944]: pgmap v301: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-05T15:16:09.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 -- 172.21.15.60:0/3737572354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468100fd0 msgr2=0x7fc468101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:09.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 --2- 172.21.15.60:0/3737572354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468100fd0 0x7fc468101450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc450009990 tx=0x7fc450009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 -- 172.21.15.60:0/3737572354 shutdown_connections 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 --2- 172.21.15.60:0/3737572354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc468101990 0x7fc4681082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 --2- 172.21.15.60:0/3737572354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 0x7fc468100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 --2- 172.21.15.60:0/3737572354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468100fd0 0x7fc468101450 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 -- 172.21.15.60:0/3737572354 >> 172.21.15.60:0/3737572354 conn(0x7fc4680fb3f0 msgr2=0x7fc4680fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 -- 172.21.15.60:0/3737572354 shutdown_connections 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.399+0000 7fc46d913700 1 -- 172.21.15.60:0/3737572354 wait complete. 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 Processor -- start 2023-10-05T15:16:09.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 -- start start 2023-10-05T15:16:09.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 0x7fc468195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:09.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc468100fd0 0x7fc4681960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:09.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 0x7fc46819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:09.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46819d720 con 0x7fc468101990 2023-10-05T15:16:09.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46819d860 con 0x7fc4680ffe70 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc46d913700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46819d9f0 con 0x7fc468100fd0 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 0x7fc46819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 0x7fc468195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 0x7fc46819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37338/0 (socket says 172.21.15.60:37338) 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 0x7fc468195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:50756/0 (socket says 172.21.15.60:50756) 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc4677fe700 1 -- 172.21.15.60:0/987327610 learned_addr learned my addr 172.21.15.60:0/987327610 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.400+0000 7fc4667fc700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc468100fd0 0x7fc4681960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc4677fe700 1 -- 172.21.15.60:0/987327610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc468100fd0 msgr2=0x7fc4681960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc4677fe700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc468100fd0 0x7fc4681960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc4677fe700 1 -- 172.21.15.60:0/987327610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 msgr2=0x7fc468195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc4677fe700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 0x7fc468195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc4677fe700 1 -- 172.21.15.60:0/987327610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500095f0 con 0x7fc468101990 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc4677fe700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 0x7fc46819d150 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc46000dbc0 tx=0x7fc46000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000e6a0 con 0x7fc468101990 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc46000bac0 con 0x7fc468101990 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4680689a0 con 0x7fc468101990 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460009e40 con 0x7fc468101990 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.401+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc468068f20 con 0x7fc468101990 2023-10-05T15:16:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.402+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46810b700 con 0x7fc468101990 2023-10-05T15:16:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.403+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc46000e800 con 0x7fc468101990 2023-10-05T15:16:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.404+0000 7fc46c911700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc4540a1590 0x7fc4540a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.404+0000 7fc466ffd700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc4540a1590 0x7fc4540a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.404+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fc460006e40 con 0x7fc468101990 2023-10-05T15:16:09.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.404+0000 7fc466ffd700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc4540a1590 0x7fc4540a3a50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc458005950 tx=0x7fc45800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:09.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.408+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc460050100 con 0x7fc468101990 2023-10-05T15:16:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.615+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc468069670 con 0x7fc4540a1590 2023-10-05T15:16:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.636+0000 7fc46c911700 1 -- 172.21.15.60:0/987327610 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fc468069670 con 0x7fc4540a1590 2023-10-05T15:16:09.638 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-05T15:16:09.638 INFO:teuthology.orchestra.run.smithi060.stdout:mds.a smithi060 running (89s) 15s ago 89s 17.3M - 18.0.0-6578-g689b3d5a 83c9d078d785 80f1b51daa3d 2023-10-05T15:16:09.638 INFO:teuthology.orchestra.run.smithi060.stdout:mds.b smithi092 running (87s) 16s ago 86s 30.7M - 18.0.0-6578-g689b3d5a 83c9d078d785 b5df32fa0c9a 2023-10-05T15:16:09.638 INFO:teuthology.orchestra.run.smithi060.stdout:mds.c smithi135 running (98s) 16s ago 98s 20.4M - 18.0.0-6578-g689b3d5a 83c9d078d785 0785e1a1c522 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.d smithi060 running (105s) 15s ago 104s 15.1M - 18.0.0-6578-g689b3d5a 83c9d078d785 224de475db8a 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.e smithi092 running (103s) 16s ago 102s 20.1M - 18.0.0-6578-g689b3d5a 83c9d078d785 bd4e7ebf43b6 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.f smithi135 running (101s) 16s ago 100s 18.9M - 18.0.0-6578-g689b3d5a 83c9d078d785 42014a784aa0 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.g smithi060 running (91s) 15s ago 91s 17.2M - 18.0.0-6578-g689b3d5a 83c9d078d785 e37cb2320c6e 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.h smithi092 running (96s) 16s ago 95s 21.4M - 18.0.0-6578-g689b3d5a 83c9d078d785 50d3ff0515d9 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.i smithi135 running (94s) 16s ago 93s 19.4M - 18.0.0-6578-g689b3d5a 83c9d078d785 ef3824d35edf 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.j smithi060 running (107s) 15s ago 107s 16.5M - 18.0.0-6578-g689b3d5a 83c9d078d785 b2c0a1390fe9 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.k smithi092 running (109s) 16s ago 109s 16.5M - 18.0.0-6578-g689b3d5a 83c9d078d785 8feb6f90f7d4 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mds.l smithi135 running (112s) 16s ago 111s 17.6M - 18.0.0-6578-g689b3d5a 83c9d078d785 dfb9fba072fc 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.x smithi060 *:9283,8765 running (8m) 15s ago 8m 521M - 18.0.0-6578-g689b3d5a 83c9d078d785 ac8f200dcec8 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.y smithi092 *:8443,8765 running (6m) 16s ago 6m 451M - 18.0.0-6578-g689b3d5a 83c9d078d785 2435ac7db78f 2023-10-05T15:16:09.639 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.z smithi135 *:8443,8765 running (6m) 16s ago 6m 452M - 18.0.0-6578-g689b3d5a 83c9d078d785 5315c8c3c62c 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:mon.a smithi060 running (8m) 15s ago 8m 95.7M 2048M 18.0.0-6578-g689b3d5a 83c9d078d785 8c1744640888 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:mon.b smithi092 running (6m) 16s ago 6m 62.5M 2048M 18.0.0-6578-g689b3d5a 83c9d078d785 79832c67e7b1 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:mon.c smithi135 running (6m) 16s ago 6m 62.1M 2048M 18.0.0-6578-g689b3d5a 83c9d078d785 f4a877ef42f0 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 15s ago 6m 70.8M 4293M 18.0.0-6578-g689b3d5a 83c9d078d785 9bde1a98a733 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi092 running (5m) 16s ago 5m 78.1M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 b06dd7ce9fc5 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi135 running (5m) 16s ago 5m 75.8M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 9ccd65819f68 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi060 running (5m) 15s ago 5m 71.0M 4293M 18.0.0-6578-g689b3d5a 83c9d078d785 6f6acab550c0 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi092 running (4m) 16s ago 4m 67.6M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 9f22791a3f9b 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi135 running (4m) 16s ago 4m 71.7M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 3dc6de99f59d 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 smithi060 running (3m) 15s ago 3m 64.5M 4293M 18.0.0-6578-g689b3d5a 83c9d078d785 dfa349d1dfd9 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 smithi092 running (3m) 16s ago 3m 65.2M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 b1b767fbe9ae 2023-10-05T15:16:09.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 smithi135 running (3m) 16s ago 3m 66.7M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 2b2e6f711c98 2023-10-05T15:16:09.641 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 smithi060 running (2m) 15s ago 2m 63.8M 4293M 18.0.0-6578-g689b3d5a 83c9d078d785 8eb0c6c7637f 2023-10-05T15:16:09.641 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 smithi092 running (2m) 16s ago 2m 63.7M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 1871f32ad903 2023-10-05T15:16:09.641 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 smithi135 running (2m) 16s ago 2m 55.2M 4292M 18.0.0-6578-g689b3d5a 83c9d078d785 82b57098be67 2023-10-05T15:16:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc4540a1590 msgr2=0x7fc4540a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc4540a1590 0x7fc4540a3a50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc458005950 tx=0x7fc45800b410 comp rx=0 tx=0).stop 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 msgr2=0x7fc46819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 0x7fc46819d150 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc46000dbc0 tx=0x7fc46000ded0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 shutdown_connections 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc4540a1590 0x7fc4540a3a50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc468101990 0x7fc46819d150 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4680ffe70 0x7fc468195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 --2- 172.21.15.60:0/987327610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc468100fd0 0x7fc4681960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.638+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 >> 172.21.15.60:0/987327610 conn(0x7fc4680fb3f0 msgr2=0x7fc4680fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.639+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 shutdown_connections 2023-10-05T15:16:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:09.639+0000 7fc46d913700 1 -- 172.21.15.60:0/987327610 wait complete. 2023-10-05T15:16:10.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-05T15:16:10.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:10 smithi060 ceph-mon[99238]: pgmap v302: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:16:10.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:10 smithi060 ceph-mon[99238]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:10 smithi135 ceph-mon[103360]: pgmap v302: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:16:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:10 smithi135 ceph-mon[103360]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:10.583 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:10 smithi092 ceph-mon[102944]: pgmap v302: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:16:10.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:10 smithi092 ceph-mon[102944]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.810+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/748342377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e0101990 msgr2=0x7fc9e01082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.810+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/748342377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e0101990 0x7fc9e01082b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b0a0 tx=0x7fc9d800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/748342377 shutdown_connections 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/748342377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e0101990 0x7fc9e01082b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/748342377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/748342377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e0100fd0 0x7fc9e0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/748342377 >> 172.21.15.60:0/748342377 conn(0x7fc9e00fb3f0 msgr2=0x7fc9e00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/748342377 shutdown_connections 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/748342377 wait complete. 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 Processor -- start 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.811+0000 7fc9e4ba0700 1 -- start start 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e0100fd0 0x7fc9e01960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0101990 0x7fc9e019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e019d730 con 0x7fc9e00ffe70 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e019d870 con 0x7fc9e0100fd0 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e019da00 con 0x7fc9e0101990 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37348/0 (socket says 172.21.15.60:37348) 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 -- 172.21.15.60:0/707013467 learned_addr learned my addr 172.21.15.60:0/707013467 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9ded9d700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0101990 0x7fc9e019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9ddd9b700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e0100fd0 0x7fc9e01960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:11.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 -- 172.21.15.60:0/707013467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0101990 msgr2=0x7fc9e019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0101990 0x7fc9e019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 -- 172.21.15.60:0/707013467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e0100fd0 msgr2=0x7fc9e01960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e0100fd0 0x7fc9e01960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 -- 172.21.15.60:0/707013467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8009d00 con 0x7fc9e00ffe70 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9de59c700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0195ba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00099a0 tx=0x7fc9d0009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0012070 con 0x7fc9e00ffe70 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9d000d260 con 0x7fc9e00ffe70 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e0068a00 con 0x7fc9e00ffe70 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.812+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000caa0 con 0x7fc9e00ffe70 2023-10-05T15:16:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.813+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e0068f50 con 0x7fc9e00ffe70 2023-10-05T15:16:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.814+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e010b680 con 0x7fc9e00ffe70 2023-10-05T15:16:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.816+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc9d0007ce0 con 0x7fc9e00ffe70 2023-10-05T15:16:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.816+0000 7fc9d77fe700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9cc0a1590 0x7fc9cc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.816+0000 7fc9ddd9b700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9cc0a1590 0x7fc9cc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.816+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fc9d00ce1e0 con 0x7fc9e00ffe70 2023-10-05T15:16:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.817+0000 7fc9ddd9b700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9cc0a1590 0x7fc9cc0a3a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8005ea0 tx=0x7fc9c8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:11.820+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9d00973e0 con 0x7fc9e00ffe70 2023-10-05T15:16:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.028+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9e01071f0 con 0x7fc9cc0a1590 2023-10-05T15:16:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.036+0000 7fc9d77fe700 1 -- 172.21.15.60:0/707013467 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7fc9e01071f0 con 0x7fc9cc0a1590 2023-10-05T15:16:12.038 INFO:teuthology.orchestra.run.smithi060.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-05T15:16:12.039 INFO:teuthology.orchestra.run.smithi060.stdout:mds.all 12/12 19s ago 116s smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-10-05T15:16:12.039 INFO:teuthology.orchestra.run.smithi060.stdout:mgr 3/3 19s ago 6m smithi060=x;smithi092=y;smithi135=z;count:3 2023-10-05T15:16:12.039 INFO:teuthology.orchestra.run.smithi060.stdout:mon 3/3 19s ago 6m smithi060:172.21.15.60=a;smithi092:172.21.15.92=b;smithi135:172.21.15.135=c;count:3 2023-10-05T15:16:12.039 INFO:teuthology.orchestra.run.smithi060.stdout:osd 12 19s ago - 2023-10-05T15:16:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9cc0a1590 msgr2=0x7fc9cc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9cc0a1590 0x7fc9cc0a3a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8005ea0 tx=0x7fc9c8005e30 comp rx=0 tx=0).stop 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 msgr2=0x7fc9e0195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0195ba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00099a0 tx=0x7fc9d0009d60 comp rx=0 tx=0).stop 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 shutdown_connections 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0101990 0x7fc9e019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc9cc0a1590 0x7fc9cc0a3a50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e00ffe70 0x7fc9e0195ba0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 --2- 172.21.15.60:0/707013467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e0100fd0 0x7fc9e01960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.038+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 >> 172.21.15.60:0/707013467 conn(0x7fc9e00fb3f0 msgr2=0x7fc9e01044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.039+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 shutdown_connections 2023-10-05T15:16:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:12.039+0000 7fc9e4ba0700 1 -- 172.21.15.60:0/707013467 wait complete. 2023-10-05T15:16:12.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:12 smithi135 ceph-mon[103360]: pgmap v303: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:16:12.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:12 smithi135 ceph-mon[103360]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:12.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:12 smithi060 ceph-mon[99238]: pgmap v303: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:16:12.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:12 smithi060 ceph-mon[99238]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:12 smithi092 ceph-mon[102944]: pgmap v303: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:16:12.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:12 smithi092 ceph-mon[102944]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:12.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-05T15:16:13.004 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 -- 172.21.15.60:0/3490130550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 msgr2=0x7fe538101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 --2- 172.21.15.60:0/3490130550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538101390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5340099c0 tx=0x7fe534009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 -- 172.21.15.60:0/3490130550 shutdown_connections 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 --2- 172.21.15.60:0/3490130550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 0x7fe5381093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 --2- 172.21.15.60:0/3490130550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538101390 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 --2- 172.21.15.60:0/3490130550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe538102170 0x7fe5381025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 -- 172.21.15.60:0/3490130550 >> 172.21.15.60:0/3490130550 conn(0x7fe5380fc4d0 msgr2=0x7fe5380fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 -- 172.21.15.60:0/3490130550 shutdown_connections 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.199+0000 7fe54014b700 1 -- 172.21.15.60:0/3490130550 wait complete. 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 Processor -- start 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 -- start start 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe538102170 0x7fe5380732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:14.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 0x7fe5380737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538073f60 con 0x7fe538100f70 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380740d0 con 0x7fe538102170 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe54014b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381a0cb0 con 0x7fe538102b10 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe53dee7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe53dee7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37360/0 (socket says 172.21.15.60:37360) 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe53dee7700 1 -- 172.21.15.60:0/861997136 learned_addr learned my addr 172.21.15.60:0/861997136 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.200+0000 7fe53d6e6700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe538102170 0x7fe5380732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53e6e8700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 0x7fe5380737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53dee7700 1 -- 172.21.15.60:0/861997136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 msgr2=0x7fe5380737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53dee7700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 0x7fe5380737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53dee7700 1 -- 172.21.15.60:0/861997136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe538102170 msgr2=0x7fe5380732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:14.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53dee7700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe538102170 0x7fe5380732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53dee7700 1 -- 172.21.15.60:0/861997136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340095f0 con 0x7fe538100f70 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53e6e8700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 0x7fe5380737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe53dee7700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538074c50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe534009990 tx=0x7fe534003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53401d070 con 0x7fe538100f70 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe534004640 con 0x7fe538100f70 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5381a0f30 con 0x7fe538100f70 2023-10-05T15:16:14.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f460 con 0x7fe538100f70 2023-10-05T15:16:14.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.201+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5381a1340 con 0x7fe538100f70 2023-10-05T15:16:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.202+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5381085b0 con 0x7fe538100f70 2023-10-05T15:16:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.203+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe534003fa0 con 0x7fe538100f70 2023-10-05T15:16:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.204+0000 7fe52affd700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5240a1590 0x7fe5240a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.204+0000 7fe53d6e6700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5240a1590 0x7fe5240a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.204+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fe5340ceb00 con 0x7fe538100f70 2023-10-05T15:16:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.204+0000 7fe53d6e6700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5240a1590 0x7fe5240a3a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005950 tx=0x7fe52c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.207+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe534097ea0 con 0x7fe538100f70 2023-10-05T15:16:14.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:14 smithi060 ceph-mon[99238]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:16:14.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.417+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe53810c770 con 0x7fe5240a1590 2023-10-05T15:16:14.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.418+0000 7fe52affd700 1 -- 172.21.15.60:0/861997136 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fe53810c770 con 0x7fe5240a1590 2023-10-05T15:16:14.421 INFO:teuthology.orchestra.run.smithi060.stdout:HOST ADDR LABELS STATUS 2023-10-05T15:16:14.421 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 172.21.15.60 2023-10-05T15:16:14.421 INFO:teuthology.orchestra.run.smithi060.stdout:smithi092 172.21.15.92 2023-10-05T15:16:14.421 INFO:teuthology.orchestra.run.smithi060.stdout:smithi135 172.21.15.135 2023-10-05T15:16:14.422 INFO:teuthology.orchestra.run.smithi060.stdout:3 hosts in cluster 2023-10-05T15:16:14.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5240a1590 msgr2=0x7fe5240a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:14.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5240a1590 0x7fe5240a3a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005950 tx=0x7fe52c00a300 comp rx=0 tx=0).stop 2023-10-05T15:16:14.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 msgr2=0x7fe538074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538074c50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe534009990 tx=0x7fe534003af0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 shutdown_connections 2023-10-05T15:16:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe538102b10 0x7fe5380737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5240a1590 0x7fe5240a3a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100f70 0x7fe538074c50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 --2- 172.21.15.60:0/861997136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe538102170 0x7fe5380732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:14.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 >> 172.21.15.60:0/861997136 conn(0x7fe5380fc4d0 msgr2=0x7fe5381056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:14.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 shutdown_connections 2023-10-05T15:16:14.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:14.420+0000 7fe54014b700 1 -- 172.21.15.60:0/861997136 wait complete. 2023-10-05T15:16:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:14 smithi135 ceph-mon[103360]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:16:14.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:14 smithi092 ceph-mon[102944]: pgmap v304: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:16:14.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-05T15:16:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:15 smithi135 ceph-mon[103360]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:15.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:15 smithi060 ceph-mon[99238]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:15 smithi092 ceph-mon[102944]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:16.280 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:16 smithi060 ceph-mon[99238]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:16:16.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:16 smithi135 ceph-mon[103360]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:16:16.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:16 smithi092 ceph-mon[102944]: pgmap v305: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 -- 172.21.15.60:0/1179903437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3200100fd0 msgr2=0x7f3200101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 --2- 172.21.15.60:0/1179903437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3200100fd0 0x7f3200101450 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009990 tx=0x7f31f4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 -- 172.21.15.60:0/1179903437 shutdown_connections 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 --2- 172.21.15.60:0/1179903437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200101990 0x7f32001082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 --2- 172.21.15.60:0/1179903437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32000ffe70 0x7f3200100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 --2- 172.21.15.60:0/1179903437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3200100fd0 0x7f3200101450 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.801+0000 7f3207821700 1 -- 172.21.15.60:0/1179903437 >> 172.21.15.60:0/1179903437 conn(0x7f32000fb3f0 msgr2=0x7f32000fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 -- 172.21.15.60:0/1179903437 shutdown_connections 2023-10-05T15:16:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 -- 172.21.15.60:0/1179903437 wait complete. 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 Processor -- start 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 -- start start 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 0x7f3200069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3200100fd0 0x7f320019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200101990 0x7f320019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320019e770 con 0x7f32000ffe70 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320019e8e0 con 0x7f3200100fd0 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f3207821700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320019eaa0 con 0x7f3200101990 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.802+0000 7f32055bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 0x7f3200069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 0x7f3200069500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37374/0 (socket says 172.21.15.60:37374) 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 -- 172.21.15.60:0/1026960798 learned_addr learned my addr 172.21.15.60:0/1026960798 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f3205dbe700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200101990 0x7f320019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f3204dbc700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3200100fd0 0x7f320019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 -- 172.21.15.60:0/1026960798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200101990 msgr2=0x7f320019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200101990 0x7f320019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 -- 172.21.15.60:0/1026960798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3200100fd0 msgr2=0x7f320019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3200100fd0 0x7f320019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 -- 172.21.15.60:0/1026960798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40095f0 con 0x7f32000ffe70 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f3204dbc700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3200100fd0 0x7f320019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f32055bd700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 0x7f3200069500 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c9b0 tx=0x7f31fc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc007b00 con 0x7f32000ffe70 2023-10-05T15:16:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31fc007c60 con 0x7f32000ffe70 2023-10-05T15:16:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320019ed80 con 0x7f32000ffe70 2023-10-05T15:16:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc018660 con 0x7f32000ffe70 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.803+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320019f220 con 0x7f32000ffe70 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.804+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32001073b0 con 0x7f32000ffe70 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.805+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f31fc00f450 con 0x7f32000ffe70 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.806+0000 7f31f27fc700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f31ec0a1480 0x7f31ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.806+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f31fc0cd270 con 0x7f32000ffe70 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.806+0000 7f3204dbc700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f31ec0a1480 0x7f31ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.806+0000 7f3204dbc700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f31ec0a1480 0x7f31ec0a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31f400b5c0 tx=0x7f31f4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:16.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:16.810+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f31fc096660 con 0x7f32000ffe70 2023-10-05T15:16:17.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.018+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f320002d390 con 0x7f31ec0a1480 2023-10-05T15:16:17.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.020+0000 7f31f27fc700 1 -- 172.21.15.60:0/1026960798 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f320002d390 con 0x7f31ec0a1480 2023-10-05T15:16:17.022 INFO:teuthology.orchestra.run.smithi060.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-05T15:16:17.022 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-05T15:16:17.022 INFO:teuthology.orchestra.run.smithi060.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-05T15:16:17.022 INFO:teuthology.orchestra.run.smithi060.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-05T15:16:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f31ec0a1480 msgr2=0x7f31ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f31ec0a1480 0x7f31ec0a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31f400b5c0 tx=0x7f31f4005fb0 comp rx=0 tx=0).stop 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 msgr2=0x7f3200069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 0x7f3200069500 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c9b0 tx=0x7f31fc00ccc0 comp rx=0 tx=0).stop 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 shutdown_connections 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200101990 0x7f320019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f31ec0a1480 0x7f31ec0a3940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000ffe70 0x7f3200069500 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 --2- 172.21.15.60:0/1026960798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3200100fd0 0x7f320019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 >> 172.21.15.60:0/1026960798 conn(0x7f32000fb3f0 msgr2=0x7f32001044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 shutdown_connections 2023-10-05T15:16:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:17.023+0000 7f3207821700 1 -- 172.21.15.60:0/1026960798 wait complete. 2023-10-05T15:16:17.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:17 smithi060 ceph-mon[99238]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-10-05T15:16:17.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:17 smithi060 ceph-mon[99238]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:17.429 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-05T15:16:17.440 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:16:17.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-05T15:16:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:17 smithi135 ceph-mon[103360]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-10-05T15:16:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:17 smithi135 ceph-mon[103360]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:17 smithi092 ceph-mon[102944]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-10-05T15:16:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:17 smithi092 ceph-mon[102944]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:18.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:18 smithi060 ceph-mon[99238]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-05T15:16:18.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:18 smithi135 ceph-mon[103360]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-05T15:16:18.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:18 smithi092 ceph-mon[102944]: pgmap v306: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-05T15:16:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 -- 172.21.15.60:0/3630035160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14100f70 msgr2=0x7fcf14101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 --2- 172.21.15.60:0/3630035160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14100f70 0x7fcf14101390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcf040099c0 tx=0x7fcf04009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 -- 172.21.15.60:0/3630035160 shutdown_connections 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 --2- 172.21.15.60:0/3630035160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf14102b10 0x7fcf141093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 --2- 172.21.15.60:0/3630035160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14100f70 0x7fcf14101390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 --2- 172.21.15.60:0/3630035160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 0x7fcf141025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 -- 172.21.15.60:0/3630035160 >> 172.21.15.60:0/3630035160 conn(0x7fcf140fc4d0 msgr2=0x7fcf140fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 -- 172.21.15.60:0/3630035160 shutdown_connections 2023-10-05T15:16:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.202+0000 7fcf1be28700 1 -- 172.21.15.60:0/3630035160 wait complete. 2023-10-05T15:16:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 Processor -- start 2023-10-05T15:16:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 -- start start 2023-10-05T15:16:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf14100f70 0x7fcf14196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 0x7fcf141971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 0x7fcf1419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1419e830 con 0x7fcf14102b10 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1419e970 con 0x7fcf14102170 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1be28700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1419eb30 con 0x7fcf14100f70 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1a3c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 0x7fcf1419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf193c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 0x7fcf141971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1a3c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 0x7fcf1419e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37390/0 (socket says 172.21.15.60:37390) 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf193c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 0x7fcf141971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:50810/0 (socket says 172.21.15.60:50810) 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf1a3c5700 1 -- 172.21.15.60:0/777092168 learned_addr learned my addr 172.21.15.60:0/777092168 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.203+0000 7fcf19bc4700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf14100f70 0x7fcf14196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1a3c5700 1 -- 172.21.15.60:0/777092168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf14100f70 msgr2=0x7fcf14196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1a3c5700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf14100f70 0x7fcf14196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1a3c5700 1 -- 172.21.15.60:0/777092168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 msgr2=0x7fcf141971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1a3c5700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 0x7fcf141971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1a3c5700 1 -- 172.21.15.60:0/777092168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040095f0 con 0x7fcf14102b10 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1a3c5700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 0x7fcf1419e260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00b970 tx=0x7fcf0c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00d860 con 0x7fcf14102b10 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf0c00de80 con 0x7fcf14102b10 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1419ee10 con 0x7fcf14102b10 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c017400 con 0x7fcf14102b10 2023-10-05T15:16:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.204+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1419f230 con 0x7fcf14102b10 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.205+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf141085c0 con 0x7fcf14102b10 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.206+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcf0c00e630 con 0x7fcf14102b10 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.207+0000 7fcf0affd700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf000a1480 0x7fcf000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.207+0000 7fcf19bc4700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf000a1480 0x7fcf000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.207+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fcf0c006e40 con 0x7fcf14102b10 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.207+0000 7fcf19bc4700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf000a1480 0x7fcf000a3940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009f50 tx=0x7fcf0400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.210+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf0c0960f0 con 0x7fcf14102b10 2023-10-05T15:16:19.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.456+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf1402cf70 con 0x7fcf14102b10 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.457+0000 7fcf0affd700 1 -- 172.21.15.60:0/777092168 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2966 (secure 0 0 0) 0x7fcf0c099710 con 0x7fcf14102b10 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout:e27 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2023-10-05T15:16:19.459 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 27 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:created 2023-10-05T15:14:47.613338+0000 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2023-10-05T15:15:11.025418+0000 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 300 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2023-10-05T15:16:19.460 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 5 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:in 0,1,2,3,4 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=24533,1=24496,2=24488,3=24472,4=24461} 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3,4] 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2023-10-05T15:16:19.461 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 0 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b{0:24533} state up:active seq 3 addr [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.f{0:24460} state up:standby-replay seq 1 addr [v2:172.21.15.135:6834/4284373269,v1:172.21.15.135:6835/4284373269] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.i{1:24496} state up:active seq 9 addr [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.k{1:24434} state up:standby-replay seq 1 addr [v2:172.21.15.92:6832/1259260250,v1:172.21.15.92:6833/1259260250] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.h{2:24488} state up:active seq 10 addr [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.l{2:24421} state up:standby-replay seq 1 addr [v2:172.21.15.135:6832/3118655820,v1:172.21.15.135:6833/3118655820] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c{3:24472} state up:active seq 11 addr [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.462 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a{3:14610} state up:standby-replay seq 1 addr [v2:172.21.15.60:6840/1110694579,v1:172.21.15.60:6841/1110694579] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.e{4:24461} state up:active seq 12 addr [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.g{4:14598} state up:standby-replay seq 1 addr [v2:172.21.15.60:6838/1500527837,v1:172.21.15.60:6839/1500527837] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.j{-1:14535} state up:standby seq 1 addr [v2:172.21.15.60:6834/2448218707,v1:172.21.15.60:6835/2448218707] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.463 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.60:6836/416878759,v1:172.21.15.60:6837/416878759] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:16:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf000a1480 msgr2=0x7fcf000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf000a1480 0x7fcf000a3940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009f50 tx=0x7fcf0400b540 comp rx=0 tx=0).stop 2023-10-05T15:16:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 msgr2=0x7fcf1419e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 0x7fcf1419e260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00b970 tx=0x7fcf0c00bc80 comp rx=0 tx=0).stop 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 shutdown_connections 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fcf000a1480 0x7fcf000a3940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14102b10 0x7fcf1419e260 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf14100f70 0x7fcf14196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 --2- 172.21.15.60:0/777092168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf14102170 0x7fcf141971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 >> 172.21.15.60:0/777092168 conn(0x7fcf140fc4d0 msgr2=0x7fcf14105700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 shutdown_connections 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:19.459+0000 7fcf1be28700 1 -- 172.21.15.60:0/777092168 wait complete. 2023-10-05T15:16:19.465 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:19.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-05T15:16:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:20 smithi135 ceph-mon[103360]: pgmap v307: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 596 B/s wr, 9 op/s 2023-10-05T15:16:20.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:20 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/777092168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-05T15:16:20.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:20 smithi060 ceph-mon[99238]: pgmap v307: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 596 B/s wr, 9 op/s 2023-10-05T15:16:20.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:20 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/777092168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-05T15:16:20.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:20 smithi092 ceph-mon[102944]: pgmap v307: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 596 B/s wr, 9 op/s 2023-10-05T15:16:20.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:20 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/777092168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-05T15:16:21.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.763+0000 7f5f39006700 1 -- 172.21.15.60:0/2679262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f34100fd0 msgr2=0x7f5f34101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 --2- 172.21.15.60:0/2679262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f34100fd0 0x7f5f34101450 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009990 tx=0x7f5f28009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 -- 172.21.15.60:0/2679262392 shutdown_connections 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 --2- 172.21.15.60:0/2679262392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f34101990 0x7f5f341082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 --2- 172.21.15.60:0/2679262392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f340ffe70 0x7f5f34100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 --2- 172.21.15.60:0/2679262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f34100fd0 0x7f5f34101450 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 -- 172.21.15.60:0/2679262392 >> 172.21.15.60:0/2679262392 conn(0x7f5f340fb3f0 msgr2=0x7f5f340fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 -- 172.21.15.60:0/2679262392 shutdown_connections 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 -- 172.21.15.60:0/2679262392 wait complete. 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.764+0000 7f5f39006700 1 Processor -- start 2023-10-05T15:16:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 -- start start 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 0x7f5f34103df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f34100fd0 0x7f5f34102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f34101990 0x7f5f34102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34103100 con 0x7f5f340ffe70 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34103270 con 0x7f5f34100fd0 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f39006700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f341a0d20 con 0x7f5f34101990 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 0x7f5f34103df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 0x7f5f34103df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37398/0 (socket says 172.21.15.60:37398) 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 -- 172.21.15.60:0/1471841170 learned_addr learned my addr 172.21.15.60:0/1471841170 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f3359e700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f34101990 0x7f5f34102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f3259c700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f34100fd0 0x7f5f34102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:21.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 -- 172.21.15.60:0/1471841170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f34101990 msgr2=0x7f5f34102980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f34101990 0x7f5f34102980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 -- 172.21.15.60:0/1471841170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f34100fd0 msgr2=0x7f5f34102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f34100fd0 0x7f5f34102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 -- 172.21.15.60:0/1471841170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280095f0 con 0x7f5f340ffe70 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.765+0000 7f5f32d9d700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 0x7f5f34103df0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400d950 tx=0x7f5f2400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.766+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400f890 con 0x7f5f340ffe70 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.766+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f24010460 con 0x7f5f340ffe70 2023-10-05T15:16:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.766+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400e610 con 0x7f5f340ffe70 2023-10-05T15:16:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.766+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f341a0fa0 con 0x7f5f340ffe70 2023-10-05T15:16:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.766+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f341a1410 con 0x7f5f340ffe70 2023-10-05T15:16:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.767+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3410b680 con 0x7f5f340ffe70 2023-10-05T15:16:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.768+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5f240108d0 con 0x7f5f340ffe70 2023-10-05T15:16:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.768+0000 7f5f1bfff700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5f1c0a1500 0x7f5f1c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.769+0000 7f5f3259c700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5f1c0a1500 0x7f5f1c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.769+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f5f240ccd20 con 0x7f5f340ffe70 2023-10-05T15:16:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.769+0000 7f5f3259c700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5f1c0a1500 0x7f5f1c0a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800b5c0 tx=0x7f5f28005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.773+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5f24096020 con 0x7f5f340ffe70 2023-10-05T15:16:21.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.975+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f5f341a1600 con 0x7f5f340ffe70 2023-10-05T15:16:21.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.976+0000 7f5f1bfff700 1 -- 172.21.15.60:0/1471841170 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) v1 ==== 56+0+5551 (secure 0 0 0) 0x7f5f24099640 con 0x7f5f340ffe70 2023-10-05T15:16:21.977 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 90 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:created 2023-10-05T15:07:46.061674+0000 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2023-10-05T15:15:47.054432+0000 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:crush_version 27 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:full_ratio 0.95 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:backfillfull_ratio 0.9 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:nearfull_ratio 0.85 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:require_min_compat_client luminous 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:min_compat_client luminous 2023-10-05T15:16:21.978 INFO:teuthology.orchestra.run.smithi060.stdout:require_osd_release reef 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:stretch_mode_enabled false 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:max_osd 12 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6802/3848725098,v1:172.21.15.60:6803/3848725098] [v2:172.21.15.60:6804/3848725098,v1:172.21.15.60:6805/3848725098] exists,up 347f2ced-67e4-4e5a-9259-3bbb7716df2f 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6800/502814453,v1:172.21.15.92:6801/502814453] [v2:172.21.15.92:6802/502814453,v1:172.21.15.92:6803/502814453] exists,up 31b61e8d-4c45-43bd-ae04-807def1aa75e 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/391606832,v1:172.21.15.135:6801/391606832] [v2:172.21.15.135:6802/391606832,v1:172.21.15.135:6803/391606832] exists,up d5814980-a6fb-4a86-86f0-d59539b4515a 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 up in weight 1 up_from 26 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6810/4586473,v1:172.21.15.60:6811/4586473] [v2:172.21.15.60:6812/4586473,v1:172.21.15.60:6813/4586473] exists,up 5847cb91-24d6-43e4-ad16-e1410664b98f 2023-10-05T15:16:21.979 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 up in weight 1 up_from 34 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6808/3732185580,v1:172.21.15.92:6809/3732185580] [v2:172.21.15.92:6810/3732185580,v1:172.21.15.92:6811/3732185580] exists,up 0d375042-3a53-4d3d-87c6-a23e1312fcaf 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 up in weight 1 up_from 39 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/3143637698,v1:172.21.15.135:6809/3143637698] [v2:172.21.15.135:6810/3143637698,v1:172.21.15.135:6811/3143637698] exists,up 5967fc00-aa3b-4b43-ac63-4b5444cbf486 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6818/2234761108,v1:172.21.15.60:6819/2234761108] [v2:172.21.15.60:6820/2234761108,v1:172.21.15.60:6821/2234761108] exists,up acf54d89-6f62-4433-90cf-d1f90de08ca8 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 up in weight 1 up_from 52 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6816/784886390,v1:172.21.15.92:6817/784886390] [v2:172.21.15.92:6818/784886390,v1:172.21.15.92:6819/784886390] exists,up 575cac22-a90b-42aa-9b1f-c2cd5fbd82e3 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 up in weight 1 up_from 59 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/2545710917,v1:172.21.15.135:6817/2545710917] [v2:172.21.15.135:6818/2545710917,v1:172.21.15.135:6819/2545710917] exists,up 30b375fe-d15e-48c7-8154-3c1aeeaf4b93 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 up in weight 1 up_from 67 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6826/2673223699,v1:172.21.15.60:6827/2673223699] [v2:172.21.15.60:6828/2673223699,v1:172.21.15.60:6829/2673223699] exists,up 944c5503-34c9-4e9c-9429-fd03f0e9013b 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 up in weight 1 up_from 72 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6824/2400346223,v1:172.21.15.92:6825/2400346223] [v2:172.21.15.92:6826/2400346223,v1:172.21.15.92:6827/2400346223] exists,up 7809fa8d-bdd5-4fe7-8057-6ac9f82a8381 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 up in weight 1 up_from 79 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/2696703622,v1:172.21.15.135:6825/2696703622] [v2:172.21.15.135:6826/2696703622,v1:172.21.15.135:6827/2696703622] exists,up b44347aa-119e-4c10-a5c7-56ae0b781fbc 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.2 [3,9] 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.1a [5,6] 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.21 [4,8] 2023-10-05T15:16:21.980 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.23 [4,7] 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.25 [5,9] 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.34 [4,9] 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 4.6 [9,11,5,8] 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 4.c [9,10] 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 4.17 [9,8] 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/1216724188 expires 2023-10-06T15:08:45.079337+0000 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6801/2843655042 expires 2023-10-06T15:08:45.079337+0000 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6800/2843655042 expires 2023-10-06T15:08:45.079337+0000 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6800/4045235795 expires 2023-10-06T15:08:18.717027+0000 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/4067501312 expires 2023-10-06T15:08:18.717027+0000 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6801/4045235795 expires 2023-10-06T15:08:18.717027+0000 2023-10-05T15:16:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/4231976701 expires 2023-10-06T15:08:45.079337+0000 2023-10-05T15:16:21.982 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/2162692982 expires 2023-10-06T15:08:18.717027+0000 2023-10-05T15:16:21.982 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/649476863 expires 2023-10-06T15:08:18.717027+0000 2023-10-05T15:16:21.982 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/364014604 expires 2023-10-06T15:08:45.079337+0000 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5f1c0a1500 msgr2=0x7f5f1c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5f1c0a1500 0x7f5f1c0a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800b5c0 tx=0x7f5f28005960 comp rx=0 tx=0).stop 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 msgr2=0x7f5f34103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 0x7f5f34103df0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400d950 tx=0x7f5f2400dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 shutdown_connections 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f34101990 0x7f5f34102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5f1c0a1500 0x7f5f1c0a39c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f340ffe70 0x7f5f34103df0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 --2- 172.21.15.60:0/1471841170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f34100fd0 0x7f5f34102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 >> 172.21.15.60:0/1471841170 conn(0x7f5f340fb3f0 msgr2=0x7f5f34068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:21.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 shutdown_connections 2023-10-05T15:16:21.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:21.978+0000 7f5f39006700 1 -- 172.21.15.60:0/1471841170 wait complete. 2023-10-05T15:16:22.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:22 smithi135 ceph-mon[103360]: pgmap v308: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 596 B/s wr, 12 op/s 2023-10-05T15:16:22.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:22 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1471841170' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-05T15:16:22.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:22 smithi060 ceph-mon[99238]: pgmap v308: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 596 B/s wr, 12 op/s 2023-10-05T15:16:22.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:22 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1471841170' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-05T15:16:22.411 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-05T15:16:22.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:22 smithi092 ceph-mon[102944]: pgmap v308: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 596 B/s wr, 12 op/s 2023-10-05T15:16:22.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:22 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1471841170' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-05T15:16:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 -- 172.21.15.60:0/752917594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 msgr2=0x7f431c1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 --2- 172.21.15.60:0/752917594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c1001e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f43180099c0 tx=0x7f4318009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 -- 172.21.15.60:0/752917594 shutdown_connections 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 --2- 172.21.15.60:0/752917594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c101950 0x7f431c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 --2- 172.21.15.60:0/752917594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c1001e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 --2- 172.21.15.60:0/752917594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c100fb0 0x7f431c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 -- 172.21.15.60:0/752917594 >> 172.21.15.60:0/752917594 conn(0x7f431c0fb310 msgr2=0x7f431c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 -- 172.21.15.60:0/752917594 shutdown_connections 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 -- 172.21.15.60:0/752917594 wait complete. 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 Processor -- start 2023-10-05T15:16:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.552+0000 7f4324700700 1 -- start start 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c100fb0 0x7f431c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c101950 0x7f431c19de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c19e630 con 0x7f431c0ffdc0 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c19e7a0 con 0x7f431c100fb0 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c19e960 con 0x7f431c101950 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37410/0 (socket says 172.21.15.60:37410) 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 -- 172.21.15.60:0/3006973861 learned_addr learned my addr 172.21.15.60:0/3006973861 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4322c9d700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c101950 0x7f431c19de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4321c9b700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c100fb0 0x7f431c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 -- 172.21.15.60:0/3006973861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c101950 msgr2=0x7f431c19de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c101950 0x7f431c19de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 -- 172.21.15.60:0/3006973861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c100fb0 msgr2=0x7f431c19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c100fb0 0x7f431c19b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 -- 172.21.15.60:0/3006973861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180095f0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4322c9d700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c101950 0x7f431c19de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4321c9b700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c100fb0 0x7f431c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f432249c700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c068bd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4318009990 tx=0x7f4318003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431801d070 con 0x7f431c0ffdc0 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4318004640 con 0x7f431c0ffdc0 2023-10-05T15:16:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800f460 con 0x7f431c0ffdc0 2023-10-05T15:16:22.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431c19ebe0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.553+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431c19f040 con 0x7f431c0ffdc0 2023-10-05T15:16:22.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.554+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431c1072b0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.556+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4318004050 con 0x7f431c0ffdc0 2023-10-05T15:16:22.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.556+0000 7f430f7fe700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43080a14d0 0x7f43080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.556+0000 7f4321c9b700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43080a14d0 0x7f43080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.556+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f43180ceae0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.557+0000 7f4321c9b700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43080a14d0 0x7f43080a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f431c068940 tx=0x7f4310005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:22.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.559+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4318097ed0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.761+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f431c10b5d0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.762+0000 7f430f7fe700 1 -- 172.21.15.60:0/3006973861 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f431809b4f0 con 0x7f431c0ffdc0 2023-10-05T15:16:22.764 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:22.765 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43080a14d0 msgr2=0x7f43080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43080a14d0 0x7f43080a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f431c068940 tx=0x7f4310005f50 comp rx=0 tx=0).stop 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 msgr2=0x7f431c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c068bd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4318009990 tx=0x7f4318003ba0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 shutdown_connections 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431c101950 0x7f431c19de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f43080a14d0 0x7f43080a3990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f431c0ffdc0 0x7f431c068bd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 --2- 172.21.15.60:0/3006973861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f431c100fb0 0x7f431c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 >> 172.21.15.60:0/3006973861 conn(0x7f431c0fb310 msgr2=0x7f431c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 shutdown_connections 2023-10-05T15:16:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.765+0000 7f4324700700 1 -- 172.21.15.60:0/3006973861 wait complete. 2023-10-05T15:16:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:16:22.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:16:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 -- 172.21.15.60:0/3277260109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141019a0 msgr2=0x7fda14103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 --2- 172.21.15.60:0/3277260109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141019a0 0x7fda14103d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda10009990 tx=0x7fda10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 -- 172.21.15.60:0/3277260109 shutdown_connections 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 --2- 172.21.15.60:0/3277260109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda14106c00 0x7fda14109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 --2- 172.21.15.60:0/3277260109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141019a0 0x7fda14103d90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 --2- 172.21.15.60:0/3277260109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda141042d0 0x7fda141066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 -- 172.21.15.60:0/3277260109 >> 172.21.15.60:0/3277260109 conn(0x7fda140fb330 msgr2=0x7fda140fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 -- 172.21.15.60:0/3277260109 shutdown_connections 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.907+0000 7fda1c34b700 1 -- 172.21.15.60:0/3277260109 wait complete. 2023-10-05T15:16:22.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 Processor -- start 2023-10-05T15:16:22.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 -- start start 2023-10-05T15:16:22.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda141019a0 0x7fda14196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 0x7fda14197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda14106c00 0x7fda1419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419e760 con 0x7fda141042d0 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419e8a0 con 0x7fda14106c00 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1c34b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419ea30 con 0x7fda141019a0 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda198e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 0x7fda14197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda198e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 0x7fda14197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37426/0 (socket says 172.21.15.60:37426) 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda198e6700 1 -- 172.21.15.60:0/1205867940 learned_addr learned my addr 172.21.15.60:0/1205867940 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.908+0000 7fda1a0e7700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda141019a0 0x7fda14196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda1a8e8700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda14106c00 0x7fda1419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda198e6700 1 -- 172.21.15.60:0/1205867940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda141019a0 msgr2=0x7fda14196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda198e6700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda141019a0 0x7fda14196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda198e6700 1 -- 172.21.15.60:0/1205867940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda14106c00 msgr2=0x7fda1419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda198e6700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda14106c00 0x7fda1419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda198e6700 1 -- 172.21.15.60:0/1205867940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda100095f0 con 0x7fda141042d0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda1a0e7700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda141019a0 0x7fda14196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda1a8e8700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda14106c00 0x7fda1419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda198e6700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 0x7fda14197120 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda0400e9a0 tx=0x7fda0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04009790 con 0x7fda141042d0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda0400cbd0 con 0x7fda141042d0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1419ed10 con 0x7fda141042d0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04018680 con 0x7fda141042d0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.909+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1419f210 con 0x7fda141042d0 2023-10-05T15:16:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.910+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda140fceb0 con 0x7fda141042d0 2023-10-05T15:16:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.911+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fda0400cd40 con 0x7fda141042d0 2023-10-05T15:16:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.912+0000 7fda0b7fe700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fda000a1500 0x7fda000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.912+0000 7fda1a0e7700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fda000a1500 0x7fda000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.912+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fda04014070 con 0x7fda141042d0 2023-10-05T15:16:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.912+0000 7fda1a0e7700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fda000a1500 0x7fda000a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda1000b2e0 tx=0x7fda10005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:22.915+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fda04096ab0 con 0x7fda141042d0 2023-10-05T15:16:23.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.120+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda140008d0 con 0x7fda141042d0 2023-10-05T15:16:23.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.120+0000 7fda0b7fe700 1 -- 172.21.15.60:0/1205867940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda0409a0d0 con 0x7fda141042d0 2023-10-05T15:16:23.122 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:16:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fda000a1500 msgr2=0x7fda000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fda000a1500 0x7fda000a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda1000b2e0 tx=0x7fda10005fb0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 msgr2=0x7fda14197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 0x7fda14197120 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda0400e9a0 tx=0x7fda0400ed60 comp rx=0 tx=0).stop 2023-10-05T15:16:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 shutdown_connections 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda14106c00 0x7fda1419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda141019a0 0x7fda14196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fda000a1500 0x7fda000a39c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 --2- 172.21.15.60:0/1205867940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda141042d0 0x7fda14197120 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 >> 172.21.15.60:0/1205867940 conn(0x7fda140fb330 msgr2=0x7fda14102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 shutdown_connections 2023-10-05T15:16:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.122+0000 7fda1c34b700 1 -- 172.21.15.60:0/1205867940 wait complete. 2023-10-05T15:16:23.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:16:23.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 -- 172.21.15.60:0/1887492916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0100fe0 msgr2=0x7f33f0101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 --2- 172.21.15.60:0/1887492916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0100fe0 0x7f33f0101440 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099c0 tx=0x7f33d8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 -- 172.21.15.60:0/1887492916 shutdown_connections 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 --2- 172.21.15.60:0/1887492916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0101980 0x7f33f0108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 --2- 172.21.15.60:0/1887492916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 0x7f33f0100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 --2- 172.21.15.60:0/1887492916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0100fe0 0x7f33f0101440 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 -- 172.21.15.60:0/1887492916 >> 172.21.15.60:0/1887492916 conn(0x7f33f00fb380 msgr2=0x7f33f00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 -- 172.21.15.60:0/1887492916 shutdown_connections 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.265+0000 7f33f57f3700 1 -- 172.21.15.60:0/1887492916 wait complete. 2023-10-05T15:16:23.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 Processor -- start 2023-10-05T15:16:23.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 -- start start 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 0x7f33f0103d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0100fe0 0x7f33f01023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 0x7f33f0102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01030a0 con 0x7f33f0101980 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0103210 con 0x7f33f00ffdf0 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33f57f3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01a0bc0 con 0x7f33f0100fe0 2023-10-05T15:16:23.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 0x7f33f0102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 0x7f33f0103d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 0x7f33f0102900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37442/0 (socket says 172.21.15.60:37442) 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33ef7fe700 1 -- 172.21.15.60:0/861980296 learned_addr learned my addr 172.21.15.60:0/861980296 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.266+0000 7f33eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 0x7f33f0103d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:50860/0 (socket says 172.21.15.60:50860) 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33e67fc700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0100fe0 0x7f33f01023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ef7fe700 1 -- 172.21.15.60:0/861980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0100fe0 msgr2=0x7f33f01023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ef7fe700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0100fe0 0x7f33f01023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ef7fe700 1 -- 172.21.15.60:0/861980296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 msgr2=0x7f33f0103d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ef7fe700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 0x7f33f0103d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ef7fe700 1 -- 172.21.15.60:0/861980296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80095f0 con 0x7f33f0101980 2023-10-05T15:16:23.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ef7fe700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 0x7f33f0102900 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f33e800b970 tx=0x7f33e800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:23.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800c930 con 0x7f33f0101980 2023-10-05T15:16:23.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33e8014440 con 0x7f33f0101980 2023-10-05T15:16:23.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f01a0ea0 con 0x7f33f0101980 2023-10-05T15:16:23.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80075d0 con 0x7f33f0101980 2023-10-05T15:16:23.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.267+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f01a1320 con 0x7f33f0101980 2023-10-05T15:16:23.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.268+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f010b680 con 0x7f33f0101980 2023-10-05T15:16:23.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.269+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f33e80145b0 con 0x7f33f0101980 2023-10-05T15:16:23.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.270+0000 7f33ecff9700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33dc0a1480 0x7f33dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.270+0000 7f33eeffd700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33dc0a1480 0x7f33dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.270+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f33e8006e40 con 0x7f33f0101980 2023-10-05T15:16:23.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.271+0000 7f33eeffd700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33dc0a1480 0x7f33dc0a3940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f33f0100e40 tx=0x7f33e000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:23.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.274+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f33e8095bb0 con 0x7f33f0101980 2023-10-05T15:16:23.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:23 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3006973861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:23.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:23 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3006973861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:23.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:23 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3006973861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:23.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.476+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33f01a1570 con 0x7f33f0101980 2023-10-05T15:16:23.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.476+0000 7f33ecff9700 1 -- 172.21.15.60:0/861980296 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33e80991d0 con 0x7f33f0101980 2023-10-05T15:16:23.478 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:23.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33dc0a1480 msgr2=0x7f33dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33dc0a1480 0x7f33dc0a3940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f33f0100e40 tx=0x7f33e000a3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 msgr2=0x7f33f0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 0x7f33f0102900 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f33e800b970 tx=0x7f33e800bc80 comp rx=0 tx=0).stop 2023-10-05T15:16:23.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 shutdown_connections 2023-10-05T15:16:23.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f33dc0a1480 0x7f33dc0a3940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f0101980 0x7f33f0102900 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f00ffdf0 0x7f33f0103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 --2- 172.21.15.60:0/861980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0100fe0 0x7f33f01023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 >> 172.21.15.60:0/861980296 conn(0x7f33f00fb380 msgr2=0x7f33f00692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:23.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 shutdown_connections 2023-10-05T15:16:23.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.478+0000 7f33f57f3700 1 -- 172.21.15.60:0/861980296 wait complete. 2023-10-05T15:16:23.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:16:23.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1008329110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 msgr2=0x7f1fbc101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1008329110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc101450 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0099c0 tx=0x7f1fac009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1008329110 shutdown_connections 2023-10-05T15:16:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1008329110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc101990 0x7f1fbc108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1008329110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fbc0ffe00 0x7f1fbc100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1008329110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc101450 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1008329110 >> 172.21.15.60:0/1008329110 conn(0x7f1fbc0fb3b0 msgr2=0x7f1fbc0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1008329110 shutdown_connections 2023-10-05T15:16:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.619+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1008329110 wait complete. 2023-10-05T15:16:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 Processor -- start 2023-10-05T15:16:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 -- start start 2023-10-05T15:16:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc0ffe00 0x7f1fbc069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fbc101990 0x7f1fbc19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc19e730 con 0x7f1fbc100ff0 2023-10-05T15:16:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc19e8a0 con 0x7f1fbc101990 2023-10-05T15:16:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fc10ce700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc19ea60 con 0x7f1fbc0ffe00 2023-10-05T15:16:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.620+0000 7f1fba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc19b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37454/0 (socket says 172.21.15.60:37454) 2023-10-05T15:16:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 -- 172.21.15.60:0/1135955419 learned_addr learned my addr 172.21.15.60:0/1135955419 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fbb59e700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fbc101990 0x7f1fbc19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fbad9d700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc0ffe00 0x7f1fbc069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 -- 172.21.15.60:0/1135955419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc0ffe00 msgr2=0x7f1fbc069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc0ffe00 0x7f1fbc069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 -- 172.21.15.60:0/1135955419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fbc101990 msgr2=0x7f1fbc19df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fbc101990 0x7f1fbc19df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 -- 172.21.15.60:0/1135955419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0095f0 con 0x7f1fbc100ff0 2023-10-05T15:16:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fbad9d700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc0ffe00 0x7f1fbc069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fba59c700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc19b900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00c010 tx=0x7f1fac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac01d070 con 0x7f1fbc100ff0 2023-10-05T15:16:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc19ece0 con 0x7f1fbc100ff0 2023-10-05T15:16:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fac0040d0 con 0x7f1fbc100ff0 2023-10-05T15:16:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac005290 con 0x7f1fbc100ff0 2023-10-05T15:16:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.621+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc19f160 con 0x7f1fbc100ff0 2023-10-05T15:16:23.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.622+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc106d80 con 0x7f1fbc100ff0 2023-10-05T15:16:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.623+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1fac004810 con 0x7f1fbc100ff0 2023-10-05T15:16:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.624+0000 7f1fa3fff700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1fa40a1480 0x7f1fa40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.624+0000 7f1fbad9d700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1fa40a1480 0x7f1fa40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.624+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1fac0ce310 con 0x7f1fbc100ff0 2023-10-05T15:16:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.625+0000 7f1fbad9d700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1fa40a1480 0x7f1fa40a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc100e50 tx=0x7f1fb000b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.628+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1fac097700 con 0x7f1fbc100ff0 2023-10-05T15:16:23.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.832+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fbc02d1c0 con 0x7f1fbc100ff0 2023-10-05T15:16:23.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.832+0000 7f1fa3fff700 1 -- 172.21.15.60:0/1135955419 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fac09ad20 con 0x7f1fbc100ff0 2023-10-05T15:16:23.834 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:23.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1fa40a1480 msgr2=0x7f1fa40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1fa40a1480 0x7f1fa40a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc100e50 tx=0x7f1fb000b670 comp rx=0 tx=0).stop 2023-10-05T15:16:23.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 msgr2=0x7f1fbc19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc19b900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00c010 tx=0x7f1fac009580 comp rx=0 tx=0).stop 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 shutdown_connections 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fbc101990 0x7f1fbc19df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fbc0ffe00 0x7f1fbc069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1fa40a1480 0x7f1fa40a3940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 --2- 172.21.15.60:0/1135955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fbc100ff0 0x7f1fbc19b900 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 >> 172.21.15.60:0/1135955419 conn(0x7f1fbc0fb3b0 msgr2=0x7f1fbc0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 shutdown_connections 2023-10-05T15:16:23.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.834+0000 7f1fc10ce700 1 -- 172.21.15.60:0/1135955419 wait complete. 2023-10-05T15:16:23.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 -- 172.21.15.60:0/3653118410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 msgr2=0x7fadb4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 --2- 172.21.15.60:0/3653118410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb4109350 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fadac00b0a0 tx=0x7fadac00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 -- 172.21.15.60:0/3653118410 shutdown_connections 2023-10-05T15:16:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 --2- 172.21.15.60:0/3653118410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb4109350 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 --2- 172.21.15.60:0/3653118410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb4100e90 0x7fadb41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 --2- 172.21.15.60:0/3653118410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb4102070 0x7fadb41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 -- 172.21.15.60:0/3653118410 >> 172.21.15.60:0/3653118410 conn(0x7fadb40fc430 msgr2=0x7fadb40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 -- 172.21.15.60:0/3653118410 shutdown_connections 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.977+0000 7fadba37f700 1 -- 172.21.15.60:0/3653118410 wait complete. 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 Processor -- start 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 -- start start 2023-10-05T15:16:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb4100e90 0x7fadb4196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb4102070 0x7fadb4197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb419e860 con 0x7fadb4102a30 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb419e9d0 con 0x7fadb4102070 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadba37f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb419eb90 con 0x7fadb4100e90 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadb891c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadb891c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb419e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37470/0 (socket says 172.21.15.60:37470) 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadb891c700 1 -- 172.21.15.60:0/295050579 learned_addr learned my addr 172.21.15.60:0/295050579 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadb37fe700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb4102070 0x7fadb4197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.978+0000 7fadb3fff700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb4100e90 0x7fadb4196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb891c700 1 -- 172.21.15.60:0/295050579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb4100e90 msgr2=0x7fadb4196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb891c700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb4100e90 0x7fadb4196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb891c700 1 -- 172.21.15.60:0/295050579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb4102070 msgr2=0x7fadb4197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb891c700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb4102070 0x7fadb4197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb891c700 1 -- 172.21.15.60:0/295050579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8009520 con 0x7fadb4102a30 2023-10-05T15:16:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb891c700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb419e290 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fadac00b780 tx=0x7fadac00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:23.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00e040 con 0x7fadb4102a30 2023-10-05T15:16:23.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadac004c50 con 0x7fadb4102a30 2023-10-05T15:16:23.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac009d00 con 0x7fadb4102a30 2023-10-05T15:16:23.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac005280 con 0x7fadb4102a30 2023-10-05T15:16:23.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.979+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb419f100 con 0x7fadb4102a30 2023-10-05T15:16:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.980+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb410c720 con 0x7fadb4102a30 2023-10-05T15:16:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.981+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fadac01d470 con 0x7fadb4102a30 2023-10-05T15:16:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.982+0000 7fadb17fa700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a1480 0x7fad9c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.982+0000 7fadb3fff700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a1480 0x7fad9c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:23.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.982+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fadac0cecf0 con 0x7fadb4102a30 2023-10-05T15:16:23.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.982+0000 7fadb3fff700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a1480 0x7fad9c0a3940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fadb41981f0 tx=0x7fada4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:23.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:23.985+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadac098200 con 0x7fadb4102a30 2023-10-05T15:16:24.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:24 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1205867940' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:24 smithi060 ceph-mon[99238]: pgmap v309: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 596 B/s wr, 9 op/s 2023-10-05T15:16:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:24 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/861980296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:24 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1135955419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.192+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fadb4107e10 con 0x7fadb4102a30 2023-10-05T15:16:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.192+0000 7fadb17fa700 1 -- 172.21.15.60:0/295050579 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fadac09b820 con 0x7fadb4102a30 2023-10-05T15:16:24.195 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.194+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a1480 msgr2=0x7fad9c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.194+0000 7fadba37f700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a1480 0x7fad9c0a3940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fadb41981f0 tx=0x7fada4009260 comp rx=0 tx=0).stop 2023-10-05T15:16:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.194+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 msgr2=0x7fadb419e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.194+0000 7fadba37f700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb419e290 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fadac00b780 tx=0x7fadac00bab0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 shutdown_connections 2023-10-05T15:16:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fad9c0a1480 0x7fad9c0a3940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadb4102a30 0x7fadb419e290 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadb4100e90 0x7fadb4196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 --2- 172.21.15.60:0/295050579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadb4102070 0x7fadb4197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 >> 172.21.15.60:0/295050579 conn(0x7fadb40fc430 msgr2=0x7fadb40fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 shutdown_connections 2023-10-05T15:16:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.195+0000 7fadba37f700 1 -- 172.21.15.60:0/295050579 wait complete. 2023-10-05T15:16:24.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1205867940' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:24 smithi135 ceph-mon[103360]: pgmap v309: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 596 B/s wr, 9 op/s 2023-10-05T15:16:24.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/861980296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:24 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1135955419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 -- 172.21.15.60:0/3302959063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c8101960 msgr2=0x7f47c8108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3302959063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c8101960 0x7f47c8108210 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f47c000b0d0 tx=0x7f47c000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 -- 172.21.15.60:0/3302959063 shutdown_connections 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3302959063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c8101960 0x7f47c8108210 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3302959063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47c80ffdd0 0x7f47c81001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3302959063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8100fc0 0x7f47c8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.332+0000 7f47cf09b700 1 -- 172.21.15.60:0/3302959063 >> 172.21.15.60:0/3302959063 conn(0x7f47c80fb300 msgr2=0x7f47c80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.333+0000 7f47cf09b700 1 -- 172.21.15.60:0/3302959063 shutdown_connections 2023-10-05T15:16:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.333+0000 7f47cf09b700 1 -- 172.21.15.60:0/3302959063 wait complete. 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.333+0000 7f47cf09b700 1 Processor -- start 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.333+0000 7f47cf09b700 1 -- start start 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cf09b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 0x7f47c8195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cf09b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47c8100fc0 0x7f47c8196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cf09b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8101960 0x7f47c819d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cf09b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c819d6c0 con 0x7f47c80ffdd0 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cf09b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c819d800 con 0x7f47c8100fc0 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cf09b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c819d990 con 0x7f47c8101960 2023-10-05T15:16:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 0x7f47c8195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 0x7f47c8195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37480/0 (socket says 172.21.15.60:37480) 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 -- 172.21.15.60:0/3042223139 learned_addr learned my addr 172.21.15.60:0/3042223139 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47c7fff700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47c8100fc0 0x7f47c8196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cd638700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8101960 0x7f47c819d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 -- 172.21.15.60:0/3042223139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8101960 msgr2=0x7f47c819d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8101960 0x7f47c819d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 -- 172.21.15.60:0/3042223139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47c8100fc0 msgr2=0x7f47c8196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47c8100fc0 0x7f47c8196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 -- 172.21.15.60:0/3042223139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0009d00 con 0x7f47c80ffdd0 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cd638700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8101960 0x7f47c819d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47cce37700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 0x7f47c8195b40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00d980 tx=0x7f47bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc004020 con 0x7f47c80ffdd0 2023-10-05T15:16:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.334+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47bc009730 con 0x7f47c80ffdd0 2023-10-05T15:16:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.335+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c819dc70 con 0x7f47c80ffdd0 2023-10-05T15:16:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.335+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003a80 con 0x7f47c80ffdd0 2023-10-05T15:16:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.335+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c819e180 con 0x7f47c80ffdd0 2023-10-05T15:16:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.336+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c8107270 con 0x7f47c80ffdd0 2023-10-05T15:16:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.337+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f47bc0098a0 con 0x7f47c80ffdd0 2023-10-05T15:16:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.337+0000 7f47c5ffb700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f47b80a14d0 0x7f47b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.337+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f47bc0ccc90 con 0x7f47c80ffdd0 2023-10-05T15:16:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.337+0000 7f47c7fff700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f47b80a14d0 0x7f47b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.338+0000 7f47c7fff700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f47b80a14d0 0x7f47b80a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47b4007be0 tx=0x7f47b40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.341+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f47bc095ff0 con 0x7f47c80ffdd0 2023-10-05T15:16:24.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:24 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1205867940' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:24 smithi092 ceph-mon[102944]: pgmap v309: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 596 B/s wr, 9 op/s 2023-10-05T15:16:24.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:24 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/861980296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:24 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1135955419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.588+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47c810b860 con 0x7f47c80ffdd0 2023-10-05T15:16:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.589+0000 7f47c5ffb700 1 -- 172.21.15.60:0/3042223139 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7f47bc099610 con 0x7f47c80ffdd0 2023-10-05T15:16:24.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:24.591 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f47b80a14d0 msgr2=0x7f47b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f47b80a14d0 0x7f47b80a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47b4007be0 tx=0x7f47b40073d0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 msgr2=0x7f47c8195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 0x7f47c8195b40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00d980 tx=0x7f47bc00dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 shutdown_connections 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c8101960 0x7f47c819d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f47b80a14d0 0x7f47b80a3990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c80ffdd0 0x7f47c8195b40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 --2- 172.21.15.60:0/3042223139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47c8100fc0 0x7f47c8196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 >> 172.21.15.60:0/3042223139 conn(0x7f47c80fb300 msgr2=0x7f47c81043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 shutdown_connections 2023-10-05T15:16:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.591+0000 7f47cf09b700 1 -- 172.21.15.60:0/3042223139 wait complete. 2023-10-05T15:16:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:24.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:24.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 -- 172.21.15.60:0/157033237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a80ff550 msgr2=0x7f49a80ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 --2- 172.21.15.60:0/157033237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a80ff550 0x7f49a80ff970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f499c00aad0 tx=0x7f499c00ade0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 -- 172.21.15.60:0/157033237 shutdown_connections 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 --2- 172.21.15.60:0/157033237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a81010e0 0x7f49a8107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 --2- 172.21.15.60:0/157033237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a80ff550 0x7f49a80ff970 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 --2- 172.21.15.60:0/157033237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49a8100740 0x7f49a8100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 -- 172.21.15.60:0/157033237 >> 172.21.15.60:0/157033237 conn(0x7f49a80faac0 msgr2=0x7f49a80fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 -- 172.21.15.60:0/157033237 shutdown_connections 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.729+0000 7f49af0a6700 1 -- 172.21.15.60:0/157033237 wait complete. 2023-10-05T15:16:24.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 Processor -- start 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 -- start start 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a80ff550 0x7f49a81034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 0x7f49a8101b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49a81010e0 0x7f49a8102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8102800 con 0x7f49a8100740 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8102970 con 0x7f49a80ff550 2023-10-05T15:16:24.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49af0a6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a81a0bf0 con 0x7f49a81010e0 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 0x7f49a8101b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 0x7f49a8101b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37494/0 (socket says 172.21.15.60:37494) 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49a7fff700 1 -- 172.21.15.60:0/3899497073 learned_addr learned my addr 172.21.15.60:0/3899497073 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49ad643700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49a81010e0 0x7f49a8102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49ace42700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a80ff550 0x7f49a81034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49a7fff700 1 -- 172.21.15.60:0/3899497073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49a81010e0 msgr2=0x7f49a8102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49a7fff700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49a81010e0 0x7f49a8102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.730+0000 7f49a7fff700 1 -- 172.21.15.60:0/3899497073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a80ff550 msgr2=0x7f49a81034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49a7fff700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a80ff550 0x7f49a81034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49a7fff700 1 -- 172.21.15.60:0/3899497073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c00a700 con 0x7f49a8100740 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49a7fff700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 0x7f49a8101b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f499400c9b0 tx=0x7f499400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994007b00 con 0x7f49a8100740 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f499400ce50 con 0x7f49a8100740 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994018660 con 0x7f49a8100740 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a81a0ed0 con 0x7f49a8100740 2023-10-05T15:16:24.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.731+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a81a1350 con 0x7f49a8100740 2023-10-05T15:16:24.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.732+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a810a590 con 0x7f49a8100740 2023-10-05T15:16:24.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.733+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f499400f450 con 0x7f49a8100740 2023-10-05T15:16:24.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.734+0000 7f49a5ffb700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49980a1550 0x7f49980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:24.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.734+0000 7f49ace42700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49980a1550 0x7f49980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:24.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.734+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f49940cce90 con 0x7f49a8100740 2023-10-05T15:16:24.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.734+0000 7f49ace42700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49980a1550 0x7f49980a3a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f499c003bc0 tx=0x7f499c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:24.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.738+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f49940961f0 con 0x7f49a8100740 2023-10-05T15:16:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.942+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49a810a7d0 con 0x7f49a8100740 2023-10-05T15:16:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.943+0000 7f49a5ffb700 1 -- 172.21.15.60:0/3899497073 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f4994099810 con 0x7f49a8100740 2023-10-05T15:16:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:24.946 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49980a1550 msgr2=0x7f49980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49980a1550 0x7f49980a3a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f499c003bc0 tx=0x7f499c005fd0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 msgr2=0x7f49a8101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 0x7f49a8101b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f499400c9b0 tx=0x7f499400ccc0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 shutdown_connections 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49a81010e0 0x7f49a8102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a80ff550 0x7f49a81034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f49980a1550 0x7f49980a3a10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 --2- 172.21.15.60:0/3899497073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a8100740 0x7f49a8101b20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 >> 172.21.15.60:0/3899497073 conn(0x7f49a80faac0 msgr2=0x7f49a8105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 shutdown_connections 2023-10-05T15:16:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:24.946+0000 7f49af0a6700 1 -- 172.21.15.60:0/3899497073 wait complete. 2023-10-05T15:16:24.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:16:24.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:16:25.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 -- 172.21.15.60:0/2037332228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 msgr2=0x7f5368108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 --2- 172.21.15.60:0/2037332228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f5368108230 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f536000b0d0 tx=0x7f536000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 -- 172.21.15.60:0/2037332228 shutdown_connections 2023-10-05T15:16:25.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 --2- 172.21.15.60:0/2037332228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f5368108230 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 --2- 172.21.15.60:0/2037332228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53680ffdf0 0x7f5368100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 --2- 172.21.15.60:0/2037332228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5368100fe0 0x7f5368101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 -- 172.21.15.60:0/2037332228 >> 172.21.15.60:0/2037332228 conn(0x7f53680fb380 msgr2=0x7f53680fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 -- 172.21.15.60:0/2037332228 shutdown_connections 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 -- 172.21.15.60:0/2037332228 wait complete. 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 Processor -- start 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 -- start start 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53680ffdf0 0x7f5368069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.092+0000 7f536eef9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5368100fe0 0x7f536819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536eef9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f536819e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536eef9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819e7c0 con 0x7f5368101980 2023-10-05T15:16:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536eef9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819e930 con 0x7f53680ffdf0 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536eef9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819eaf0 con 0x7f5368100fe0 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f536819e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f536819e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37510/0 (socket says 172.21.15.60:37510) 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 -- 172.21.15.60:0/621586844 learned_addr learned my addr 172.21.15.60:0/621586844 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f5367fff700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5368100fe0 0x7f536819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536cc95700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53680ffdf0 0x7f5368069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 -- 172.21.15.60:0/621586844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5368100fe0 msgr2=0x7f536819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5368100fe0 0x7f536819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 -- 172.21.15.60:0/621586844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53680ffdf0 msgr2=0x7f5368069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53680ffdf0 0x7f5368069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 -- 172.21.15.60:0/621586844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360009d00 con 0x7f5368101980 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536d496700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f536819e020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5360008ec0 tx=0x7f5360008fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536000e040 con 0x7f5368101980 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5360003c00 con 0x7f5368101980 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536819ed70 con 0x7f5368101980 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.093+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536001b7d0 con 0x7f5368101980 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.094+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536819f190 con 0x7f5368101980 2023-10-05T15:16:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.094+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536810b680 con 0x7f5368101980 2023-10-05T15:16:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.096+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5360005090 con 0x7f5368101980 2023-10-05T15:16:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.096+0000 7f5365ffb700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f53580a1500 0x7f53580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.096+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f53600ce680 con 0x7f5368101980 2023-10-05T15:16:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.096+0000 7f536cc95700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f53580a1500 0x7f53580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.097+0000 7f536cc95700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f53580a1500 0x7f53580a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5368100e40 tx=0x7f535c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.100+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5360097a70 con 0x7f5368101980 2023-10-05T15:16:25.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.302+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5368106ca0 con 0x7f5368101980 2023-10-05T15:16:25.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.302+0000 7f5365ffb700 1 -- 172.21.15.60:0/621586844 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5360005340 con 0x7f5368101980 2023-10-05T15:16:25.304 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.304+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f53580a1500 msgr2=0x7f53580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.304+0000 7f536eef9700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f53580a1500 0x7f53580a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5368100e40 tx=0x7f535c009260 comp rx=0 tx=0).stop 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.304+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 msgr2=0x7f536819e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.304+0000 7f536eef9700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f536819e020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5360008ec0 tx=0x7f5360008fa0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 shutdown_connections 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f53580a1500 0x7f53580a39c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5368101980 0x7f536819e020 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53680ffdf0 0x7f5368069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 --2- 172.21.15.60:0/621586844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5368100fe0 0x7f536819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 >> 172.21.15.60:0/621586844 conn(0x7f53680fb380 msgr2=0x7f53680fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 shutdown_connections 2023-10-05T15:16:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.305+0000 7f536eef9700 1 -- 172.21.15.60:0/621586844 wait complete. 2023-10-05T15:16:25.318 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:25 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/295050579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:25.318 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:25 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3042223139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:25.318 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:25 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3899497073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:25.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:16:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:25 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/295050579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:25 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3042223139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:25.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:25 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3899497073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:25.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:25 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/295050579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:25.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:25 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3042223139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:25.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:25 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3899497073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 -- 172.21.15.60:0/2775906527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f8106be0 msgr2=0x7f54f8109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/2775906527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f8106be0 0x7f54f8109050 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f54f000b0a0 tx=0x7f54f000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 -- 172.21.15.60:0/2775906527 shutdown_connections 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/2775906527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f8106be0 0x7f54f8109050 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/2775906527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 0x7f54f8103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/2775906527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f81042b0 0x7f54f81066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 -- 172.21.15.60:0/2775906527 >> 172.21.15.60:0/2775906527 conn(0x7f54f80fb3b0 msgr2=0x7f54f80fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 -- 172.21.15.60:0/2775906527 shutdown_connections 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 -- 172.21.15.60:0/2775906527 wait complete. 2023-10-05T15:16:25.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.446+0000 7f54ff1a7700 1 Processor -- start 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 -- start start 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 0x7f54f8196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 0x7f54f8197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f8106be0 0x7f54f819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f819e830 con 0x7f54f81042b0 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f819e9a0 con 0x7f54f8106be0 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54ff1a7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f819eb60 con 0x7f54f8101980 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 0x7f54f8197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 0x7f54f8197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37522/0 (socket says 172.21.15.60:37522) 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 -- 172.21.15.60:0/3543062065 learned_addr learned my addr 172.21.15.60:0/3543062065 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54fcf43700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 0x7f54f8196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54fd744700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f8106be0 0x7f54f819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 -- 172.21.15.60:0/3543062065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 msgr2=0x7f54f8196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 0x7f54f8196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 -- 172.21.15.60:0/3543062065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f8106be0 msgr2=0x7f54f819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f8106be0 0x7f54f819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 -- 172.21.15.60:0/3543062065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f0009d00 con 0x7f54f81042b0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54fcf43700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 0x7f54f8196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f7fff700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 0x7f54f8197200 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f54e400e9a0 tx=0x7f54e400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.447+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4009790 con 0x7f54f81042b0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.448+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54e400cbd0 con 0x7f54f81042b0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.448+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f819ee40 con 0x7f54f81042b0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.448+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4018680 con 0x7f54f81042b0 2023-10-05T15:16:25.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.448+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f819f310 con 0x7f54f81042b0 2023-10-05T15:16:25.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.449+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f80fcf30 con 0x7f54f81042b0 2023-10-05T15:16:25.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.450+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f54e400cd40 con 0x7f54f81042b0 2023-10-05T15:16:25.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.451+0000 7f54f5ffb700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54e80a1500 0x7f54e80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.451+0000 7f54fcf43700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54e80a1500 0x7f54e80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.451+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f54e4014070 con 0x7f54f81042b0 2023-10-05T15:16:25.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.451+0000 7f54fcf43700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54e80a1500 0x7f54e80a39c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f54ec005950 tx=0x7f54ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:25.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.454+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f54e4096a90 con 0x7f54f81042b0 2023-10-05T15:16:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.658+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54f810c980 con 0x7f54f81042b0 2023-10-05T15:16:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.658+0000 7f54f5ffb700 1 -- 172.21.15.60:0/3543062065 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54e4026020 con 0x7f54f81042b0 2023-10-05T15:16:25.660 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.660+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54e80a1500 msgr2=0x7f54e80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.660+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54e80a1500 0x7f54e80a39c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f54ec005950 tx=0x7f54ec0058e0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.660+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 msgr2=0x7f54f8197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.660+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 0x7f54f8197200 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f54e400e9a0 tx=0x7f54e400ed60 comp rx=0 tx=0).stop 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 shutdown_connections 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54f8106be0 0x7f54f819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54f8101980 0x7f54f8196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f54e80a1500 0x7f54e80a39c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 --2- 172.21.15.60:0/3543062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f81042b0 0x7f54f8197200 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 >> 172.21.15.60:0/3543062065 conn(0x7f54f80fb3b0 msgr2=0x7f54f8102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 shutdown_connections 2023-10-05T15:16:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.661+0000 7f54ff1a7700 1 -- 172.21.15.60:0/3543062065 wait complete. 2023-10-05T15:16:25.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:16:25.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 -- 172.21.15.60:0/3443199373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe588100fb0 msgr2=0x7fe588101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/3443199373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe588100fb0 0x7fe588101410 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe5700099c0 tx=0x7fe570009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 -- 172.21.15.60:0/3443199373 shutdown_connections 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/3443199373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe588101950 0x7fe588108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/3443199373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5880ffdc0 0x7fe5881001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/3443199373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe588100fb0 0x7fe588101410 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 -- 172.21.15.60:0/3443199373 >> 172.21.15.60:0/3443199373 conn(0x7fe5880fb330 msgr2=0x7fe5880fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 -- 172.21.15.60:0/3443199373 shutdown_connections 2023-10-05T15:16:25.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.801+0000 7fe58cf4e700 1 -- 172.21.15.60:0/3443199373 wait complete. 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 Processor -- start 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 -- start start 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 0x7fe588068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe588100fb0 0x7fe58819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe588101950 0x7fe58819df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58819e700 con 0x7fe5880ffdc0 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58819e870 con 0x7fe588101950 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.802+0000 7fe58cf4e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58819ea30 con 0x7fe588100fb0 2023-10-05T15:16:25.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 0x7fe588068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 0x7fe588068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37534/0 (socket says 172.21.15.60:37534) 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 -- 172.21.15.60:0/1463411876 learned_addr learned my addr 172.21.15.60:0/1463411876 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe586d9d700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe588101950 0x7fe58819df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe585d9b700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe588100fb0 0x7fe58819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 -- 172.21.15.60:0/1463411876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe588100fb0 msgr2=0x7fe58819b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe588100fb0 0x7fe58819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 -- 172.21.15.60:0/1463411876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe588101950 msgr2=0x7fe58819df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe588101950 0x7fe58819df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 -- 172.21.15.60:0/1463411876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700095f0 con 0x7fe5880ffdc0 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58659c700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 0x7fe588068bd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe57800d980 tx=0x7fe57800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800bb60 con 0x7fe5880ffdc0 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58819ed10 con 0x7fe5880ffdc0 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe578007620 con 0x7fe5880ffdc0 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800f620 con 0x7fe5880ffdc0 2023-10-05T15:16:25.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.803+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58819f1d0 con 0x7fe5880ffdc0 2023-10-05T15:16:25.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.804+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe588106d40 con 0x7fe5880ffdc0 2023-10-05T15:16:25.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.805+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe578010460 con 0x7fe5880ffdc0 2023-10-05T15:16:25.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.806+0000 7fe57f7fe700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5740a1480 0x7fe5740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:25.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.806+0000 7fe585d9b700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5740a1480 0x7fe5740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:25.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.806+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fe5780cd080 con 0x7fe5880ffdc0 2023-10-05T15:16:25.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.806+0000 7fe585d9b700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5740a1480 0x7fe5740a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe5700098e0 tx=0x7fe570019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:25.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:25.810+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe578100100 con 0x7fe5880ffdc0 2023-10-05T15:16:26.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.015+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5880008d0 con 0x7fe5880ffdc0 2023-10-05T15:16:26.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.015+0000 7fe57f7fe700 1 -- 172.21.15.60:0/1463411876 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5780160a0 con 0x7fe5880ffdc0 2023-10-05T15:16:26.017 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.017+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5740a1480 msgr2=0x7fe5740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.017+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5740a1480 0x7fe5740a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe5700098e0 tx=0x7fe570019040 comp rx=0 tx=0).stop 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.017+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 msgr2=0x7fe588068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.017+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 0x7fe588068bd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe57800d980 tx=0x7fe57800dd40 comp rx=0 tx=0).stop 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 shutdown_connections 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe588101950 0x7fe58819df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fe5740a1480 0x7fe5740a3940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5880ffdc0 0x7fe588068bd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 --2- 172.21.15.60:0/1463411876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe588100fb0 0x7fe58819b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 >> 172.21.15.60:0/1463411876 conn(0x7fe5880fb330 msgr2=0x7fe5880fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 shutdown_connections 2023-10-05T15:16:26.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.018+0000 7fe58cf4e700 1 -- 172.21.15.60:0/1463411876 wait complete. 2023-10-05T15:16:26.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:26.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 -- 172.21.15.60:0/1920702629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102a40 msgr2=0x7f194c109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1920702629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102a40 0x7f194c109360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f194400b0a0 tx=0x7f194400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 -- 172.21.15.60:0/1920702629 shutdown_connections 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1920702629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102a40 0x7f194c109360 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1920702629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c100ea0 0x7f194c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1920702629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f194c102080 0x7f194c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.160+0000 7f1951b0d700 1 -- 172.21.15.60:0/1920702629 >> 172.21.15.60:0/1920702629 conn(0x7f194c0fc460 msgr2=0x7f194c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.161+0000 7f1951b0d700 1 -- 172.21.15.60:0/1920702629 shutdown_connections 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.161+0000 7f1951b0d700 1 -- 172.21.15.60:0/1920702629 wait complete. 2023-10-05T15:16:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.161+0000 7f1951b0d700 1 Processor -- start 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.161+0000 7f1951b0d700 1 -- start start 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c100ea0 0x7f194c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 0x7f194c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f194c102a40 0x7f194c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c073f80 con 0x7f194c102080 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0740f0 con 0x7f194c100ea0 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c1a0d20 con 0x7f194c102a40 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 0x7f194c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 0x7f194c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37550/0 (socket says 172.21.15.60:37550) 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 -- 172.21.15.60:0/1201681183 learned_addr learned my addr 172.21.15.60:0/1201681183 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194b7fe700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c100ea0 0x7f194c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194bfff700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f194c102a40 0x7f194c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 -- 172.21.15.60:0/1201681183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f194c102a40 msgr2=0x7f194c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f194c102a40 0x7f194c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 -- 172.21.15.60:0/1201681183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c100ea0 msgr2=0x7f194c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c100ea0 0x7f194c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 -- 172.21.15.60:0/1201681183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944009d00 con 0x7f194c102080 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f194affd700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 0x7f194c0732a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f194000d980 tx=0x7f194000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940004020 con 0x7f194c102080 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f194000f690 con 0x7f194c102080 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c1a0fa0 con 0x7f194c102080 2023-10-05T15:16:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940003a60 con 0x7f194c102080 2023-10-05T15:16:26.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.162+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c1a1480 con 0x7f194c102080 2023-10-05T15:16:26.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.164+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c108470 con 0x7f194c102080 2023-10-05T15:16:26.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.164+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f194000fb00 con 0x7f194c102080 2023-10-05T15:16:26.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.165+0000 7f1948ff9700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19340a1480 0x7f19340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.165+0000 7f194b7fe700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19340a1480 0x7f19340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.165+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f19400ccb90 con 0x7f194c102080 2023-10-05T15:16:26.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.166+0000 7f194b7fe700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19340a1480 0x7f19340a3940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f194c101bf0 tx=0x7f193c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:26.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.169+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1940095ef0 con 0x7f194c102080 2023-10-05T15:16:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:26 smithi135 ceph-mon[103360]: pgmap v310: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 596 B/s wr, 10 op/s 2023-10-05T15:16:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:26 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/621586844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:26 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3543062065' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:26 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1463411876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.372+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f194c02d1e0 con 0x7f194c102080 2023-10-05T15:16:26.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.372+0000 7f1948ff9700 1 -- 172.21.15.60:0/1201681183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1940099510 con 0x7f194c102080 2023-10-05T15:16:26.374 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:26.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19340a1480 msgr2=0x7f19340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19340a1480 0x7f19340a3940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f194c101bf0 tx=0x7f193c009260 comp rx=0 tx=0).stop 2023-10-05T15:16:26.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 msgr2=0x7f194c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 0x7f194c0732a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f194000d980 tx=0x7f194000dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 shutdown_connections 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f194c102a40 0x7f194c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c100ea0 0x7f194c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f19340a1480 0x7f19340a3940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 --2- 172.21.15.60:0/1201681183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f194c102080 0x7f194c0732a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 >> 172.21.15.60:0/1201681183 conn(0x7f194c0fc460 msgr2=0x7f194c1055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 shutdown_connections 2023-10-05T15:16:26.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.374+0000 7f1951b0d700 1 -- 172.21.15.60:0/1201681183 wait complete. 2023-10-05T15:16:26.387 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:26 smithi060 ceph-mon[99238]: pgmap v310: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 596 B/s wr, 10 op/s 2023-10-05T15:16:26.388 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:26 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/621586844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.388 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:26 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3543062065' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.388 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:26 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1463411876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:26.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:26 smithi092 ceph-mon[102944]: pgmap v310: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 596 B/s wr, 10 op/s 2023-10-05T15:16:26.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:26 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/621586844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:26 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3543062065' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:26 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1463411876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 -- 172.21.15.60:0/2434580341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 msgr2=0x7ff3481001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 --2- 172.21.15.60:0/2434580341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff3481001e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff3380099c0 tx=0x7ff338009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 -- 172.21.15.60:0/2434580341 shutdown_connections 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 --2- 172.21.15.60:0/2434580341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348101950 0x7ff348108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 --2- 172.21.15.60:0/2434580341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff3481001e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 --2- 172.21.15.60:0/2434580341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff348100fb0 0x7ff348101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 -- 172.21.15.60:0/2434580341 >> 172.21.15.60:0/2434580341 conn(0x7ff3480fb310 msgr2=0x7ff3480fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 -- 172.21.15.60:0/2434580341 shutdown_connections 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.512+0000 7ff34dc39700 1 -- 172.21.15.60:0/2434580341 wait complete. 2023-10-05T15:16:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 Processor -- start 2023-10-05T15:16:26.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 -- start start 2023-10-05T15:16:26.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff348195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348100fb0 0x7ff348196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff348101950 0x7ff34819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819d680 con 0x7ff3480ffdc0 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819d7c0 con 0x7ff348101950 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff34dc39700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819d950 con 0x7ff348100fb0 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.513+0000 7ff3477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff348195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff348195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37562/0 (socket says 172.21.15.60:37562) 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 -- 172.21.15.60:0/3086721992 learned_addr learned my addr 172.21.15.60:0/3086721992 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff347fff700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff348101950 0x7ff34819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff346ffd700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348100fb0 0x7ff348196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 -- 172.21.15.60:0/3086721992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348100fb0 msgr2=0x7ff348196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348100fb0 0x7ff348196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 -- 172.21.15.60:0/3086721992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff348101950 msgr2=0x7ff34819d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff348101950 0x7ff34819d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 -- 172.21.15.60:0/3086721992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380095f0 con 0x7ff3480ffdc0 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff346ffd700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348100fb0 0x7ff348196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff3477fe700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff348195b00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff338009fd0 tx=0x7ff33801a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33801f070 con 0x7ff3480ffdc0 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff348068040 con 0x7ff3480ffdc0 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff338005030 con 0x7ff3480ffdc0 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004ae0 con 0x7ff3480ffdc0 2023-10-05T15:16:26.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.514+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3480684e0 con 0x7ff3480ffdc0 2023-10-05T15:16:26.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.515+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff348068f30 con 0x7ff3480ffdc0 2023-10-05T15:16:26.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.517+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff338023070 con 0x7ff3480ffdc0 2023-10-05T15:16:26.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.518+0000 7ff344ff9700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff3340a14d0 0x7ff3340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.518+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7ff3380d0350 con 0x7ff3480ffdc0 2023-10-05T15:16:26.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.518+0000 7ff346ffd700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff3340a14d0 0x7ff3340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.518+0000 7ff346ffd700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff3340a14d0 0x7ff3340a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff330005fd0 tx=0x7ff330005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:26.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.521+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff3380996e0 con 0x7ff3480ffdc0 2023-10-05T15:16:26.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.768+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff34810b5d0 con 0x7ff3480ffdc0 2023-10-05T15:16:26.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.769+0000 7ff344ff9700 1 -- 172.21.15.60:0/3086721992 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7ff33809cd00 con 0x7ff3480ffdc0 2023-10-05T15:16:26.771 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:26.771 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:26.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.771+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff3340a14d0 msgr2=0x7ff3340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.771+0000 7ff34dc39700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff3340a14d0 0x7ff3340a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff330005fd0 tx=0x7ff330005ee0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 msgr2=0x7ff348195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff348195b00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff338009fd0 tx=0x7ff33801a840 comp rx=0 tx=0).stop 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 shutdown_connections 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff348101950 0x7ff34819d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7ff3340a14d0 0x7ff3340a3990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3480ffdc0 0x7ff348195b00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 --2- 172.21.15.60:0/3086721992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348100fb0 0x7ff348196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 >> 172.21.15.60:0/3086721992 conn(0x7ff3480fb310 msgr2=0x7ff3481044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:26.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 shutdown_connections 2023-10-05T15:16:26.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.772+0000 7ff34dc39700 1 -- 172.21.15.60:0/3086721992 wait complete. 2023-10-05T15:16:26.775 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:26.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:26.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.910+0000 7f6fc0805700 1 -- 172.21.15.60:0/1565100755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc101450 msgr2=0x7f6fbc101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.910+0000 7f6fc0805700 1 --2- 172.21.15.60:0/1565100755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc101450 0x7f6fbc101870 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009990 tx=0x7f6fac009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 -- 172.21.15.60:0/1565100755 shutdown_connections 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 --2- 172.21.15.60:0/1565100755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc1009d0 0x7f6fbc108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 --2- 172.21.15.60:0/1565100755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc101450 0x7f6fbc101870 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 --2- 172.21.15.60:0/1565100755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc100010 0x7f6fbc100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 -- 172.21.15.60:0/1565100755 >> 172.21.15.60:0/1565100755 conn(0x7f6fbc0faac0 msgr2=0x7f6fbc0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 -- 172.21.15.60:0/1565100755 shutdown_connections 2023-10-05T15:16:26.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 -- 172.21.15.60:0/1565100755 wait complete. 2023-10-05T15:16:26.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 Processor -- start 2023-10-05T15:16:26.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.911+0000 7f6fc0805700 1 -- start start 2023-10-05T15:16:26.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 0x7f6fbc196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc1009d0 0x7f6fbc1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc101450 0x7f6fbc19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc19e6e0 con 0x7f6fbc100010 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc19e820 con 0x7f6fbc101450 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc19e9b0 con 0x7f6fbc1009d0 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 0x7f6fbc196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 0x7f6fbc196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37576/0 (socket says 172.21.15.60:37576) 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 -- 172.21.15.60:0/3111740025 learned_addr learned my addr 172.21.15.60:0/3111740025 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fb9d9b700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc1009d0 0x7f6fbc1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fbad9d700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc101450 0x7f6fbc19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 -- 172.21.15.60:0/3111740025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc1009d0 msgr2=0x7f6fbc1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc1009d0 0x7f6fbc1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 -- 172.21.15.60:0/3111740025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc101450 msgr2=0x7f6fbc19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc101450 0x7f6fbc19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 -- 172.21.15.60:0/3111740025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0095f0 con 0x7f6fbc100010 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fbad9d700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc101450 0x7f6fbc19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fba59c700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 0x7f6fbc196b60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0059d0 tx=0x7f6fac00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac01d070 con 0x7f6fbc100010 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fac00fd60 con 0x7f6fbc100010 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac017650 con 0x7f6fbc100010 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc19ec30 con 0x7f6fbc100010 2023-10-05T15:16:26.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.912+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc19f000 con 0x7f6fbc100010 2023-10-05T15:16:26.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.913+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc10b5c0 con 0x7f6fbc100010 2023-10-05T15:16:26.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.914+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6fac0177b0 con 0x7f6fbc100010 2023-10-05T15:16:26.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.915+0000 7f6fab7fe700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6fa40a14d0 0x7f6fa40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:26.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.915+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f6fac0ce620 con 0x7f6fbc100010 2023-10-05T15:16:26.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.915+0000 7f6fb9d9b700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6fa40a14d0 0x7f6fa40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:26.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.916+0000 7f6fb9d9b700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6fa40a14d0 0x7f6fa40a3990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009bf0 tx=0x7f6fb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:26.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:26.919+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6fac05d100 con 0x7f6fbc100010 2023-10-05T15:16:27.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.125+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fbc19f190 con 0x7f6fbc100010 2023-10-05T15:16:27.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.127+0000 7f6fab7fe700 1 -- 172.21.15.60:0/3111740025 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f6fac0979b0 con 0x7f6fbc100010 2023-10-05T15:16:27.129 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:27.129 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:27.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6fa40a14d0 msgr2=0x7f6fa40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6fa40a14d0 0x7f6fa40a3990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009bf0 tx=0x7f6fb0009260 comp rx=0 tx=0).stop 2023-10-05T15:16:27.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 msgr2=0x7f6fbc196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 0x7f6fbc196b60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0059d0 tx=0x7f6fac00f510 comp rx=0 tx=0).stop 2023-10-05T15:16:27.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 shutdown_connections 2023-10-05T15:16:27.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fbc101450 0x7f6fbc19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6fa40a14d0 0x7f6fa40a3990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc100010 0x7f6fbc196b60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 --2- 172.21.15.60:0/3111740025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fbc1009d0 0x7f6fbc1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 >> 172.21.15.60:0/3111740025 conn(0x7f6fbc0faac0 msgr2=0x7f6fbc0fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 shutdown_connections 2023-10-05T15:16:27.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.129+0000 7f6fc0805700 1 -- 172.21.15.60:0/3111740025 wait complete. 2023-10-05T15:16:27.144 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-05T15:14:47.613338+0000', 'modified': '2023-10-05T15:15:11.025418+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24533, 'mds_1': 24496, 'mds_2': 24488, 'mds_3': 24472, 'mds_4': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/1500527837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1500527837}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1500527837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6841/1110694579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6840', 'nonce': 1110694579}, {'type': 'v1', 'addr': '172.21.15.60:6841', 'nonce': 1110694579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/3118655820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3118655820}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 3118655820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6833/1259260250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 1259260250}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 1259260250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/4284373269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 4284373269}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 4284373269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.92:6835/2553924574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 2553924574}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2553924574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.135:6837/2461370959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 2461370959}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2461370959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.92:6837/1596160002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 1596160002}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 1596160002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.135:6839/1073230370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1073230370}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1073230370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6839/3541269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3541269}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3541269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-05T15:16:27.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-05T15:16:27.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-05T15:16:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.270+0000 7f46d9be6700 1 -- 172.21.15.60:0/1097954063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4101440 msgr2=0x7f46d4101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.270+0000 7f46d9be6700 1 --2- 172.21.15.60:0/1097954063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4101440 0x7f46d4101860 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009990 tx=0x7f46c4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 -- 172.21.15.60:0/1097954063 shutdown_connections 2023-10-05T15:16:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 --2- 172.21.15.60:0/1097954063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 0x7f46d4108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 --2- 172.21.15.60:0/1097954063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4101440 0x7f46d4101860 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 --2- 172.21.15.60:0/1097954063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46d4100000 0x7f46d4100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 -- 172.21.15.60:0/1097954063 >> 172.21.15.60:0/1097954063 conn(0x7f46d40faab0 msgr2=0x7f46d40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 -- 172.21.15.60:0/1097954063 shutdown_connections 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 -- 172.21.15.60:0/1097954063 wait complete. 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 Processor -- start 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.271+0000 7f46d9be6700 1 -- start start 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 0x7f46d40ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 0x7f46d419dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46d4101440 0x7f46d41a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41a08c0 con 0x7f46d4100000 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41a0a30 con 0x7f46d4101440 2023-10-05T15:16:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41a0bf0 con 0x7f46d41009c0 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 0x7f46d40ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 0x7f46d40ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37590/0 (socket says 172.21.15.60:37590) 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 -- 172.21.15.60:0/2661212321 learned_addr learned my addr 172.21.15.60:0/2661212321 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 0x7f46d419dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d3fff700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46d4101440 0x7f46d41a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 -- 172.21.15.60:0/2661212321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 msgr2=0x7f46d419dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 0x7f46d419dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 -- 172.21.15.60:0/2661212321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46d4101440 msgr2=0x7f46d41a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46d4101440 0x7f46d41a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 -- 172.21.15.60:0/2661212321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40095f0 con 0x7f46d4100000 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 0x7f46d419dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 0x7f46d40ffa60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f46c40098e0 tx=0x7f46c400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d0ff9700 1 -- 172.21.15.60:0/2661212321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c401d070 con 0x7f46d4100000 2023-10-05T15:16:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d41a0e70 con 0x7f46d4100000 2023-10-05T15:16:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d0ff9700 1 -- 172.21.15.60:0/2661212321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46c4022470 con 0x7f46d4100000 2023-10-05T15:16:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d0ff9700 1 -- 172.21.15.60:0/2661212321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4017650 con 0x7f46d4100000 2023-10-05T15:16:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.272+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d41a11e0 con 0x7f46d4100000 2023-10-05T15:16:27.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.275+0000 7f46d0ff9700 1 -- 172.21.15.60:0/2661212321 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f46c40225e0 con 0x7f46d4100000 2023-10-05T15:16:27.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.275+0000 7f46d0ff9700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f46bc0a1480 0x7f46bc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.275+0000 7f46d0ff9700 1 -- 172.21.15.60:0/2661212321 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f46c40ce2f0 con 0x7f46d4100000 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.275+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f46bc0a1480 0x7f46bc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f46bc0a1480 0x7f46bc0a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f46c8005fd0 tx=0x7f46c8005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 Processor -- start 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 -- start start 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25bda630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25bdb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bdbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25b42410 con 0x55dc25bda210 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25b33bd0 con 0x55dc25bdab70 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25b314f0 con 0x55dc25bdba10 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46d37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25bda630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46d37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25bda630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37598/0 (socket says 172.21.15.60:37598) 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.276+0000 7f46d37fe700 1 -- 172.21.15.60:0/2410521114 learned_addr learned my addr 172.21.15.60:0/2410521114 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25bdb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d37fe700 1 -- 172.21.15.60:0/2410521114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 msgr2=0x55dc25bdbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bdbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d37fe700 1 -- 172.21.15.60:0/2410521114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 msgr2=0x55dc25bdb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25bdb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d37fe700 1 -- 172.21.15.60:0/2410521114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc25957d90 con 0x55dc25bda210 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25bda630 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f46c409b330 tx=0x7f46c4022c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5a86a8c516363f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46b9ffb700 1 -- 172.21.15.60:0/2410521114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40ce130 con 0x55dc25bda210 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46b9ffb700 1 -- 172.21.15.60:0/2410521114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46c409b3a0 con 0x55dc25bda210 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.277+0000 7f46b9ffb700 1 -- 172.21.15.60:0/2410521114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c409a890 con 0x55dc25bda210 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2410521114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 msgr2=0x55dc25bda630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25bda630 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f46c409b330 tx=0x7f46c4022c80 comp rx=0 tx=0).stop 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2410521114 shutdown_connections 2023-10-05T15:16:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bdbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25bda630 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2410521114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25bdb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2410521114 >> 172.21.15.60:0/2410521114 conn(0x55dc25b4e210 msgr2=0x55dc25bd50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2410521114 shutdown_connections 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2410521114 wait complete. 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 -- start start 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.278+0000 7f46e5dd0b80 1 Processor -- start 2023-10-05T15:16:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bda210 0x55dc25be3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 0x55dc25beb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25b2cde0 con 0x55dc25bdba10 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25ac96c0 con 0x55dc25bdab70 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25ac9360 con 0x55dc25bda210 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 10 client.0 _ll_register_callbacks cb 0x55dc259267b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 0x55dc25beb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 0x55dc25beb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37608/0 (socket says 172.21.15.60:37608) 2023-10-05T15:16:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 -- 172.21.15.60:0/1578581852 learned_addr learned my addr 172.21.15.60:0/1578581852 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d37fe700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bda210 0x55dc25be3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 -- 172.21.15.60:0/1578581852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bda210 msgr2=0x55dc25be3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bda210 0x55dc25be3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 -- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 msgr2=0x55dc25be4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 -- 172.21.15.60:0/1578581852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d41a11e0 con 0x55dc25bdba10 2023-10-05T15:16:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d37fe700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bda210 0x55dc25be3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46d3fff700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 0x55dc25beb280 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00fc80 tx=0x7f46cc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62438b02f7e8323 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46b2ffd700 1 -- 172.21.15.60:0/1578581852 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc007c00 con 0x55dc25bdba10 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc25bccec0 con 0x55dc25bdba10 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.279+0000 7f46b2ffd700 1 -- 172.21.15.60:0/1578581852 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f46cc007d60 con 0x55dc25bdba10 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46b2ffd700 1 -- 172.21.15.60:0/1578581852 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46cc003a00 con 0x55dc25bdba10 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 10 client.15396 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55dc25940c10 con 0x55dc25bdba10 2023-10-05T15:16:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46b2ffd700 1 -- 172.21.15.60:0/1578581852 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc25bccec0 con 0x55dc25bdba10 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46b2ffd700 1 -- 172.21.15.60:0/1578581852 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46cc012070 con 0x55dc25bdba10 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 10 client.15396 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 10 client.15396 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 20 client.15396 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25bef990 0x55dc25bee430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 4 client.15396 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc25b25dc0 con 0x55dc25bef990 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.280+0000 7f46d37fe700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25bef990 0x55dc25bee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.281+0000 7f46d37fe700 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25bef990 0x55dc25bee430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6f35916a0ee700f5 server_cookie=bfbd03f925aea47d in_seq=0 out_seq=0 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.281+0000 7f46b2ffd700 10 client.15396 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.281+0000 7f46b2ffd700 1 -- 172.21.15.60:0/1578581852 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc25b25dc0 con 0x55dc25bef990 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.281+0000 7f46b2ffd700 10 client.15396 handle_command_reply: tid=0 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.281+0000 7f46e5dd0b80 1 client.15396 shutdown 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 msgr2=0x55dc25beb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 0x55dc25beb280 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00fc80 tx=0x7f46cc00d430 comp rx=0 tx=0).stop 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 shutdown_connections 2023-10-05T15:16:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25bef990 0x55dc25bee430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdba10 0x55dc25beb280 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46b2ffd700 0 client.15396 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bda210 0x55dc25be3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/1578581852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 >> 172.21.15.60:0/1578581852 conn(0x55dc25b4e210 msgr2=0x55dc25bd4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 shutdown_connections 2023-10-05T15:16:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/1578581852 wait complete. 2023-10-05T15:16:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.282+0000 7f46e5dd0b80 20 client.15396 trim_cache size 0 max 16384 2023-10-05T15:16:27.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.299+0000 7f46e5dd0b80 1 Processor -- start 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.299+0000 7f46e5dd0b80 1 -- start start 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bda210 0x55dc25be1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 0x55dc25beb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bd4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc259ad8d0 con 0x55dc25bdab70 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25bdb1a0 con 0x55dc25bda210 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25ad34d0 con 0x55dc25bdba10 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 0x55dc25beb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 0x55dc25beb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37614/0 (socket says 172.21.15.60:37614) 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 -- 172.21.15.60:0/2343429423 learned_addr learned my addr 172.21.15.60:0/2343429423 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d37fe700 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bda210 0x55dc25be1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 -- 172.21.15.60:0/2343429423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 msgr2=0x55dc25bd4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d3fff700 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bd4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bd4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 -- 172.21.15.60:0/2343429423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bda210 msgr2=0x55dc25be1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bda210 0x55dc25be1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 -- 172.21.15.60:0/2343429423 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc2597e200 con 0x55dc25bdab70 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 0x55dc25beb1a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f46c8011540 tx=0x7f46c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9a5b863576648d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46ba7fc700 1 -- 172.21.15.60:0/2343429423 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8024070 con 0x55dc25bdab70 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46ba7fc700 1 -- 172.21.15.60:0/2343429423 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46c80044e0 con 0x55dc25bdab70 2023-10-05T15:16:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.300+0000 7f46ba7fc700 1 -- 172.21.15.60:0/2343429423 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8003df0 con 0x55dc25bdab70 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2343429423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 msgr2=0x55dc25beb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 0x55dc25beb1a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f46c8011540 tx=0x7f46c8012000 comp rx=0 tx=0).stop 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2343429423 shutdown_connections 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25bd4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bda210 0x55dc25be1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/2343429423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bdab70 0x55dc25beb1a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2343429423 >> 172.21.15.60:0/2343429423 conn(0x55dc25b4e210 msgr2=0x55dc25bf82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2343429423 shutdown_connections 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/2343429423 wait complete. 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.301+0000 7f46e5dd0b80 1 -- start start 2023-10-05T15:16:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 Processor -- start 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25beb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25be8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25be8580 con 0x55dc25bda210 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25be86f0 con 0x55dc25bdab70 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc25c43380 con 0x55dc25bdba10 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46e5dd0b80 10 client.0 _ll_register_callbacks cb 0x55dc259267b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25beb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25beb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37618/0 (socket says 172.21.15.60:37618) 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 -- 172.21.15.60:0/4070721184 learned_addr learned my addr 172.21.15.60:0/4070721184 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d3fff700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25be8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 -- 172.21.15.60:0/4070721184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 msgr2=0x55dc25be8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25be8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 -- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 msgr2=0x55dc25be7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 -- 172.21.15.60:0/4070721184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c800fdb0 con 0x55dc25bda210 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46d37fe700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25beb060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f46c40cbe60 tx=0x7f46c4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f4107294f8b342 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.302+0000 7f46b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46b2ffd700 1 -- 172.21.15.60:0/4070721184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c409f320 con 0x55dc25bda210 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46b2ffd700 1 -- 172.21.15.60:0/4070721184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f46c409a890 con 0x55dc25bda210 2023-10-05T15:16:27.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46c409b3a0 con 0x55dc25bda210 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46b2ffd700 1 -- 172.21.15.60:0/4070721184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46c4099590 con 0x55dc25bda210 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 10 client.15402 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55dc25956260 con 0x55dc25bda210 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46b2ffd700 1 -- 172.21.15.60:0/4070721184 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46c409b3a0 con 0x55dc25bda210 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46b2ffd700 1 -- 172.21.15.60:0/4070721184 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46c407b020 con 0x55dc25bda210 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 10 client.15402 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 10 client.15402 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-05T15:16:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 20 client.15402 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25c48110 0x55dc25c44620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 4 client.15402 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc25b25ae0 con 0x55dc25c48110 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.303+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25c48110 0x55dc25c44620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46b2ffd700 10 client.15402 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46d2ffd700 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25c48110 0x55dc25c44620 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c162df6efeedb9f1 server_cookie=80fe1a0350c55db9 in_seq=0 out_seq=0 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46b2ffd700 1 -- 172.21.15.60:0/4070721184 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55dc25b25ae0 con 0x55dc25c48110 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46b2ffd700 10 client.15402 handle_command_reply: tid=0 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 client.15402 shutdown 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 msgr2=0x55dc25beb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25beb060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f46c40cbe60 tx=0x7f46c4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 shutdown_connections 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc25bdba10 0x55dc25be8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55dc25c48110 0x55dc25c44620 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc25bda210 0x55dc25beb060 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46b2ffd700 0 client.15402 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 --2- 172.21.15.60:0/4070721184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc25bdab70 0x55dc25be7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.304+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 >> 172.21.15.60:0/4070721184 conn(0x55dc25b4e210 msgr2=0x55dc25be29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 shutdown_connections 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46e5dd0b80 1 -- 172.21.15.60:0/4070721184 wait complete. 2023-10-05T15:16:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46e5dd0b80 20 client.15402 trim_cache size 0 max 16384 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 4, 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24461, 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 76.985307184999996, 2023-10-05T15:16:27.317 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:27.317 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:27.317 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:27.317 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 120.490674681 2023-10-05T15:16:27.317 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f46bc0a1480 msgr2=0x7f46bc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f46bc0a1480 0x7f46bc0a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f46c8005fd0 tx=0x7f46c8005f60 comp rx=0 tx=0).stop 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 msgr2=0x7f46d40ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 0x7f46d40ffa60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f46c40098e0 tx=0x7f46c400f690 comp rx=0 tx=0).stop 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 shutdown_connections 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46d4101440 0x7f46d41a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f46bc0a1480 0x7f46bc0a3940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d4100000 0x7f46d40ffa60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 --2- 172.21.15.60:0/2661212321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41009c0 0x7f46d419dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 >> 172.21.15.60:0/2661212321 conn(0x7f46d40faab0 msgr2=0x7f46d40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 shutdown_connections 2023-10-05T15:16:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.305+0000 7f46d9be6700 1 -- 172.21.15.60:0/2661212321 wait complete. 2023-10-05T15:16:27.319 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:27 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1201681183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:27.319 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:27 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3086721992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:27.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-05T15:16:27.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:27 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1201681183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:27.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:27 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3086721992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:27.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:27 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1201681183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:27.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:27 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3086721992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:27.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 -- 172.21.15.60:0/2183386935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8100fb0 msgr2=0x7efca8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 --2- 172.21.15.60:0/2183386935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8100fb0 0x7efca8101410 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0099c0 tx=0x7efc9c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 -- 172.21.15.60:0/2183386935 shutdown_connections 2023-10-05T15:16:27.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 --2- 172.21.15.60:0/2183386935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efca8101950 0x7efca8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 --2- 172.21.15.60:0/2183386935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efca80ffdc0 0x7efca81001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 --2- 172.21.15.60:0/2183386935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8100fb0 0x7efca8101410 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 -- 172.21.15.60:0/2183386935 >> 172.21.15.60:0/2183386935 conn(0x7efca80fb330 msgr2=0x7efca80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 -- 172.21.15.60:0/2183386935 shutdown_connections 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 -- 172.21.15.60:0/2183386935 wait complete. 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 Processor -- start 2023-10-05T15:16:27.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.445+0000 7efcae411700 1 -- start start 2023-10-05T15:16:27.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcae411700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efca80ffdc0 0x7efca8068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcae411700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efca8100fb0 0x7efca819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcae411700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 0x7efca819df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcae411700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca819e700 con 0x7efca8101950 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcae411700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca819e870 con 0x7efca80ffdc0 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcae411700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca819ea30 con 0x7efca8100fb0 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 0x7efca819df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 0x7efca819df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37636/0 (socket says 172.21.15.60:37636) 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 -- 172.21.15.60:0/350085447 learned_addr learned my addr 172.21.15.60:0/350085447 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efca7fff700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efca80ffdc0 0x7efca8068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efca77fe700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efca8100fb0 0x7efca819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 -- 172.21.15.60:0/350085447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efca8100fb0 msgr2=0x7efca819b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efca8100fb0 0x7efca819b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 -- 172.21.15.60:0/350085447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efca80ffdc0 msgr2=0x7efca8068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efca80ffdc0 0x7efca8068bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 -- 172.21.15.60:0/350085447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0095f0 con 0x7efca8101950 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.446+0000 7efcac9ae700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 0x7efca819df30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efca0007ee0 tx=0x7efca000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.447+0000 7efca57fa700 1 -- 172.21.15.60:0/350085447 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0017070 con 0x7efca8101950 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.447+0000 7efca57fa700 1 -- 172.21.15.60:0/350085447 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca000f040 con 0x7efca8101950 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.447+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca819ed10 con 0x7efca8101950 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.447+0000 7efca57fa700 1 -- 172.21.15.60:0/350085447 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005740 con 0x7efca8101950 2023-10-05T15:16:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.447+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca819f1a0 con 0x7efca8101950 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.449+0000 7efca57fa700 1 -- 172.21.15.60:0/350085447 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efca000dc60 con 0x7efca8101950 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.450+0000 7efca57fa700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efc900a1500 0x7efc900a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.450+0000 7efca57fa700 1 -- 172.21.15.60:0/350085447 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efca00cc760 con 0x7efca8101950 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.450+0000 7efca7fff700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efc900a1500 0x7efc900a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efca7fff700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efc900a1500 0x7efc900a39c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efca8100e10 tx=0x7efc98007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 Processor -- start 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 -- start start 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f33630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f34e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e9b410 con 0x5562c8f34a10 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e8cbd0 con 0x5562c8f33b70 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e8a4f0 con 0x5562c8f33210 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f34e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f34e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37644/0 (socket says 172.21.15.60:37644) 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 -- 172.21.15.60:0/1110490953 learned_addr learned my addr 172.21.15.60:0/1110490953 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efca77fe700 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efca7fff700 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f33630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 -- 172.21.15.60:0/1110490953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 msgr2=0x5562c8f33630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f33630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 -- 172.21.15.60:0/1110490953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 msgr2=0x5562c8f34430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f34430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efcac9ae700 1 -- 172.21.15.60:0/1110490953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562c8cb0d90 con 0x5562c8f34a10 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.451+0000 7efca77fe700 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f34430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcac9ae700 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f34e90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efca0096190 tx=0x7efca0004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e468e3c2b2e21a26 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efc8e7fc700 1 -- 172.21.15.60:0/1110490953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00b90d0 con 0x5562c8f34a10 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efc8e7fc700 1 -- 172.21.15.60:0/1110490953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca0099720 con 0x5562c8f34a10 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efc8e7fc700 1 -- 172.21.15.60:0/1110490953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0022450 con 0x5562c8f34a10 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1110490953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 msgr2=0x5562c8f34e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f34e90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efca0096190 tx=0x7efca0004c40 comp rx=0 tx=0).stop 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1110490953 shutdown_connections 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f34e90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f33630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1110490953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f34430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.452+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1110490953 >> 172.21.15.60:0/1110490953 conn(0x5562c8ea7210 msgr2=0x5562c8f2e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1110490953 shutdown_connections 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1110490953 wait complete. 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 -- start start 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 Processor -- start 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 0x5562c8f3d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f3d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f34a10 0x5562c8f44580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e85de0 con 0x5562c8f33210 2023-10-05T15:16:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e226c0 con 0x5562c8f33b70 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e22360 con 0x5562c8f34a10 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efcba5fbb80 10 client.0 _ll_register_callbacks cb 0x5562c8c7f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.453+0000 7efca7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 0x5562c8f3d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 0x5562c8f3d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37646/0 (socket says 172.21.15.60:37646) 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 -- 172.21.15.60:0/1246891675 learned_addr learned my addr 172.21.15.60:0/1246891675 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca77fe700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f3d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efcac9ae700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f34a10 0x5562c8f44580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 -- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f34a10 msgr2=0x5562c8f44580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f34a10 0x5562c8f44580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 -- 172.21.15.60:0/1246891675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 msgr2=0x5562c8f3d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f3d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 -- 172.21.15.60:0/1246891675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca819f1a0 con 0x5562c8f33210 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca77fe700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f3d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efca7fff700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 0x5562c8f3d000 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efc980116c0 tx=0x7efc980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77faebee954501c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efc877fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efc877fe700 1 -- 172.21.15.60:0/1246891675 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98004460 con 0x5562c8f33210 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efc877fe700 1 -- 172.21.15.60:0/1246891675 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efc98017070 con 0x5562c8f33210 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562c8f25ec0 con 0x5562c8f33210 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efc877fe700 1 -- 172.21.15.60:0/1246891675 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc98010e70 con 0x5562c8f33210 2023-10-05T15:16:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efcba5fbb80 10 client.15414 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.454+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5562c8c99c10 con 0x5562c8f33210 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efc877fe700 1 -- 172.21.15.60:0/1246891675 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562c8f25ec0 con 0x5562c8f33210 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efc877fe700 1 -- 172.21.15.60:0/1246891675 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efc9801f730 con 0x5562c8f33210 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efcba5fbb80 10 client.15414 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efcba5fbb80 10 client.15414 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efcba5fbb80 20 client.15414 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8f48c80 0x5562c8f476e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efcba5fbb80 4 client.15414 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562c8e7edc0 con 0x5562c8f48c80 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.455+0000 7efca77fe700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8f48c80 0x5562c8f476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.456+0000 7efc877fe700 10 client.15414 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:27.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.456+0000 7efca77fe700 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8f48c80 0x5562c8f476e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec45aba6f2fdd7c4 server_cookie=32a2d8c778017768 in_seq=0 out_seq=0 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.456+0000 7efc877fe700 1 -- 172.21.15.60:0/1246891675 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5562c8e7edc0 con 0x5562c8f48c80 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.456+0000 7efc877fe700 10 client.15414 handle_command_reply: tid=0 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.456+0000 7efcba5fbb80 1 client.15414 shutdown 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 msgr2=0x5562c8f3d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 0x5562c8f3d000 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efc980116c0 tx=0x7efc980047c0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 shutdown_connections 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8f48c80 0x5562c8f476e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f34a10 0x5562c8f44580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efc877fe700 0 client.15414 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:27.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33210 0x5562c8f3d000 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/1246891675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33b70 0x5562c8f3d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 >> 172.21.15.60:0/1246891675 conn(0x5562c8ea7210 msgr2=0x5562c8f2df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 shutdown_connections 2023-10-05T15:16:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 1 -- 172.21.15.60:0/1246891675 wait complete. 2023-10-05T15:16:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.457+0000 7efcba5fbb80 20 client.15414 trim_cache size 0 max 16384 2023-10-05T15:16:27.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 Processor -- start 2023-10-05T15:16:27.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 -- start start 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33210 0x5562c8f3ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33b70 0x5562c8f37920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f37e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8d068d0 con 0x5562c8f34a10 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8f342f0 con 0x5562c8f33210 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8e2c4d0 con 0x5562c8f33b70 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f37e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f37e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37658/0 (socket says 172.21.15.60:37658) 2023-10-05T15:16:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 -- 172.21.15.60:0/2737239440 learned_addr learned my addr 172.21.15.60:0/2737239440 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efca77fe700 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33b70 0x5562c8f37920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efca7fff700 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33210 0x5562c8f3ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 -- 172.21.15.60:0/2737239440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33b70 msgr2=0x5562c8f37920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33b70 0x5562c8f37920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 -- 172.21.15.60:0/2737239440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33210 msgr2=0x5562c8f3ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33210 0x5562c8f3ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 -- 172.21.15.60:0/2737239440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562c8cd7200 con 0x5562c8f34a10 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efcac9ae700 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f37e60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efca0009510 tx=0x7efca00991b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9d715ef68a274e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.475+0000 7efc8effd700 1 -- 172.21.15.60:0/2737239440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00b90d0 con 0x5562c8f34a10 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efc8effd700 1 -- 172.21.15.60:0/2737239440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca009d870 con 0x5562c8f34a10 2023-10-05T15:16:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efc8effd700 1 -- 172.21.15.60:0/2737239440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0022490 con 0x5562c8f34a10 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 -- 172.21.15.60:0/2737239440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 msgr2=0x5562c8f37e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f37e60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efca0009510 tx=0x7efca00991b0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 -- 172.21.15.60:0/2737239440 shutdown_connections 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f34a10 0x5562c8f37e60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f33210 0x5562c8f3ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/2737239440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33b70 0x5562c8f37920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 -- 172.21.15.60:0/2737239440 >> 172.21.15.60:0/2737239440 conn(0x5562c8ea7210 msgr2=0x5562c8f2cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 -- 172.21.15.60:0/2737239440 shutdown_connections 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 -- 172.21.15.60:0/2737239440 wait complete. 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.476+0000 7efcba5fbb80 1 -- start start 2023-10-05T15:16:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 Processor -- start 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f3fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 0x5562c8f3e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f34a10 0x5562c8f3ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8f402e0 con 0x5562c8f33b70 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8f3ef60 con 0x5562c8f34a10 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c8f3f120 con 0x5562c8f33210 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcba5fbb80 10 client.0 _ll_register_callbacks cb 0x7efc98010cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 0x5562c8f3e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 0x5562c8f3e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37662/0 (socket says 172.21.15.60:37662) 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 -- 172.21.15.60:0/3022965095 learned_addr learned my addr 172.21.15.60:0/3022965095 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca7fff700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f3fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efcac9ae700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f34a10 0x5562c8f3ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 -- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 msgr2=0x5562c8f3fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f3fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 -- 172.21.15.60:0/3022965095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f34a10 msgr2=0x5562c8f3ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.477+0000 7efca77fe700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f34a10 0x5562c8f3ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efca77fe700 1 -- 172.21.15.60:0/3022965095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562c8cb0d90 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efca77fe700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 0x5562c8f3e4e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc9c003680 tx=0x7efc9c0054c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dd7c10be85a8b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efc877fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efc877fe700 1 -- 172.21.15.60:0/3022965095 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0056e0 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efc877fe700 1 -- 172.21.15.60:0/3022965095 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efc9c028c90 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efca0099720 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efc877fe700 1 -- 172.21.15.60:0/3022965095 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc9c028e50 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 10 client.15420 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5562c8caf260 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efc877fe700 1 -- 172.21.15.60:0/3022965095 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca0099720 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efc877fe700 1 -- 172.21.15.60:0/3022965095 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efc9c0099f0 con 0x5562c8f33b70 2023-10-05T15:16:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 10 client.15420 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 10 client.15420 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 20 client.15420 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8fa5460 0x5562c8fa18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 4 client.15420 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.478+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5562c8e7eae0 con 0x5562c8fa5460 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efca7fff700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8fa5460 0x5562c8fa18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efca7fff700 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8fa5460 0x5562c8fa18a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f349d8e51d59ace2 server_cookie=6346c3bae89eb17c in_seq=0 out_seq=0 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efc877fe700 10 client.15420 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efc877fe700 1 -- 172.21.15.60:0/3022965095 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5562c8e7eae0 con 0x5562c8fa5460 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efc877fe700 10 client.15420 handle_command_reply: tid=0 2023-10-05T15:16:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efcba5fbb80 1 client.15420 shutdown 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 msgr2=0x5562c8f3e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.479+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 0x5562c8f3e4e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc9c003680 tx=0x7efc9c0054c0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 shutdown_connections 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5562c8fa5460 0x5562c8fa18a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562c8f34a10 0x5562c8f3ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efc877fe700 0 client.15420 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562c8f33210 0x5562c8f3fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 --2- 172.21.15.60:0/3022965095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562c8f33b70 0x5562c8f3e4e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 >> 172.21.15.60:0/3022965095 conn(0x5562c8ea7210 msgr2=0x5562c8f3ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 shutdown_connections 2023-10-05T15:16:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 1 -- 172.21.15.60:0/3022965095 wait complete. 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcba5fbb80 20 client.15420 trim_cache size 0 max 16384 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 3, 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24472, 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 78.170707860999997, 2023-10-05T15:16:27.492 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:27.492 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:27.492 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:27.492 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 116.124714157 2023-10-05T15:16:27.492 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efc900a1500 msgr2=0x7efc900a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efc900a1500 0x7efc900a39c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efca8100e10 tx=0x7efc98007400 comp rx=0 tx=0).stop 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 msgr2=0x7efca819df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 0x7efca819df30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efca0007ee0 tx=0x7efca000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 shutdown_connections 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efc900a1500 0x7efc900a39c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8101950 0x7efca819df30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efca80ffdc0 0x7efca8068bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 --2- 172.21.15.60:0/350085447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efca8100fb0 0x7efca819b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 >> 172.21.15.60:0/350085447 conn(0x7efca80fb330 msgr2=0x7efca80fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 shutdown_connections 2023-10-05T15:16:27.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.480+0000 7efcae411700 1 -- 172.21.15.60:0/350085447 wait complete. 2023-10-05T15:16:27.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-05T15:16:27.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.619+0000 7f606f2d2700 1 -- 172.21.15.60:0/223034791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102070 msgr2=0x7f60681024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.619+0000 7f606f2d2700 1 --2- 172.21.15.60:0/223034791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102070 0x7f60681024f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6058009990 tx=0x7f6058009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.619+0000 7f606f2d2700 1 -- 172.21.15.60:0/223034791 shutdown_connections 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 --2- 172.21.15.60:0/223034791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068102a30 0x7f6068109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 --2- 172.21.15.60:0/223034791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6068100e90 0x7f60681012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 --2- 172.21.15.60:0/223034791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102070 0x7f60681024f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- 172.21.15.60:0/223034791 >> 172.21.15.60:0/223034791 conn(0x7f60680fc430 msgr2=0x7f60680fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- 172.21.15.60:0/223034791 shutdown_connections 2023-10-05T15:16:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- 172.21.15.60:0/223034791 wait complete. 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 Processor -- start 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- start start 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068100e90 0x7f6068196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6068102070 0x7f6068197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 0x7f606819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606819e780 con 0x7f6068102a30 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606819e8f0 con 0x7f6068102070 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.620+0000 7f606f2d2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606819eab0 con 0x7f6068100e90 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 0x7f606819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 0x7f606819e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37678/0 (socket says 172.21.15.60:37678) 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 -- 172.21.15.60:0/2869532699 learned_addr learned my addr 172.21.15.60:0/2869532699 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606c86d700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6068102070 0x7f6068197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d06e700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068100e90 0x7f6068196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 -- 172.21.15.60:0/2869532699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068100e90 msgr2=0x7f6068196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068100e90 0x7f6068196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 -- 172.21.15.60:0/2869532699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6068102070 msgr2=0x7f6068197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6068102070 0x7f6068197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 -- 172.21.15.60:0/2869532699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580095f0 con 0x7f6068102a30 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d06e700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068100e90 0x7f6068196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606d86f700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 0x7f606819e1b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6060007ee0 tx=0x7f606000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f605e7fc700 1 -- 172.21.15.60:0/2869532699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060017070 con 0x7f6068102a30 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f605e7fc700 1 -- 172.21.15.60:0/2869532699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f606000f040 con 0x7f6068102a30 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606819ed90 con 0x7f6068102a30 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f605e7fc700 1 -- 172.21.15.60:0/2869532699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060005740 con 0x7f6068102a30 2023-10-05T15:16:27.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.621+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606819f190 con 0x7f6068102a30 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.624+0000 7f605e7fc700 1 -- 172.21.15.60:0/2869532699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f606000dc60 con 0x7f6068102a30 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.624+0000 7f605e7fc700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f60540a1480 0x7f60540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.624+0000 7f605e7fc700 1 -- 172.21.15.60:0/2869532699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f60600cc800 con 0x7f6068102a30 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.624+0000 7f606d06e700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f60540a1480 0x7f60540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d06e700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f60540a1480 0x7f60540a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6064005fd0 tx=0x7f6064005f20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 Processor -- start 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 -- start start 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83a5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5b70 0x55a9e83a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e830d410 con 0x55a9e83a6a10 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e82febd0 con 0x55a9e83a5b70 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e82fc4f0 con 0x55a9e83a5210 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83a6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37686/0 (socket says 172.21.15.60:37686) 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 -- 172.21.15.60:0/2724239326 learned_addr learned my addr 172.21.15.60:0/2724239326 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d06e700 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606c86d700 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5b70 0x55a9e83a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 -- 172.21.15.60:0/2724239326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 msgr2=0x55a9e83a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 -- 172.21.15.60:0/2724239326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5b70 msgr2=0x55a9e83a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5b70 0x55a9e83a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.625+0000 7f606d86f700 1 -- 172.21.15.60:0/2724239326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e8122d90 con 0x55a9e83a6a10 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.626+0000 7f606d86f700 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83a6e90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6060099520 tx=0x7f606001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481d19d3bca34a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.626+0000 7f60537fe700 1 -- 172.21.15.60:0/2724239326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606009d970 con 0x55a9e83a6a10 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.626+0000 7f60537fe700 1 -- 172.21.15.60:0/2724239326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60600a1bb0 con 0x55a9e83a6a10 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.626+0000 7f60537fe700 1 -- 172.21.15.60:0/2724239326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60600840c0 con 0x55a9e83a6a10 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.626+0000 7f607b4bcb80 1 -- 172.21.15.60:0/2724239326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 msgr2=0x55a9e83a6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.626+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83a6e90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6060099520 tx=0x7f606001c000 comp rx=0 tx=0).stop 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 -- 172.21.15.60:0/2724239326 shutdown_connections 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83a6e90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/2724239326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5b70 0x55a9e83a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 -- 172.21.15.60:0/2724239326 >> 172.21.15.60:0/2724239326 conn(0x55a9e8319210 msgr2=0x55a9e83a00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 -- 172.21.15.60:0/2724239326 shutdown_connections 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 -- 172.21.15.60:0/2724239326 wait complete. 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 -- start start 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.627+0000 7f607b4bcb80 1 Processor -- start 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 0x55a9e83af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e82f7de0 con 0x55a9e83a5b70 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e82946c0 con 0x55a9e83a6a10 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8294360 con 0x55a9e83a5210 2023-10-05T15:16:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 10 client.0 _ll_register_callbacks cb 0x55a9e80f17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 0x55a9e83af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 0x55a9e83af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37690/0 (socket says 172.21.15.60:37690) 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 -- 172.21.15.60:0/1655927443 learned_addr learned my addr 172.21.15.60:0/1655927443 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606d06e700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606d86f700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 -- 172.21.15.60:0/1655927443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 msgr2=0x55a9e83af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 -- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 msgr2=0x55a9e83b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 -- 172.21.15.60:0/1655927443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606819f190 con 0x55a9e83a5b70 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606d06e700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606d86f700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f606c86d700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 0x55a9e83af580 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6068100bb0 tx=0x7f6058009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673bb1d2e3421221 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f6050ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f6050ff9700 1 -- 172.21.15.60:0/1655927443 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605801d070 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f6050ff9700 1 -- 172.21.15.60:0/1655927443 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f6058003ca0 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.628+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9e8397ec0 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f6050ff9700 1 -- 172.21.15.60:0/1655927443 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6058003e60 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 10 client.15432 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9e810bc10 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f6050ff9700 1 -- 172.21.15.60:0/1655927443 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a9e8397ec0 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f6050ff9700 1 -- 172.21.15.60:0/1655927443 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f605800fa50 con 0x55a9e83a5b70 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 10 client.15432 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 20 client.15432 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e83bac60 0x55a9e83b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 4 client.15432 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9e82f0dc0 con 0x55a9e83bac60 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.629+0000 7f606d06e700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e83bac60 0x55a9e83b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f606d06e700 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e83bac60 0x55a9e83b9710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1aca6f35559f264 server_cookie=ffbe775664239af8 in_seq=0 out_seq=0 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f6050ff9700 10 client.15432 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f6050ff9700 1 -- 172.21.15.60:0/1655927443 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a9e82f0dc0 con 0x55a9e83bac60 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f6050ff9700 10 client.15432 handle_command_reply: tid=0 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f607b4bcb80 1 client.15432 shutdown 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 msgr2=0x55a9e83af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.630+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 0x55a9e83af580 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6068100bb0 tx=0x7f6058009ee0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 shutdown_connections 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e83bac60 0x55a9e83b9710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f6050ff9700 0 client.15432 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5210 0x55a9e83af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/1655927443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5b70 0x55a9e83af580 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 >> 172.21.15.60:0/1655927443 conn(0x55a9e8319210 msgr2=0x55a9e839ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 shutdown_connections 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 1 -- 172.21.15.60:0/1655927443 wait complete. 2023-10-05T15:16:27.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.631+0000 7f607b4bcb80 20 client.15432 trim_cache size 0 max 16384 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 Processor -- start 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 -- start start 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 0x55a9e8397a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e81788d0 con 0x55a9e83a5210 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e82f3f00 con 0x55a9e83a6a10 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8184de0 con 0x55a9e83a5b70 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.648+0000 7f606d06e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 0x55a9e8397a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 0x55a9e8397a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37696/0 (socket says 172.21.15.60:37696) 2023-10-05T15:16:27.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 -- 172.21.15.60:0/3314768363 learned_addr learned my addr 172.21.15.60:0/3314768363 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d86f700 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606c86d700 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 -- 172.21.15.60:0/3314768363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 msgr2=0x55a9e83b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 -- 172.21.15.60:0/3314768363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 msgr2=0x55a9e83adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 -- 172.21.15.60:0/3314768363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e8149200 con 0x55a9e83a5210 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d86f700 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f606d06e700 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 0x55a9e8397a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6064009450 tx=0x7f6064014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949c5666f56ce4f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f6053fff700 1 -- 172.21.15.60:0/3314768363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606402d070 con 0x55a9e83a5210 2023-10-05T15:16:27.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f6053fff700 1 -- 172.21.15.60:0/3314768363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6064004cf0 con 0x55a9e83a5210 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.649+0000 7f6053fff700 1 -- 172.21.15.60:0/3314768363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064025040 con 0x55a9e83a5210 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 -- 172.21.15.60:0/3314768363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 msgr2=0x55a9e8397a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 0x55a9e8397a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6064009450 tx=0x7f6064014000 comp rx=0 tx=0).stop 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 -- 172.21.15.60:0/3314768363 shutdown_connections 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a6a10 0x55a9e83adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a5210 0x55a9e8397a00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/3314768363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 -- 172.21.15.60:0/3314768363 >> 172.21.15.60:0/3314768363 conn(0x55a9e8319210 msgr2=0x55a9e839eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 -- 172.21.15.60:0/3314768363 shutdown_connections 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 -- 172.21.15.60:0/3314768363 wait complete. 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 -- start start 2023-10-05T15:16:27.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.650+0000 7f607b4bcb80 1 Processor -- start 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5210 0x55a9e83b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e83b2f20 con 0x55a9e83a6a10 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e83b3060 con 0x55a9e83a5210 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e83b3220 con 0x55a9e83a5b70 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 10 client.0 _ll_register_callbacks cb 0x7f605800bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37706/0 (socket says 172.21.15.60:37706) 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 -- 172.21.15.60:0/747417405 learned_addr learned my addr 172.21.15.60:0/747417405 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606c86d700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d06e700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5210 0x55a9e83b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 -- 172.21.15.60:0/747417405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 msgr2=0x55a9e83b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 -- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5210 msgr2=0x55a9e83b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5210 0x55a9e83b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 -- 172.21.15.60:0/747417405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606400eb00 con 0x55a9e83a6a10 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d06e700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5210 0x55a9e83b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f606d86f700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83b2900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f60600997b0 tx=0x7f606000d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0ca6bd40fdf74f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f6050ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f6050ff9700 1 -- 172.21.15.60:0/747417405 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060099a80 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f6050ff9700 1 -- 172.21.15.60:0/747417405 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f6060099be0 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.651+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60600a1bb0 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f6050ff9700 1 -- 172.21.15.60:0/747417405 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6060098d10 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 10 client.15438 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9e8121260 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f6050ff9700 1 -- 172.21.15.60:0/747417405 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60600a1bb0 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f6050ff9700 1 -- 172.21.15.60:0/747417405 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f60600b7d20 con 0x55a9e83a6a10 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 10 client.15438 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 10 client.15438 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 20 client.15438 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e84131d0 0x55a9e840f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 4 client.15438 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9e82f0ae0 con 0x55a9e84131d0 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.652+0000 7f606d06e700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e84131d0 0x55a9e840f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f6050ff9700 10 client.15438 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f606d06e700 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e84131d0 0x55a9e840f690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3cf3057ffa4cda9 server_cookie=54a6d227d5c494fe in_seq=0 out_seq=0 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f6050ff9700 1 -- 172.21.15.60:0/747417405 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a9e82f0ae0 con 0x55a9e84131d0 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f6050ff9700 10 client.15438 handle_command_reply: tid=0 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 client.15438 shutdown 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 msgr2=0x55a9e83b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83b2900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f60600997b0 tx=0x7f606000d8e0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 shutdown_connections 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55a9e84131d0 0x55a9e840f690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a9e83a6a10 0x55a9e83b2900 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9e83a5210 0x55a9e83b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 --2- 172.21.15.60:0/747417405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9e83a5b70 0x55a9e83b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f6050ff9700 0 client.15438 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 >> 172.21.15.60:0/747417405 conn(0x55a9e8319210 msgr2=0x55a9e83adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 shutdown_connections 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 1 -- 172.21.15.60:0/747417405 wait complete. 2023-10-05T15:16:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.653+0000 7f607b4bcb80 20 client.15438 trim_cache size 0 max 16384 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24488, 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 79.355621314999993, 2023-10-05T15:16:27.663 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:27.664 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:27.664 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:27.664 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 114.058687269 2023-10-05T15:16:27.664 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f60540a1480 msgr2=0x7f60540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f60540a1480 0x7f60540a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6064005fd0 tx=0x7f6064005f20 comp rx=0 tx=0).stop 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 msgr2=0x7f606819e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 0x7f606819e1b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6060007ee0 tx=0x7f606000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 shutdown_connections 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f60540a1480 0x7f60540a3940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6068102a30 0x7f606819e1b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6068100e90 0x7f6068196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 --2- 172.21.15.60:0/2869532699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6068102070 0x7f6068197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 >> 172.21.15.60:0/2869532699 conn(0x7f60680fc430 msgr2=0x7f60680fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 shutdown_connections 2023-10-05T15:16:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.654+0000 7f606f2d2700 1 -- 172.21.15.60:0/2869532699 wait complete. 2023-10-05T15:16:27.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 -- 172.21.15.60:0/1010791521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c106be0 msgr2=0x7f611c109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 --2- 172.21.15.60:0/1010791521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c106be0 0x7f611c109050 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f611400b0a0 tx=0x7f611400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 -- 172.21.15.60:0/1010791521 shutdown_connections 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 --2- 172.21.15.60:0/1010791521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c106be0 0x7f611c109050 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 --2- 172.21.15.60:0/1010791521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611c101980 0x7f611c103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 --2- 172.21.15.60:0/1010791521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1042b0 0x7f611c1066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 -- 172.21.15.60:0/1010791521 >> 172.21.15.60:0/1010791521 conn(0x7f611c0fb3b0 msgr2=0x7f611c0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 -- 172.21.15.60:0/1010791521 shutdown_connections 2023-10-05T15:16:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.793+0000 7f6123d35700 1 -- 172.21.15.60:0/1010791521 wait complete. 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 Processor -- start 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 -- start start 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 0x7f611c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611c1042b0 0x7f611c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c106be0 0x7f611c1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c1a0a30 con 0x7f611c101980 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c1a0b70 con 0x7f611c106be0 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6123d35700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c1a0d00 con 0x7f611c1042b0 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 0x7f611c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 0x7f611c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37716/0 (socket says 172.21.15.60:37716) 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 -- 172.21.15.60:0/3501250318 learned_addr learned my addr 172.21.15.60:0/3501250318 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f61212d0700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611c1042b0 0x7f611c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f61222d2700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c106be0 0x7f611c1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 -- 172.21.15.60:0/3501250318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611c1042b0 msgr2=0x7f611c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611c1042b0 0x7f611c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 -- 172.21.15.60:0/3501250318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c106be0 msgr2=0x7f611c1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c106be0 0x7f611c1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f6121ad1700 1 -- 172.21.15.60:0/3501250318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114009d00 con 0x7f611c101980 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.794+0000 7f61222d2700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c106be0 0x7f611c1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.795+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 0x7f611c198eb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f611000d950 tx=0x7f611000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.795+0000 7f610effd700 1 -- 172.21.15.60:0/3501250318 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110009940 con 0x7f611c101980 2023-10-05T15:16:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.795+0000 7f610effd700 1 -- 172.21.15.60:0/3501250318 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6110010460 con 0x7f611c101980 2023-10-05T15:16:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.795+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c1a0fe0 con 0x7f611c101980 2023-10-05T15:16:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.795+0000 7f610effd700 1 -- 172.21.15.60:0/3501250318 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000f620 con 0x7f611c101980 2023-10-05T15:16:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.795+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c1a1400 con 0x7f611c101980 2023-10-05T15:16:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.797+0000 7f610effd700 1 -- 172.21.15.60:0/3501250318 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f61100108d0 con 0x7f611c101980 2023-10-05T15:16:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.798+0000 7f610effd700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61080a1480 0x7f61080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.798+0000 7f61212d0700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61080a1480 0x7f61080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.798+0000 7f610effd700 1 -- 172.21.15.60:0/3501250318 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f61100cce50 con 0x7f611c101980 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.798+0000 7f61212d0700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61080a1480 0x7f61080a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6118009c60 tx=0x7f6118009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 Processor -- start 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 -- start start 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442ed430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 0x5628442ede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562844254410 con 0x5628442eda10 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562844245bd0 con 0x5628442ecb70 2023-10-05T15:16:27.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628442434f0 con 0x5628442ec210 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 0x5628442ede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 0x5628442ede90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37728/0 (socket says 172.21.15.60:37728) 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 -- 172.21.15.60:0/2070565189 learned_addr learned my addr 172.21.15.60:0/2070565189 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f6121ad1700 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61212d0700 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 -- 172.21.15.60:0/2070565189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 msgr2=0x5628442ec630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442ec630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 -- 172.21.15.60:0/2070565189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 msgr2=0x5628442ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61222d2700 1 -- 172.21.15.60:0/2070565189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562844069d90 con 0x5628442eda10 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.799+0000 7f61212d0700 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f61222d2700 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 0x5628442ede90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6114006130 tx=0x7f6114009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadfa1921455caca server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f6107fff700 1 -- 172.21.15.60:0/2070565189 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400e040 con 0x5628442eda10 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f6107fff700 1 -- 172.21.15.60:0/2070565189 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61140076e0 con 0x5628442eda10 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f6107fff700 1 -- 172.21.15.60:0/2070565189 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611401d6b0 con 0x5628442eda10 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 -- 172.21.15.60:0/2070565189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 msgr2=0x5628442ede90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 0x5628442ede90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6114006130 tx=0x7f6114009c80 comp rx=0 tx=0).stop 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 -- 172.21.15.60:0/2070565189 shutdown_connections 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442eda10 0x5628442ede90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442ec630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/2070565189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.800+0000 7f612ff1fb80 1 -- 172.21.15.60:0/2070565189 >> 172.21.15.60:0/2070565189 conn(0x562844260210 msgr2=0x5628442e70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 -- 172.21.15.60:0/2070565189 shutdown_connections 2023-10-05T15:16:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 -- 172.21.15.60:0/2070565189 wait complete. 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 -- start start 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 Processor -- start 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284423ede0 con 0x5628442ec210 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628441db6c0 con 0x5628442ecb70 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.801+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628441db360 con 0x5628442eda10 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f612ff1fb80 10 client.0 _ll_register_callbacks cb 0x5628440387b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37730/0 (socket says 172.21.15.60:37730) 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 -- 172.21.15.60:0/390177078 learned_addr learned my addr 172.21.15.60:0/390177078 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61212d0700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61222d2700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 -- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 msgr2=0x5628442fd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 -- 172.21.15.60:0/390177078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 msgr2=0x5628442f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 -- 172.21.15.60:0/390177078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c109c40 con 0x5628442ec210 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61212d0700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f6121ad1700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f5f30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6110099b70 tx=0x7f6110099f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83df7d59fbc19cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61057fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61057fa700 1 -- 172.21.15.60:0/390177078 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611009a2d0 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61057fa700 1 -- 172.21.15.60:0/390177078 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f6110099360 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628442deec0 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f61057fa700 1 -- 172.21.15.60:0/390177078 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6110099520 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f612ff1fb80 10 client.15450 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.802+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562844052c10 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f61057fa700 1 -- 172.21.15.60:0/390177078 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5628442deec0 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f61057fa700 1 -- 172.21.15.60:0/390177078 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6110095c60 con 0x5628442ec210 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f612ff1fb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f612ff1fb80 10 client.15450 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f612ff1fb80 20 client.15450 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x562844301a60 0x562844300580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f612ff1fb80 4 client.15450 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562844237dc0 con 0x562844301a60 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.803+0000 7f61212d0700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x562844301a60 0x562844300580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f61057fa700 10 client.15450 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f61212d0700 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x562844301a60 0x562844300580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e77ff947679a1cd server_cookie=b62d76f2ed05834d in_seq=0 out_seq=0 2023-10-05T15:16:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f61057fa700 1 -- 172.21.15.60:0/390177078 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562844237dc0 con 0x562844301a60 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f61057fa700 10 client.15450 handle_command_reply: tid=0 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 client.15450 shutdown 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 msgr2=0x5628442f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f5f30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6110099b70 tx=0x7f6110099f40 comp rx=0 tx=0).stop 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 shutdown_connections 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x562844301a60 0x562844300580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f61057fa700 0 client.15450 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f5f30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/390177078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.804+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 >> 172.21.15.60:0/390177078 conn(0x562844260210 msgr2=0x5628442e6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.805+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 shutdown_connections 2023-10-05T15:16:27.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.805+0000 7f612ff1fb80 1 -- 172.21.15.60:0/390177078 wait complete. 2023-10-05T15:16:27.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.805+0000 7f612ff1fb80 20 client.15450 trim_cache size 0 max 16384 2023-10-05T15:16:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 Processor -- start 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 -- start start 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628440bf8d0 con 0x5628442ec210 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562844240070 con 0x5628442ecb70 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.822+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284423aed0 con 0x5628442eda10 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37738/0 (socket says 172.21.15.60:37738) 2023-10-05T15:16:27.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 -- 172.21.15.60:0/4203226803 learned_addr learned my addr 172.21.15.60:0/4203226803 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f61212d0700 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 -- 172.21.15.60:0/4203226803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 msgr2=0x5628442fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f61222d2700 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 -- 172.21.15.60:0/4203226803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 msgr2=0x5628442f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 -- 172.21.15.60:0/4203226803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562844090200 con 0x5628442ec210 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f61212d0700 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f6121ad1700 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f08e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f61100981c0 tx=0x7f61100a2380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a504c9d326d27dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f610cff9700 1 -- 172.21.15.60:0/4203226803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110014070 con 0x5628442ec210 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f610cff9700 1 -- 172.21.15.60:0/4203226803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6110099160 con 0x5628442ec210 2023-10-05T15:16:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.823+0000 7f610cff9700 1 -- 172.21.15.60:0/4203226803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100a1d70 con 0x5628442ec210 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 -- 172.21.15.60:0/4203226803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 msgr2=0x5628442f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f08e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f61100981c0 tx=0x7f61100a2380 comp rx=0 tx=0).stop 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 -- 172.21.15.60:0/4203226803 shutdown_connections 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442eda10 0x5628442fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ec210 0x5628442f08e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/4203226803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442ecb70 0x5628442f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 -- 172.21.15.60:0/4203226803 >> 172.21.15.60:0/4203226803 conn(0x562844260210 msgr2=0x5628442f4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 -- 172.21.15.60:0/4203226803 shutdown_connections 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 -- 172.21.15.60:0/4203226803 wait complete. 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 -- start start 2023-10-05T15:16:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.824+0000 7f612ff1fb80 1 Processor -- start 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 0x5628442f8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442eda10 0x5628442fd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628442fd650 con 0x5628442ecb70 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628442fd7c0 con 0x5628442eda10 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628442fd980 con 0x5628442ec210 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 10 client.0 _ll_register_callbacks cb 0x5628440387b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 0x5628442f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 0x5628442f8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37746/0 (socket says 172.21.15.60:37746) 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 -- 172.21.15.60:0/3066511975 learned_addr learned my addr 172.21.15.60:0/3066511975 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61222d2700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442eda10 0x5628442fd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 -- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 msgr2=0x5628442f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 -- 172.21.15.60:0/3066511975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442eda10 msgr2=0x5628442fd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442eda10 0x5628442fd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 -- 172.21.15.60:0/3066511975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562844052c10 con 0x5628442ecb70 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61212d0700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 0x5628442f8190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x5628442f6f90 tx=0x7f6118013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22939419837282a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61057fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61057fa700 1 -- 172.21.15.60:0/3066511975 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118022040 con 0x5628442ecb70 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f61057fa700 1 -- 172.21.15.60:0/3066511975 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f611801daa0 con 0x5628442ecb70 2023-10-05T15:16:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.825+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61140076e0 con 0x5628442ecb70 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f61057fa700 1 -- 172.21.15.60:0/3066511975 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f611801dc60 con 0x5628442ecb70 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 10 client.15456 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562844068260 con 0x5628442ecb70 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f61057fa700 1 -- 172.21.15.60:0/3066511975 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61140076e0 con 0x5628442ecb70 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f61057fa700 1 -- 172.21.15.60:0/3066511975 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6118027be0 con 0x5628442ecb70 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 10 client.15456 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 10 client.15456 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 20 client.15456 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x56284435a590 0x562844356a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 4 client.15456 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562844237ae0 con 0x56284435a590 2023-10-05T15:16:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.826+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x56284435a590 0x562844356a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f61057fa700 10 client.15456 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f6121ad1700 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x56284435a590 0x562844356a30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd3dc91a91c8663c server_cookie=2cb04f9a23b381a7 in_seq=0 out_seq=0 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f61057fa700 1 -- 172.21.15.60:0/3066511975 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562844237ae0 con 0x56284435a590 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f61057fa700 10 client.15456 handle_command_reply: tid=0 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 client.15456 shutdown 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 msgr2=0x5628442f8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 0x5628442f8190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x5628442f6f90 tx=0x7f6118013040 comp rx=0 tx=0).stop 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 shutdown_connections 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x56284435a590 0x562844356a30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628442eda10 0x5628442fd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628442ec210 0x5628442f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 --2- 172.21.15.60:0/3066511975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628442ecb70 0x5628442f8190 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f61057fa700 0 client.15456 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 >> 172.21.15.60:0/3066511975 conn(0x562844260210 msgr2=0x5628442f08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 shutdown_connections 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 1 -- 172.21.15.60:0/3066511975 wait complete. 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.827+0000 7f612ff1fb80 20 client.15456 trim_cache size 0 max 16384 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2023-10-05T15:16:27.837 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24496, 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 80.536769831000001, 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 111.9226575 2023-10-05T15:16:27.838 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61080a1480 msgr2=0x7f61080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61080a1480 0x7f61080a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6118009c60 tx=0x7f6118009260 comp rx=0 tx=0).stop 2023-10-05T15:16:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 msgr2=0x7f611c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 0x7f611c198eb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f611000d950 tx=0x7f611000dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 shutdown_connections 2023-10-05T15:16:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c106be0 0x7f611c1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f61080a1480 0x7f61080a3940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f611c101980 0x7f611c198eb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 --2- 172.21.15.60:0/3501250318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f611c1042b0 0x7f611c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 >> 172.21.15.60:0/3501250318 conn(0x7f611c0fb3b0 msgr2=0x7f611c100020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 shutdown_connections 2023-10-05T15:16:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.828+0000 7f6123d35700 1 -- 172.21.15.60:0/3501250318 wait complete. 2023-10-05T15:16:27.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-05T15:16:27.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 -- 172.21.15.60:0/526451417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6524101980 msgr2=0x7f6524103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 --2- 172.21.15.60:0/526451417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6524101980 0x7f6524103d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6514009990 tx=0x7f6514009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 -- 172.21.15.60:0/526451417 shutdown_connections 2023-10-05T15:16:27.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 --2- 172.21.15.60:0/526451417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f6524109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 --2- 172.21.15.60:0/526451417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6524101980 0x7f6524103d70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 --2- 172.21.15.60:0/526451417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65241042b0 0x7f65241066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 -- 172.21.15.60:0/526451417 >> 172.21.15.60:0/526451417 conn(0x7f65240fb3b0 msgr2=0x7f65240fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 -- 172.21.15.60:0/526451417 shutdown_connections 2023-10-05T15:16:27.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 -- 172.21.15.60:0/526451417 wait complete. 2023-10-05T15:16:27.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 Processor -- start 2023-10-05T15:16:27.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.967+0000 7f652a55e700 1 -- start start 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f652a55e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6524101980 0x7f6524196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f652a55e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65241042b0 0x7f65241970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f652a55e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f652419e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f652a55e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652419e720 con 0x7f6524106be0 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f652a55e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652419e860 con 0x7f6524101980 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f652a55e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652419e9f0 con 0x7f65241042b0 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f652419e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f652419e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37762/0 (socket says 172.21.15.60:37762) 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 -- 172.21.15.60:0/1684250355 learned_addr learned my addr 172.21.15.60:0/1684250355 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6523fff700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6524101980 0x7f6524196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f65237fe700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65241042b0 0x7f65241970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 -- 172.21.15.60:0/1684250355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65241042b0 msgr2=0x7f65241970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65241042b0 0x7f65241970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 -- 172.21.15.60:0/1684250355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6524101980 msgr2=0x7f6524196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6524101980 0x7f6524196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 -- 172.21.15.60:0/1684250355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140095f0 con 0x7f6524106be0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.968+0000 7f6528afb700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f652419e150 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f651c00ef30 tx=0x7f651c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.969+0000 7f65217fa700 1 -- 172.21.15.60:0/1684250355 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c018070 con 0x7f6524106be0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.969+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652419ec70 con 0x7f6524106be0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.969+0000 7f65217fa700 1 -- 172.21.15.60:0/1684250355 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f651c00f040 con 0x7f6524106be0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.969+0000 7f65217fa700 1 -- 172.21.15.60:0/1684250355 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c00cd00 con 0x7f6524106be0 2023-10-05T15:16:27.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.969+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652419f180 con 0x7f6524106be0 2023-10-05T15:16:27.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.971+0000 7f65217fa700 1 -- 172.21.15.60:0/1684250355 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f651c003a00 con 0x7f6524106be0 2023-10-05T15:16:27.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.971+0000 7f65217fa700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f65100a1480 0x7f65100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.972+0000 7f6523fff700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f65100a1480 0x7f65100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.972+0000 7f65217fa700 1 -- 172.21.15.60:0/1684250355 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f651c0ccba0 con 0x7f6524106be0 2023-10-05T15:16:27.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.972+0000 7f6523fff700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f65100a1480 0x7f65100a3940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f651400b2e0 tx=0x7f6514005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.972+0000 7f6536748b80 1 Processor -- start 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.972+0000 7f6536748b80 1 -- start start 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6536748b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8b210 0x55e9ddf8b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6536748b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6536748b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6536748b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddef3410 con 0x55e9ddf8ca10 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6536748b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddee4bd0 con 0x55e9ddf8bb70 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6536748b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddee24f0 con 0x55e9ddf8b210 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37770/0 (socket says 172.21.15.60:37770) 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 -- 172.21.15.60:0/2002428106 learned_addr learned my addr 172.21.15.60:0/2002428106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f65237fe700 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6523fff700 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8b210 0x55e9ddf8b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 -- 172.21.15.60:0/2002428106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8b210 msgr2=0x55e9ddf8b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8b210 0x55e9ddf8b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 -- 172.21.15.60:0/2002428106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 msgr2=0x55e9ddf8c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 -- 172.21.15.60:0/2002428106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ddd08d90 con 0x55e9ddf8ca10 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f6528afb700 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8ce90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f651c0960f0 tx=0x7f651c099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a0f8291d8563d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f651a7fc700 1 -- 172.21.15.60:0/2002428106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c004ad0 con 0x55e9ddf8ca10 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f651a7fc700 1 -- 172.21.15.60:0/2002428106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f651c00ce80 con 0x55e9ddf8ca10 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.973+0000 7f651a7fc700 1 -- 172.21.15.60:0/2002428106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c0b2210 con 0x55e9ddf8ca10 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 -- 172.21.15.60:0/2002428106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 msgr2=0x55e9ddf8ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8ce90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f651c0960f0 tx=0x7f651c099af0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 -- 172.21.15.60:0/2002428106 shutdown_connections 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8ce90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8b210 0x55e9ddf8b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 --2- 172.21.15.60:0/2002428106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 -- 172.21.15.60:0/2002428106 >> 172.21.15.60:0/2002428106 conn(0x55e9ddeff210 msgr2=0x55e9ddf860f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 -- 172.21.15.60:0/2002428106 shutdown_connections 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 -- 172.21.15.60:0/2002428106 wait complete. 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.974+0000 7f6536748b80 1 -- start start 2023-10-05T15:16:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 Processor -- start 2023-10-05T15:16:27.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddf95030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf95570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf9c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddeddde0 con 0x55e9ddf8b210 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9dde7a6c0 con 0x55e9ddf8ca10 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9dde7a360 con 0x55e9ddf8bb70 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6536748b80 10 client.0 _ll_register_callbacks cb 0x55e9ddcd77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddf95030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddf95030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37772/0 (socket says 172.21.15.60:37772) 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 -- 172.21.15.60:0/2017999373 learned_addr learned my addr 172.21.15.60:0/2017999373 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6528afb700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf9c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f65237fe700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf95570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 -- 172.21.15.60:0/2017999373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8bb70 msgr2=0x55e9ddf95570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf95570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 -- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8ca10 msgr2=0x55e9ddf9c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf9c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.975+0000 7f6523fff700 1 -- 172.21.15.60:0/2017999373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652419f180 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6523fff700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddf95030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6514015000 tx=0x7f6514009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c846c9041d568514 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f65037fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f65037fe700 1 -- 172.21.15.60:0/2017999373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651400be70 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f65037fe700 1 -- 172.21.15.60:0/2017999373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f651400f460 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9ddf7dec0 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f65037fe700 1 -- 172.21.15.60:0/2017999373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f651400f620 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 10 client.15468 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e9ddcf1c10 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f65037fe700 1 -- 172.21.15.60:0/2017999373 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e9ddf7dec0 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f65037fe700 1 -- 172.21.15.60:0/2017999373 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6514030960 con 0x55e9ddf8b210 2023-10-05T15:16:27.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 10 client.15468 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 20 client.15468 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddfa0c30 0x55e9ddf9f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 4 client.15468 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.976+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9dded6dc0 con 0x55e9ddfa0c30 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.977+0000 7f65237fe700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddfa0c30 0x55e9ddf9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.977+0000 7f65037fe700 10 client.15468 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.977+0000 7f65237fe700 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddfa0c30 0x55e9ddf9f700 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48326e37acfb9332 server_cookie=e8c2b26ee99bed9 in_seq=0 out_seq=0 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f65037fe700 1 -- 172.21.15.60:0/2017999373 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e9dded6dc0 con 0x55e9ddfa0c30 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f65037fe700 10 client.15468 handle_command_reply: tid=0 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 client.15468 shutdown 2023-10-05T15:16:27.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 msgr2=0x55e9ddf95030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddf95030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6514015000 tx=0x7f6514009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 shutdown_connections 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddfa0c30 0x55e9ddf9f700 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf9c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddf95030 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f65037fe700 0 client.15468 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 --2- 172.21.15.60:0/2017999373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf95570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 >> 172.21.15.60:0/2017999373 conn(0x55e9ddeff210 msgr2=0x55e9ddf85f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 shutdown_connections 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 1 -- 172.21.15.60:0/2017999373 wait complete. 2023-10-05T15:16:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.978+0000 7f6536748b80 20 client.15468 trim_cache size 0 max 16384 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.996+0000 7f6536748b80 1 Processor -- start 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.996+0000 7f6536748b80 1 -- start start 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6536748b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8b210 0x55e9ddf93c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6536748b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6536748b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6536748b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddd5e8d0 con 0x55e9ddf8bb70 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6536748b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9dded6dc0 con 0x55e9ddf8b210 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6536748b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9dde844d0 con 0x55e9ddf8ca10 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37782/0 (socket says 172.21.15.60:37782) 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 -- 172.21.15.60:0/243484905 learned_addr learned my addr 172.21.15.60:0/243484905 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6523fff700 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8b210 0x55e9ddf93c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6528afb700 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 -- 172.21.15.60:0/243484905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 msgr2=0x55e9ddf8fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 -- 172.21.15.60:0/243484905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8b210 msgr2=0x55e9ddf93c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8b210 0x55e9ddf93c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 -- 172.21.15.60:0/243484905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ddd2f200 con 0x55e9ddf8bb70 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f6523fff700 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8b210 0x55e9ddf93c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.997+0000 7f65237fe700 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8f980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f650c000c00 tx=0x7f650c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35bf47186ae1630 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f651affd700 1 -- 172.21.15.60:0/243484905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c017070 con 0x55e9ddf8bb70 2023-10-05T15:16:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f651affd700 1 -- 172.21.15.60:0/243484905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f650c018040 con 0x55e9ddf8bb70 2023-10-05T15:16:28.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f651affd700 1 -- 172.21.15.60:0/243484905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c0107b0 con 0x55e9ddf8bb70 2023-10-05T15:16:28.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 -- 172.21.15.60:0/243484905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 msgr2=0x55e9ddf8f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:28.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8f980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f650c000c00 tx=0x7f650c009260 comp rx=0 tx=0).stop 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 -- 172.21.15.60:0/243484905 shutdown_connections 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddf8fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8b210 0x55e9ddf93c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 --2- 172.21.15.60:0/243484905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8bb70 0x55e9ddf8f980 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 -- 172.21.15.60:0/243484905 >> 172.21.15.60:0/243484905 conn(0x55e9ddeff210 msgr2=0x55e9ddf84b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.998+0000 7f6536748b80 1 -- 172.21.15.60:0/243484905 shutdown_connections 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.999+0000 7f6536748b80 1 -- 172.21.15.60:0/243484905 wait complete. 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.999+0000 7f6536748b80 1 -- start start 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.999+0000 7f6536748b80 1 Processor -- start 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.999+0000 7f6536748b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddff0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.999+0000 7f6536748b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddff1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:27.999+0000 7f6536748b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddff82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddff87f0 con 0x55e9ddf8b210 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddff8930 con 0x55e9ddf8bb70 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ddff8ac0 con 0x55e9ddf8ca10 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 10 client.0 _ll_register_callbacks cb 0x55e9ddcd77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddff0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddff0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37786/0 (socket says 172.21.15.60:37786) 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 -- 172.21.15.60:0/2822062915 learned_addr learned my addr 172.21.15.60:0/2822062915 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f65237fe700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddff1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6528afb700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddff82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 -- 172.21.15.60:0/2822062915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 msgr2=0x55e9ddff82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddff82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 -- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 msgr2=0x55e9ddff1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddff1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 -- 172.21.15.60:0/2822062915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c004040 con 0x55e9ddf8b210 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6528afb700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddff82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6523fff700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddff0d30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6514030cc0 tx=0x7f6514005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8eeea2656f8803 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f65037fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f65037fe700 1 -- 172.21.15.60:0/2822062915 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514030630 con 0x55e9ddf8b210 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f65037fe700 1 -- 172.21.15.60:0/2822062915 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f6514030790 con 0x55e9ddf8b210 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f651c00ce80 con 0x55e9ddf8b210 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f65037fe700 1 -- 172.21.15.60:0/2822062915 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6514030950 con 0x55e9ddf8b210 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 10 client.15474 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.000+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e9ddd07260 con 0x55e9ddf8b210 2023-10-05T15:16:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f65037fe700 1 -- 172.21.15.60:0/2822062915 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f651c00ce80 con 0x55e9ddf8b210 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f65037fe700 1 -- 172.21.15.60:0/2822062915 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6514038070 con 0x55e9ddf8b210 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f6536748b80 10 client.15474 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f6536748b80 10 client.15474 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f6536748b80 20 client.15474 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f6536748b80 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddffd9f0 0x55e9ddff9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f6536748b80 4 client.15474 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9dded6ae0 con 0x55e9ddffd9f0 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f65237fe700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddffd9f0 0x55e9ddff9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f65237fe700 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddffd9f0 0x55e9ddff9e50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89917943351caf05 server_cookie=36099ee28b168fb3 in_seq=0 out_seq=0 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.001+0000 7f65037fe700 10 client.15474 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f65037fe700 1 -- 172.21.15.60:0/2822062915 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e9dded6ae0 con 0x55e9ddffd9f0 2023-10-05T15:16:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f65037fe700 10 client.15474 handle_command_reply: tid=0 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 client.15474 shutdown 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 msgr2=0x55e9ddff0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddff0d30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6514030cc0 tx=0x7f6514005a50 comp rx=0 tx=0).stop 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 shutdown_connections 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e9ddffd9f0 0x55e9ddff9e50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9ddf8ca10 0x55e9ddff82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9ddf8b210 0x55e9ddff0d30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f65037fe700 0 client.15474 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 --2- 172.21.15.60:0/2822062915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9ddf8bb70 0x55e9ddff1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 >> 172.21.15.60:0/2822062915 conn(0x55e9ddeff210 msgr2=0x55e9ddf93c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 shutdown_connections 2023-10-05T15:16:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 1 -- 172.21.15.60:0/2822062915 wait complete. 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.002+0000 7f6536748b80 20 client.15474 trim_cache size 0 max 16384 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "d07a9b62-6390-11ee-8db5-212e2dc638e7", 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24533, 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-05T15:16:28.011 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 99.804486971000003, 2023-10-05T15:16:28.012 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 27, 2023-10-05T15:16:28.012 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 90, 2023-10-05T15:16:28.012 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 88, 2023-10-05T15:16:28.012 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 105.351158611 2023-10-05T15:16:28.012 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f65100a1480 msgr2=0x7f65100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f65100a1480 0x7f65100a3940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f651400b2e0 tx=0x7f6514005fb0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 msgr2=0x7f652419e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f652419e150 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f651c00ef30 tx=0x7f651c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 shutdown_connections 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f65100a1480 0x7f65100a3940 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6524106be0 0x7f652419e150 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6524101980 0x7f6524196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 --2- 172.21.15.60:0/1684250355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65241042b0 0x7f65241970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 >> 172.21.15.60:0/1684250355 conn(0x7f65240fb3b0 msgr2=0x7f6524102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 shutdown_connections 2023-10-05T15:16:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:28.003+0000 7f652a55e700 1 -- 172.21.15.60:0/1684250355 wait complete. 2023-10-05T15:16:28.017 INFO:teuthology.run_tasks:Running task kclient... 2023-10-05T15:16:28.032 INFO:tasks.kclient:Mounting kernel clients... 2023-10-05T15:16:28.032 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-05T15:16:28.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:28.032 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-05T15:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-05T15:16:28.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:28.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:16:28.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:28.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-05T15:16:28.223 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-10-05T15:16:28.223 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-05T15:16:28.224 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:28.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-05T15:16:28.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:28 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3111740025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:28.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:28 smithi135 ceph-mon[103360]: pgmap v311: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:16:28.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:28 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3111740025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:28.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:28 smithi060 ceph-mon[99238]: pgmap v311: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:16:28.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:28 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3111740025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:28.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:28 smithi092 ceph-mon[102944]: pgmap v311: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:16:28.790 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 -- 172.21.15.60:0/2106994877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc1007d0 msgr2=0x7fc1dc10cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 --2- 172.21.15.60:0/2106994877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc1007d0 0x7fc1dc10cc70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400b0a0 tx=0x7fc1d400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 -- 172.21.15.60:0/2106994877 shutdown_connections 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 --2- 172.21.15.60:0/2106994877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc1007d0 0x7fc1dc10cc70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 --2- 172.21.15.60:0/2106994877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 0x7fc1dc1062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 --2- 172.21.15.60:0/2106994877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 -- 172.21.15.60:0/2106994877 >> 172.21.15.60:0/2106994877 conn(0x7fc1dc076dc0 msgr2=0x7fc1dc0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:30.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 -- 172.21.15.60:0/2106994877 shutdown_connections 2023-10-05T15:16:30.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.132+0000 7fc1e135b700 1 -- 172.21.15.60:0/2106994877 wait complete. 2023-10-05T15:16:30.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 Processor -- start 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 -- start start 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1dc1007d0 0x7fc1dc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 0x7fc1dc1a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc1a33c0 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc1a3500 con 0x7fc1dc1007d0 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1e135b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc1a3640 con 0x7fc1dc105ec0 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1daffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1daffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37800/0 (socket says 172.21.15.60:37800) 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1daffd700 1 -- 172.21.15.60:0/3456658722 learned_addr learned my addr 172.21.15.60:0/3456658722 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1da7fc700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1dc1007d0 0x7fc1dc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:30.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.133+0000 7fc1db7fe700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 0x7fc1dc1a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1daffd700 1 -- 172.21.15.60:0/3456658722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 msgr2=0x7fc1dc1a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1daffd700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 0x7fc1dc1a2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1daffd700 1 -- 172.21.15.60:0/3456658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1dc1007d0 msgr2=0x7fc1dc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1daffd700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1dc1007d0 0x7fc1dc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1daffd700 1 -- 172.21.15.60:0/3456658722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4009d00 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1db7fe700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 0x7fc1dc1a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1daffd700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc197e00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000d950 tx=0x7fc1d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0009940 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1d0010460 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc1a38a0 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000f620 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.134+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc1a3d70 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.135+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc04ebb0 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.136+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc1d00108d0 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.137+0000 7fc1c3fff700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc1c40a1480 0x7fc1c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.137+0000 7fc1da7fc700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc1c40a1480 0x7fc1c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.137+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fc1d00ccdc0 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.137+0000 7fc1da7fc700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc1c40a1480 0x7fc1c40a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc06a310 tx=0x7fc1cc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:30.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.140+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc1d0096120 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.390+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1dc069880 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.390+0000 7fc1c3fff700 1 -- 172.21.15.60:0/3456658722 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc1d0016070 con 0x7fc1dc0ffe10 2023-10-05T15:16:30.392 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-05T15:16:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc1c40a1480 msgr2=0x7fc1c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc1c40a1480 0x7fc1c40a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc06a310 tx=0x7fc1cc00a380 comp rx=0 tx=0).stop 2023-10-05T15:16:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 msgr2=0x7fc1dc197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc197e00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000d950 tx=0x7fc1d000dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 shutdown_connections 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1dc105ec0 0x7fc1dc1a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fc1c40a1480 0x7fc1c40a3940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1dc0ffe10 0x7fc1dc197e00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 --2- 172.21.15.60:0/3456658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1dc1007d0 0x7fc1dc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 >> 172.21.15.60:0/3456658722 conn(0x7fc1dc076dc0 msgr2=0x7fc1dc103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 shutdown_connections 2023-10-05T15:16:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:30.392+0000 7fc1e135b700 1 -- 172.21.15.60:0/3456658722 wait complete. 2023-10-05T15:16:30.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:30 smithi060 ceph-mon[99238]: pgmap v312: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:16:30.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:30 smithi135 ceph-mon[103360]: pgmap v312: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:16:30.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:30 smithi092 ceph-mon[102944]: pgmap v312: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:16:30.743 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-05T15:16:30.743 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-05T15:16:30.744 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-05T15:16:30.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:30.744 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:16:30.764 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 41789sec preferred_lft 41789sec 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:16:30.765 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:16:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:16:30.766 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-05T15:16:30.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:30.766 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:16:30.766 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:16:30.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-10-05T15:16:30.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-10-05T15:16:30.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-10-05T15:16:30.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-05T15:16:30.767 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:16:30.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:30.888 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-05T15:16:30.916 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-05T15:16:30.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:30.918 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-05T15:16:30.977 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-05T15:16:30.977 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-05T15:16:30.977 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-05T15:16:30.977 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-05T15:16:30.977 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-05T15:16:30.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:30.978 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:16:30.978 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:16:30.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-05T15:16:30.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-05T15:16:30.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-05T15:16:30.978 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:16:31.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.087 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-05T15:16:31.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.105 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-05T15:16:31.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.162 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:16:31.162 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:16:31.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-05T15:16:31.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-05T15:16:31.162 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:16:31.258 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-05T15:16:31.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-05T15:16:31.259 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:16:31.315 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:31 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3456658722' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:16:31.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.475 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-05T15:16:31.475 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-05T15:16:31.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-05T15:16:31.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-10-05T15:16:31.476 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-05T15:16:31.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:31 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3456658722' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:16:31.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:16:31.613 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:31.637 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-05T15:16:31.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:16:31.638 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:31 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3456658722' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:16:31.695 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-05T15:16:31.695 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-05T15:16:31.695 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf 2023-10-05T15:16:31.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2023-10-05T15:16:31.782 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2023-10-05T15:16:31.782 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2023-10-05T15:16:31.782 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-05T15:16:31.938 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2023-10-05T15:16:31.938 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2023-10-05T15:16:31.938 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-05T15:16:31.938 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.92:6789,172.21.15.135:6789" 2023-10-05T15:16:31.938 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.92:6789,172.21.15.135:6789:/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf 2023-10-05T15:16:31.938 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,key=0,fsid=d07a9b62-6390-11ee-8db5-212e2dc638e7" will pass to kernel 2023-10-05T15:16:31.944 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-05T15:16:31.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:31.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:31.981 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-05T15:16:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:client15483 2023-10-05T15:16:32.055 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:16:32.055 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:16:32.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:32.113 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-05T15:16:32.187 INFO:teuthology.orchestra.run.smithi060.stdout:client15483 2023-10-05T15:16:32.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:32.188 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-05T15:16:32.261 INFO:teuthology.orchestra.run.smithi060.stdout:client15483 2023-10-05T15:16:32.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:16:32.262 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7.client15483/status') 2023-10-05T15:16:32.343 INFO:teuthology.orchestra.run.smithi060.stdout:instance: client.15483 (3)192.168.0.1:0/3015474451 2023-10-05T15:16:32.343 INFO:teuthology.orchestra.run.smithi060.stdout:blocklisted: false 2023-10-05T15:16:32.344 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2023-10-05T15:16:32.344 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2023-10-05T15:16:32.344 INFO:teuthology.orchestra.run.smithi060.stderr:70 bytes copied, 2.5826e-05 s, 2.7 MB/s 2023-10-05T15:16:32.345 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-05T15:16:32.356 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-05T15:16:32.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 -- 172.21.15.60:0/3568924345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e240ffe10 msgr2=0x7f7e24100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 --2- 172.21.15.60:0/3568924345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e240ffe10 0x7f7e24100230 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009990 tx=0x7f7e18009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 -- 172.21.15.60:0/3568924345 shutdown_connections 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 --2- 172.21.15.60:0/3568924345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e24101920 0x7f7e24108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 --2- 172.21.15.60:0/3568924345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e240ffe10 0x7f7e24100230 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 --2- 172.21.15.60:0/3568924345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24100f60 0x7f7e241013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 -- 172.21.15.60:0/3568924345 >> 172.21.15.60:0/3568924345 conn(0x7f7e240fb380 msgr2=0x7f7e240fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 -- 172.21.15.60:0/3568924345 shutdown_connections 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.510+0000 7f7e2968d700 1 -- 172.21.15.60:0/3568924345 wait complete. 2023-10-05T15:16:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 Processor -- start 2023-10-05T15:16:32.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 -- start start 2023-10-05T15:16:32.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e240ffe10 0x7f7e24195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24100f60 0x7f7e24196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 0x7f7e2419d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419d650 con 0x7f7e24101920 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419d790 con 0x7f7e24100f60 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.511+0000 7f7e2968d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419d920 con 0x7f7e240ffe10 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 0x7f7e2419d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 0x7f7e2419d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37822/0 (socket says 172.21.15.60:37822) 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 -- 172.21.15.60:0/32101484 learned_addr learned my addr 172.21.15.60:0/32101484 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e227fc700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24100f60 0x7f7e24196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e22ffd700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e240ffe10 0x7f7e24195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 -- 172.21.15.60:0/32101484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e240ffe10 msgr2=0x7f7e24195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e240ffe10 0x7f7e24195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 -- 172.21.15.60:0/32101484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24100f60 msgr2=0x7f7e24196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24100f60 0x7f7e24196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 -- 172.21.15.60:0/32101484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e180095f0 con 0x7f7e24101920 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e237fe700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 0x7f7e2419d080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00b970 tx=0x7f7e1c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00c930 con 0x7f7e24101920 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2419dc00 con 0x7f7e24101920 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e1c014440 con 0x7f7e24101920 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0075d0 con 0x7f7e24101920 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.512+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2419e0c0 con 0x7f7e24101920 2023-10-05T15:16:32.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.513+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e24106c90 con 0x7f7e24101920 2023-10-05T15:16:32.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.514+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7e1c0145b0 con 0x7f7e24101920 2023-10-05T15:16:32.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.515+0000 7f7e0bfff700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e0c0a14d0 0x7f7e0c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.515+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f7e1c006e40 con 0x7f7e24101920 2023-10-05T15:16:32.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.515+0000 7f7e22ffd700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e0c0a14d0 0x7f7e0c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.515+0000 7f7e22ffd700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e0c0a14d0 0x7f7e0c0a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e18006010 tx=0x7f7e1800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:32.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.519+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e1c04f100 con 0x7f7e24101920 2023-10-05T15:16:32.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:32 smithi135 ceph-mon[103360]: pgmap v313: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 0 B/s wr, 11 op/s 2023-10-05T15:16:32.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:32 smithi060 ceph-mon[99238]: pgmap v313: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 0 B/s wr, 11 op/s 2023-10-05T15:16:32.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:32 smithi092 ceph-mon[102944]: pgmap v313: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 0 B/s wr, 11 op/s 2023-10-05T15:16:32.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.721+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e2410b690 con 0x7f7e24101920 2023-10-05T15:16:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.723+0000 7f7e0bfff700 1 -- 172.21.15.60:0/32101484 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f7e1c0959e0 con 0x7f7e24101920 2023-10-05T15:16:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:32.725 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e0c0a14d0 msgr2=0x7f7e0c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e0c0a14d0 0x7f7e0c0a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e18006010 tx=0x7f7e1800b540 comp rx=0 tx=0).stop 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 msgr2=0x7f7e2419d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 0x7f7e2419d080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00b970 tx=0x7f7e1c00bc80 comp rx=0 tx=0).stop 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 shutdown_connections 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7e0c0a14d0 0x7f7e0c0a3990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e24101920 0x7f7e2419d080 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e240ffe10 0x7f7e24195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 --2- 172.21.15.60:0/32101484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24100f60 0x7f7e24196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 >> 172.21.15.60:0/32101484 conn(0x7f7e240fb380 msgr2=0x7f7e240fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 shutdown_connections 2023-10-05T15:16:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.725+0000 7f7e2968d700 1 -- 172.21.15.60:0/32101484 wait complete. 2023-10-05T15:16:32.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:16:32.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:16:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 -- 172.21.15.60:0/1792615523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 msgr2=0x7f32801012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 --2- 172.21.15.60:0/1792615523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f32801012c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3268009990 tx=0x7f3268009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 -- 172.21.15.60:0/1792615523 shutdown_connections 2023-10-05T15:16:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 --2- 172.21.15.60:0/1792615523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3280102a40 0x7f3280109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 --2- 172.21.15.60:0/1792615523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f32801012c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 --2- 172.21.15.60:0/1792615523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3280102080 0x7f3280102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 -- 172.21.15.60:0/1792615523 >> 172.21.15.60:0/1792615523 conn(0x7f32800fc460 msgr2=0x7f32800fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 -- 172.21.15.60:0/1792615523 shutdown_connections 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.868+0000 7f3285c5c700 1 -- 172.21.15.60:0/1792615523 wait complete. 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 Processor -- start 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 -- start start 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f3280196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3280102080 0x7f32801970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3280102a40 0x7f328019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328019e730 con 0x7f3280100ea0 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328019e870 con 0x7f3280102080 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f3285c5c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328019ea00 con 0x7f3280102a40 2023-10-05T15:16:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f3280196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f3280196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37832/0 (socket says 172.21.15.60:37832) 2023-10-05T15:16:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 -- 172.21.15.60:0/584501620 learned_addr learned my addr 172.21.15.60:0/584501620 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327ffff700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3280102a40 0x7f328019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327effd700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3280102080 0x7f32801970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 -- 172.21.15.60:0/584501620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3280102a40 msgr2=0x7f328019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3280102a40 0x7f328019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 -- 172.21.15.60:0/584501620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3280102080 msgr2=0x7f32801970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3280102080 0x7f32801970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 -- 172.21.15.60:0/584501620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680095f0 con 0x7f3280100ea0 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.869+0000 7f327f7fe700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f3280196bb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f326800b680 tx=0x7f3268005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.870+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326801d070 con 0x7f3280100ea0 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.870+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3268004ca0 con 0x7f3280100ea0 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.870+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328019ec80 con 0x7f3280100ea0 2023-10-05T15:16:32.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.870+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32680055f0 con 0x7f3280100ea0 2023-10-05T15:16:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.870+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328019f040 con 0x7f3280100ea0 2023-10-05T15:16:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.871+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280107e50 con 0x7f3280100ea0 2023-10-05T15:16:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.872+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f326800fc70 con 0x7f3280100ea0 2023-10-05T15:16:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.872+0000 7f327cff9700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f326c0a1480 0x7f326c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.873+0000 7f327effd700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f326c0a1480 0x7f326c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.873+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f32680ce420 con 0x7f3280100ea0 2023-10-05T15:16:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.873+0000 7f327effd700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f326c0a1480 0x7f326c0a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3270005950 tx=0x7f32700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:32.877+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f326805b100 con 0x7f3280100ea0 2023-10-05T15:16:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.078+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f328002cf70 con 0x7f3280100ea0 2023-10-05T15:16:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.079+0000 7f327cff9700 1 -- 172.21.15.60:0/584501620 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3268097810 con 0x7f3280100ea0 2023-10-05T15:16:33.081 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:16:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f326c0a1480 msgr2=0x7f326c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f326c0a1480 0x7f326c0a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3270005950 tx=0x7f32700058e0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 msgr2=0x7f3280196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f3280196bb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f326800b680 tx=0x7f3268005ef0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 shutdown_connections 2023-10-05T15:16:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3280102a40 0x7f328019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f326c0a1480 0x7f326c0a3940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3280100ea0 0x7f3280196bb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 --2- 172.21.15.60:0/584501620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3280102080 0x7f32801970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 >> 172.21.15.60:0/584501620 conn(0x7f32800fc460 msgr2=0x7f32800fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 shutdown_connections 2023-10-05T15:16:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.081+0000 7f3285c5c700 1 -- 172.21.15.60:0/584501620 wait complete. 2023-10-05T15:16:33.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 -- 172.21.15.60:0/2949465689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102080 msgr2=0x7f1c9c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 --2- 172.21.15.60:0/2949465689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102080 0x7f1c9c102500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009990 tx=0x7f1c98009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 -- 172.21.15.60:0/2949465689 shutdown_connections 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 --2- 172.21.15.60:0/2949465689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c9c102a40 0x7f1c9c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 --2- 172.21.15.60:0/2949465689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c9c100ea0 0x7f1c9c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 --2- 172.21.15.60:0/2949465689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102080 0x7f1c9c102500 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 -- 172.21.15.60:0/2949465689 >> 172.21.15.60:0/2949465689 conn(0x7f1c9c0fc460 msgr2=0x7f1c9c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 -- 172.21.15.60:0/2949465689 shutdown_connections 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.224+0000 7f1ca4492700 1 -- 172.21.15.60:0/2949465689 wait complete. 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 Processor -- start 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 -- start start 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c9c100ea0 0x7f1c9c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c9c102080 0x7f1c9c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 0x7f1c9c19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c19e780 con 0x7f1c9c102a40 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c19e8f0 con 0x7f1c9c102080 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca4492700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c19eab0 con 0x7f1c9c100ea0 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 0x7f1c9c19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 0x7f1c9c19e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37850/0 (socket says 172.21.15.60:37850) 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 -- 172.21.15.60:0/4189318446 learned_addr learned my addr 172.21.15.60:0/4189318446 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca1a2d700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c9c102080 0x7f1c9c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca222e700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c9c100ea0 0x7f1c9c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 -- 172.21.15.60:0/4189318446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c9c100ea0 msgr2=0x7f1c9c196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c9c100ea0 0x7f1c9c196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 -- 172.21.15.60:0/4189318446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c9c102080 msgr2=0x7f1c9c197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c9c102080 0x7f1c9c197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.225+0000 7f1ca2a2f700 1 -- 172.21.15.60:0/4189318446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c980095f0 con 0x7f1c9c102a40 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.226+0000 7f1ca2a2f700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 0x7f1c9c19e1b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400ef30 tx=0x7f1c9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.226+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94018070 con 0x7f1c9c102a40 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.226+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9400f040 con 0x7f1c9c102a40 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.226+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c19ed30 con 0x7f1c9c102a40 2023-10-05T15:16:33.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.226+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400cd00 con 0x7f1c9c102a40 2023-10-05T15:16:33.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.226+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c19f190 con 0x7f1c9c102a40 2023-10-05T15:16:33.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.227+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c107ea0 con 0x7f1c9c102a40 2023-10-05T15:16:33.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.228+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1c94003a00 con 0x7f1c9c102a40 2023-10-05T15:16:33.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.228+0000 7f1c8f7fe700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1c880a1500 0x7f1c880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.229+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1c940cd4c0 con 0x7f1c9c102a40 2023-10-05T15:16:33.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.229+0000 7f1ca222e700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1c880a1500 0x7f1c880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.229+0000 7f1ca222e700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1c880a1500 0x7f1c880a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c198110 tx=0x7f1c9000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:33.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.232+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1c94096850 con 0x7f1c9c102a40 2023-10-05T15:16:33.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:33 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/32101484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:33.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:33 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/584501620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:33.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.437+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c9c02d020 con 0x7f1c9c102a40 2023-10-05T15:16:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.437+0000 7f1c8f7fe700 1 -- 172.21.15.60:0/4189318446 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c94099e70 con 0x7f1c9c102a40 2023-10-05T15:16:33.439 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1c880a1500 msgr2=0x7f1c880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1c880a1500 0x7f1c880a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c198110 tx=0x7f1c9000b410 comp rx=0 tx=0).stop 2023-10-05T15:16:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 msgr2=0x7f1c9c19e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 0x7f1c9c19e1b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400ef30 tx=0x7f1c9400c3a0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 shutdown_connections 2023-10-05T15:16:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f1c880a1500 0x7f1c880a39c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c9c102a40 0x7f1c9c19e1b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c9c100ea0 0x7f1c9c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 --2- 172.21.15.60:0/4189318446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c9c102080 0x7f1c9c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 >> 172.21.15.60:0/4189318446 conn(0x7f1c9c0fc460 msgr2=0x7f1c9c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 shutdown_connections 2023-10-05T15:16:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.439+0000 7f1ca4492700 1 -- 172.21.15.60:0/4189318446 wait complete. 2023-10-05T15:16:33.454 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:16:33.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:33 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/32101484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:33.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:33 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/584501620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 -- 172.21.15.60:0/1460923338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c101950 msgr2=0x7f281c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 --2- 172.21.15.60:0/1460923338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c101950 0x7f281c108200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f281400b0d0 tx=0x7f281400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 -- 172.21.15.60:0/1460923338 shutdown_connections 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 --2- 172.21.15.60:0/1460923338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c101950 0x7f281c108200 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 --2- 172.21.15.60:0/1460923338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ffdc0 0x7f281c1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 --2- 172.21.15.60:0/1460923338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c100fb0 0x7f281c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 -- 172.21.15.60:0/1460923338 >> 172.21.15.60:0/1460923338 conn(0x7f281c0fb330 msgr2=0x7f281c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 -- 172.21.15.60:0/1460923338 shutdown_connections 2023-10-05T15:16:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.580+0000 7f2822d50700 1 -- 172.21.15.60:0/1460923338 wait complete. 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 Processor -- start 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 -- start start 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ffdc0 0x7f281c196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 0x7f281c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c101950 0x7f281c19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19e820 con 0x7f281c100fb0 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19e990 con 0x7f281c101950 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2822d50700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19eb50 con 0x7f281c0ffdc0 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 0x7f281c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 0x7f281c1971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37862/0 (socket says 172.21.15.60:37862) 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 -- 172.21.15.60:0/274564543 learned_addr learned my addr 172.21.15.60:0/274564543 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f2820aec700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ffdc0 0x7f281c196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f28212ed700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c101950 0x7f281c19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 -- 172.21.15.60:0/274564543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ffdc0 msgr2=0x7f281c196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ffdc0 0x7f281c196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 -- 172.21.15.60:0/274564543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c101950 msgr2=0x7f281c19e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c101950 0x7f281c19e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 -- 172.21.15.60:0/274564543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009d00 con 0x7f281c100fb0 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.581+0000 7f281bfff700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 0x7f281c1971f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f280800e9a0 tx=0x7f280800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.582+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808009790 con 0x7f281c100fb0 2023-10-05T15:16:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.582+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2808010430 con 0x7f281c100fb0 2023-10-05T15:16:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.582+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c19ee30 con 0x7f281c100fb0 2023-10-05T15:16:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.582+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808018680 con 0x7f281c100fb0 2023-10-05T15:16:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.582+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c19f300 con 0x7f281c100fb0 2023-10-05T15:16:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.583+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c10b5e0 con 0x7f281c100fb0 2023-10-05T15:16:33.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.584+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f28080105a0 con 0x7f281c100fb0 2023-10-05T15:16:33.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.585+0000 7f2819ffb700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f280c0a1500 0x7f280c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.585+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2808014070 con 0x7f281c100fb0 2023-10-05T15:16:33.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.585+0000 7f2820aec700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f280c0a1500 0x7f280c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.585+0000 7f2820aec700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f280c0a1500 0x7f280c0a39c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f281c197b80 tx=0x7f281000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.588+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f28080966f0 con 0x7f281c100fb0 2023-10-05T15:16:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:33 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/32101484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:33 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/584501620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:33.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.787+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f281c19f4f0 con 0x7f281c100fb0 2023-10-05T15:16:33.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.788+0000 7f2819ffb700 1 -- 172.21.15.60:0/274564543 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28080260a0 con 0x7f281c100fb0 2023-10-05T15:16:33.790 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f280c0a1500 msgr2=0x7f280c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f280c0a1500 0x7f280c0a39c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f281c197b80 tx=0x7f281000b410 comp rx=0 tx=0).stop 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 msgr2=0x7f281c1971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 0x7f281c1971f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f280800e9a0 tx=0x7f280800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 shutdown_connections 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c101950 0x7f281c19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ffdc0 0x7f281c196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f280c0a1500 0x7f280c0a39c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 --2- 172.21.15.60:0/274564543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f281c100fb0 0x7f281c1971f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 >> 172.21.15.60:0/274564543 conn(0x7f281c0fb330 msgr2=0x7f281c068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:33.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 shutdown_connections 2023-10-05T15:16:33.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.790+0000 7f2822d50700 1 -- 172.21.15.60:0/274564543 wait complete. 2023-10-05T15:16:33.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:33.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 -- 172.21.15.60:0/202953295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 msgr2=0x7f6690108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 --2- 172.21.15.60:0/202953295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f6690108200 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f668800b0d0 tx=0x7f668800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 -- 172.21.15.60:0/202953295 shutdown_connections 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 --2- 172.21.15.60:0/202953295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f6690108200 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 --2- 172.21.15.60:0/202953295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66900ffdc0 0x7f66901001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 --2- 172.21.15.60:0/202953295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6690100fb0 0x7f6690101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 -- 172.21.15.60:0/202953295 >> 172.21.15.60:0/202953295 conn(0x7f66900fb330 msgr2=0x7f66900fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.931+0000 7f6698569700 1 -- 172.21.15.60:0/202953295 shutdown_connections 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 -- 172.21.15.60:0/202953295 wait complete. 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 Processor -- start 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 -- start start 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900ffdc0 0x7f6690068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6690100fb0 0x7f669019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f669019e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669019e820 con 0x7f6690101950 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669019e990 con 0x7f6690100fb0 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6698569700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669019eb50 con 0x7f66900ffdc0 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.932+0000 7f6695b04700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6690100fb0 0x7f669019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f669019e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6695b04700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6690100fb0 0x7f669019ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:51298/0 (socket says 172.21.15.60:51298) 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6695b04700 1 -- 172.21.15.60:0/173929029 learned_addr learned my addr 172.21.15.60:0/173929029 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696305700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900ffdc0 0x7f6690068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 -- 172.21.15.60:0/173929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900ffdc0 msgr2=0x7f6690068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900ffdc0 0x7f6690068bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 -- 172.21.15.60:0/173929029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6690100fb0 msgr2=0x7f669019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6690100fb0 0x7f669019ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 -- 172.21.15.60:0/173929029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688009d00 con 0x7f6690101950 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6696b06700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f669019e050 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f668800b770 tx=0x7f6688008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800e040 con 0x7f6690101950 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f668801d930 con 0x7f6690101950 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669019edd0 con 0x7f6690101950 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668801b930 con 0x7f6690101950 2023-10-05T15:16:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.933+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669019f1a0 con 0x7f6690101950 2023-10-05T15:16:33.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.934+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6690107350 con 0x7f6690101950 2023-10-05T15:16:33.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.935+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f668801d470 con 0x7f6690101950 2023-10-05T15:16:33.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.936+0000 7f66877fe700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f667c0a1480 0x7f667c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:33.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.936+0000 7f6696305700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f667c0a1480 0x7f667c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:33.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.936+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f66880ceae0 con 0x7f6690101950 2023-10-05T15:16:33.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.936+0000 7f6696305700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f667c0a1480 0x7f667c0a3940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6690100e10 tx=0x7f668c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:33.939+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6688097f90 con 0x7f6690101950 2023-10-05T15:16:34.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.140+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f669010b5e0 con 0x7f6690101950 2023-10-05T15:16:34.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.140+0000 7f66877fe700 1 -- 172.21.15.60:0/173929029 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f668809b5b0 con 0x7f6690101950 2023-10-05T15:16:34.142 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:34.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f667c0a1480 msgr2=0x7f667c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f667c0a1480 0x7f667c0a3940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6690100e10 tx=0x7f668c009260 comp rx=0 tx=0).stop 2023-10-05T15:16:34.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 msgr2=0x7f669019e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f669019e050 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f668800b770 tx=0x7f6688008f10 comp rx=0 tx=0).stop 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 shutdown_connections 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f667c0a1480 0x7f667c0a3940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6690101950 0x7f669019e050 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900ffdc0 0x7f6690068bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 --2- 172.21.15.60:0/173929029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6690100fb0 0x7f669019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 >> 172.21.15.60:0/173929029 conn(0x7f66900fb330 msgr2=0x7f6690104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.142+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 shutdown_connections 2023-10-05T15:16:34.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.143+0000 7f6698569700 1 -- 172.21.15.60:0/173929029 wait complete. 2023-10-05T15:16:34.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:34.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.281+0000 7fb5c4311700 1 -- 172.21.15.60:0/1230267146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0fef50 msgr2=0x7fb5bc0ff3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.281+0000 7fb5c4311700 1 --2- 172.21.15.60:0/1230267146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0fef50 0x7fb5bc0ff3b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00099c0 tx=0x7fb5b0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 -- 172.21.15.60:0/1230267146 shutdown_connections 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 --2- 172.21.15.60:0/1230267146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5bc0ff8f0 0x7fb5bc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 --2- 172.21.15.60:0/1230267146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 --2- 172.21.15.60:0/1230267146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0fef50 0x7fb5bc0ff3b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 -- 172.21.15.60:0/1230267146 >> 172.21.15.60:0/1230267146 conn(0x7fb5bc0faaf0 msgr2=0x7fb5bc0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 -- 172.21.15.60:0/1230267146 shutdown_connections 2023-10-05T15:16:34.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 -- 172.21.15.60:0/1230267146 wait complete. 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 Processor -- start 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.282+0000 7fb5c4311700 1 -- start start 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c4311700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5bc0fef50 0x7fb5bc196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c4311700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc0ff8f0 0x7fb5bc197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c4311700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c4311700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc19e780 con 0x7fb5bc1024e0 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c4311700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc19e8f0 con 0x7fb5bc0ff8f0 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c4311700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc19eab0 con 0x7fb5bc0fef50 2023-10-05T15:16:34.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc19e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37892/0 (socket says 172.21.15.60:37892) 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 -- 172.21.15.60:0/2040231295 learned_addr learned my addr 172.21.15.60:0/2040231295 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c18ac700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc0ff8f0 0x7fb5bc197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c20ad700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5bc0fef50 0x7fb5bc196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 -- 172.21.15.60:0/2040231295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5bc0fef50 msgr2=0x7fb5bc196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5bc0fef50 0x7fb5bc196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 -- 172.21.15.60:0/2040231295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc0ff8f0 msgr2=0x7fb5bc197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc0ff8f0 0x7fb5bc197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 -- 172.21.15.60:0/2040231295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00095f0 con 0x7fb5bc1024e0 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c18ac700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc0ff8f0 0x7fb5bc197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:34.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.283+0000 7fb5c28ae700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc19e1b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400d980 tx=0x7fb5b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:34.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.284+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4004220 con 0x7fb5bc1024e0 2023-10-05T15:16:34.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.284+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5b40075e0 con 0x7fb5bc1024e0 2023-10-05T15:16:34.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.284+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc19ed90 con 0x7fb5bc1024e0 2023-10-05T15:16:34.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.284+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4005650 con 0x7fb5bc1024e0 2023-10-05T15:16:34.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.284+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc19f1e0 con 0x7fb5bc1024e0 2023-10-05T15:16:34.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.284+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc108640 con 0x7fb5bc1024e0 2023-10-05T15:16:34.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.286+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb5b4004750 con 0x7fb5bc1024e0 2023-10-05T15:16:34.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.286+0000 7fb5bb7fe700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb5a40a1550 0x7fb5a40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.286+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fb5b40cd2f0 con 0x7fb5bc1024e0 2023-10-05T15:16:34.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.286+0000 7fb5c20ad700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb5a40a1550 0x7fb5a40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.287+0000 7fb5c20ad700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb5a40a1550 0x7fb5a40a3a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc198110 tx=0x7fb5ac00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:34.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.290+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb5b4096650 con 0x7fb5bc1024e0 2023-10-05T15:16:34.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:34 smithi060 ceph-mon[99238]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-10-05T15:16:34.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:34 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4189318446' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:34 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/274564543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:34 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/173929029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.498+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5bc10c920 con 0x7fb5bc1024e0 2023-10-05T15:16:34.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.500+0000 7fb5bb7fe700 1 -- 172.21.15.60:0/2040231295 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7fb5b4016020 con 0x7fb5bc1024e0 2023-10-05T15:16:34.502 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:34.503 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:34.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb5a40a1550 msgr2=0x7fb5a40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb5a40a1550 0x7fb5a40a3a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc198110 tx=0x7fb5ac00b040 comp rx=0 tx=0).stop 2023-10-05T15:16:34.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 msgr2=0x7fb5bc19e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc19e1b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400d980 tx=0x7fb5b400dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:34.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 shutdown_connections 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fb5a40a1550 0x7fb5a40a3a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc1024e0 0x7fb5bc19e1b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5bc0fef50 0x7fb5bc196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 --2- 172.21.15.60:0/2040231295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5bc0ff8f0 0x7fb5bc197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.502+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 >> 172.21.15.60:0/2040231295 conn(0x7fb5bc0faaf0 msgr2=0x7fb5bc105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.503+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 shutdown_connections 2023-10-05T15:16:34.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.503+0000 7fb5c4311700 1 -- 172.21.15.60:0/2040231295 wait complete. 2023-10-05T15:16:34.517 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:16:34.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:16:34.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:34 smithi135 ceph-mon[103360]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-10-05T15:16:34.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:34 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4189318446' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:34 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/274564543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:34 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/173929029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 -- 172.21.15.60:0/230811728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8104270 msgr2=0x7f0da8106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 --2- 172.21.15.60:0/230811728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8104270 0x7f0da8106660 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009990 tx=0x7f0d9c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 -- 172.21.15.60:0/230811728 shutdown_connections 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 --2- 172.21.15.60:0/230811728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da8106ba0 0x7f0da8109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 --2- 172.21.15.60:0/230811728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da8101940 0x7f0da8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 --2- 172.21.15.60:0/230811728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8104270 0x7f0da8106660 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 -- 172.21.15.60:0/230811728 >> 172.21.15.60:0/230811728 conn(0x7f0da80fb330 msgr2=0x7f0da80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 -- 172.21.15.60:0/230811728 shutdown_connections 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.645+0000 7f0dae32a700 1 -- 172.21.15.60:0/230811728 wait complete. 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 Processor -- start 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 -- start start 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da8101940 0x7f0da81012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da8104270 0x7f0da80ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 0x7f0da80ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81005d0 con 0x7f0da8106ba0 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8100740 con 0x7f0da8104270 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dae32a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81a0c10 con 0x7f0da8101940 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 0x7f0da80ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 0x7f0da80ffe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37906/0 (socket says 172.21.15.60:37906) 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 -- 172.21.15.60:0/695367579 learned_addr learned my addr 172.21.15.60:0/695367579 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0da7fff700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da8101940 0x7f0da81012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0da77fe700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da8104270 0x7f0da80ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 -- 172.21.15.60:0/695367579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da8101940 msgr2=0x7f0da81012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da8101940 0x7f0da81012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 -- 172.21.15.60:0/695367579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da8104270 msgr2=0x7f0da80ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da8104270 0x7f0da80ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.646+0000 7f0dac8c7700 1 -- 172.21.15.60:0/695367579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c0095f0 con 0x7f0da8106ba0 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.647+0000 7f0dac8c7700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 0x7f0da80ffe30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0da000ef30 tx=0x7f0da000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.647+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0018070 con 0x7f0da8106ba0 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.647+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da81a0e90 con 0x7f0da8106ba0 2023-10-05T15:16:34.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.647+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0da000f040 con 0x7f0da8106ba0 2023-10-05T15:16:34.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.647+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0003dc0 con 0x7f0da8106ba0 2023-10-05T15:16:34.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.647+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da81a1310 con 0x7f0da8106ba0 2023-10-05T15:16:34.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.648+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da80fceb0 con 0x7f0da8106ba0 2023-10-05T15:16:34.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.649+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0da000caa0 con 0x7f0da8106ba0 2023-10-05T15:16:34.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.650+0000 7f0da57fa700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0d900a1480 0x7f0d900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:34.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.650+0000 7f0da7fff700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0d900a1480 0x7f0d900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:34.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.650+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0da00cd600 con 0x7f0da8106ba0 2023-10-05T15:16:34.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.651+0000 7f0da7fff700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0d900a1480 0x7f0d900a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005fd0 tx=0x7f0d9800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:34.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.653+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0da00969f0 con 0x7f0da8106ba0 2023-10-05T15:16:34.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:34 smithi092 ceph-mon[102944]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-10-05T15:16:34.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:34 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4189318446' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:34 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/274564543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:34 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/173929029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:34.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.855+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0da802d020 con 0x7f0da8106ba0 2023-10-05T15:16:34.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.855+0000 7f0da57fa700 1 -- 172.21.15.60:0/695367579 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0da009a010 con 0x7f0da8106ba0 2023-10-05T15:16:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:16:34.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0d900a1480 msgr2=0x7f0d900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0d900a1480 0x7f0d900a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005fd0 tx=0x7f0d9800a560 comp rx=0 tx=0).stop 2023-10-05T15:16:34.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 msgr2=0x7f0da80ffe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:34.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 0x7f0da80ffe30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0da000ef30 tx=0x7f0da000c450 comp rx=0 tx=0).stop 2023-10-05T15:16:34.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 shutdown_connections 2023-10-05T15:16:34.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f0d900a1480 0x7f0d900a3940 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da8106ba0 0x7f0da80ffe30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da8101940 0x7f0da81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 --2- 172.21.15.60:0/695367579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da8104270 0x7f0da80ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:34.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 >> 172.21.15.60:0/695367579 conn(0x7f0da80fb330 msgr2=0x7f0da81025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:34.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 shutdown_connections 2023-10-05T15:16:34.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:34.858+0000 7f0dae32a700 1 -- 172.21.15.60:0/695367579 wait complete. 2023-10-05T15:16:34.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:16:35.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 -- 172.21.15.60:0/915867438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c1042a0 msgr2=0x7f149c106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 --2- 172.21.15.60:0/915867438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c1042a0 0x7f149c106690 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f148c009990 tx=0x7f148c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 -- 172.21.15.60:0/915867438 shutdown_connections 2023-10-05T15:16:35.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 --2- 172.21.15.60:0/915867438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f149c106bd0 0x7f149c109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 --2- 172.21.15.60:0/915867438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f149c101970 0x7f149c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 --2- 172.21.15.60:0/915867438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c1042a0 0x7f149c106690 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 -- 172.21.15.60:0/915867438 >> 172.21.15.60:0/915867438 conn(0x7f149c0fb380 msgr2=0x7f149c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 -- 172.21.15.60:0/915867438 shutdown_connections 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.000+0000 7f14a1293700 1 -- 172.21.15.60:0/915867438 wait complete. 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 Processor -- start 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 -- start start 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 0x7f149c196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f149c1042a0 0x7f149c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f149c106bd0 0x7f149c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c19e730 con 0x7f149c101970 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c19e870 con 0x7f149c1042a0 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f14a1293700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c19ea00 con 0x7f149c106bd0 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f149affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 0x7f149c196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f149affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 0x7f149c196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37916/0 (socket says 172.21.15.60:37916) 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f149affd700 1 -- 172.21.15.60:0/3768963580 learned_addr learned my addr 172.21.15.60:0/3768963580 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f149a7fc700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f149c1042a0 0x7f149c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.001+0000 7f149b7fe700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f149c106bd0 0x7f149c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f149affd700 1 -- 172.21.15.60:0/3768963580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f149c106bd0 msgr2=0x7f149c19e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f149affd700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f149c106bd0 0x7f149c19e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f149affd700 1 -- 172.21.15.60:0/3768963580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f149c1042a0 msgr2=0x7f149c1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f149affd700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f149c1042a0 0x7f149c1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f149affd700 1 -- 172.21.15.60:0/3768963580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0095f0 con 0x7f149c101970 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f149affd700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 0x7f149c196bb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f149000d950 tx=0x7f149000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000f890 con 0x7f149c101970 2023-10-05T15:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1490010460 con 0x7f149c101970 2023-10-05T15:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c19ece0 con 0x7f149c101970 2023-10-05T15:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000e610 con 0x7f149c101970 2023-10-05T15:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.002+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c19f190 con 0x7f149c101970 2023-10-05T15:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.003+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c0fcf00 con 0x7f149c101970 2023-10-05T15:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.004+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f14900108d0 con 0x7f149c101970 2023-10-05T15:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.005+0000 7f1483fff700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f14840a1500 0x7f14840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.005+0000 7f149a7fc700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f14840a1500 0x7f14840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.005+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f14900ccd40 con 0x7f149c101970 2023-10-05T15:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.005+0000 7f149a7fc700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f14840a1500 0x7f14840a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b5c0 tx=0x7f148c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.009+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1490096040 con 0x7f149c101970 2023-10-05T15:16:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.214+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f149c02d020 con 0x7f149c101970 2023-10-05T15:16:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.214+0000 7f1483fff700 1 -- 172.21.15.60:0/3768963580 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1490016020 con 0x7f149c101970 2023-10-05T15:16:35.216 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f14840a1500 msgr2=0x7f14840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f14840a1500 0x7f14840a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b5c0 tx=0x7f148c005fd0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 msgr2=0x7f149c196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 0x7f149c196bb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f149000d950 tx=0x7f149000dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 shutdown_connections 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f149c106bd0 0x7f149c19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f14840a1500 0x7f14840a39c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f149c101970 0x7f149c196bb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 --2- 172.21.15.60:0/3768963580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f149c1042a0 0x7f149c1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 >> 172.21.15.60:0/3768963580 conn(0x7f149c0fb380 msgr2=0x7f149c1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 shutdown_connections 2023-10-05T15:16:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.217+0000 7f14a1293700 1 -- 172.21.15.60:0/3768963580 wait complete. 2023-10-05T15:16:35.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:16:35.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.359+0000 7f0345ea1700 1 -- 172.21.15.60:0/292807682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340101940 msgr2=0x7f0340103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.359+0000 7f0345ea1700 1 --2- 172.21.15.60:0/292807682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340101940 0x7f0340103d30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0330009990 tx=0x7f0330009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 -- 172.21.15.60:0/292807682 shutdown_connections 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 --2- 172.21.15.60:0/292807682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340106ba0 0x7f0340109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 --2- 172.21.15.60:0/292807682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340101940 0x7f0340103d30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 --2- 172.21.15.60:0/292807682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0340104270 0x7f0340106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 -- 172.21.15.60:0/292807682 >> 172.21.15.60:0/292807682 conn(0x7f03400fb330 msgr2=0x7f03400fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 -- 172.21.15.60:0/292807682 shutdown_connections 2023-10-05T15:16:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 -- 172.21.15.60:0/292807682 wait complete. 2023-10-05T15:16:35.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.360+0000 7f0345ea1700 1 Processor -- start 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 -- start start 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340101940 0x7f0340196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 0x7f03401970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0340106ba0 0x7f034019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034019e730 con 0x7f0340104270 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034019e870 con 0x7f0340101940 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f0345ea1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034019ea00 con 0x7f0340106ba0 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 0x7f03401970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 0x7f03401970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37932/0 (socket says 172.21.15.60:37932) 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 -- 172.21.15.60:0/259339195 learned_addr learned my addr 172.21.15.60:0/259339195 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033f7fe700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340101940 0x7f0340196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033ffff700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0340106ba0 0x7f034019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 -- 172.21.15.60:0/259339195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0340106ba0 msgr2=0x7f034019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0340106ba0 0x7f034019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 -- 172.21.15.60:0/259339195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340101940 msgr2=0x7f0340196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340101940 0x7f0340196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033effd700 1 -- 172.21.15.60:0/259339195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300095f0 con 0x7f0340104270 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.361+0000 7f033f7fe700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340101940 0x7f0340196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.362+0000 7f033effd700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 0x7f03401970f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f033400e9a0 tx=0x7f033400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.362+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334009790 con 0x7f0340104270 2023-10-05T15:16:35.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.362+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0334010430 con 0x7f0340104270 2023-10-05T15:16:35.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.362+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034019ece0 con 0x7f0340104270 2023-10-05T15:16:35.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.362+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334018680 con 0x7f0340104270 2023-10-05T15:16:35.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.362+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034019f1a0 con 0x7f0340104270 2023-10-05T15:16:35.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.363+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03400fceb0 con 0x7f0340104270 2023-10-05T15:16:35.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.364+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f03340105a0 con 0x7f0340104270 2023-10-05T15:16:35.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.364+0000 7f033cff9700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f03280a1480 0x7f03280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.365+0000 7f033f7fe700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f03280a1480 0x7f03280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.365+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0334014070 con 0x7f0340104270 2023-10-05T15:16:35.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.365+0000 7f033f7fe700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f03280a1480 0x7f03280a3940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f033000b2e0 tx=0x7f0330005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:35.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.369+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0334052100 con 0x7f0340104270 2023-10-05T15:16:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.569+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f034002d270 con 0x7f0340104270 2023-10-05T15:16:35.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.570+0000 7f033cff9700 1 -- 172.21.15.60:0/259339195 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0334096500 con 0x7f0340104270 2023-10-05T15:16:35.573 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f03280a1480 msgr2=0x7f03280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f03280a1480 0x7f03280a3940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f033000b2e0 tx=0x7f0330005fb0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 msgr2=0x7f03401970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 0x7f03401970f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f033400e9a0 tx=0x7f033400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 shutdown_connections 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0340106ba0 0x7f034019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0340101940 0x7f0340196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f03280a1480 0x7f03280a3940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 --2- 172.21.15.60:0/259339195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0340104270 0x7f03401970f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 >> 172.21.15.60:0/259339195 conn(0x7f03400fb330 msgr2=0x7f03401025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:35.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 shutdown_connections 2023-10-05T15:16:35.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.572+0000 7f0345ea1700 1 -- 172.21.15.60:0/259339195 wait complete. 2023-10-05T15:16:35.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:35 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2040231295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:35.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:35 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/695367579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:35.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:35 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3768963580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:35.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:35 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2040231295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:35.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:35 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/695367579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:35.586 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:35 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3768963580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:35.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:35.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:35 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2040231295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:35.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:35 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/695367579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:35.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:35 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3768963580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:35.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 -- 172.21.15.60:0/1433946252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f81024a0 msgr2=0x7f07f81028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 --2- 172.21.15.60:0/1433946252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f81024a0 0x7f07f81028c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07f40099c0 tx=0x7f07f4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 -- 172.21.15.60:0/1433946252 shutdown_connections 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 --2- 172.21.15.60:0/1433946252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80ff8b0 0x7f07f8109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 --2- 172.21.15.60:0/1433946252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f81024a0 0x7f07f81028c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 --2- 172.21.15.60:0/1433946252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07f80fef10 0x7f07f80ff370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.713+0000 7f07ffc95700 1 -- 172.21.15.60:0/1433946252 >> 172.21.15.60:0/1433946252 conn(0x7f07f80faab0 msgr2=0x7f07f80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 -- 172.21.15.60:0/1433946252 shutdown_connections 2023-10-05T15:16:35.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 -- 172.21.15.60:0/1433946252 wait complete. 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 Processor -- start 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 -- start start 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 0x7f07f8101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80ff8b0 0x7f07f81001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07f81024a0 0x7f07f8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8100ec0 con 0x7f07f80fef10 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8101030 con 0x7f07f81024a0 2023-10-05T15:16:35.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07ffc95700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81a0c90 con 0x7f07f80ff8b0 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07fda31700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 0x7f07f8101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.714+0000 7f07fda31700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 0x7f07f8101ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37944/0 (socket says 172.21.15.60:37944) 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 -- 172.21.15.60:0/4288986527 learned_addr learned my addr 172.21.15.60:0/4288986527 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fe232700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07f81024a0 0x7f07f8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fd230700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80ff8b0 0x7f07f81001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 -- 172.21.15.60:0/4288986527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80ff8b0 msgr2=0x7f07f81001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80ff8b0 0x7f07f81001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 -- 172.21.15.60:0/4288986527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07f81024a0 msgr2=0x7f07f8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07f81024a0 0x7f07f8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 -- 172.21.15.60:0/4288986527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40095f0 con 0x7f07f80fef10 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07fda31700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 0x7f07f8101ba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f07f4006010 tx=0x7f07f400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f401c070 con 0x7f07f80fef10 2023-10-05T15:16:35.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07f400fe30 con 0x7f07f80fef10 2023-10-05T15:16:35.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f81a0f10 con 0x7f07f80fef10 2023-10-05T15:16:35.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40053a0 con 0x7f07f80fef10 2023-10-05T15:16:35.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.715+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f81a1280 con 0x7f07f80fef10 2023-10-05T15:16:35.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.716+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8108020 con 0x7f07f80fef10 2023-10-05T15:16:35.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.717+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f07f4020070 con 0x7f07f80fef10 2023-10-05T15:16:35.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.718+0000 7f07eeffd700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f07e40a1480 0x7f07e40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:35.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.718+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f07f40ce0f0 con 0x7f07f80fef10 2023-10-05T15:16:35.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.718+0000 7f07fd230700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f07e40a1480 0x7f07e40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:35.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.718+0000 7f07fd230700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f07e40a1480 0x7f07e40a3940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f07e8005950 tx=0x7f07e80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:35.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.721+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f07f4097480 con 0x7f07f80fef10 2023-10-05T15:16:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.927+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f07f810c9f0 con 0x7f07f80fef10 2023-10-05T15:16:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.927+0000 7f07eeffd700 1 -- 172.21.15.60:0/4288986527 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07f810c9f0 con 0x7f07f80fef10 2023-10-05T15:16:35.931 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f07e40a1480 msgr2=0x7f07e40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f07e40a1480 0x7f07e40a3940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f07e8005950 tx=0x7f07e80058e0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 msgr2=0x7f07f8101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 0x7f07f8101ba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f07f4006010 tx=0x7f07f400f690 comp rx=0 tx=0).stop 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 shutdown_connections 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07f81024a0 0x7f07f8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f07e40a1480 0x7f07e40a3940 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f80fef10 0x7f07f8101ba0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 --2- 172.21.15.60:0/4288986527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80ff8b0 0x7f07f81001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 >> 172.21.15.60:0/4288986527 conn(0x7f07f80faab0 msgr2=0x7f07f80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:35.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 shutdown_connections 2023-10-05T15:16:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:35.930+0000 7f07ffc95700 1 -- 172.21.15.60:0/4288986527 wait complete. 2023-10-05T15:16:35.945 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-05T15:16:35.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:36.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 -- 172.21.15.60:0/4032044053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee8101950 msgr2=0x7efee8108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 --2- 172.21.15.60:0/4032044053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee8101950 0x7efee8108200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efed80099c0 tx=0x7efed8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 -- 172.21.15.60:0/4032044053 shutdown_connections 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 --2- 172.21.15.60:0/4032044053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee8101950 0x7efee8108200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 --2- 172.21.15.60:0/4032044053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee80ffdc0 0x7efee81001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 --2- 172.21.15.60:0/4032044053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 0x7efee8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 -- 172.21.15.60:0/4032044053 >> 172.21.15.60:0/4032044053 conn(0x7efee80fb310 msgr2=0x7efee80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 -- 172.21.15.60:0/4032044053 shutdown_connections 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.068+0000 7efeee078700 1 -- 172.21.15.60:0/4032044053 wait complete. 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 Processor -- start 2023-10-05T15:16:36.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 -- start start 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 0x7efee8196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 0x7efee8197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee8101950 0x7efee819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee819e6a0 con 0x7efee80ffdc0 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee819e7e0 con 0x7efee8100fb0 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efeee078700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee819e970 con 0x7efee8101950 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 0x7efee8196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 0x7efee8196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37958/0 (socket says 172.21.15.60:37958) 2023-10-05T15:16:36.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 -- 172.21.15.60:0/3708253410 learned_addr learned my addr 172.21.15.60:0/3708253410 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee7fff700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee8101950 0x7efee819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee6ffd700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 0x7efee8197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 -- 172.21.15.60:0/3708253410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee8101950 msgr2=0x7efee819e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee8101950 0x7efee819e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 -- 172.21.15.60:0/3708253410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 msgr2=0x7efee8197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 0x7efee8197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee77fe700 1 -- 172.21.15.60:0/3708253410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80095f0 con 0x7efee80ffdc0 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.069+0000 7efee6ffd700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 0x7efee8197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.070+0000 7efee77fe700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 0x7efee8196b20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efee0007f10 tx=0x7efee000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.070+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0017070 con 0x7efee80ffdc0 2023-10-05T15:16:36.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.070+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee819ec50 con 0x7efee80ffdc0 2023-10-05T15:16:36.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.070+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efee000f040 con 0x7efee80ffdc0 2023-10-05T15:16:36.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.070+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0004630 con 0x7efee80ffdc0 2023-10-05T15:16:36.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.070+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee819f1b0 con 0x7efee80ffdc0 2023-10-05T15:16:36.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.071+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee8107ea0 con 0x7efee80ffdc0 2023-10-05T15:16:36.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.072+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efee0004790 con 0x7efee80ffdc0 2023-10-05T15:16:36.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.072+0000 7efee4ff9700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efed40a14d0 0x7efed40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.073+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efee00cc710 con 0x7efee80ffdc0 2023-10-05T15:16:36.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.073+0000 7efee6ffd700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efed40a14d0 0x7efed40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.073+0000 7efee6ffd700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efed40a14d0 0x7efed40a3990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efed0009be0 tx=0x7efed0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:36.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.077+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efee0095a70 con 0x7efee80ffdc0 2023-10-05T15:16:36.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.328+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efee810b5e0 con 0x7efee80ffdc0 2023-10-05T15:16:36.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.329+0000 7efee4ff9700 1 -- 172.21.15.60:0/3708253410 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7efee0099090 con 0x7efee80ffdc0 2023-10-05T15:16:36.332 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:36.332 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efed40a14d0 msgr2=0x7efed40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efed40a14d0 0x7efed40a3990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efed0009be0 tx=0x7efed0009260 comp rx=0 tx=0).stop 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 msgr2=0x7efee8196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 0x7efee8196b20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efee0007f10 tx=0x7efee000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 shutdown_connections 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee8101950 0x7efee819e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7efed40a14d0 0x7efed40a3990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee80ffdc0 0x7efee8196b20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 --2- 172.21.15.60:0/3708253410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee8100fb0 0x7efee8197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 >> 172.21.15.60:0/3708253410 conn(0x7efee80fb310 msgr2=0x7efee80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 shutdown_connections 2023-10-05T15:16:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.331+0000 7efeee078700 1 -- 172.21.15.60:0/3708253410 wait complete. 2023-10-05T15:16:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:36.347 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-05T15:16:36.347 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-05T15:16:36.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 -- 172.21.15.60:0/1566249624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100f10 msgr2=0x7f9750101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 --2- 172.21.15.60:0/1566249624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100f10 0x7f9750101330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9744009990 tx=0x7f9744009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 -- 172.21.15.60:0/1566249624 shutdown_connections 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 --2- 172.21.15.60:0/1566249624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9750102a20 0x7f9750109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 --2- 172.21.15.60:0/1566249624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100f10 0x7f9750101330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 --2- 172.21.15.60:0/1566249624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9750102060 0x7f97501024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 -- 172.21.15.60:0/1566249624 >> 172.21.15.60:0/1566249624 conn(0x7f97500fc480 msgr2=0x7f97500fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:36.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 -- 172.21.15.60:0/1566249624 shutdown_connections 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 -- 172.21.15.60:0/1566249624 wait complete. 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 Processor -- start 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.471+0000 7f9756cbb700 1 -- start start 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9750100f10 0x7f9750074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 0x7f97500732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9750102a20 0x7f97500737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9750073f80 con 0x7f9750102060 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500740f0 con 0x7f9750102a20 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501a0bd0 con 0x7f9750100f10 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 0x7f97500732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 0x7f97500732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37974/0 (socket says 172.21.15.60:37974) 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 -- 172.21.15.60:0/2037224122 learned_addr learned my addr 172.21.15.60:0/2037224122 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9755258700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9750102a20 0x7f97500737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9754a57700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9750100f10 0x7f9750074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 -- 172.21.15.60:0/2037224122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9750100f10 msgr2=0x7f9750074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9750100f10 0x7f9750074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 -- 172.21.15.60:0/2037224122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9750102a20 msgr2=0x7f97500737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9750102a20 0x7f97500737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 -- 172.21.15.60:0/2037224122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440095f0 con 0x7f9750102060 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974ffff700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 0x7f97500732a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c9b0 tx=0x7f973c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c007b00 con 0x7f9750102060 2023-10-05T15:16:36.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f973c007c60 con 0x7f9750102060 2023-10-05T15:16:36.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.472+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97501a0eb0 con 0x7f9750102060 2023-10-05T15:16:36.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.473+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c018660 con 0x7f9750102060 2023-10-05T15:16:36.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.473+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501a1330 con 0x7f9750102060 2023-10-05T15:16:36.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.474+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750108450 con 0x7f9750102060 2023-10-05T15:16:36.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.475+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f973c00f450 con 0x7f9750102060 2023-10-05T15:16:36.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.475+0000 7f974dffb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f97400a14d0 0x7f97400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.475+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f973c0ccf70 con 0x7f9750102060 2023-10-05T15:16:36.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.475+0000 7f9754a57700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f97400a14d0 0x7f97400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.476+0000 7f9754a57700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f97400a14d0 0x7f97400a3990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9744006010 tx=0x7f974400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:36.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.480+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f973c0962d0 con 0x7f9750102060 2023-10-05T15:16:36.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:36 smithi135 ceph-mon[103360]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:16:36.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:36 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/259339195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:36.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:36 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4288986527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:36.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:36 smithi060 ceph-mon[99238]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:16:36.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:36 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/259339195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:36.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:36 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4288986527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:36.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:36 smithi092 ceph-mon[102944]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:16:36.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:36 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/259339195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:36.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:36 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4288986527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.677+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f975002d2b0 con 0x7f97400a14d0 2023-10-05T15:16:36.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.692+0000 7f974dffb700 1 -- 172.21.15.60:0/2037224122 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427233 (secure 0 0 0) 0x7f975002d2b0 con 0x7f97400a14d0 2023-10-05T15:16:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f97400a14d0 msgr2=0x7f97400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f97400a14d0 0x7f97400a3990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9744006010 tx=0x7f974400b260 comp rx=0 tx=0).stop 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 msgr2=0x7f97500732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 0x7f97500732a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c9b0 tx=0x7f973c00ccc0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 shutdown_connections 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9750102a20 0x7f97500737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9750100f10 0x7f9750074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f97400a14d0 0x7f97400a3990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 --2- 172.21.15.60:0/2037224122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750102060 0x7f97500732a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 >> 172.21.15.60:0/2037224122 conn(0x7f97500fc480 msgr2=0x7f9750105590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 shutdown_connections 2023-10-05T15:16:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.697+0000 7f9756cbb700 1 -- 172.21.15.60:0/2037224122 wait complete. 2023-10-05T15:16:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:16:36.712 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2023-10-05T15:16:35.200362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657264,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":990,"num_read_kb":617,"num_write":429,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338164,"kb_used_data":13972,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603660,"statfs":{"total":1151940427776,"available":1151594147840,"internally_reserved":0,"allocated":14307328,"data_stored":7846052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":318,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":56,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211407+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:16:15.211407+0000","last_peered":"2023-10-05T15:16:15.211407+0000","last_clean":"2023-10-05T15:16:15.211407+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:16:15.211407+0000","last_undegraded":"2023-10-05T15:16:15.211407+0000","last_fullsized":"2023-10-05T15:16:15.211407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209294+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:16:15.209294+0000","last_peered":"2023-10-05T15:16:15.209294+0000","last_clean":"2023-10-05T15:16:15.209294+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:16:15.209294+0000","last_undegraded":"2023-10-05T15:16:15.209294+0000","last_fullsized":"2023-10-05T15:16:15.209294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210807+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:16:15.210807+0000","last_peered":"2023-10-05T15:16:15.210807+0000","last_clean":"2023-10-05T15:16:15.210807+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:16:15.210807+0000","last_undegraded":"2023-10-05T15:16:15.210807+0000","last_fullsized":"2023-10-05T15:16:15.210807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210321+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:16:15.210321+0000","last_peered":"2023-10-05T15:16:15.210321+0000","last_clean":"2023-10-05T15:16:15.210321+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:16:15.210321+0000","last_undegraded":"2023-10-05T15:16:15.210321+0000","last_fullsized":"2023-10-05T15:16:15.210321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207502+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:16:15.207502+0000","last_peered":"2023-10-05T15:16:15.207502+0000","last_clean":"2023-10-05T15:16:15.207502+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:16:15.207502+0000","last_undegraded":"2023-10-05T15:16:15.207502+0000","last_fullsized":"2023-10-05T15:16:15.207502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206224+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:16:15.206224+0000","last_peered":"2023-10-05T15:16:15.206224+0000","last_clean":"2023-10-05T15:16:15.206224+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:16:15.206224+0000","last_undegraded":"2023-10-05T15:16:15.206224+0000","last_fullsized":"2023-10-05T15:16:15.206224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212120+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:16:15.212120+0000","last_peered":"2023-10-05T15:16:15.212120+0000","last_clean":"2023-10-05T15:16:15.212120+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:16:15.212120+0000","last_undegraded":"2023-10-05T15:16:15.212120+0000","last_fullsized":"2023-10-05T15:16:15.212120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211290+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:16:15.211290+0000","last_peered":"2023-10-05T15:16:15.211290+0000","last_clean":"2023-10-05T15:16:15.211290+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:16:15.211290+0000","last_undegraded":"2023-10-05T15:16:15.211290+0000","last_fullsized":"2023-10-05T15:16:15.211290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.208489+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:16:15.208489+0000","last_peered":"2023-10-05T15:16:15.208489+0000","last_clean":"2023-10-05T15:16:15.208489+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:16:15.208489+0000","last_undegraded":"2023-10-05T15:16:15.208489+0000","last_fullsized":"2023-10-05T15:16:15.208489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206634+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:16:15.206634+0000","last_peered":"2023-10-05T15:16:15.206634+0000","last_clean":"2023-10-05T15:16:15.206634+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:16:15.206634+0000","last_undegraded":"2023-10-05T15:16:15.206634+0000","last_fullsized":"2023-10-05T15:16:15.206634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218897+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:16:15.218897+0000","last_peered":"2023-10-05T15:16:15.218897+0000","last_clean":"2023-10-05T15:16:15.218897+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:16:15.218897+0000","last_undegraded":"2023-10-05T15:16:15.218897+0000","last_fullsized":"2023-10-05T15:16:15.218897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.201262+0000","last_change":"2023-10-05T15:15:47.090497+0000","last_active":"2023-10-05T15:16:15.201262+0000","last_peered":"2023-10-05T15:16:15.201262+0000","last_clean":"2023-10-05T15:16:15.201262+0000","last_became_active":"2023-10-05T15:15:47.090160+0000","last_became_peered":"2023-10-05T15:15:47.090160+0000","last_unstale":"2023-10-05T15:16:15.201262+0000","last_undegraded":"2023-10-05T15:16:15.201262+0000","last_fullsized":"2023-10-05T15:16:15.201262+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:15.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209232+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:16:15.209232+0000","last_peered":"2023-10-05T15:16:15.209232+0000","last_clean":"2023-10-05T15:16:15.209232+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:16:15.209232+0000","last_undegraded":"2023-10-05T15:16:15.209232+0000","last_fullsized":"2023-10-05T15:16:15.209232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207385+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:16:15.207385+0000","last_peered":"2023-10-05T15:16:15.207385+0000","last_clean":"2023-10-05T15:16:15.207385+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:16:15.207385+0000","last_undegraded":"2023-10-05T15:16:15.207385+0000","last_fullsized":"2023-10-05T15:16:15.207385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210798+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:16:15.210798+0000","last_peered":"2023-10-05T15:16:15.210798+0000","last_clean":"2023-10-05T15:16:15.210798+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:16:15.210798+0000","last_undegraded":"2023-10-05T15:16:15.210798+0000","last_fullsized":"2023-10-05T15:16:15.210798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216623+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:16:15.216623+0000","last_peered":"2023-10-05T15:16:15.216623+0000","last_clean":"2023-10-05T15:16:15.216623+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:16:15.216623+0000","last_undegraded":"2023-10-05T15:16:15.216623+0000","last_fullsized":"2023-10-05T15:16:15.216623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211501+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:16:15.211501+0000","last_peered":"2023-10-05T15:16:15.211501+0000","last_clean":"2023-10-05T15:16:15.211501+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:16:15.211501+0000","last_undegraded":"2023-10-05T15:16:15.211501+0000","last_fullsized":"2023-10-05T15:16:15.211501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206735+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:16:15.206735+0000","last_peered":"2023-10-05T15:16:15.206735+0000","last_clean":"2023-10-05T15:16:15.206735+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:16:15.206735+0000","last_undegraded":"2023-10-05T15:16:15.206735+0000","last_fullsized":"2023-10-05T15:16:15.206735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211345+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:16:15.211345+0000","last_peered":"2023-10-05T15:16:15.211345+0000","last_clean":"2023-10-05T15:16:15.211345+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:16:15.211345+0000","last_undegraded":"2023-10-05T15:16:15.211345+0000","last_fullsized":"2023-10-05T15:16:15.211345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057151+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:15:46.057151+0000","last_peered":"2023-10-05T15:15:46.057151+0000","last_clean":"2023-10-05T15:15:46.057151+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:15:46.057151+0000","last_undegraded":"2023-10-05T15:15:46.057151+0000","last_fullsized":"2023-10-05T15:15:46.057151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":117,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:33.150058+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:16:33.150058+0000","last_peered":"2023-10-05T15:16:33.150058+0000","last_clean":"2023-10-05T15:16:33.150058+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:16:33.150058+0000","last_undegraded":"2023-10-05T15:16:33.150058+0000","last_fullsized":"2023-10-05T15:16:33.150058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209723+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:16:15.209723+0000","last_peered":"2023-10-05T15:16:15.209723+0000","last_clean":"2023-10-05T15:16:15.209723+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:16:15.209723+0000","last_undegraded":"2023-10-05T15:16:15.209723+0000","last_fullsized":"2023-10-05T15:16:15.209723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060005+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:15:46.060005+0000","last_peered":"2023-10-05T15:15:46.060005+0000","last_clean":"2023-10-05T15:15:46.060005+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:15:46.060005+0000","last_undegraded":"2023-10-05T15:15:46.060005+0000","last_fullsized":"2023-10-05T15:15:46.060005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066765+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:15:46.066765+0000","last_peered":"2023-10-05T15:15:46.066765+0000","last_clean":"2023-10-05T15:15:46.066765+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:15:46.066765+0000","last_undegraded":"2023-10-05T15:15:46.066765+0000","last_fullsized":"2023-10-05T15:15:46.066765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209963+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:16:15.209963+0000","last_peered":"2023-10-05T15:16:15.209963+0000","last_clean":"2023-10-05T15:16:15.209963+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:16:15.209963+0000","last_undegraded":"2023-10-05T15:16:15.209963+0000","last_fullsized":"2023-10-05T15:16:15.209963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060966+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:15:46.060966+0000","last_peered":"2023-10-05T15:15:46.060966+0000","last_clean":"2023-10-05T15:15:46.060966+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:15:46.060966+0000","last_undegraded":"2023-10-05T15:15:46.060966+0000","last_fullsized":"2023-10-05T15:15:46.060966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064382+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:15:46.064382+0000","last_peered":"2023-10-05T15:15:46.064382+0000","last_clean":"2023-10-05T15:15:46.064382+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:15:46.064382+0000","last_undegraded":"2023-10-05T15:15:46.064382+0000","last_fullsized":"2023-10-05T15:15:46.064382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206076+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:16:15.206076+0000","last_peered":"2023-10-05T15:16:15.206076+0000","last_clean":"2023-10-05T15:16:15.206076+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:16:15.206076+0000","last_undegraded":"2023-10-05T15:16:15.206076+0000","last_fullsized":"2023-10-05T15:16:15.206076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060253+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:15:46.060253+0000","last_peered":"2023-10-05T15:15:46.060253+0000","last_clean":"2023-10-05T15:15:46.060253+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:15:46.060253+0000","last_undegraded":"2023-10-05T15:15:46.060253+0000","last_fullsized":"2023-10-05T15:15:46.060253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064078+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:15:46.064078+0000","last_peered":"2023-10-05T15:15:46.064078+0000","last_clean":"2023-10-05T15:15:46.064078+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:15:46.064078+0000","last_undegraded":"2023-10-05T15:15:46.064078+0000","last_fullsized":"2023-10-05T15:15:46.064078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.208020+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:16:15.208020+0000","last_peered":"2023-10-05T15:16:15.208020+0000","last_clean":"2023-10-05T15:16:15.208020+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:16:15.208020+0000","last_undegraded":"2023-10-05T15:16:15.208020+0000","last_fullsized":"2023-10-05T15:16:15.208020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057601+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:15:46.057601+0000","last_peered":"2023-10-05T15:15:46.057601+0000","last_clean":"2023-10-05T15:15:46.057601+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:15:46.057601+0000","last_undegraded":"2023-10-05T15:15:46.057601+0000","last_fullsized":"2023-10-05T15:15:46.057601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":112,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:32.155407+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:16:32.155407+0000","last_peered":"2023-10-05T15:16:32.155407+0000","last_clean":"2023-10-05T15:16:32.155407+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:16:32.155407+0000","last_undegraded":"2023-10-05T15:16:32.155407+0000","last_fullsized":"2023-10-05T15:16:32.155407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207045+0000","last_change":"2023-10-05T15:15:47.088761+0000","last_active":"2023-10-05T15:16:15.207045+0000","last_peered":"2023-10-05T15:16:15.207045+0000","last_clean":"2023-10-05T15:16:15.207045+0000","last_became_active":"2023-10-05T15:15:47.088438+0000","last_became_peered":"2023-10-05T15:15:47.088438+0000","last_unstale":"2023-10-05T15:16:15.207045+0000","last_undegraded":"2023-10-05T15:16:15.207045+0000","last_fullsized":"2023-10-05T15:16:15.207045+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:22.419833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057415+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:15:46.057415+0000","last_peered":"2023-10-05T15:15:46.057415+0000","last_clean":"2023-10-05T15:15:46.057415+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:15:46.057415+0000","last_undegraded":"2023-10-05T15:15:46.057415+0000","last_fullsized":"2023-10-05T15:15:46.057415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063306+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:46.063306+0000","last_peered":"2023-10-05T15:15:46.063306+0000","last_clean":"2023-10-05T15:15:46.063306+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:46.063306+0000","last_undegraded":"2023-10-05T15:15:46.063306+0000","last_fullsized":"2023-10-05T15:15:46.063306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211892+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:16:15.211892+0000","last_peered":"2023-10-05T15:16:15.211892+0000","last_clean":"2023-10-05T15:16:15.211892+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:16:15.211892+0000","last_undegraded":"2023-10-05T15:16:15.211892+0000","last_fullsized":"2023-10-05T15:16:15.211892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063486+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:15:46.063486+0000","last_peered":"2023-10-05T15:15:46.063486+0000","last_clean":"2023-10-05T15:15:46.063486+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:15:46.063486+0000","last_undegraded":"2023-10-05T15:15:46.063486+0000","last_fullsized":"2023-10-05T15:15:46.063486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062727+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:46.062727+0000","last_peered":"2023-10-05T15:15:46.062727+0000","last_clean":"2023-10-05T15:15:46.062727+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:46.062727+0000","last_undegraded":"2023-10-05T15:15:46.062727+0000","last_fullsized":"2023-10-05T15:15:46.062727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.213513+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:16:15.213513+0000","last_peered":"2023-10-05T15:16:15.213513+0000","last_clean":"2023-10-05T15:16:15.213513+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:16:15.213513+0000","last_undegraded":"2023-10-05T15:16:15.213513+0000","last_fullsized":"2023-10-05T15:16:15.213513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064063+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:15:46.064063+0000","last_peered":"2023-10-05T15:15:46.064063+0000","last_clean":"2023-10-05T15:15:46.064063+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:15:46.064063+0000","last_undegraded":"2023-10-05T15:15:46.064063+0000","last_fullsized":"2023-10-05T15:15:46.064063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060854+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:15:46.060854+0000","last_peered":"2023-10-05T15:15:46.060854+0000","last_clean":"2023-10-05T15:15:46.060854+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:15:46.060854+0000","last_undegraded":"2023-10-05T15:15:46.060854+0000","last_fullsized":"2023-10-05T15:15:46.060854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214071+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:16:15.214071+0000","last_peered":"2023-10-05T15:16:15.214071+0000","last_clean":"2023-10-05T15:16:15.214071+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:16:15.214071+0000","last_undegraded":"2023-10-05T15:16:15.214071+0000","last_fullsized":"2023-10-05T15:16:15.214071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064833+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:15:46.064833+0000","last_peered":"2023-10-05T15:15:46.064833+0000","last_clean":"2023-10-05T15:15:46.064833+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:15:46.064833+0000","last_undegraded":"2023-10-05T15:15:46.064833+0000","last_fullsized":"2023-10-05T15:15:46.064833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":184,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:30.151822+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:16:30.151822+0000","last_peered":"2023-10-05T15:16:30.151822+0000","last_clean":"2023-10-05T15:16:30.151822+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:16:30.151822+0000","last_undegraded":"2023-10-05T15:16:30.151822+0000","last_fullsized":"2023-10-05T15:16:30.151822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.203997+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:16:15.203997+0000","last_peered":"2023-10-05T15:16:15.203997+0000","last_clean":"2023-10-05T15:16:15.203997+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:16:15.203997+0000","last_undegraded":"2023-10-05T15:16:15.203997+0000","last_fullsized":"2023-10-05T15:16:15.203997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057080+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:15:46.057080+0000","last_peered":"2023-10-05T15:15:46.057080+0000","last_clean":"2023-10-05T15:15:46.057080+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:15:46.057080+0000","last_undegraded":"2023-10-05T15:15:46.057080+0000","last_fullsized":"2023-10-05T15:15:46.057080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058014+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:46.058014+0000","last_peered":"2023-10-05T15:15:46.058014+0000","last_clean":"2023-10-05T15:15:46.058014+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:46.058014+0000","last_undegraded":"2023-10-05T15:15:46.058014+0000","last_fullsized":"2023-10-05T15:15:46.058014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210513+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:16:15.210513+0000","last_peered":"2023-10-05T15:16:15.210513+0000","last_clean":"2023-10-05T15:16:15.210513+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:16:15.210513+0000","last_undegraded":"2023-10-05T15:16:15.210513+0000","last_fullsized":"2023-10-05T15:16:15.210513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060826+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:15:46.060826+0000","last_peered":"2023-10-05T15:15:46.060826+0000","last_clean":"2023-10-05T15:15:46.060826+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:15:46.060826+0000","last_undegraded":"2023-10-05T15:15:46.060826+0000","last_fullsized":"2023-10-05T15:15:46.060826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061383+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:15:46.061383+0000","last_peered":"2023-10-05T15:15:46.061383+0000","last_clean":"2023-10-05T15:15:46.061383+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:15:46.061383+0000","last_undegraded":"2023-10-05T15:15:46.061383+0000","last_fullsized":"2023-10-05T15:15:46.061383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211802+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:16:15.211802+0000","last_peered":"2023-10-05T15:16:15.211802+0000","last_clean":"2023-10-05T15:16:15.211802+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:16:15.211802+0000","last_undegraded":"2023-10-05T15:16:15.211802+0000","last_fullsized":"2023-10-05T15:16:15.211802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057315+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:15:46.057315+0000","last_peered":"2023-10-05T15:15:46.057315+0000","last_clean":"2023-10-05T15:15:46.057315+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:15:46.057315+0000","last_undegraded":"2023-10-05T15:15:46.057315+0000","last_fullsized":"2023-10-05T15:15:46.057315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:30.168149+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:16:30.168149+0000","last_peered":"2023-10-05T15:16:30.168149+0000","last_clean":"2023-10-05T15:16:30.168149+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:16:30.168149+0000","last_undegraded":"2023-10-05T15:16:30.168149+0000","last_fullsized":"2023-10-05T15:16:30.168149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58848,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":141,"num_write":38,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219014+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:16:15.219014+0000","last_peered":"2023-10-05T15:16:15.219014+0000","last_clean":"2023-10-05T15:16:15.219014+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:16:15.219014+0000","last_undegraded":"2023-10-05T15:16:15.219014+0000","last_fullsized":"2023-10-05T15:16:15.219014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062190+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:15:46.062190+0000","last_peered":"2023-10-05T15:15:46.062190+0000","last_clean":"2023-10-05T15:15:46.062190+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:15:46.062190+0000","last_undegraded":"2023-10-05T15:15:46.062190+0000","last_fullsized":"2023-10-05T15:15:46.062190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057412+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:46.057412+0000","last_peered":"2023-10-05T15:15:46.057412+0000","last_clean":"2023-10-05T15:15:46.057412+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:46.057412+0000","last_undegraded":"2023-10-05T15:15:46.057412+0000","last_fullsized":"2023-10-05T15:15:46.057412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214790+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:16:15.214790+0000","last_peered":"2023-10-05T15:16:15.214790+0000","last_clean":"2023-10-05T15:16:15.214790+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:16:15.214790+0000","last_undegraded":"2023-10-05T15:16:15.214790+0000","last_fullsized":"2023-10-05T15:16:15.214790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062770+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:15:46.062770+0000","last_peered":"2023-10-05T15:15:46.062770+0000","last_clean":"2023-10-05T15:15:46.062770+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:15:46.062770+0000","last_undegraded":"2023-10-05T15:15:46.062770+0000","last_fullsized":"2023-10-05T15:15:46.062770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062773+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:46.062773+0000","last_peered":"2023-10-05T15:15:46.062773+0000","last_clean":"2023-10-05T15:15:46.062773+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:46.062773+0000","last_undegraded":"2023-10-05T15:15:46.062773+0000","last_fullsized":"2023-10-05T15:15:46.062773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218714+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:16:15.218714+0000","last_peered":"2023-10-05T15:16:15.218714+0000","last_clean":"2023-10-05T15:16:15.218714+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:16:15.218714+0000","last_undegraded":"2023-10-05T15:16:15.218714+0000","last_fullsized":"2023-10-05T15:16:15.218714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.103509+0000","last_change":"2023-10-05T15:15:47.103509+0000","last_active":"2023-10-05T15:15:47.103509+0000","last_peered":"2023-10-05T15:15:47.103509+0000","last_clean":"2023-10-05T15:15:47.103509+0000","last_became_active":"2023-10-05T15:15:47.103150+0000","last_became_peered":"2023-10-05T15:15:47.103150+0000","last_unstale":"2023-10-05T15:15:47.103509+0000","last_undegraded":"2023-10-05T15:15:47.103509+0000","last_fullsized":"2023-10-05T15:15:47.103509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:59.848397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"90'8","reported_seq":113,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:32.155419+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:16:32.155419+0000","last_peered":"2023-10-05T15:16:32.155419+0000","last_clean":"2023-10-05T15:16:32.155419+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:16:32.155419+0000","last_undegraded":"2023-10-05T15:16:32.155419+0000","last_fullsized":"2023-10-05T15:16:32.155419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1437,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217226+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:16:15.217226+0000","last_peered":"2023-10-05T15:16:15.217226+0000","last_clean":"2023-10-05T15:16:15.217226+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:16:15.217226+0000","last_undegraded":"2023-10-05T15:16:15.217226+0000","last_fullsized":"2023-10-05T15:16:15.217226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066044+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:15:46.066044+0000","last_peered":"2023-10-05T15:15:46.066044+0000","last_clean":"2023-10-05T15:15:46.066044+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:15:46.066044+0000","last_undegraded":"2023-10-05T15:15:46.066044+0000","last_fullsized":"2023-10-05T15:15:46.066044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060708+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:15:46.060708+0000","last_peered":"2023-10-05T15:15:46.060708+0000","last_clean":"2023-10-05T15:15:46.060708+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:15:46.060708+0000","last_undegraded":"2023-10-05T15:15:46.060708+0000","last_fullsized":"2023-10-05T15:15:46.060708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206773+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:16:15.206773+0000","last_peered":"2023-10-05T15:16:15.206773+0000","last_clean":"2023-10-05T15:16:15.206773+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:16:15.206773+0000","last_undegraded":"2023-10-05T15:16:15.206773+0000","last_fullsized":"2023-10-05T15:16:15.206773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062593+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:15:46.062593+0000","last_peered":"2023-10-05T15:15:46.062593+0000","last_clean":"2023-10-05T15:15:46.062593+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:15:46.062593+0000","last_undegraded":"2023-10-05T15:15:46.062593+0000","last_fullsized":"2023-10-05T15:15:46.062593+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064299+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:15:46.064299+0000","last_peered":"2023-10-05T15:15:46.064299+0000","last_clean":"2023-10-05T15:15:46.064299+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:15:46.064299+0000","last_undegraded":"2023-10-05T15:15:46.064299+0000","last_fullsized":"2023-10-05T15:15:46.064299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211465+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:16:15.211465+0000","last_peered":"2023-10-05T15:16:15.211465+0000","last_clean":"2023-10-05T15:16:15.211465+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:16:15.211465+0000","last_undegraded":"2023-10-05T15:16:15.211465+0000","last_fullsized":"2023-10-05T15:16:15.211465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063976+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:15:46.063976+0000","last_peered":"2023-10-05T15:15:46.063976+0000","last_clean":"2023-10-05T15:15:46.063976+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:15:46.063976+0000","last_undegraded":"2023-10-05T15:15:46.063976+0000","last_fullsized":"2023-10-05T15:15:46.063976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058304+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:15:46.058304+0000","last_peered":"2023-10-05T15:15:46.058304+0000","last_clean":"2023-10-05T15:15:46.058304+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:15:46.058304+0000","last_undegraded":"2023-10-05T15:15:46.058304+0000","last_fullsized":"2023-10-05T15:15:46.058304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210452+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:16:15.210452+0000","last_peered":"2023-10-05T15:16:15.210452+0000","last_clean":"2023-10-05T15:16:15.210452+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:16:15.210452+0000","last_undegraded":"2023-10-05T15:16:15.210452+0000","last_fullsized":"2023-10-05T15:16:15.210452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063886+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:15:46.063886+0000","last_peered":"2023-10-05T15:15:46.063886+0000","last_clean":"2023-10-05T15:15:46.063886+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:15:46.063886+0000","last_undegraded":"2023-10-05T15:15:46.063886+0000","last_fullsized":"2023-10-05T15:15:46.063886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:29.145038+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:16:29.145038+0000","last_peered":"2023-10-05T15:16:29.145038+0000","last_clean":"2023-10-05T15:16:29.145038+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:16:29.145038+0000","last_undegraded":"2023-10-05T15:16:29.145038+0000","last_fullsized":"2023-10-05T15:16:29.145038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207552+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:16:15.207552+0000","last_peered":"2023-10-05T15:16:15.207552+0000","last_clean":"2023-10-05T15:16:15.207552+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:16:15.207552+0000","last_undegraded":"2023-10-05T15:16:15.207552+0000","last_fullsized":"2023-10-05T15:16:15.207552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065857+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:15:46.065857+0000","last_peered":"2023-10-05T15:15:46.065857+0000","last_clean":"2023-10-05T15:15:46.065857+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:15:46.065857+0000","last_undegraded":"2023-10-05T15:15:46.065857+0000","last_fullsized":"2023-10-05T15:15:46.065857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211731+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:16:15.211731+0000","last_peered":"2023-10-05T15:16:15.211731+0000","last_clean":"2023-10-05T15:16:15.211731+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:16:15.211731+0000","last_undegraded":"2023-10-05T15:16:15.211731+0000","last_fullsized":"2023-10-05T15:16:15.211731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:29.150284+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:16:29.150284+0000","last_peered":"2023-10-05T15:16:29.150284+0000","last_clean":"2023-10-05T15:16:29.150284+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:16:29.150284+0000","last_undegraded":"2023-10-05T15:16:29.150284+0000","last_fullsized":"2023-10-05T15:16:29.150284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058004+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:15:46.058004+0000","last_peered":"2023-10-05T15:15:46.058004+0000","last_clean":"2023-10-05T15:15:46.058004+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:15:46.058004+0000","last_undegraded":"2023-10-05T15:15:46.058004+0000","last_fullsized":"2023-10-05T15:15:46.058004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.196784+0000","last_change":"2023-10-05T15:15:47.094134+0000","last_active":"2023-10-05T15:16:15.196784+0000","last_peered":"2023-10-05T15:16:15.196784+0000","last_clean":"2023-10-05T15:16:15.196784+0000","last_became_active":"2023-10-05T15:15:47.093826+0000","last_became_peered":"2023-10-05T15:15:47.093826+0000","last_unstale":"2023-10-05T15:16:15.196784+0000","last_undegraded":"2023-10-05T15:16:15.196784+0000","last_fullsized":"2023-10-05T15:16:15.196784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:16:26.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060721+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:46.060721+0000","last_peered":"2023-10-05T15:15:46.060721+0000","last_clean":"2023-10-05T15:15:46.060721+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:46.060721+0000","last_undegraded":"2023-10-05T15:15:46.060721+0000","last_fullsized":"2023-10-05T15:15:46.060721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057603+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:15:46.057603+0000","last_peered":"2023-10-05T15:15:46.057603+0000","last_clean":"2023-10-05T15:15:46.057603+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:15:46.057603+0000","last_undegraded":"2023-10-05T15:15:46.057603+0000","last_fullsized":"2023-10-05T15:15:46.057603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.089429+0000","last_change":"2023-10-05T15:15:47.089429+0000","last_active":"2023-10-05T15:15:47.089429+0000","last_peered":"2023-10-05T15:15:47.089429+0000","last_clean":"2023-10-05T15:15:47.089429+0000","last_became_active":"2023-10-05T15:15:47.088950+0000","last_became_peered":"2023-10-05T15:15:47.088950+0000","last_unstale":"2023-10-05T15:15:47.089429+0000","last_undegraded":"2023-10-05T15:15:47.089429+0000","last_fullsized":"2023-10-05T15:15:47.089429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:36:14.592094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212172+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:16:15.212172+0000","last_peered":"2023-10-05T15:16:15.212172+0000","last_clean":"2023-10-05T15:16:15.212172+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:16:15.212172+0000","last_undegraded":"2023-10-05T15:16:15.212172+0000","last_fullsized":"2023-10-05T15:16:15.212172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057731+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:46.057731+0000","last_peered":"2023-10-05T15:15:46.057731+0000","last_clean":"2023-10-05T15:15:46.057731+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:46.057731+0000","last_undegraded":"2023-10-05T15:15:46.057731+0000","last_fullsized":"2023-10-05T15:15:46.057731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062666+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:15:46.062666+0000","last_peered":"2023-10-05T15:15:46.062666+0000","last_clean":"2023-10-05T15:15:46.062666+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:15:46.062666+0000","last_undegraded":"2023-10-05T15:15:46.062666+0000","last_fullsized":"2023-10-05T15:15:46.062666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064250+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:15:46.064250+0000","last_peered":"2023-10-05T15:15:46.064250+0000","last_clean":"2023-10-05T15:15:46.064250+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:15:46.064250+0000","last_undegraded":"2023-10-05T15:15:46.064250+0000","last_fullsized":"2023-10-05T15:15:46.064250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.204382+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:16:15.204382+0000","last_peered":"2023-10-05T15:16:15.204382+0000","last_clean":"2023-10-05T15:16:15.204382+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:16:15.204382+0000","last_undegraded":"2023-10-05T15:16:15.204382+0000","last_fullsized":"2023-10-05T15:16:15.204382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065067+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:15:46.065067+0000","last_peered":"2023-10-05T15:15:46.065067+0000","last_clean":"2023-10-05T15:15:46.065067+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:15:46.065067+0000","last_undegraded":"2023-10-05T15:15:46.065067+0000","last_fullsized":"2023-10-05T15:15:46.065067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:17.657319+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:16:17.657319+0000","last_peered":"2023-10-05T15:16:17.657319+0000","last_clean":"2023-10-05T15:16:17.657319+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:16:17.657319+0000","last_undegraded":"2023-10-05T15:16:17.657319+0000","last_fullsized":"2023-10-05T15:16:17.657319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219296+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:16:15.219296+0000","last_peered":"2023-10-05T15:16:15.219296+0000","last_clean":"2023-10-05T15:16:15.219296+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:16:15.219296+0000","last_undegraded":"2023-10-05T15:16:15.219296+0000","last_fullsized":"2023-10-05T15:16:15.219296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057131+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:15:46.057131+0000","last_peered":"2023-10-05T15:15:46.057131+0000","last_clean":"2023-10-05T15:15:46.057131+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:15:46.057131+0000","last_undegraded":"2023-10-05T15:15:46.057131+0000","last_fullsized":"2023-10-05T15:15:46.057131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060702+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:46.060702+0000","last_peered":"2023-10-05T15:15:46.060702+0000","last_clean":"2023-10-05T15:15:46.060702+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:46.060702+0000","last_undegraded":"2023-10-05T15:15:46.060702+0000","last_fullsized":"2023-10-05T15:15:46.060702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214108+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:16:15.214108+0000","last_peered":"2023-10-05T15:16:15.214108+0000","last_clean":"2023-10-05T15:16:15.214108+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:16:15.214108+0000","last_undegraded":"2023-10-05T15:16:15.214108+0000","last_fullsized":"2023-10-05T15:16:15.214108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060211+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:15:46.060211+0000","last_peered":"2023-10-05T15:15:46.060211+0000","last_clean":"2023-10-05T15:15:46.060211+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:15:46.060211+0000","last_undegraded":"2023-10-05T15:15:46.060211+0000","last_fullsized":"2023-10-05T15:15:46.060211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067424+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:46.067424+0000","last_peered":"2023-10-05T15:15:46.067424+0000","last_clean":"2023-10-05T15:15:46.067424+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:46.067424+0000","last_undegraded":"2023-10-05T15:15:46.067424+0000","last_fullsized":"2023-10-05T15:15:46.067424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.174876+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:16:15.174876+0000","last_peered":"2023-10-05T15:16:15.174876+0000","last_clean":"2023-10-05T15:16:15.174876+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:16:15.174876+0000","last_undegraded":"2023-10-05T15:16:15.174876+0000","last_fullsized":"2023-10-05T15:16:15.174876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058609+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:15:46.058609+0000","last_peered":"2023-10-05T15:15:46.058609+0000","last_clean":"2023-10-05T15:15:46.058609+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:15:46.058609+0000","last_undegraded":"2023-10-05T15:15:46.058609+0000","last_fullsized":"2023-10-05T15:15:46.058609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064579+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:46.064579+0000","last_peered":"2023-10-05T15:15:46.064579+0000","last_clean":"2023-10-05T15:15:46.064579+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:46.064579+0000","last_undegraded":"2023-10-05T15:15:46.064579+0000","last_fullsized":"2023-10-05T15:15:46.064579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209977+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:16:15.209977+0000","last_peered":"2023-10-05T15:16:15.209977+0000","last_clean":"2023-10-05T15:16:15.209977+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:16:15.209977+0000","last_undegraded":"2023-10-05T15:16:15.209977+0000","last_fullsized":"2023-10-05T15:16:15.209977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.095591+0000","last_change":"2023-10-05T15:15:47.095591+0000","last_active":"2023-10-05T15:15:47.095591+0000","last_peered":"2023-10-05T15:15:47.095591+0000","last_clean":"2023-10-05T15:15:47.095591+0000","last_became_active":"2023-10-05T15:15:47.090503+0000","last_became_peered":"2023-10-05T15:15:47.090503+0000","last_unstale":"2023-10-05T15:15:47.095591+0000","last_undegraded":"2023-10-05T15:15:47.095591+0000","last_fullsized":"2023-10-05T15:15:47.095591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:35.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057335+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:15:46.057335+0000","last_peered":"2023-10-05T15:15:46.057335+0000","last_clean":"2023-10-05T15:15:46.057335+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:15:46.057335+0000","last_undegraded":"2023-10-05T15:15:46.057335+0000","last_fullsized":"2023-10-05T15:15:46.057335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212801+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:16:15.212801+0000","last_peered":"2023-10-05T15:16:15.212801+0000","last_clean":"2023-10-05T15:16:15.212801+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:16:15.212801+0000","last_undegraded":"2023-10-05T15:16:15.212801+0000","last_fullsized":"2023-10-05T15:16:15.212801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060452+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:15:46.060452+0000","last_peered":"2023-10-05T15:15:46.060452+0000","last_clean":"2023-10-05T15:15:46.060452+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:15:46.060452+0000","last_undegraded":"2023-10-05T15:15:46.060452+0000","last_fullsized":"2023-10-05T15:15:46.060452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063970+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:15:46.063970+0000","last_peered":"2023-10-05T15:15:46.063970+0000","last_clean":"2023-10-05T15:15:46.063970+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:15:46.063970+0000","last_undegraded":"2023-10-05T15:15:46.063970+0000","last_fullsized":"2023-10-05T15:15:46.063970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217129+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:16:15.217129+0000","last_peered":"2023-10-05T15:16:15.217129+0000","last_clean":"2023-10-05T15:16:15.217129+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:16:15.217129+0000","last_undegraded":"2023-10-05T15:16:15.217129+0000","last_fullsized":"2023-10-05T15:16:15.217129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067523+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:15:46.067523+0000","last_peered":"2023-10-05T15:15:46.067523+0000","last_clean":"2023-10-05T15:15:46.067523+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:15:46.067523+0000","last_undegraded":"2023-10-05T15:15:46.067523+0000","last_fullsized":"2023-10-05T15:15:46.067523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:33.156630+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:16:33.156630+0000","last_peered":"2023-10-05T15:16:33.156630+0000","last_clean":"2023-10-05T15:16:33.156630+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:16:33.156630+0000","last_undegraded":"2023-10-05T15:16:33.156630+0000","last_fullsized":"2023-10-05T15:16:33.156630+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.220009+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:16:15.220009+0000","last_peered":"2023-10-05T15:16:15.220009+0000","last_clean":"2023-10-05T15:16:15.220009+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:16:15.220009+0000","last_undegraded":"2023-10-05T15:16:15.220009+0000","last_fullsized":"2023-10-05T15:16:15.220009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063292+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:15:46.063292+0000","last_peered":"2023-10-05T15:15:46.063292+0000","last_clean":"2023-10-05T15:15:46.063292+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:15:46.063292+0000","last_undegraded":"2023-10-05T15:15:46.063292+0000","last_fullsized":"2023-10-05T15:15:46.063292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061487+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:15:46.061487+0000","last_peered":"2023-10-05T15:15:46.061487+0000","last_clean":"2023-10-05T15:15:46.061487+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:15:46.061487+0000","last_undegraded":"2023-10-05T15:15:46.061487+0000","last_fullsized":"2023-10-05T15:15:46.061487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217154+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:16:15.217154+0000","last_peered":"2023-10-05T15:16:15.217154+0000","last_clean":"2023-10-05T15:16:15.217154+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:16:15.217154+0000","last_undegraded":"2023-10-05T15:16:15.217154+0000","last_fullsized":"2023-10-05T15:16:15.217154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060696+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:15:46.060696+0000","last_peered":"2023-10-05T15:15:46.060696+0000","last_clean":"2023-10-05T15:15:46.060696+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:15:46.060696+0000","last_undegraded":"2023-10-05T15:15:46.060696+0000","last_fullsized":"2023-10-05T15:15:46.060696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065946+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:46.065946+0000","last_peered":"2023-10-05T15:15:46.065946+0000","last_clean":"2023-10-05T15:15:46.065946+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:46.065946+0000","last_undegraded":"2023-10-05T15:15:46.065946+0000","last_fullsized":"2023-10-05T15:15:46.065946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216870+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:16:15.216870+0000","last_peered":"2023-10-05T15:16:15.216870+0000","last_clean":"2023-10-05T15:16:15.216870+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:16:15.216870+0000","last_undegraded":"2023-10-05T15:16:15.216870+0000","last_fullsized":"2023-10-05T15:16:15.216870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209827+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:16:15.209827+0000","last_peered":"2023-10-05T15:16:15.209827+0000","last_clean":"2023-10-05T15:16:15.209827+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:16:15.209827+0000","last_undegraded":"2023-10-05T15:16:15.209827+0000","last_fullsized":"2023-10-05T15:16:15.209827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209385+0000","last_change":"2023-10-05T15:15:47.094198+0000","last_active":"2023-10-05T15:16:15.209385+0000","last_peered":"2023-10-05T15:16:15.209385+0000","last_clean":"2023-10-05T15:16:15.209385+0000","last_became_active":"2023-10-05T15:15:47.093766+0000","last_became_peered":"2023-10-05T15:15:47.093766+0000","last_unstale":"2023-10-05T15:16:15.209385+0000","last_undegraded":"2023-10-05T15:16:15.209385+0000","last_fullsized":"2023-10-05T15:16:15.209385+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:48:59.949643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210923+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:16:15.210923+0000","last_peered":"2023-10-05T15:16:15.210923+0000","last_clean":"2023-10-05T15:16:15.210923+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:16:15.210923+0000","last_undegraded":"2023-10-05T15:16:15.210923+0000","last_fullsized":"2023-10-05T15:16:15.210923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218232+0000","last_change":"2023-10-05T15:15:47.088923+0000","last_active":"2023-10-05T15:16:15.218232+0000","last_peered":"2023-10-05T15:16:15.218232+0000","last_clean":"2023-10-05T15:16:15.218232+0000","last_became_active":"2023-10-05T15:15:47.088562+0000","last_became_peered":"2023-10-05T15:15:47.088562+0000","last_unstale":"2023-10-05T15:16:15.218232+0000","last_undegraded":"2023-10-05T15:16:15.218232+0000","last_fullsized":"2023-10-05T15:16:15.218232+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:25.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211925+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:16:15.211925+0000","last_peered":"2023-10-05T15:16:15.211925+0000","last_clean":"2023-10-05T15:16:15.211925+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:16:15.211925+0000","last_undegraded":"2023-10-05T15:16:15.211925+0000","last_fullsized":"2023-10-05T15:16:15.211925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207863+0000","last_change":"2023-10-05T15:15:47.065363+0000","last_active":"2023-10-05T15:16:15.207863+0000","last_peered":"2023-10-05T15:16:15.207863+0000","last_clean":"2023-10-05T15:16:15.207863+0000","last_became_active":"2023-10-05T15:15:47.064990+0000","last_became_peered":"2023-10-05T15:15:47.064990+0000","last_unstale":"2023-10-05T15:16:15.207863+0000","last_undegraded":"2023-10-05T15:16:15.207863+0000","last_fullsized":"2023-10-05T15:16:15.207863+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:31.355817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207667+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:16:15.207667+0000","last_peered":"2023-10-05T15:16:15.207667+0000","last_clean":"2023-10-05T15:16:15.207667+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:16:15.207667+0000","last_undegraded":"2023-10-05T15:16:15.207667+0000","last_fullsized":"2023-10-05T15:16:15.207667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211612+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:16:15.211612+0000","last_peered":"2023-10-05T15:16:15.211612+0000","last_clean":"2023-10-05T15:16:15.211612+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:16:15.211612+0000","last_undegraded":"2023-10-05T15:16:15.211612+0000","last_fullsized":"2023-10-05T15:16:15.211612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206529+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:16:15.206529+0000","last_peered":"2023-10-05T15:16:15.206529+0000","last_clean":"2023-10-05T15:16:15.206529+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:16:15.206529+0000","last_undegraded":"2023-10-05T15:16:15.206529+0000","last_fullsized":"2023-10-05T15:16:15.206529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212422+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:16:15.212422+0000","last_peered":"2023-10-05T15:16:15.212422+0000","last_clean":"2023-10-05T15:16:15.212422+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:16:15.212422+0000","last_undegraded":"2023-10-05T15:16:15.212422+0000","last_fullsized":"2023-10-05T15:16:15.212422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219057+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:16:15.219057+0000","last_peered":"2023-10-05T15:16:15.219057+0000","last_clean":"2023-10-05T15:16:15.219057+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:16:15.219057+0000","last_undegraded":"2023-10-05T15:16:15.219057+0000","last_fullsized":"2023-10-05T15:16:15.219057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216405+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:16:15.216405+0000","last_peered":"2023-10-05T15:16:15.216405+0000","last_clean":"2023-10-05T15:16:15.216405+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:16:15.216405+0000","last_undegraded":"2023-10-05T15:16:15.216405+0000","last_fullsized":"2023-10-05T15:16:15.216405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211710+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:16:15.211710+0000","last_peered":"2023-10-05T15:16:15.211710+0000","last_clean":"2023-10-05T15:16:15.211710+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:16:15.211710+0000","last_undegraded":"2023-10-05T15:16:15.211710+0000","last_fullsized":"2023-10-05T15:16:15.211710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66650,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":854,"num_read_kb":498,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":210708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416417,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":491395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.58299999999999996,"15min":0.59399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":1.264,"15min":1.264},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":1.304,"15min":1.304},"last":0.63}]},{"osd":1,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.32600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":1.069,"15min":1.069},"last":0.498}]},{"osd":6,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85399999999999998,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69299999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82499999999999996,"15min":0.83299999999999996},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.91400000000000003,"5min":1.621,"15min":1.621},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96599999999999997,"5min":1.492,"15min":1.492},"last":0.755}]},{"osd":10,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.58899999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92300000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94399999999999995,"5min":1.74,"15min":1.74},"last":0.73499999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1141355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69199999999999995,"5min":1.335,"15min":1.335},"last":0.502},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79200000000000004,"5min":0.874,"15min":0.874},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91800000000000004,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.622}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0009999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68300000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96199999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78700000000000003,"15min":0.79100000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0169999999999999,"5min":1.196,"15min":1.196},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97599999999999998,"5min":1.167,"15min":1.167},"last":0.75700000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808873,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":491325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.372},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.84299999999999997,"5min":1.986,"15min":1.986},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.876,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.84899999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.99299999999999999,"5min":1.216,"15min":1.216},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.30499999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91900000000000004,"5min":2.794,"15min":2.794},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":0.65200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.004,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":1.141,"15min":1.141},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.45800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1419999999999999,"5min":1.407,"15min":1.407},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.74399999999999999},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.266,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.49399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0409999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.196,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78200000000000003,"15min":0.83399999999999996},"min":{"1min":0.49199999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61599999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.94899999999999995,"5min":1.327,"15min":1.327},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2969999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65400000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.628},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66400000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":491703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.871,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.63300000000000001},"min":{"1min":0.46200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46200000000000002,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66900000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.46500000000000002,"15min":0.44700000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84599999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65200000000000002,"15min":0.623},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":2.073,"15min":2.073},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.57599999999999996,"15min":0.54800000000000004},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.71299999999999997,"15min":0.67300000000000004},"min":{"1min":0.51300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.69599999999999995},"min":{"1min":0.54500000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.745}]},{"osd":7,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.746,"15min":0.70199999999999996},"min":{"1min":0.59599999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":2.109,"15min":2.109},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.05,"5min":1.583,"15min":1.583},"last":0.73399999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.72399999999999998,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.749},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.038,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.83499999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.65400000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.73199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0109999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.85599999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78100000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299441,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1088871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.44}]},{"osd":2,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.496},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.622},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76000000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74199999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80100000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462965,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":486829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.503}]},{"osd":2,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.23,"15min":1.23},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.441},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.0960000000000001,"5min":1.147,"15min":1.147},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97299999999999998,"5min":1.296,"15min":1.296},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.264,"15min":1.264},"last":0.745},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.242,"15min":1.242},"last":0.59599999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93899999999999995,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.80900000000000005},"min":{"1min":0.55100000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":1.181,"15min":1.181},"last":0.79200000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.77100000000000002,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":1.323,"15min":1.323},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.44,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89600000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.64200000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.64700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0629999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":552131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.58999999999999997,"15min":0.52700000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59499999999999997,"15min":0.54900000000000004},"min":{"1min":0.51400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83699999999999997,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":11.920999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.752}]},{"osd":5,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.63400000000000001,"15min":0.59399999999999997},"min":{"1min":0.59799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.87},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.879,"5min":0.995,"15min":0.995},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":0.66600000000000004},"min":{"1min":0.46999999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":10.085000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":5.3010000000000002,"15min":5.3010000000000002},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93300000000000005,"5min":1.038,"15min":1.038},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.96399999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71399999999999997,"15min":0.68400000000000005},"min":{"1min":0.55200000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95999999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.66300000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.54400000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.129},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80300000000000005,"15min":0.77500000000000002},"min":{"1min":0.60699999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":4.6630000000000003,"15min":4.6630000000000003},"last":0.998}]},{"osd":10,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89000000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.97899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":488012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.69799999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":11.119999999999999,"5min":11.119999999999999,"15min":11.119999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Oct 5 15:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58099999999999996,"15min":0.51500000000000001},"min":{"1min":0.438,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.64100000000000001,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.048,"5min":11.048,"15min":11.048},"last":0.621}]},{"osd":5,"last update":"Thu Oct 5 15:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.63300000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77900000000000003,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.084,"5min":11.084,"15min":11.084},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.745}]},{"osd":8,"last update":"Thu Oct 5 15:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.871,"15min":0.85499999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5620000000000001,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.76600000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.75900000000000001,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":11.151999999999999,"15min":11.151999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.72599999999999998,"15min":0.73699999999999999},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78900000000000003,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.82199999999999995,"15min":0.76000000000000001},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":10.984999999999999,"5min":10.984999999999999,"15min":10.984999999999999},"last":0.67300000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.61599999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.72799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":553155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55200000000000005,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.58899999999999997,"15min":0.52100000000000002},"min":{"1min":0.40200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.4429999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.50900000000000001},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56799999999999995,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.59199999999999997,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.438},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.42999999999999999},"min":{"1min":0.31900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.45500000000000002},"min":{"1min":0.35499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Thu Oct 5 15:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":3.831,"15min":3.831},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.63400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.878,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.88500000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.56000000000000005,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.753},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.628}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.745},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":0.747},"min":{"1min":0.63900000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91800000000000004,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.68400000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85199999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":486206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29199999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61799999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.30399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.55500000000000005},"min":{"1min":0.51400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80700000000000005,"5min":1.097,"15min":1.097},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66900000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77600000000000002,"5min":1.087,"15min":1.087},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76300000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":1.097,"15min":1.097},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77400000000000002,"5min":1.149,"15min":1.149},"last":0.749},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90400000000000003,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82499999999999996,"5min":1.04,"15min":1.04},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94799999999999995,"5min":1.044,"15min":1.044},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.71499999999999997,"15min":0.78100000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.878,"5min":1.605,"15min":1.605},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.69399999999999995,"15min":0.76000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.433}]},{"osd":10,"last update":"Thu Oct 5 15:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.081,"15min":1.081},"last":0.67200000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64900000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":491479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.379},"min":{"1min":0.317,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38}]},{"osd":2,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.57699999999999996},"min":{"1min":0.505,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89700000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.87},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.57099999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.76300000000000001,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4750000000000001,"5min":1.528,"15min":1.528},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.452,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.73199999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.88600000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724602,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1083591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78900000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.63800000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59299999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55700000000000005,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.75900000000000001,"5min":1.044,"15min":1.044},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.45000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70899999999999996,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.028,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.675,"15min":1.675},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60499999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2849999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8759999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:16:36.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:16:36.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 -- 172.21.15.60:0/1232645056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 msgr2=0x7f6b60101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 --2- 172.21.15.60:0/1232645056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60101410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6b540099c0 tx=0x7f6b54009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 -- 172.21.15.60:0/1232645056 shutdown_connections 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 --2- 172.21.15.60:0/1232645056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b60101950 0x7f6b60108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 --2- 172.21.15.60:0/1232645056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b600ffdc0 0x7f6b601001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 --2- 172.21.15.60:0/1232645056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60101410 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 -- 172.21.15.60:0/1232645056 >> 172.21.15.60:0/1232645056 conn(0x7f6b600fb350 msgr2=0x7f6b600fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 -- 172.21.15.60:0/1232645056 shutdown_connections 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.877+0000 7f6b653f4700 1 -- 172.21.15.60:0/1232645056 wait complete. 2023-10-05T15:16:36.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 Processor -- start 2023-10-05T15:16:36.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 -- start start 2023-10-05T15:16:36.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b600ffdc0 0x7f6b60196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b60101950 0x7f6b6019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019e6d0 con 0x7f6b60100fb0 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019e810 con 0x7f6b60101950 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b653f4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019e9a0 con 0x7f6b600ffdc0 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b5e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b5e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37988/0 (socket says 172.21.15.60:37988) 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b5e7fc700 1 -- 172.21.15.60:0/386083494 learned_addr learned my addr 172.21.15.60:0/386083494 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b5f7fe700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b60101950 0x7f6b6019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.878+0000 7f6b5effd700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b600ffdc0 0x7f6b60196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b5e7fc700 1 -- 172.21.15.60:0/386083494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b600ffdc0 msgr2=0x7f6b60196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b5e7fc700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b600ffdc0 0x7f6b60196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b5e7fc700 1 -- 172.21.15.60:0/386083494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b60101950 msgr2=0x7f6b6019e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b5e7fc700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b60101950 0x7f6b6019e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b5e7fc700 1 -- 172.21.15.60:0/386083494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540095f0 con 0x7f6b60100fb0 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b5e7fc700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60197090 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009990 tx=0x7f6b54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5401d070 con 0x7f6b60100fb0 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b54004090 con 0x7f6b60100fb0 2023-10-05T15:16:36.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6019ec20 con 0x7f6b60100fb0 2023-10-05T15:16:36.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54004a00 con 0x7f6b60100fb0 2023-10-05T15:16:36.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.879+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6019f0d0 con 0x7f6b60100fb0 2023-10-05T15:16:36.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.880+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6010b5d0 con 0x7f6b60100fb0 2023-10-05T15:16:36.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.881+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6b54003bd0 con 0x7f6b60100fb0 2023-10-05T15:16:36.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.882+0000 7f6b47fff700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6b480a14d0 0x7f6b480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:36.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.882+0000 7f6b5effd700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6b480a14d0 0x7f6b480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:36.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.882+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f6b540ce350 con 0x7f6b60100fb0 2023-10-05T15:16:36.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.882+0000 7f6b5effd700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6b480a14d0 0x7f6b480a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b60100e10 tx=0x7f6b5000b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:36.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:36.885+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b540976e0 con 0x7f6b60100fb0 2023-10-05T15:16:37.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.084+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b60069a30 con 0x7f6b480a14d0 2023-10-05T15:16:37.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.099+0000 7f6b47fff700 1 -- 172.21.15.60:0/386083494 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427233 (secure 0 0 0) 0x7f6b60069a30 con 0x7f6b480a14d0 2023-10-05T15:16:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:37.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6b480a14d0 msgr2=0x7f6b480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6b480a14d0 0x7f6b480a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b60100e10 tx=0x7f6b5000b590 comp rx=0 tx=0).stop 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 msgr2=0x7f6b60197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60197090 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009990 tx=0x7f6b54004730 comp rx=0 tx=0).stop 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 shutdown_connections 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b60101950 0x7f6b6019e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b600ffdc0 0x7f6b60196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f6b480a14d0 0x7f6b480a3990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 --2- 172.21.15.60:0/386083494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b60100fb0 0x7f6b60197090 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 >> 172.21.15.60:0/386083494 conn(0x7f6b600fb350 msgr2=0x7f6b60069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:37.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 shutdown_connections 2023-10-05T15:16:37.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.103+0000 7f6b653f4700 1 -- 172.21.15.60:0/386083494 wait complete. 2023-10-05T15:16:37.114 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:16:37.119 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2023-10-05T15:16:35.200362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657264,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":990,"num_read_kb":617,"num_write":429,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338164,"kb_used_data":13972,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603660,"statfs":{"total":1151940427776,"available":1151594147840,"internally_reserved":0,"allocated":14307328,"data_stored":7846052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":318,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":56,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211407+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:16:15.211407+0000","last_peered":"2023-10-05T15:16:15.211407+0000","last_clean":"2023-10-05T15:16:15.211407+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:16:15.211407+0000","last_undegraded":"2023-10-05T15:16:15.211407+0000","last_fullsized":"2023-10-05T15:16:15.211407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209294+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:16:15.209294+0000","last_peered":"2023-10-05T15:16:15.209294+0000","last_clean":"2023-10-05T15:16:15.209294+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:16:15.209294+0000","last_undegraded":"2023-10-05T15:16:15.209294+0000","last_fullsized":"2023-10-05T15:16:15.209294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210807+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:16:15.210807+0000","last_peered":"2023-10-05T15:16:15.210807+0000","last_clean":"2023-10-05T15:16:15.210807+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:16:15.210807+0000","last_undegraded":"2023-10-05T15:16:15.210807+0000","last_fullsized":"2023-10-05T15:16:15.210807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210321+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:16:15.210321+0000","last_peered":"2023-10-05T15:16:15.210321+0000","last_clean":"2023-10-05T15:16:15.210321+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:16:15.210321+0000","last_undegraded":"2023-10-05T15:16:15.210321+0000","last_fullsized":"2023-10-05T15:16:15.210321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207502+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:16:15.207502+0000","last_peered":"2023-10-05T15:16:15.207502+0000","last_clean":"2023-10-05T15:16:15.207502+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:16:15.207502+0000","last_undegraded":"2023-10-05T15:16:15.207502+0000","last_fullsized":"2023-10-05T15:16:15.207502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206224+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:16:15.206224+0000","last_peered":"2023-10-05T15:16:15.206224+0000","last_clean":"2023-10-05T15:16:15.206224+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:16:15.206224+0000","last_undegraded":"2023-10-05T15:16:15.206224+0000","last_fullsized":"2023-10-05T15:16:15.206224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212120+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:16:15.212120+0000","last_peered":"2023-10-05T15:16:15.212120+0000","last_clean":"2023-10-05T15:16:15.212120+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:16:15.212120+0000","last_undegraded":"2023-10-05T15:16:15.212120+0000","last_fullsized":"2023-10-05T15:16:15.212120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211290+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:16:15.211290+0000","last_peered":"2023-10-05T15:16:15.211290+0000","last_clean":"2023-10-05T15:16:15.211290+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:16:15.211290+0000","last_undegraded":"2023-10-05T15:16:15.211290+0000","last_fullsized":"2023-10-05T15:16:15.211290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.208489+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:16:15.208489+0000","last_peered":"2023-10-05T15:16:15.208489+0000","last_clean":"2023-10-05T15:16:15.208489+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:16:15.208489+0000","last_undegraded":"2023-10-05T15:16:15.208489+0000","last_fullsized":"2023-10-05T15:16:15.208489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206634+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:16:15.206634+0000","last_peered":"2023-10-05T15:16:15.206634+0000","last_clean":"2023-10-05T15:16:15.206634+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:16:15.206634+0000","last_undegraded":"2023-10-05T15:16:15.206634+0000","last_fullsized":"2023-10-05T15:16:15.206634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218897+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:16:15.218897+0000","last_peered":"2023-10-05T15:16:15.218897+0000","last_clean":"2023-10-05T15:16:15.218897+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:16:15.218897+0000","last_undegraded":"2023-10-05T15:16:15.218897+0000","last_fullsized":"2023-10-05T15:16:15.218897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.201262+0000","last_change":"2023-10-05T15:15:47.090497+0000","last_active":"2023-10-05T15:16:15.201262+0000","last_peered":"2023-10-05T15:16:15.201262+0000","last_clean":"2023-10-05T15:16:15.201262+0000","last_became_active":"2023-10-05T15:15:47.090160+0000","last_became_peered":"2023-10-05T15:15:47.090160+0000","last_unstale":"2023-10-05T15:16:15.201262+0000","last_undegraded":"2023-10-05T15:16:15.201262+0000","last_fullsized":"2023-10-05T15:16:15.201262+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:15.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209232+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:16:15.209232+0000","last_peered":"2023-10-05T15:16:15.209232+0000","last_clean":"2023-10-05T15:16:15.209232+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:16:15.209232+0000","last_undegraded":"2023-10-05T15:16:15.209232+0000","last_fullsized":"2023-10-05T15:16:15.209232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207385+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:16:15.207385+0000","last_peered":"2023-10-05T15:16:15.207385+0000","last_clean":"2023-10-05T15:16:15.207385+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:16:15.207385+0000","last_undegraded":"2023-10-05T15:16:15.207385+0000","last_fullsized":"2023-10-05T15:16:15.207385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210798+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:16:15.210798+0000","last_peered":"2023-10-05T15:16:15.210798+0000","last_clean":"2023-10-05T15:16:15.210798+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:16:15.210798+0000","last_undegraded":"2023-10-05T15:16:15.210798+0000","last_fullsized":"2023-10-05T15:16:15.210798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216623+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:16:15.216623+0000","last_peered":"2023-10-05T15:16:15.216623+0000","last_clean":"2023-10-05T15:16:15.216623+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:16:15.216623+0000","last_undegraded":"2023-10-05T15:16:15.216623+0000","last_fullsized":"2023-10-05T15:16:15.216623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211501+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:16:15.211501+0000","last_peered":"2023-10-05T15:16:15.211501+0000","last_clean":"2023-10-05T15:16:15.211501+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:16:15.211501+0000","last_undegraded":"2023-10-05T15:16:15.211501+0000","last_fullsized":"2023-10-05T15:16:15.211501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206735+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:16:15.206735+0000","last_peered":"2023-10-05T15:16:15.206735+0000","last_clean":"2023-10-05T15:16:15.206735+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:16:15.206735+0000","last_undegraded":"2023-10-05T15:16:15.206735+0000","last_fullsized":"2023-10-05T15:16:15.206735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211345+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:16:15.211345+0000","last_peered":"2023-10-05T15:16:15.211345+0000","last_clean":"2023-10-05T15:16:15.211345+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:16:15.211345+0000","last_undegraded":"2023-10-05T15:16:15.211345+0000","last_fullsized":"2023-10-05T15:16:15.211345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057151+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:15:46.057151+0000","last_peered":"2023-10-05T15:15:46.057151+0000","last_clean":"2023-10-05T15:15:46.057151+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:15:46.057151+0000","last_undegraded":"2023-10-05T15:15:46.057151+0000","last_fullsized":"2023-10-05T15:15:46.057151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":117,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:33.150058+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:16:33.150058+0000","last_peered":"2023-10-05T15:16:33.150058+0000","last_clean":"2023-10-05T15:16:33.150058+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:16:33.150058+0000","last_undegraded":"2023-10-05T15:16:33.150058+0000","last_fullsized":"2023-10-05T15:16:33.150058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209723+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:16:15.209723+0000","last_peered":"2023-10-05T15:16:15.209723+0000","last_clean":"2023-10-05T15:16:15.209723+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:16:15.209723+0000","last_undegraded":"2023-10-05T15:16:15.209723+0000","last_fullsized":"2023-10-05T15:16:15.209723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060005+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:15:46.060005+0000","last_peered":"2023-10-05T15:15:46.060005+0000","last_clean":"2023-10-05T15:15:46.060005+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:15:46.060005+0000","last_undegraded":"2023-10-05T15:15:46.060005+0000","last_fullsized":"2023-10-05T15:15:46.060005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066765+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:15:46.066765+0000","last_peered":"2023-10-05T15:15:46.066765+0000","last_clean":"2023-10-05T15:15:46.066765+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:15:46.066765+0000","last_undegraded":"2023-10-05T15:15:46.066765+0000","last_fullsized":"2023-10-05T15:15:46.066765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209963+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:16:15.209963+0000","last_peered":"2023-10-05T15:16:15.209963+0000","last_clean":"2023-10-05T15:16:15.209963+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:16:15.209963+0000","last_undegraded":"2023-10-05T15:16:15.209963+0000","last_fullsized":"2023-10-05T15:16:15.209963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060966+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:15:46.060966+0000","last_peered":"2023-10-05T15:15:46.060966+0000","last_clean":"2023-10-05T15:15:46.060966+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:15:46.060966+0000","last_undegraded":"2023-10-05T15:15:46.060966+0000","last_fullsized":"2023-10-05T15:15:46.060966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064382+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:15:46.064382+0000","last_peered":"2023-10-05T15:15:46.064382+0000","last_clean":"2023-10-05T15:15:46.064382+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:15:46.064382+0000","last_undegraded":"2023-10-05T15:15:46.064382+0000","last_fullsized":"2023-10-05T15:15:46.064382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206076+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:16:15.206076+0000","last_peered":"2023-10-05T15:16:15.206076+0000","last_clean":"2023-10-05T15:16:15.206076+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:16:15.206076+0000","last_undegraded":"2023-10-05T15:16:15.206076+0000","last_fullsized":"2023-10-05T15:16:15.206076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060253+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:15:46.060253+0000","last_peered":"2023-10-05T15:15:46.060253+0000","last_clean":"2023-10-05T15:15:46.060253+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:15:46.060253+0000","last_undegraded":"2023-10-05T15:15:46.060253+0000","last_fullsized":"2023-10-05T15:15:46.060253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064078+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:15:46.064078+0000","last_peered":"2023-10-05T15:15:46.064078+0000","last_clean":"2023-10-05T15:15:46.064078+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:15:46.064078+0000","last_undegraded":"2023-10-05T15:15:46.064078+0000","last_fullsized":"2023-10-05T15:15:46.064078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.208020+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:16:15.208020+0000","last_peered":"2023-10-05T15:16:15.208020+0000","last_clean":"2023-10-05T15:16:15.208020+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:16:15.208020+0000","last_undegraded":"2023-10-05T15:16:15.208020+0000","last_fullsized":"2023-10-05T15:16:15.208020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057601+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:15:46.057601+0000","last_peered":"2023-10-05T15:15:46.057601+0000","last_clean":"2023-10-05T15:15:46.057601+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:15:46.057601+0000","last_undegraded":"2023-10-05T15:15:46.057601+0000","last_fullsized":"2023-10-05T15:15:46.057601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":112,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:32.155407+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:16:32.155407+0000","last_peered":"2023-10-05T15:16:32.155407+0000","last_clean":"2023-10-05T15:16:32.155407+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:16:32.155407+0000","last_undegraded":"2023-10-05T15:16:32.155407+0000","last_fullsized":"2023-10-05T15:16:32.155407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207045+0000","last_change":"2023-10-05T15:15:47.088761+0000","last_active":"2023-10-05T15:16:15.207045+0000","last_peered":"2023-10-05T15:16:15.207045+0000","last_clean":"2023-10-05T15:16:15.207045+0000","last_became_active":"2023-10-05T15:15:47.088438+0000","last_became_peered":"2023-10-05T15:15:47.088438+0000","last_unstale":"2023-10-05T15:16:15.207045+0000","last_undegraded":"2023-10-05T15:16:15.207045+0000","last_fullsized":"2023-10-05T15:16:15.207045+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:22.419833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057415+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:15:46.057415+0000","last_peered":"2023-10-05T15:15:46.057415+0000","last_clean":"2023-10-05T15:15:46.057415+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:15:46.057415+0000","last_undegraded":"2023-10-05T15:15:46.057415+0000","last_fullsized":"2023-10-05T15:15:46.057415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063306+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:46.063306+0000","last_peered":"2023-10-05T15:15:46.063306+0000","last_clean":"2023-10-05T15:15:46.063306+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:46.063306+0000","last_undegraded":"2023-10-05T15:15:46.063306+0000","last_fullsized":"2023-10-05T15:15:46.063306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211892+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:16:15.211892+0000","last_peered":"2023-10-05T15:16:15.211892+0000","last_clean":"2023-10-05T15:16:15.211892+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:16:15.211892+0000","last_undegraded":"2023-10-05T15:16:15.211892+0000","last_fullsized":"2023-10-05T15:16:15.211892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063486+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:15:46.063486+0000","last_peered":"2023-10-05T15:15:46.063486+0000","last_clean":"2023-10-05T15:15:46.063486+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:15:46.063486+0000","last_undegraded":"2023-10-05T15:15:46.063486+0000","last_fullsized":"2023-10-05T15:15:46.063486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062727+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:46.062727+0000","last_peered":"2023-10-05T15:15:46.062727+0000","last_clean":"2023-10-05T15:15:46.062727+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:46.062727+0000","last_undegraded":"2023-10-05T15:15:46.062727+0000","last_fullsized":"2023-10-05T15:15:46.062727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.213513+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:16:15.213513+0000","last_peered":"2023-10-05T15:16:15.213513+0000","last_clean":"2023-10-05T15:16:15.213513+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:16:15.213513+0000","last_undegraded":"2023-10-05T15:16:15.213513+0000","last_fullsized":"2023-10-05T15:16:15.213513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064063+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:15:46.064063+0000","last_peered":"2023-10-05T15:15:46.064063+0000","last_clean":"2023-10-05T15:15:46.064063+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:15:46.064063+0000","last_undegraded":"2023-10-05T15:15:46.064063+0000","last_fullsized":"2023-10-05T15:15:46.064063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060854+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:15:46.060854+0000","last_peered":"2023-10-05T15:15:46.060854+0000","last_clean":"2023-10-05T15:15:46.060854+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:15:46.060854+0000","last_undegraded":"2023-10-05T15:15:46.060854+0000","last_fullsized":"2023-10-05T15:15:46.060854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214071+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:16:15.214071+0000","last_peered":"2023-10-05T15:16:15.214071+0000","last_clean":"2023-10-05T15:16:15.214071+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:16:15.214071+0000","last_undegraded":"2023-10-05T15:16:15.214071+0000","last_fullsized":"2023-10-05T15:16:15.214071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064833+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:15:46.064833+0000","last_peered":"2023-10-05T15:15:46.064833+0000","last_clean":"2023-10-05T15:15:46.064833+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:15:46.064833+0000","last_undegraded":"2023-10-05T15:15:46.064833+0000","last_fullsized":"2023-10-05T15:15:46.064833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":184,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:30.151822+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:16:30.151822+0000","last_peered":"2023-10-05T15:16:30.151822+0000","last_clean":"2023-10-05T15:16:30.151822+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:16:30.151822+0000","last_undegraded":"2023-10-05T15:16:30.151822+0000","last_fullsized":"2023-10-05T15:16:30.151822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.203997+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:16:15.203997+0000","last_peered":"2023-10-05T15:16:15.203997+0000","last_clean":"2023-10-05T15:16:15.203997+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:16:15.203997+0000","last_undegraded":"2023-10-05T15:16:15.203997+0000","last_fullsized":"2023-10-05T15:16:15.203997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057080+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:15:46.057080+0000","last_peered":"2023-10-05T15:15:46.057080+0000","last_clean":"2023-10-05T15:15:46.057080+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:15:46.057080+0000","last_undegraded":"2023-10-05T15:15:46.057080+0000","last_fullsized":"2023-10-05T15:15:46.057080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058014+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:46.058014+0000","last_peered":"2023-10-05T15:15:46.058014+0000","last_clean":"2023-10-05T15:15:46.058014+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:46.058014+0000","last_undegraded":"2023-10-05T15:15:46.058014+0000","last_fullsized":"2023-10-05T15:15:46.058014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210513+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:16:15.210513+0000","last_peered":"2023-10-05T15:16:15.210513+0000","last_clean":"2023-10-05T15:16:15.210513+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:16:15.210513+0000","last_undegraded":"2023-10-05T15:16:15.210513+0000","last_fullsized":"2023-10-05T15:16:15.210513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060826+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:15:46.060826+0000","last_peered":"2023-10-05T15:15:46.060826+0000","last_clean":"2023-10-05T15:15:46.060826+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:15:46.060826+0000","last_undegraded":"2023-10-05T15:15:46.060826+0000","last_fullsized":"2023-10-05T15:15:46.060826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061383+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:15:46.061383+0000","last_peered":"2023-10-05T15:15:46.061383+0000","last_clean":"2023-10-05T15:15:46.061383+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:15:46.061383+0000","last_undegraded":"2023-10-05T15:15:46.061383+0000","last_fullsized":"2023-10-05T15:15:46.061383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211802+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:16:15.211802+0000","last_peered":"2023-10-05T15:16:15.211802+0000","last_clean":"2023-10-05T15:16:15.211802+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:16:15.211802+0000","last_undegraded":"2023-10-05T15:16:15.211802+0000","last_fullsized":"2023-10-05T15:16:15.211802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057315+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:15:46.057315+0000","last_peered":"2023-10-05T15:15:46.057315+0000","last_clean":"2023-10-05T15:15:46.057315+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:15:46.057315+0000","last_undegraded":"2023-10-05T15:15:46.057315+0000","last_fullsized":"2023-10-05T15:15:46.057315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:30.168149+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:16:30.168149+0000","last_peered":"2023-10-05T15:16:30.168149+0000","last_clean":"2023-10-05T15:16:30.168149+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:16:30.168149+0000","last_undegraded":"2023-10-05T15:16:30.168149+0000","last_fullsized":"2023-10-05T15:16:30.168149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58848,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":141,"num_write":38,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219014+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:16:15.219014+0000","last_peered":"2023-10-05T15:16:15.219014+0000","last_clean":"2023-10-05T15:16:15.219014+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:16:15.219014+0000","last_undegraded":"2023-10-05T15:16:15.219014+0000","last_fullsized":"2023-10-05T15:16:15.219014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062190+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:15:46.062190+0000","last_peered":"2023-10-05T15:15:46.062190+0000","last_clean":"2023-10-05T15:15:46.062190+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:15:46.062190+0000","last_undegraded":"2023-10-05T15:15:46.062190+0000","last_fullsized":"2023-10-05T15:15:46.062190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057412+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:46.057412+0000","last_peered":"2023-10-05T15:15:46.057412+0000","last_clean":"2023-10-05T15:15:46.057412+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:46.057412+0000","last_undegraded":"2023-10-05T15:15:46.057412+0000","last_fullsized":"2023-10-05T15:15:46.057412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214790+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:16:15.214790+0000","last_peered":"2023-10-05T15:16:15.214790+0000","last_clean":"2023-10-05T15:16:15.214790+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:16:15.214790+0000","last_undegraded":"2023-10-05T15:16:15.214790+0000","last_fullsized":"2023-10-05T15:16:15.214790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062770+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:15:46.062770+0000","last_peered":"2023-10-05T15:15:46.062770+0000","last_clean":"2023-10-05T15:15:46.062770+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:15:46.062770+0000","last_undegraded":"2023-10-05T15:15:46.062770+0000","last_fullsized":"2023-10-05T15:15:46.062770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062773+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:46.062773+0000","last_peered":"2023-10-05T15:15:46.062773+0000","last_clean":"2023-10-05T15:15:46.062773+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:46.062773+0000","last_undegraded":"2023-10-05T15:15:46.062773+0000","last_fullsized":"2023-10-05T15:15:46.062773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218714+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:16:15.218714+0000","last_peered":"2023-10-05T15:16:15.218714+0000","last_clean":"2023-10-05T15:16:15.218714+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:16:15.218714+0000","last_undegraded":"2023-10-05T15:16:15.218714+0000","last_fullsized":"2023-10-05T15:16:15.218714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.103509+0000","last_change":"2023-10-05T15:15:47.103509+0000","last_active":"2023-10-05T15:15:47.103509+0000","last_peered":"2023-10-05T15:15:47.103509+0000","last_clean":"2023-10-05T15:15:47.103509+0000","last_became_active":"2023-10-05T15:15:47.103150+0000","last_became_peered":"2023-10-05T15:15:47.103150+0000","last_unstale":"2023-10-05T15:15:47.103509+0000","last_undegraded":"2023-10-05T15:15:47.103509+0000","last_fullsized":"2023-10-05T15:15:47.103509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:59.848397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"90'8","reported_seq":113,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:32.155419+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:16:32.155419+0000","last_peered":"2023-10-05T15:16:32.155419+0000","last_clean":"2023-10-05T15:16:32.155419+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:16:32.155419+0000","last_undegraded":"2023-10-05T15:16:32.155419+0000","last_fullsized":"2023-10-05T15:16:32.155419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1437,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217226+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:16:15.217226+0000","last_peered":"2023-10-05T15:16:15.217226+0000","last_clean":"2023-10-05T15:16:15.217226+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:16:15.217226+0000","last_undegraded":"2023-10-05T15:16:15.217226+0000","last_fullsized":"2023-10-05T15:16:15.217226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066044+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:15:46.066044+0000","last_peered":"2023-10-05T15:15:46.066044+0000","last_clean":"2023-10-05T15:15:46.066044+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:15:46.066044+0000","last_undegraded":"2023-10-05T15:15:46.066044+0000","last_fullsized":"2023-10-05T15:15:46.066044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060708+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:15:46.060708+0000","last_peered":"2023-10-05T15:15:46.060708+0000","last_clean":"2023-10-05T15:15:46.060708+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:15:46.060708+0000","last_undegraded":"2023-10-05T15:15:46.060708+0000","last_fullsized":"2023-10-05T15:15:46.060708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206773+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:16:15.206773+0000","last_peered":"2023-10-05T15:16:15.206773+0000","last_clean":"2023-10-05T15:16:15.206773+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:16:15.206773+0000","last_undegraded":"2023-10-05T15:16:15.206773+0000","last_fullsized":"2023-10-05T15:16:15.206773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062593+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:15:46.062593+0000","last_peered":"2023-10-05T15:15:46.062593+0000","last_clean":"2023-10-05T15:15:46.062593+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:15:46.062593+0000","last_undegraded":"2023-10-05T15:15:46.062593+0000","last_fullsized":"2023-10-05T15:15:46.062593+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064299+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:15:46.064299+0000","last_peered":"2023-10-05T15:15:46.064299+0000","last_clean":"2023-10-05T15:15:46.064299+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:15:46.064299+0000","last_undegraded":"2023-10-05T15:15:46.064299+0000","last_fullsized":"2023-10-05T15:15:46.064299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211465+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:16:15.211465+0000","last_peered":"2023-10-05T15:16:15.211465+0000","last_clean":"2023-10-05T15:16:15.211465+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:16:15.211465+0000","last_undegraded":"2023-10-05T15:16:15.211465+0000","last_fullsized":"2023-10-05T15:16:15.211465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063976+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:15:46.063976+0000","last_peered":"2023-10-05T15:15:46.063976+0000","last_clean":"2023-10-05T15:15:46.063976+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:15:46.063976+0000","last_undegraded":"2023-10-05T15:15:46.063976+0000","last_fullsized":"2023-10-05T15:15:46.063976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058304+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:15:46.058304+0000","last_peered":"2023-10-05T15:15:46.058304+0000","last_clean":"2023-10-05T15:15:46.058304+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:15:46.058304+0000","last_undegraded":"2023-10-05T15:15:46.058304+0000","last_fullsized":"2023-10-05T15:15:46.058304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210452+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:16:15.210452+0000","last_peered":"2023-10-05T15:16:15.210452+0000","last_clean":"2023-10-05T15:16:15.210452+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:16:15.210452+0000","last_undegraded":"2023-10-05T15:16:15.210452+0000","last_fullsized":"2023-10-05T15:16:15.210452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063886+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:15:46.063886+0000","last_peered":"2023-10-05T15:15:46.063886+0000","last_clean":"2023-10-05T15:15:46.063886+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:15:46.063886+0000","last_undegraded":"2023-10-05T15:15:46.063886+0000","last_fullsized":"2023-10-05T15:15:46.063886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:29.145038+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:16:29.145038+0000","last_peered":"2023-10-05T15:16:29.145038+0000","last_clean":"2023-10-05T15:16:29.145038+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:16:29.145038+0000","last_undegraded":"2023-10-05T15:16:29.145038+0000","last_fullsized":"2023-10-05T15:16:29.145038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207552+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:16:15.207552+0000","last_peered":"2023-10-05T15:16:15.207552+0000","last_clean":"2023-10-05T15:16:15.207552+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:16:15.207552+0000","last_undegraded":"2023-10-05T15:16:15.207552+0000","last_fullsized":"2023-10-05T15:16:15.207552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065857+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:15:46.065857+0000","last_peered":"2023-10-05T15:15:46.065857+0000","last_clean":"2023-10-05T15:15:46.065857+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:15:46.065857+0000","last_undegraded":"2023-10-05T15:15:46.065857+0000","last_fullsized":"2023-10-05T15:15:46.065857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211731+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:16:15.211731+0000","last_peered":"2023-10-05T15:16:15.211731+0000","last_clean":"2023-10-05T15:16:15.211731+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:16:15.211731+0000","last_undegraded":"2023-10-05T15:16:15.211731+0000","last_fullsized":"2023-10-05T15:16:15.211731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:29.150284+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:16:29.150284+0000","last_peered":"2023-10-05T15:16:29.150284+0000","last_clean":"2023-10-05T15:16:29.150284+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:16:29.150284+0000","last_undegraded":"2023-10-05T15:16:29.150284+0000","last_fullsized":"2023-10-05T15:16:29.150284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058004+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:15:46.058004+0000","last_peered":"2023-10-05T15:15:46.058004+0000","last_clean":"2023-10-05T15:15:46.058004+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:15:46.058004+0000","last_undegraded":"2023-10-05T15:15:46.058004+0000","last_fullsized":"2023-10-05T15:15:46.058004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.196784+0000","last_change":"2023-10-05T15:15:47.094134+0000","last_active":"2023-10-05T15:16:15.196784+0000","last_peered":"2023-10-05T15:16:15.196784+0000","last_clean":"2023-10-05T15:16:15.196784+0000","last_became_active":"2023-10-05T15:15:47.093826+0000","last_became_peered":"2023-10-05T15:15:47.093826+0000","last_unstale":"2023-10-05T15:16:15.196784+0000","last_undegraded":"2023-10-05T15:16:15.196784+0000","last_fullsized":"2023-10-05T15:16:15.196784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:16:26.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060721+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:46.060721+0000","last_peered":"2023-10-05T15:15:46.060721+0000","last_clean":"2023-10-05T15:15:46.060721+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:46.060721+0000","last_undegraded":"2023-10-05T15:15:46.060721+0000","last_fullsized":"2023-10-05T15:15:46.060721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057603+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:15:46.057603+0000","last_peered":"2023-10-05T15:15:46.057603+0000","last_clean":"2023-10-05T15:15:46.057603+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:15:46.057603+0000","last_undegraded":"2023-10-05T15:15:46.057603+0000","last_fullsized":"2023-10-05T15:15:46.057603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.089429+0000","last_change":"2023-10-05T15:15:47.089429+0000","last_active":"2023-10-05T15:15:47.089429+0000","last_peered":"2023-10-05T15:15:47.089429+0000","last_clean":"2023-10-05T15:15:47.089429+0000","last_became_active":"2023-10-05T15:15:47.088950+0000","last_became_peered":"2023-10-05T15:15:47.088950+0000","last_unstale":"2023-10-05T15:15:47.089429+0000","last_undegraded":"2023-10-05T15:15:47.089429+0000","last_fullsized":"2023-10-05T15:15:47.089429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:36:14.592094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212172+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:16:15.212172+0000","last_peered":"2023-10-05T15:16:15.212172+0000","last_clean":"2023-10-05T15:16:15.212172+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:16:15.212172+0000","last_undegraded":"2023-10-05T15:16:15.212172+0000","last_fullsized":"2023-10-05T15:16:15.212172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057731+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:46.057731+0000","last_peered":"2023-10-05T15:15:46.057731+0000","last_clean":"2023-10-05T15:15:46.057731+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:46.057731+0000","last_undegraded":"2023-10-05T15:15:46.057731+0000","last_fullsized":"2023-10-05T15:15:46.057731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062666+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:15:46.062666+0000","last_peered":"2023-10-05T15:15:46.062666+0000","last_clean":"2023-10-05T15:15:46.062666+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:15:46.062666+0000","last_undegraded":"2023-10-05T15:15:46.062666+0000","last_fullsized":"2023-10-05T15:15:46.062666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064250+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:15:46.064250+0000","last_peered":"2023-10-05T15:15:46.064250+0000","last_clean":"2023-10-05T15:15:46.064250+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:15:46.064250+0000","last_undegraded":"2023-10-05T15:15:46.064250+0000","last_fullsized":"2023-10-05T15:15:46.064250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.204382+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:16:15.204382+0000","last_peered":"2023-10-05T15:16:15.204382+0000","last_clean":"2023-10-05T15:16:15.204382+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:16:15.204382+0000","last_undegraded":"2023-10-05T15:16:15.204382+0000","last_fullsized":"2023-10-05T15:16:15.204382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065067+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:15:46.065067+0000","last_peered":"2023-10-05T15:15:46.065067+0000","last_clean":"2023-10-05T15:15:46.065067+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:15:46.065067+0000","last_undegraded":"2023-10-05T15:15:46.065067+0000","last_fullsized":"2023-10-05T15:15:46.065067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:17.657319+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:16:17.657319+0000","last_peered":"2023-10-05T15:16:17.657319+0000","last_clean":"2023-10-05T15:16:17.657319+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:16:17.657319+0000","last_undegraded":"2023-10-05T15:16:17.657319+0000","last_fullsized":"2023-10-05T15:16:17.657319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219296+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:16:15.219296+0000","last_peered":"2023-10-05T15:16:15.219296+0000","last_clean":"2023-10-05T15:16:15.219296+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:16:15.219296+0000","last_undegraded":"2023-10-05T15:16:15.219296+0000","last_fullsized":"2023-10-05T15:16:15.219296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057131+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:15:46.057131+0000","last_peered":"2023-10-05T15:15:46.057131+0000","last_clean":"2023-10-05T15:15:46.057131+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:15:46.057131+0000","last_undegraded":"2023-10-05T15:15:46.057131+0000","last_fullsized":"2023-10-05T15:15:46.057131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060702+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:46.060702+0000","last_peered":"2023-10-05T15:15:46.060702+0000","last_clean":"2023-10-05T15:15:46.060702+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:46.060702+0000","last_undegraded":"2023-10-05T15:15:46.060702+0000","last_fullsized":"2023-10-05T15:15:46.060702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214108+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:16:15.214108+0000","last_peered":"2023-10-05T15:16:15.214108+0000","last_clean":"2023-10-05T15:16:15.214108+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:16:15.214108+0000","last_undegraded":"2023-10-05T15:16:15.214108+0000","last_fullsized":"2023-10-05T15:16:15.214108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060211+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:15:46.060211+0000","last_peered":"2023-10-05T15:15:46.060211+0000","last_clean":"2023-10-05T15:15:46.060211+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:15:46.060211+0000","last_undegraded":"2023-10-05T15:15:46.060211+0000","last_fullsized":"2023-10-05T15:15:46.060211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067424+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:46.067424+0000","last_peered":"2023-10-05T15:15:46.067424+0000","last_clean":"2023-10-05T15:15:46.067424+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:46.067424+0000","last_undegraded":"2023-10-05T15:15:46.067424+0000","last_fullsized":"2023-10-05T15:15:46.067424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.174876+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:16:15.174876+0000","last_peered":"2023-10-05T15:16:15.174876+0000","last_clean":"2023-10-05T15:16:15.174876+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:16:15.174876+0000","last_undegraded":"2023-10-05T15:16:15.174876+0000","last_fullsized":"2023-10-05T15:16:15.174876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058609+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:15:46.058609+0000","last_peered":"2023-10-05T15:15:46.058609+0000","last_clean":"2023-10-05T15:15:46.058609+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:15:46.058609+0000","last_undegraded":"2023-10-05T15:15:46.058609+0000","last_fullsized":"2023-10-05T15:15:46.058609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064579+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:46.064579+0000","last_peered":"2023-10-05T15:15:46.064579+0000","last_clean":"2023-10-05T15:15:46.064579+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:46.064579+0000","last_undegraded":"2023-10-05T15:15:46.064579+0000","last_fullsized":"2023-10-05T15:15:46.064579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209977+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:16:15.209977+0000","last_peered":"2023-10-05T15:16:15.209977+0000","last_clean":"2023-10-05T15:16:15.209977+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:16:15.209977+0000","last_undegraded":"2023-10-05T15:16:15.209977+0000","last_fullsized":"2023-10-05T15:16:15.209977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.095591+0000","last_change":"2023-10-05T15:15:47.095591+0000","last_active":"2023-10-05T15:15:47.095591+0000","last_peered":"2023-10-05T15:15:47.095591+0000","last_clean":"2023-10-05T15:15:47.095591+0000","last_became_active":"2023-10-05T15:15:47.090503+0000","last_became_peered":"2023-10-05T15:15:47.090503+0000","last_unstale":"2023-10-05T15:15:47.095591+0000","last_undegraded":"2023-10-05T15:15:47.095591+0000","last_fullsized":"2023-10-05T15:15:47.095591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:35.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057335+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:15:46.057335+0000","last_peered":"2023-10-05T15:15:46.057335+0000","last_clean":"2023-10-05T15:15:46.057335+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:15:46.057335+0000","last_undegraded":"2023-10-05T15:15:46.057335+0000","last_fullsized":"2023-10-05T15:15:46.057335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212801+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:16:15.212801+0000","last_peered":"2023-10-05T15:16:15.212801+0000","last_clean":"2023-10-05T15:16:15.212801+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:16:15.212801+0000","last_undegraded":"2023-10-05T15:16:15.212801+0000","last_fullsized":"2023-10-05T15:16:15.212801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060452+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:15:46.060452+0000","last_peered":"2023-10-05T15:15:46.060452+0000","last_clean":"2023-10-05T15:15:46.060452+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:15:46.060452+0000","last_undegraded":"2023-10-05T15:15:46.060452+0000","last_fullsized":"2023-10-05T15:15:46.060452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063970+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:15:46.063970+0000","last_peered":"2023-10-05T15:15:46.063970+0000","last_clean":"2023-10-05T15:15:46.063970+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:15:46.063970+0000","last_undegraded":"2023-10-05T15:15:46.063970+0000","last_fullsized":"2023-10-05T15:15:46.063970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217129+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:16:15.217129+0000","last_peered":"2023-10-05T15:16:15.217129+0000","last_clean":"2023-10-05T15:16:15.217129+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:16:15.217129+0000","last_undegraded":"2023-10-05T15:16:15.217129+0000","last_fullsized":"2023-10-05T15:16:15.217129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067523+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:15:46.067523+0000","last_peered":"2023-10-05T15:15:46.067523+0000","last_clean":"2023-10-05T15:15:46.067523+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:15:46.067523+0000","last_undegraded":"2023-10-05T15:15:46.067523+0000","last_fullsized":"2023-10-05T15:15:46.067523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:33.156630+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:16:33.156630+0000","last_peered":"2023-10-05T15:16:33.156630+0000","last_clean":"2023-10-05T15:16:33.156630+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:16:33.156630+0000","last_undegraded":"2023-10-05T15:16:33.156630+0000","last_fullsized":"2023-10-05T15:16:33.156630+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.220009+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:16:15.220009+0000","last_peered":"2023-10-05T15:16:15.220009+0000","last_clean":"2023-10-05T15:16:15.220009+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:16:15.220009+0000","last_undegraded":"2023-10-05T15:16:15.220009+0000","last_fullsized":"2023-10-05T15:16:15.220009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063292+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:15:46.063292+0000","last_peered":"2023-10-05T15:15:46.063292+0000","last_clean":"2023-10-05T15:15:46.063292+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:15:46.063292+0000","last_undegraded":"2023-10-05T15:15:46.063292+0000","last_fullsized":"2023-10-05T15:15:46.063292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061487+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:15:46.061487+0000","last_peered":"2023-10-05T15:15:46.061487+0000","last_clean":"2023-10-05T15:15:46.061487+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:15:46.061487+0000","last_undegraded":"2023-10-05T15:15:46.061487+0000","last_fullsized":"2023-10-05T15:15:46.061487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217154+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:16:15.217154+0000","last_peered":"2023-10-05T15:16:15.217154+0000","last_clean":"2023-10-05T15:16:15.217154+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:16:15.217154+0000","last_undegraded":"2023-10-05T15:16:15.217154+0000","last_fullsized":"2023-10-05T15:16:15.217154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060696+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:15:46.060696+0000","last_peered":"2023-10-05T15:15:46.060696+0000","last_clean":"2023-10-05T15:15:46.060696+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:15:46.060696+0000","last_undegraded":"2023-10-05T15:15:46.060696+0000","last_fullsized":"2023-10-05T15:15:46.060696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065946+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:46.065946+0000","last_peered":"2023-10-05T15:15:46.065946+0000","last_clean":"2023-10-05T15:15:46.065946+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:46.065946+0000","last_undegraded":"2023-10-05T15:15:46.065946+0000","last_fullsized":"2023-10-05T15:15:46.065946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216870+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:16:15.216870+0000","last_peered":"2023-10-05T15:16:15.216870+0000","last_clean":"2023-10-05T15:16:15.216870+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:16:15.216870+0000","last_undegraded":"2023-10-05T15:16:15.216870+0000","last_fullsized":"2023-10-05T15:16:15.216870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209827+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:16:15.209827+0000","last_peered":"2023-10-05T15:16:15.209827+0000","last_clean":"2023-10-05T15:16:15.209827+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:16:15.209827+0000","last_undegraded":"2023-10-05T15:16:15.209827+0000","last_fullsized":"2023-10-05T15:16:15.209827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209385+0000","last_change":"2023-10-05T15:15:47.094198+0000","last_active":"2023-10-05T15:16:15.209385+0000","last_peered":"2023-10-05T15:16:15.209385+0000","last_clean":"2023-10-05T15:16:15.209385+0000","last_became_active":"2023-10-05T15:15:47.093766+0000","last_became_peered":"2023-10-05T15:15:47.093766+0000","last_unstale":"2023-10-05T15:16:15.209385+0000","last_undegraded":"2023-10-05T15:16:15.209385+0000","last_fullsized":"2023-10-05T15:16:15.209385+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:48:59.949643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210923+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:16:15.210923+0000","last_peered":"2023-10-05T15:16:15.210923+0000","last_clean":"2023-10-05T15:16:15.210923+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:16:15.210923+0000","last_undegraded":"2023-10-05T15:16:15.210923+0000","last_fullsized":"2023-10-05T15:16:15.210923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218232+0000","last_change":"2023-10-05T15:15:47.088923+0000","last_active":"2023-10-05T15:16:15.218232+0000","last_peered":"2023-10-05T15:16:15.218232+0000","last_clean":"2023-10-05T15:16:15.218232+0000","last_became_active":"2023-10-05T15:15:47.088562+0000","last_became_peered":"2023-10-05T15:15:47.088562+0000","last_unstale":"2023-10-05T15:16:15.218232+0000","last_undegraded":"2023-10-05T15:16:15.218232+0000","last_fullsized":"2023-10-05T15:16:15.218232+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:25.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211925+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:16:15.211925+0000","last_peered":"2023-10-05T15:16:15.211925+0000","last_clean":"2023-10-05T15:16:15.211925+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:16:15.211925+0000","last_undegraded":"2023-10-05T15:16:15.211925+0000","last_fullsized":"2023-10-05T15:16:15.211925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207863+0000","last_change":"2023-10-05T15:15:47.065363+0000","last_active":"2023-10-05T15:16:15.207863+0000","last_peered":"2023-10-05T15:16:15.207863+0000","last_clean":"2023-10-05T15:16:15.207863+0000","last_became_active":"2023-10-05T15:15:47.064990+0000","last_became_peered":"2023-10-05T15:15:47.064990+0000","last_unstale":"2023-10-05T15:16:15.207863+0000","last_undegraded":"2023-10-05T15:16:15.207863+0000","last_fullsized":"2023-10-05T15:16:15.207863+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:31.355817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207667+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:16:15.207667+0000","last_peered":"2023-10-05T15:16:15.207667+0000","last_clean":"2023-10-05T15:16:15.207667+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:16:15.207667+0000","last_undegraded":"2023-10-05T15:16:15.207667+0000","last_fullsized":"2023-10-05T15:16:15.207667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211612+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:16:15.211612+0000","last_peered":"2023-10-05T15:16:15.211612+0000","last_clean":"2023-10-05T15:16:15.211612+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:16:15.211612+0000","last_undegraded":"2023-10-05T15:16:15.211612+0000","last_fullsized":"2023-10-05T15:16:15.211612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206529+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:16:15.206529+0000","last_peered":"2023-10-05T15:16:15.206529+0000","last_clean":"2023-10-05T15:16:15.206529+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:16:15.206529+0000","last_undegraded":"2023-10-05T15:16:15.206529+0000","last_fullsized":"2023-10-05T15:16:15.206529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212422+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:16:15.212422+0000","last_peered":"2023-10-05T15:16:15.212422+0000","last_clean":"2023-10-05T15:16:15.212422+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:16:15.212422+0000","last_undegraded":"2023-10-05T15:16:15.212422+0000","last_fullsized":"2023-10-05T15:16:15.212422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219057+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:16:15.219057+0000","last_peered":"2023-10-05T15:16:15.219057+0000","last_clean":"2023-10-05T15:16:15.219057+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:16:15.219057+0000","last_undegraded":"2023-10-05T15:16:15.219057+0000","last_fullsized":"2023-10-05T15:16:15.219057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216405+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:16:15.216405+0000","last_peered":"2023-10-05T15:16:15.216405+0000","last_clean":"2023-10-05T15:16:15.216405+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:16:15.216405+0000","last_undegraded":"2023-10-05T15:16:15.216405+0000","last_fullsized":"2023-10-05T15:16:15.216405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211710+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:16:15.211710+0000","last_peered":"2023-10-05T15:16:15.211710+0000","last_clean":"2023-10-05T15:16:15.211710+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:16:15.211710+0000","last_undegraded":"2023-10-05T15:16:15.211710+0000","last_fullsized":"2023-10-05T15:16:15.211710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66650,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":854,"num_read_kb":498,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":210708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416417,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":491395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.58299999999999996,"15min":0.59399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":1.264,"15min":1.264},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":1.304,"15min":1.304},"last":0.63}]},{"osd":1,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.32600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":1.069,"15min":1.069},"last":0.498}]},{"osd":6,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85399999999999998,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69299999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82499999999999996,"15min":0.83299999999999996},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.91400000000000003,"5min":1.621,"15min":1.621},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96599999999999997,"5min":1.492,"15min":1.492},"last":0.755}]},{"osd":10,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.58899999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92300000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94399999999999995,"5min":1.74,"15min":1.74},"last":0.73499999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1141355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69199999999999995,"5min":1.335,"15min":1.335},"last":0.502},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79200000000000004,"5min":0.874,"15min":0.874},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91800000000000004,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.622}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0009999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68300000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96199999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78700000000000003,"15min":0.79100000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0169999999999999,"5min":1.196,"15min":1.196},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97599999999999998,"5min":1.167,"15min":1.167},"last":0.75700000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808873,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":491325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.372},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.84299999999999997,"5min":1.986,"15min":1.986},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.876,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.84899999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.99299999999999999,"5min":1.216,"15min":1.216},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.30499999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91900000000000004,"5min":2.794,"15min":2.794},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":0.65200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.004,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":1.141,"15min":1.141},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.45800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1419999999999999,"5min":1.407,"15min":1.407},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.74399999999999999},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.266,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.49399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0409999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.196,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78200000000000003,"15min":0.83399999999999996},"min":{"1min":0.49199999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61599999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.94899999999999995,"5min":1.327,"15min":1.327},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2969999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65400000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.628},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66400000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":491703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.871,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.63300000000000001},"min":{"1min":0.46200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46200000000000002,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66900000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.46500000000000002,"15min":0.44700000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84599999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65200000000000002,"15min":0.623},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":2.073,"15min":2.073},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.57599999999999996,"15min":0.54800000000000004},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.71299999999999997,"15min":0.67300000000000004},"min":{"1min":0.51300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.69599999999999995},"min":{"1min":0.54500000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.745}]},{"osd":7,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.746,"15min":0.70199999999999996},"min":{"1min":0.59599999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":2.109,"15min":2.109},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.05,"5min":1.583,"15min":1.583},"last":0.73399999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.72399999999999998,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.749},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.038,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.83499999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.65400000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.73199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0109999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.85599999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78100000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299441,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1088871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.44}]},{"osd":2,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.496},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.622},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76000000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74199999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80100000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462965,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":486829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.503}]},{"osd":2,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.23,"15min":1.23},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.441},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.0960000000000001,"5min":1.147,"15min":1.147},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97299999999999998,"5min":1.296,"15min":1.296},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.264,"15min":1.264},"last":0.745},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.242,"15min":1.242},"last":0.59599999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93899999999999995,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.80900000000000005},"min":{"1min":0.55100000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":1.181,"15min":1.181},"last":0.79200000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.77100000000000002,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":1.323,"15min":1.323},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.44,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89600000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.64200000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.64700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0629999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":552131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.58999999999999997,"15min":0.52700000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59499999999999997,"15min":0.54900000000000004},"min":{"1min":0.51400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83699999999999997,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":11.920999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.752}]},{"osd":5,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.63400000000000001,"15min":0.59399999999999997},"min":{"1min":0.59799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.87},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.879,"5min":0.995,"15min":0.995},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":0.66600000000000004},"min":{"1min":0.46999999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":10.085000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":5.3010000000000002,"15min":5.3010000000000002},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93300000000000005,"5min":1.038,"15min":1.038},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.96399999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71399999999999997,"15min":0.68400000000000005},"min":{"1min":0.55200000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95999999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.66300000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.54400000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.129},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80300000000000005,"15min":0.77500000000000002},"min":{"1min":0.60699999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":4.6630000000000003,"15min":4.6630000000000003},"last":0.998}]},{"osd":10,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89000000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.97899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":488012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.69799999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":11.119999999999999,"5min":11.119999999999999,"15min":11.119999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Oct 5 15:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58099999999999996,"15min":0.51500000000000001},"min":{"1min":0.438,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.64100000000000001,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.048,"5min":11.048,"15min":11.048},"last":0.621}]},{"osd":5,"last update":"Thu Oct 5 15:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.63300000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77900000000000003,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.084,"5min":11.084,"15min":11.084},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.745}]},{"osd":8,"last update":"Thu Oct 5 15:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.871,"15min":0.85499999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5620000000000001,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.76600000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.75900000000000001,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":11.151999999999999,"15min":11.151999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.72599999999999998,"15min":0.73699999999999999},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78900000000000003,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.82199999999999995,"15min":0.76000000000000001},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":10.984999999999999,"5min":10.984999999999999,"15min":10.984999999999999},"last":0.67300000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.61599999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.72799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":553155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55200000000000005,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.58899999999999997,"15min":0.52100000000000002},"min":{"1min":0.40200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.4429999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.50900000000000001},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56799999999999995,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.59199999999999997,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.438},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.42999999999999999},"min":{"1min":0.31900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.45500000000000002},"min":{"1min":0.35499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Thu Oct 5 15:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":3.831,"15min":3.831},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.63400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.878,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.88500000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.56000000000000005,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.753},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.628}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.745},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":0.747},"min":{"1min":0.63900000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91800000000000004,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.68400000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85199999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":486206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29199999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61799999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.30399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.55500000000000005},"min":{"1min":0.51400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80700000000000005,"5min":1.097,"15min":1.097},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66900000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77600000000000002,"5min":1.087,"15min":1.087},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76300000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":1.097,"15min":1.097},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77400000000000002,"5min":1.149,"15min":1.149},"last":0.749},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90400000000000003,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82499999999999996,"5min":1.04,"15min":1.04},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94799999999999995,"5min":1.044,"15min":1.044},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.71499999999999997,"15min":0.78100000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.878,"5min":1.605,"15min":1.605},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.69399999999999995,"15min":0.76000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.433}]},{"osd":10,"last update":"Thu Oct 5 15:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.081,"15min":1.081},"last":0.67200000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64900000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":491479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.379},"min":{"1min":0.317,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38}]},{"osd":2,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.57699999999999996},"min":{"1min":0.505,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89700000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.87},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.57099999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.76300000000000001,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4750000000000001,"5min":1.528,"15min":1.528},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.452,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.73199999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.88600000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724602,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1083591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78900000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.63800000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59299999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55700000000000005,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.75900000000000001,"5min":1.044,"15min":1.044},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.45000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70899999999999996,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.028,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.675,"15min":1.675},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60499999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2849999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8759999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:16:37.130 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-05T15:16:37.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:16:37.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 -- 172.21.15.60:0/139720108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc4100fb0 msgr2=0x7f9cc4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 --2- 172.21.15.60:0/139720108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc4100fb0 0x7f9cc4101410 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40099c0 tx=0x7f9cb4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 -- 172.21.15.60:0/139720108 shutdown_connections 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 --2- 172.21.15.60:0/139720108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc4101950 0x7f9cc4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 --2- 172.21.15.60:0/139720108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 --2- 172.21.15.60:0/139720108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc4100fb0 0x7f9cc4101410 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 -- 172.21.15.60:0/139720108 >> 172.21.15.60:0/139720108 conn(0x7f9cc40fb310 msgr2=0x7f9cc40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 -- 172.21.15.60:0/139720108 shutdown_connections 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.283+0000 7f9cca816700 1 -- 172.21.15.60:0/139720108 wait complete. 2023-10-05T15:16:37.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 Processor -- start 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 -- start start 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc4068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cc4100fb0 0x7f9cc419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc4101950 0x7f9cc419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc419e630 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc419e7a0 con 0x7f9cc4100fb0 2023-10-05T15:16:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cca816700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc419e960 con 0x7f9cc4101950 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cc3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc4068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cc3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc4068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38000/0 (socket says 172.21.15.60:38000) 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cc3fff700 1 -- 172.21.15.60:0/1382958706 learned_addr learned my addr 172.21.15.60:0/1382958706 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.284+0000 7f9cc37fe700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cc4100fb0 0x7f9cc419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc8db3700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc4101950 0x7f9cc419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc3fff700 1 -- 172.21.15.60:0/1382958706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc4101950 msgr2=0x7f9cc419de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc3fff700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc4101950 0x7f9cc419de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc3fff700 1 -- 172.21.15.60:0/1382958706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cc4100fb0 msgr2=0x7f9cc419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc3fff700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cc4100fb0 0x7f9cc419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc3fff700 1 -- 172.21.15.60:0/1382958706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40095f0 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc3fff700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc4068bb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c990 tx=0x7f9cac00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac007b00 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc419ec40 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cac007c60 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00fea0 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.285+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc419f1a0 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.286+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4107290 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.287+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9cac00f450 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.288+0000 7f9cc17fa700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9cb00a14d0 0x7f9cb00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.288+0000 7f9cc37fe700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9cb00a14d0 0x7f9cb00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.288+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f9cac0cd090 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.289+0000 7f9cc37fe700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9cb00a14d0 0x7f9cb00a3990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400b580 tx=0x7f9cb4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.292+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9cac096480 con 0x7f9cc40ffdc0 2023-10-05T15:16:37.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:37 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3708253410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:37.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:37 smithi060 ceph-mon[99238]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:37.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.489+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cc402d250 con 0x7f9cb00a14d0 2023-10-05T15:16:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.504+0000 7f9cc17fa700 1 -- 172.21.15.60:0/1382958706 <== mgr.14152 v2:172.21.15.60:6800/3043189857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427291 (secure 0 0 0) 0x7f9cc402d250 con 0x7f9cb00a14d0 2023-10-05T15:16:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9cb00a14d0 msgr2=0x7f9cb00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9cb00a14d0 0x7f9cb00a3990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400b580 tx=0x7f9cb4000bc0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 msgr2=0x7f9cc4068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc4068bb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c990 tx=0x7f9cac00cca0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 shutdown_connections 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc4101950 0x7f9cc419de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f9cb00a14d0 0x7f9cb00a3990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cc40ffdc0 0x7f9cc4068bb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 --2- 172.21.15.60:0/1382958706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cc4100fb0 0x7f9cc419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 >> 172.21.15.60:0/1382958706 conn(0x7f9cc40fb310 msgr2=0x7f9cc41043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:37.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 shutdown_connections 2023-10-05T15:16:37.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.508+0000 7f9cca816700 1 -- 172.21.15.60:0/1382958706 wait complete. 2023-10-05T15:16:37.516 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-05T15:16:37.523 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-05T15:16:37.200832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662961,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1022,"num_read_kb":644,"num_write":433,"num_write_kb":3090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338168,"kb_used_data":13976,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603656,"statfs":{"total":1151940427776,"available":1151594143744,"internally_reserved":0,"allocated":14311424,"data_stored":7852385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6015,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":78,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003259"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211407+0000","last_change":"2023-10-05T15:14:48.007922+0000","last_active":"2023-10-05T15:16:15.211407+0000","last_peered":"2023-10-05T15:16:15.211407+0000","last_clean":"2023-10-05T15:16:15.211407+0000","last_became_active":"2023-10-05T15:14:48.007204+0000","last_became_peered":"2023-10-05T15:14:48.007204+0000","last_unstale":"2023-10-05T15:16:15.211407+0000","last_undegraded":"2023-10-05T15:16:15.211407+0000","last_fullsized":"2023-10-05T15:16:15.211407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:43:15.001142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209294+0000","last_change":"2023-10-05T15:14:48.000091+0000","last_active":"2023-10-05T15:16:15.209294+0000","last_peered":"2023-10-05T15:16:15.209294+0000","last_clean":"2023-10-05T15:16:15.209294+0000","last_became_active":"2023-10-05T15:14:47.999353+0000","last_became_peered":"2023-10-05T15:14:47.999353+0000","last_unstale":"2023-10-05T15:16:15.209294+0000","last_undegraded":"2023-10-05T15:16:15.209294+0000","last_fullsized":"2023-10-05T15:16:15.209294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:31.204628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210807+0000","last_change":"2023-10-05T15:14:48.006757+0000","last_active":"2023-10-05T15:16:15.210807+0000","last_peered":"2023-10-05T15:16:15.210807+0000","last_clean":"2023-10-05T15:16:15.210807+0000","last_became_active":"2023-10-05T15:14:48.006456+0000","last_became_peered":"2023-10-05T15:14:48.006456+0000","last_unstale":"2023-10-05T15:16:15.210807+0000","last_undegraded":"2023-10-05T15:16:15.210807+0000","last_fullsized":"2023-10-05T15:16:15.210807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:28.226419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210321+0000","last_change":"2023-10-05T15:14:47.996566+0000","last_active":"2023-10-05T15:16:15.210321+0000","last_peered":"2023-10-05T15:16:15.210321+0000","last_clean":"2023-10-05T15:16:15.210321+0000","last_became_active":"2023-10-05T15:14:47.996243+0000","last_became_peered":"2023-10-05T15:14:47.996243+0000","last_unstale":"2023-10-05T15:16:15.210321+0000","last_undegraded":"2023-10-05T15:16:15.210321+0000","last_fullsized":"2023-10-05T15:16:15.210321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:06.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207502+0000","last_change":"2023-10-05T15:14:47.997671+0000","last_active":"2023-10-05T15:16:15.207502+0000","last_peered":"2023-10-05T15:16:15.207502+0000","last_clean":"2023-10-05T15:16:15.207502+0000","last_became_active":"2023-10-05T15:14:47.997304+0000","last_became_peered":"2023-10-05T15:14:47.997304+0000","last_unstale":"2023-10-05T15:16:15.207502+0000","last_undegraded":"2023-10-05T15:16:15.207502+0000","last_fullsized":"2023-10-05T15:16:15.207502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:51.296816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206224+0000","last_change":"2023-10-05T15:14:48.008770+0000","last_active":"2023-10-05T15:16:15.206224+0000","last_peered":"2023-10-05T15:16:15.206224+0000","last_clean":"2023-10-05T15:16:15.206224+0000","last_became_active":"2023-10-05T15:14:48.008469+0000","last_became_peered":"2023-10-05T15:14:48.008469+0000","last_unstale":"2023-10-05T15:16:15.206224+0000","last_undegraded":"2023-10-05T15:16:15.206224+0000","last_fullsized":"2023-10-05T15:16:15.206224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:12:16.101316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212120+0000","last_change":"2023-10-05T15:14:48.009512+0000","last_active":"2023-10-05T15:16:15.212120+0000","last_peered":"2023-10-05T15:16:15.212120+0000","last_clean":"2023-10-05T15:16:15.212120+0000","last_became_active":"2023-10-05T15:14:48.009251+0000","last_became_peered":"2023-10-05T15:14:48.009251+0000","last_unstale":"2023-10-05T15:16:15.212120+0000","last_undegraded":"2023-10-05T15:16:15.212120+0000","last_fullsized":"2023-10-05T15:16:15.212120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:19.343140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211290+0000","last_change":"2023-10-05T15:14:48.003457+0000","last_active":"2023-10-05T15:16:15.211290+0000","last_peered":"2023-10-05T15:16:15.211290+0000","last_clean":"2023-10-05T15:16:15.211290+0000","last_became_active":"2023-10-05T15:14:48.003149+0000","last_became_peered":"2023-10-05T15:14:48.003149+0000","last_unstale":"2023-10-05T15:16:15.211290+0000","last_undegraded":"2023-10-05T15:16:15.211290+0000","last_fullsized":"2023-10-05T15:16:15.211290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:33:26.884066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.208489+0000","last_change":"2023-10-05T15:14:48.002566+0000","last_active":"2023-10-05T15:16:15.208489+0000","last_peered":"2023-10-05T15:16:15.208489+0000","last_clean":"2023-10-05T15:16:15.208489+0000","last_became_active":"2023-10-05T15:14:48.002301+0000","last_became_peered":"2023-10-05T15:14:48.002301+0000","last_unstale":"2023-10-05T15:16:15.208489+0000","last_undegraded":"2023-10-05T15:16:15.208489+0000","last_fullsized":"2023-10-05T15:16:15.208489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:52.595982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206634+0000","last_change":"2023-10-05T15:14:47.996016+0000","last_active":"2023-10-05T15:16:15.206634+0000","last_peered":"2023-10-05T15:16:15.206634+0000","last_clean":"2023-10-05T15:16:15.206634+0000","last_became_active":"2023-10-05T15:14:47.995705+0000","last_became_peered":"2023-10-05T15:14:47.995705+0000","last_unstale":"2023-10-05T15:16:15.206634+0000","last_undegraded":"2023-10-05T15:16:15.206634+0000","last_fullsized":"2023-10-05T15:16:15.206634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:57:44.090573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218897+0000","last_change":"2023-10-05T15:14:48.007187+0000","last_active":"2023-10-05T15:16:15.218897+0000","last_peered":"2023-10-05T15:16:15.218897+0000","last_clean":"2023-10-05T15:16:15.218897+0000","last_became_active":"2023-10-05T15:14:48.006533+0000","last_became_peered":"2023-10-05T15:14:48.006533+0000","last_unstale":"2023-10-05T15:16:15.218897+0000","last_undegraded":"2023-10-05T15:16:15.218897+0000","last_fullsized":"2023-10-05T15:16:15.218897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:46:42.867642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.201262+0000","last_change":"2023-10-05T15:15:47.090497+0000","last_active":"2023-10-05T15:16:15.201262+0000","last_peered":"2023-10-05T15:16:15.201262+0000","last_clean":"2023-10-05T15:16:15.201262+0000","last_became_active":"2023-10-05T15:15:47.090160+0000","last_became_peered":"2023-10-05T15:15:47.090160+0000","last_unstale":"2023-10-05T15:16:15.201262+0000","last_undegraded":"2023-10-05T15:16:15.201262+0000","last_fullsized":"2023-10-05T15:16:15.201262+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:15.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209232+0000","last_change":"2023-10-05T15:14:48.005523+0000","last_active":"2023-10-05T15:16:15.209232+0000","last_peered":"2023-10-05T15:16:15.209232+0000","last_clean":"2023-10-05T15:16:15.209232+0000","last_became_active":"2023-10-05T15:14:48.005183+0000","last_became_peered":"2023-10-05T15:14:48.005183+0000","last_unstale":"2023-10-05T15:16:15.209232+0000","last_undegraded":"2023-10-05T15:16:15.209232+0000","last_fullsized":"2023-10-05T15:16:15.209232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:09.645066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207385+0000","last_change":"2023-10-05T15:14:48.002402+0000","last_active":"2023-10-05T15:16:15.207385+0000","last_peered":"2023-10-05T15:16:15.207385+0000","last_clean":"2023-10-05T15:16:15.207385+0000","last_became_active":"2023-10-05T15:14:48.002173+0000","last_became_peered":"2023-10-05T15:14:48.002173+0000","last_unstale":"2023-10-05T15:16:15.207385+0000","last_undegraded":"2023-10-05T15:16:15.207385+0000","last_fullsized":"2023-10-05T15:16:15.207385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:50.059299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210798+0000","last_change":"2023-10-05T15:14:47.999032+0000","last_active":"2023-10-05T15:16:15.210798+0000","last_peered":"2023-10-05T15:16:15.210798+0000","last_clean":"2023-10-05T15:16:15.210798+0000","last_became_active":"2023-10-05T15:14:47.998775+0000","last_became_peered":"2023-10-05T15:14:47.998775+0000","last_unstale":"2023-10-05T15:16:15.210798+0000","last_undegraded":"2023-10-05T15:16:15.210798+0000","last_fullsized":"2023-10-05T15:16:15.210798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:11.236797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216623+0000","last_change":"2023-10-05T15:14:48.004213+0000","last_active":"2023-10-05T15:16:15.216623+0000","last_peered":"2023-10-05T15:16:15.216623+0000","last_clean":"2023-10-05T15:16:15.216623+0000","last_became_active":"2023-10-05T15:14:48.003930+0000","last_became_peered":"2023-10-05T15:14:48.003930+0000","last_unstale":"2023-10-05T15:16:15.216623+0000","last_undegraded":"2023-10-05T15:16:15.216623+0000","last_fullsized":"2023-10-05T15:16:15.216623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:04:10.650600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211501+0000","last_change":"2023-10-05T15:14:48.008114+0000","last_active":"2023-10-05T15:16:15.211501+0000","last_peered":"2023-10-05T15:16:15.211501+0000","last_clean":"2023-10-05T15:16:15.211501+0000","last_became_active":"2023-10-05T15:14:48.007625+0000","last_became_peered":"2023-10-05T15:14:48.007625+0000","last_unstale":"2023-10-05T15:16:15.211501+0000","last_undegraded":"2023-10-05T15:16:15.211501+0000","last_fullsized":"2023-10-05T15:16:15.211501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:48:21.258713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206735+0000","last_change":"2023-10-05T15:14:47.995565+0000","last_active":"2023-10-05T15:16:15.206735+0000","last_peered":"2023-10-05T15:16:15.206735+0000","last_clean":"2023-10-05T15:16:15.206735+0000","last_became_active":"2023-10-05T15:14:47.995239+0000","last_became_peered":"2023-10-05T15:14:47.995239+0000","last_unstale":"2023-10-05T15:16:15.206735+0000","last_undegraded":"2023-10-05T15:16:15.206735+0000","last_fullsized":"2023-10-05T15:16:15.206735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:15.998017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211345+0000","last_change":"2023-10-05T15:14:48.004026+0000","last_active":"2023-10-05T15:16:15.211345+0000","last_peered":"2023-10-05T15:16:15.211345+0000","last_clean":"2023-10-05T15:16:15.211345+0000","last_became_active":"2023-10-05T15:14:48.003717+0000","last_became_peered":"2023-10-05T15:14:48.003717+0000","last_unstale":"2023-10-05T15:16:15.211345+0000","last_undegraded":"2023-10-05T15:16:15.211345+0000","last_fullsized":"2023-10-05T15:16:15.211345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:48:07.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057151+0000","last_change":"2023-10-05T15:14:52.243261+0000","last_active":"2023-10-05T15:15:46.057151+0000","last_peered":"2023-10-05T15:15:46.057151+0000","last_clean":"2023-10-05T15:15:46.057151+0000","last_became_active":"2023-10-05T15:14:52.242854+0000","last_became_peered":"2023-10-05T15:14:52.242854+0000","last_unstale":"2023-10-05T15:15:46.057151+0000","last_undegraded":"2023-10-05T15:15:46.057151+0000","last_fullsized":"2023-10-05T15:15:46.057151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:02.332743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":117,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:33.150058+0000","last_change":"2023-10-05T15:14:47.203000+0000","last_active":"2023-10-05T15:16:33.150058+0000","last_peered":"2023-10-05T15:16:33.150058+0000","last_clean":"2023-10-05T15:16:33.150058+0000","last_became_active":"2023-10-05T15:14:47.202020+0000","last_became_peered":"2023-10-05T15:14:47.202020+0000","last_unstale":"2023-10-05T15:16:33.150058+0000","last_undegraded":"2023-10-05T15:16:33.150058+0000","last_fullsized":"2023-10-05T15:16:33.150058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:33:46.543826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209723+0000","last_change":"2023-10-05T15:14:48.003252+0000","last_active":"2023-10-05T15:16:15.209723+0000","last_peered":"2023-10-05T15:16:15.209723+0000","last_clean":"2023-10-05T15:16:15.209723+0000","last_became_active":"2023-10-05T15:14:48.002927+0000","last_became_peered":"2023-10-05T15:14:48.002927+0000","last_unstale":"2023-10-05T15:16:15.209723+0000","last_undegraded":"2023-10-05T15:16:15.209723+0000","last_fullsized":"2023-10-05T15:16:15.209723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:43:52.232188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060005+0000","last_change":"2023-10-05T15:14:52.243111+0000","last_active":"2023-10-05T15:15:46.060005+0000","last_peered":"2023-10-05T15:15:46.060005+0000","last_clean":"2023-10-05T15:15:46.060005+0000","last_became_active":"2023-10-05T15:14:52.242673+0000","last_became_peered":"2023-10-05T15:14:52.242673+0000","last_unstale":"2023-10-05T15:15:46.060005+0000","last_undegraded":"2023-10-05T15:15:46.060005+0000","last_fullsized":"2023-10-05T15:15:46.060005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:24.658925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066765+0000","last_change":"2023-10-05T15:14:47.200894+0000","last_active":"2023-10-05T15:15:46.066765+0000","last_peered":"2023-10-05T15:15:46.066765+0000","last_clean":"2023-10-05T15:15:46.066765+0000","last_became_active":"2023-10-05T15:14:47.200598+0000","last_became_peered":"2023-10-05T15:14:47.200598+0000","last_unstale":"2023-10-05T15:15:46.066765+0000","last_undegraded":"2023-10-05T15:15:46.066765+0000","last_fullsized":"2023-10-05T15:15:46.066765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:24:24.979062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209963+0000","last_change":"2023-10-05T15:14:48.009294+0000","last_active":"2023-10-05T15:16:15.209963+0000","last_peered":"2023-10-05T15:16:15.209963+0000","last_clean":"2023-10-05T15:16:15.209963+0000","last_became_active":"2023-10-05T15:14:48.008057+0000","last_became_peered":"2023-10-05T15:14:48.008057+0000","last_unstale":"2023-10-05T15:16:15.209963+0000","last_undegraded":"2023-10-05T15:16:15.209963+0000","last_fullsized":"2023-10-05T15:16:15.209963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:30:09.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060966+0000","last_change":"2023-10-05T15:14:52.253196+0000","last_active":"2023-10-05T15:15:46.060966+0000","last_peered":"2023-10-05T15:15:46.060966+0000","last_clean":"2023-10-05T15:15:46.060966+0000","last_became_active":"2023-10-05T15:14:52.252777+0000","last_became_peered":"2023-10-05T15:14:52.252777+0000","last_unstale":"2023-10-05T15:15:46.060966+0000","last_undegraded":"2023-10-05T15:15:46.060966+0000","last_fullsized":"2023-10-05T15:15:46.060966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:56:48.699818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064382+0000","last_change":"2023-10-05T15:14:47.202982+0000","last_active":"2023-10-05T15:15:46.064382+0000","last_peered":"2023-10-05T15:15:46.064382+0000","last_clean":"2023-10-05T15:15:46.064382+0000","last_became_active":"2023-10-05T15:14:47.202687+0000","last_became_peered":"2023-10-05T15:14:47.202687+0000","last_unstale":"2023-10-05T15:15:46.064382+0000","last_undegraded":"2023-10-05T15:15:46.064382+0000","last_fullsized":"2023-10-05T15:15:46.064382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:22:32.825853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206076+0000","last_change":"2023-10-05T15:14:48.003286+0000","last_active":"2023-10-05T15:16:15.206076+0000","last_peered":"2023-10-05T15:16:15.206076+0000","last_clean":"2023-10-05T15:16:15.206076+0000","last_became_active":"2023-10-05T15:14:48.002825+0000","last_became_peered":"2023-10-05T15:14:48.002825+0000","last_unstale":"2023-10-05T15:16:15.206076+0000","last_undegraded":"2023-10-05T15:16:15.206076+0000","last_fullsized":"2023-10-05T15:16:15.206076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:06.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060253+0000","last_change":"2023-10-05T15:14:52.245342+0000","last_active":"2023-10-05T15:15:46.060253+0000","last_peered":"2023-10-05T15:15:46.060253+0000","last_clean":"2023-10-05T15:15:46.060253+0000","last_became_active":"2023-10-05T15:14:52.244938+0000","last_became_peered":"2023-10-05T15:14:52.244938+0000","last_unstale":"2023-10-05T15:15:46.060253+0000","last_undegraded":"2023-10-05T15:15:46.060253+0000","last_fullsized":"2023-10-05T15:15:46.060253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:05:54.614979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064078+0000","last_change":"2023-10-05T15:14:47.203103+0000","last_active":"2023-10-05T15:15:46.064078+0000","last_peered":"2023-10-05T15:15:46.064078+0000","last_clean":"2023-10-05T15:15:46.064078+0000","last_became_active":"2023-10-05T15:14:47.202246+0000","last_became_peered":"2023-10-05T15:14:47.202246+0000","last_unstale":"2023-10-05T15:15:46.064078+0000","last_undegraded":"2023-10-05T15:15:46.064078+0000","last_fullsized":"2023-10-05T15:15:46.064078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:51:23.076501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.208020+0000","last_change":"2023-10-05T15:14:48.005782+0000","last_active":"2023-10-05T15:16:15.208020+0000","last_peered":"2023-10-05T15:16:15.208020+0000","last_clean":"2023-10-05T15:16:15.208020+0000","last_became_active":"2023-10-05T15:14:48.005460+0000","last_became_peered":"2023-10-05T15:14:48.005460+0000","last_unstale":"2023-10-05T15:16:15.208020+0000","last_undegraded":"2023-10-05T15:16:15.208020+0000","last_fullsized":"2023-10-05T15:16:15.208020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:15:51.139183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057601+0000","last_change":"2023-10-05T15:14:52.244818+0000","last_active":"2023-10-05T15:15:46.057601+0000","last_peered":"2023-10-05T15:15:46.057601+0000","last_clean":"2023-10-05T15:15:46.057601+0000","last_became_active":"2023-10-05T15:14:52.244396+0000","last_became_peered":"2023-10-05T15:14:52.244396+0000","last_unstale":"2023-10-05T15:15:46.057601+0000","last_undegraded":"2023-10-05T15:15:46.057601+0000","last_fullsized":"2023-10-05T15:15:46.057601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:13.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":112,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:32.155407+0000","last_change":"2023-10-05T15:14:47.194956+0000","last_active":"2023-10-05T15:16:32.155407+0000","last_peered":"2023-10-05T15:16:32.155407+0000","last_clean":"2023-10-05T15:16:32.155407+0000","last_became_active":"2023-10-05T15:14:47.194673+0000","last_became_peered":"2023-10-05T15:14:47.194673+0000","last_unstale":"2023-10-05T15:16:32.155407+0000","last_undegraded":"2023-10-05T15:16:32.155407+0000","last_fullsized":"2023-10-05T15:16:32.155407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:53:28.823948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207045+0000","last_change":"2023-10-05T15:15:47.088761+0000","last_active":"2023-10-05T15:16:15.207045+0000","last_peered":"2023-10-05T15:16:15.207045+0000","last_clean":"2023-10-05T15:16:15.207045+0000","last_became_active":"2023-10-05T15:15:47.088438+0000","last_became_peered":"2023-10-05T15:15:47.088438+0000","last_unstale":"2023-10-05T15:16:15.207045+0000","last_undegraded":"2023-10-05T15:16:15.207045+0000","last_fullsized":"2023-10-05T15:16:15.207045+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:22.419833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057415+0000","last_change":"2023-10-05T15:14:52.243013+0000","last_active":"2023-10-05T15:15:46.057415+0000","last_peered":"2023-10-05T15:15:46.057415+0000","last_clean":"2023-10-05T15:15:46.057415+0000","last_became_active":"2023-10-05T15:14:52.242548+0000","last_became_peered":"2023-10-05T15:14:52.242548+0000","last_unstale":"2023-10-05T15:15:46.057415+0000","last_undegraded":"2023-10-05T15:15:46.057415+0000","last_fullsized":"2023-10-05T15:15:46.057415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:12:46.689680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063306+0000","last_change":"2023-10-05T15:14:47.204285+0000","last_active":"2023-10-05T15:15:46.063306+0000","last_peered":"2023-10-05T15:15:46.063306+0000","last_clean":"2023-10-05T15:15:46.063306+0000","last_became_active":"2023-10-05T15:14:47.203962+0000","last_became_peered":"2023-10-05T15:14:47.203962+0000","last_unstale":"2023-10-05T15:15:46.063306+0000","last_undegraded":"2023-10-05T15:15:46.063306+0000","last_fullsized":"2023-10-05T15:15:46.063306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:08.809081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211892+0000","last_change":"2023-10-05T15:14:48.006271+0000","last_active":"2023-10-05T15:16:15.211892+0000","last_peered":"2023-10-05T15:16:15.211892+0000","last_clean":"2023-10-05T15:16:15.211892+0000","last_became_active":"2023-10-05T15:14:48.005968+0000","last_became_peered":"2023-10-05T15:14:48.005968+0000","last_unstale":"2023-10-05T15:16:15.211892+0000","last_undegraded":"2023-10-05T15:16:15.211892+0000","last_fullsized":"2023-10-05T15:16:15.211892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:42.141442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063486+0000","last_change":"2023-10-05T15:14:52.251845+0000","last_active":"2023-10-05T15:15:46.063486+0000","last_peered":"2023-10-05T15:15:46.063486+0000","last_clean":"2023-10-05T15:15:46.063486+0000","last_became_active":"2023-10-05T15:14:52.251404+0000","last_became_peered":"2023-10-05T15:14:52.251404+0000","last_unstale":"2023-10-05T15:15:46.063486+0000","last_undegraded":"2023-10-05T15:15:46.063486+0000","last_fullsized":"2023-10-05T15:15:46.063486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:14:48.801808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062727+0000","last_change":"2023-10-05T15:14:47.201876+0000","last_active":"2023-10-05T15:15:46.062727+0000","last_peered":"2023-10-05T15:15:46.062727+0000","last_clean":"2023-10-05T15:15:46.062727+0000","last_became_active":"2023-10-05T15:14:47.201530+0000","last_became_peered":"2023-10-05T15:14:47.201530+0000","last_unstale":"2023-10-05T15:15:46.062727+0000","last_undegraded":"2023-10-05T15:15:46.062727+0000","last_fullsized":"2023-10-05T15:15:46.062727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:30:40.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.213513+0000","last_change":"2023-10-05T15:14:48.010364+0000","last_active":"2023-10-05T15:16:15.213513+0000","last_peered":"2023-10-05T15:16:15.213513+0000","last_clean":"2023-10-05T15:16:15.213513+0000","last_became_active":"2023-10-05T15:14:48.010100+0000","last_became_peered":"2023-10-05T15:14:48.010100+0000","last_unstale":"2023-10-05T15:16:15.213513+0000","last_undegraded":"2023-10-05T15:16:15.213513+0000","last_fullsized":"2023-10-05T15:16:15.213513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:22.862206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064063+0000","last_change":"2023-10-05T15:14:52.236558+0000","last_active":"2023-10-05T15:15:46.064063+0000","last_peered":"2023-10-05T15:15:46.064063+0000","last_clean":"2023-10-05T15:15:46.064063+0000","last_became_active":"2023-10-05T15:14:52.236081+0000","last_became_peered":"2023-10-05T15:14:52.236081+0000","last_unstale":"2023-10-05T15:15:46.064063+0000","last_undegraded":"2023-10-05T15:15:46.064063+0000","last_fullsized":"2023-10-05T15:15:46.064063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:29:57.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060854+0000","last_change":"2023-10-05T15:14:47.192551+0000","last_active":"2023-10-05T15:15:46.060854+0000","last_peered":"2023-10-05T15:15:46.060854+0000","last_clean":"2023-10-05T15:15:46.060854+0000","last_became_active":"2023-10-05T15:14:47.192158+0000","last_became_peered":"2023-10-05T15:14:47.192158+0000","last_unstale":"2023-10-05T15:15:46.060854+0000","last_undegraded":"2023-10-05T15:15:46.060854+0000","last_fullsized":"2023-10-05T15:15:46.060854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:51.839013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214071+0000","last_change":"2023-10-05T15:14:47.994800+0000","last_active":"2023-10-05T15:16:15.214071+0000","last_peered":"2023-10-05T15:16:15.214071+0000","last_clean":"2023-10-05T15:16:15.214071+0000","last_became_active":"2023-10-05T15:14:47.994547+0000","last_became_peered":"2023-10-05T15:14:47.994547+0000","last_unstale":"2023-10-05T15:16:15.214071+0000","last_undegraded":"2023-10-05T15:16:15.214071+0000","last_fullsized":"2023-10-05T15:16:15.214071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:41:22.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064833+0000","last_change":"2023-10-05T15:14:52.251223+0000","last_active":"2023-10-05T15:15:46.064833+0000","last_peered":"2023-10-05T15:15:46.064833+0000","last_clean":"2023-10-05T15:15:46.064833+0000","last_became_active":"2023-10-05T15:14:52.250816+0000","last_became_peered":"2023-10-05T15:14:52.250816+0000","last_unstale":"2023-10-05T15:15:46.064833+0000","last_undegraded":"2023-10-05T15:15:46.064833+0000","last_fullsized":"2023-10-05T15:15:46.064833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:02:21.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":194,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:35.159001+0000","last_change":"2023-10-05T15:14:47.198559+0000","last_active":"2023-10-05T15:16:35.159001+0000","last_peered":"2023-10-05T15:16:35.159001+0000","last_clean":"2023-10-05T15:16:35.159001+0000","last_became_active":"2023-10-05T15:14:47.198282+0000","last_became_peered":"2023-10-05T15:14:47.198282+0000","last_unstale":"2023-10-05T15:16:35.159001+0000","last_undegraded":"2023-10-05T15:16:35.159001+0000","last_fullsized":"2023-10-05T15:16:35.159001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:58:05.394962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.203997+0000","last_change":"2023-10-05T15:14:48.001549+0000","last_active":"2023-10-05T15:16:15.203997+0000","last_peered":"2023-10-05T15:16:15.203997+0000","last_clean":"2023-10-05T15:16:15.203997+0000","last_became_active":"2023-10-05T15:14:48.001204+0000","last_became_peered":"2023-10-05T15:14:48.001204+0000","last_unstale":"2023-10-05T15:16:15.203997+0000","last_undegraded":"2023-10-05T15:16:15.203997+0000","last_fullsized":"2023-10-05T15:16:15.203997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:33.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057080+0000","last_change":"2023-10-05T15:14:52.247293+0000","last_active":"2023-10-05T15:15:46.057080+0000","last_peered":"2023-10-05T15:15:46.057080+0000","last_clean":"2023-10-05T15:15:46.057080+0000","last_became_active":"2023-10-05T15:14:52.246725+0000","last_became_peered":"2023-10-05T15:14:52.246725+0000","last_unstale":"2023-10-05T15:15:46.057080+0000","last_undegraded":"2023-10-05T15:15:46.057080+0000","last_fullsized":"2023-10-05T15:15:46.057080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:03:58.221531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058014+0000","last_change":"2023-10-05T15:14:47.201894+0000","last_active":"2023-10-05T15:15:46.058014+0000","last_peered":"2023-10-05T15:15:46.058014+0000","last_clean":"2023-10-05T15:15:46.058014+0000","last_became_active":"2023-10-05T15:14:47.201552+0000","last_became_peered":"2023-10-05T15:14:47.201552+0000","last_unstale":"2023-10-05T15:15:46.058014+0000","last_undegraded":"2023-10-05T15:15:46.058014+0000","last_fullsized":"2023-10-05T15:15:46.058014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:42:42.107027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210513+0000","last_change":"2023-10-05T15:14:48.001809+0000","last_active":"2023-10-05T15:16:15.210513+0000","last_peered":"2023-10-05T15:16:15.210513+0000","last_clean":"2023-10-05T15:16:15.210513+0000","last_became_active":"2023-10-05T15:14:48.001490+0000","last_became_peered":"2023-10-05T15:14:48.001490+0000","last_unstale":"2023-10-05T15:16:15.210513+0000","last_undegraded":"2023-10-05T15:16:15.210513+0000","last_fullsized":"2023-10-05T15:16:15.210513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:09:12.338295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060826+0000","last_change":"2023-10-05T15:14:52.252806+0000","last_active":"2023-10-05T15:15:46.060826+0000","last_peered":"2023-10-05T15:15:46.060826+0000","last_clean":"2023-10-05T15:15:46.060826+0000","last_became_active":"2023-10-05T15:14:52.252326+0000","last_became_peered":"2023-10-05T15:14:52.252326+0000","last_unstale":"2023-10-05T15:15:46.060826+0000","last_undegraded":"2023-10-05T15:15:46.060826+0000","last_fullsized":"2023-10-05T15:15:46.060826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:11:33.808462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061383+0000","last_change":"2023-10-05T15:14:47.195840+0000","last_active":"2023-10-05T15:15:46.061383+0000","last_peered":"2023-10-05T15:15:46.061383+0000","last_clean":"2023-10-05T15:15:46.061383+0000","last_became_active":"2023-10-05T15:14:47.195500+0000","last_became_peered":"2023-10-05T15:14:47.195500+0000","last_unstale":"2023-10-05T15:15:46.061383+0000","last_undegraded":"2023-10-05T15:15:46.061383+0000","last_fullsized":"2023-10-05T15:15:46.061383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:17.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211802+0000","last_change":"2023-10-05T15:14:48.003101+0000","last_active":"2023-10-05T15:16:15.211802+0000","last_peered":"2023-10-05T15:16:15.211802+0000","last_clean":"2023-10-05T15:16:15.211802+0000","last_became_active":"2023-10-05T15:14:48.002417+0000","last_became_peered":"2023-10-05T15:14:48.002417+0000","last_unstale":"2023-10-05T15:16:15.211802+0000","last_undegraded":"2023-10-05T15:16:15.211802+0000","last_fullsized":"2023-10-05T15:16:15.211802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:57:50.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057315+0000","last_change":"2023-10-05T15:14:52.250306+0000","last_active":"2023-10-05T15:15:46.057315+0000","last_peered":"2023-10-05T15:15:46.057315+0000","last_clean":"2023-10-05T15:15:46.057315+0000","last_became_active":"2023-10-05T15:14:52.249434+0000","last_became_peered":"2023-10-05T15:14:52.249434+0000","last_unstale":"2023-10-05T15:15:46.057315+0000","last_undegraded":"2023-10-05T15:15:46.057315+0000","last_fullsized":"2023-10-05T15:15:46.057315+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:00:36.095056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":238,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:35.177971+0000","last_change":"2023-10-05T15:14:47.201800+0000","last_active":"2023-10-05T15:16:35.177971+0000","last_peered":"2023-10-05T15:16:35.177971+0000","last_clean":"2023-10-05T15:16:35.177971+0000","last_became_active":"2023-10-05T15:14:47.201481+0000","last_became_peered":"2023-10-05T15:14:47.201481+0000","last_unstale":"2023-10-05T15:16:35.177971+0000","last_undegraded":"2023-10-05T15:16:35.177971+0000","last_fullsized":"2023-10-05T15:16:35.177971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:10:15.010816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64545,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":153,"num_write":41,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219014+0000","last_change":"2023-10-05T15:14:47.997807+0000","last_active":"2023-10-05T15:16:15.219014+0000","last_peered":"2023-10-05T15:16:15.219014+0000","last_clean":"2023-10-05T15:16:15.219014+0000","last_became_active":"2023-10-05T15:14:47.997579+0000","last_became_peered":"2023-10-05T15:14:47.997579+0000","last_unstale":"2023-10-05T15:16:15.219014+0000","last_undegraded":"2023-10-05T15:16:15.219014+0000","last_fullsized":"2023-10-05T15:16:15.219014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:13:43.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062190+0000","last_change":"2023-10-05T15:14:52.247073+0000","last_active":"2023-10-05T15:15:46.062190+0000","last_peered":"2023-10-05T15:15:46.062190+0000","last_clean":"2023-10-05T15:15:46.062190+0000","last_became_active":"2023-10-05T15:14:52.246615+0000","last_became_peered":"2023-10-05T15:14:52.246615+0000","last_unstale":"2023-10-05T15:15:46.062190+0000","last_undegraded":"2023-10-05T15:15:46.062190+0000","last_fullsized":"2023-10-05T15:15:46.062190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:21:28.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057412+0000","last_change":"2023-10-05T15:14:47.202025+0000","last_active":"2023-10-05T15:15:46.057412+0000","last_peered":"2023-10-05T15:15:46.057412+0000","last_clean":"2023-10-05T15:15:46.057412+0000","last_became_active":"2023-10-05T15:14:47.201738+0000","last_became_peered":"2023-10-05T15:14:47.201738+0000","last_unstale":"2023-10-05T15:15:46.057412+0000","last_undegraded":"2023-10-05T15:15:46.057412+0000","last_fullsized":"2023-10-05T15:15:46.057412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:33.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214790+0000","last_change":"2023-10-05T15:14:48.005071+0000","last_active":"2023-10-05T15:16:15.214790+0000","last_peered":"2023-10-05T15:16:15.214790+0000","last_clean":"2023-10-05T15:16:15.214790+0000","last_became_active":"2023-10-05T15:14:48.003910+0000","last_became_peered":"2023-10-05T15:14:48.003910+0000","last_unstale":"2023-10-05T15:16:15.214790+0000","last_undegraded":"2023-10-05T15:16:15.214790+0000","last_fullsized":"2023-10-05T15:16:15.214790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:39.272321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062770+0000","last_change":"2023-10-05T15:14:52.244711+0000","last_active":"2023-10-05T15:15:46.062770+0000","last_peered":"2023-10-05T15:15:46.062770+0000","last_clean":"2023-10-05T15:15:46.062770+0000","last_became_active":"2023-10-05T15:14:52.244262+0000","last_became_peered":"2023-10-05T15:14:52.244262+0000","last_unstale":"2023-10-05T15:15:46.062770+0000","last_undegraded":"2023-10-05T15:15:46.062770+0000","last_fullsized":"2023-10-05T15:15:46.062770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:58:46.729415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062773+0000","last_change":"2023-10-05T15:14:47.201802+0000","last_active":"2023-10-05T15:15:46.062773+0000","last_peered":"2023-10-05T15:15:46.062773+0000","last_clean":"2023-10-05T15:15:46.062773+0000","last_became_active":"2023-10-05T15:14:47.201531+0000","last_became_peered":"2023-10-05T15:14:47.201531+0000","last_unstale":"2023-10-05T15:15:46.062773+0000","last_undegraded":"2023-10-05T15:15:46.062773+0000","last_fullsized":"2023-10-05T15:15:46.062773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:49:08.491098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218714+0000","last_change":"2023-10-05T15:14:48.005813+0000","last_active":"2023-10-05T15:16:15.218714+0000","last_peered":"2023-10-05T15:16:15.218714+0000","last_clean":"2023-10-05T15:16:15.218714+0000","last_became_active":"2023-10-05T15:14:48.005572+0000","last_became_peered":"2023-10-05T15:14:48.005572+0000","last_unstale":"2023-10-05T15:16:15.218714+0000","last_undegraded":"2023-10-05T15:16:15.218714+0000","last_fullsized":"2023-10-05T15:16:15.218714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:51:29.326358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.103509+0000","last_change":"2023-10-05T15:15:47.103509+0000","last_active":"2023-10-05T15:15:47.103509+0000","last_peered":"2023-10-05T15:15:47.103509+0000","last_clean":"2023-10-05T15:15:47.103509+0000","last_became_active":"2023-10-05T15:15:47.103150+0000","last_became_peered":"2023-10-05T15:15:47.103150+0000","last_unstale":"2023-10-05T15:15:47.103509+0000","last_undegraded":"2023-10-05T15:15:47.103509+0000","last_fullsized":"2023-10-05T15:15:47.103509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:59.848397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"90'8","reported_seq":113,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:32.155419+0000","last_change":"2023-10-05T15:14:47.192357+0000","last_active":"2023-10-05T15:16:32.155419+0000","last_peered":"2023-10-05T15:16:32.155419+0000","last_clean":"2023-10-05T15:16:32.155419+0000","last_became_active":"2023-10-05T15:14:47.191977+0000","last_became_peered":"2023-10-05T15:14:47.191977+0000","last_unstale":"2023-10-05T15:16:32.155419+0000","last_undegraded":"2023-10-05T15:16:32.155419+0000","last_fullsized":"2023-10-05T15:16:32.155419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:38:58.183027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1437,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217226+0000","last_change":"2023-10-05T15:14:48.004951+0000","last_active":"2023-10-05T15:16:15.217226+0000","last_peered":"2023-10-05T15:16:15.217226+0000","last_clean":"2023-10-05T15:16:15.217226+0000","last_became_active":"2023-10-05T15:14:48.004477+0000","last_became_peered":"2023-10-05T15:14:48.004477+0000","last_unstale":"2023-10-05T15:16:15.217226+0000","last_undegraded":"2023-10-05T15:16:15.217226+0000","last_fullsized":"2023-10-05T15:16:15.217226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:17:17.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.066044+0000","last_change":"2023-10-05T15:14:52.244265+0000","last_active":"2023-10-05T15:15:46.066044+0000","last_peered":"2023-10-05T15:15:46.066044+0000","last_clean":"2023-10-05T15:15:46.066044+0000","last_became_active":"2023-10-05T15:14:52.243868+0000","last_became_peered":"2023-10-05T15:14:52.243868+0000","last_unstale":"2023-10-05T15:15:46.066044+0000","last_undegraded":"2023-10-05T15:15:46.066044+0000","last_fullsized":"2023-10-05T15:15:46.066044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:07:12.900878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060708+0000","last_change":"2023-10-05T15:14:47.196873+0000","last_active":"2023-10-05T15:15:46.060708+0000","last_peered":"2023-10-05T15:15:46.060708+0000","last_clean":"2023-10-05T15:15:46.060708+0000","last_became_active":"2023-10-05T15:14:47.196493+0000","last_became_peered":"2023-10-05T15:14:47.196493+0000","last_unstale":"2023-10-05T15:15:46.060708+0000","last_undegraded":"2023-10-05T15:15:46.060708+0000","last_fullsized":"2023-10-05T15:15:46.060708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:37:43.576613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206773+0000","last_change":"2023-10-05T15:14:48.006333+0000","last_active":"2023-10-05T15:16:15.206773+0000","last_peered":"2023-10-05T15:16:15.206773+0000","last_clean":"2023-10-05T15:16:15.206773+0000","last_became_active":"2023-10-05T15:14:48.006023+0000","last_became_peered":"2023-10-05T15:14:48.006023+0000","last_unstale":"2023-10-05T15:16:15.206773+0000","last_undegraded":"2023-10-05T15:16:15.206773+0000","last_fullsized":"2023-10-05T15:16:15.206773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:22:15.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062593+0000","last_change":"2023-10-05T15:14:52.244699+0000","last_active":"2023-10-05T15:15:46.062593+0000","last_peered":"2023-10-05T15:15:46.062593+0000","last_clean":"2023-10-05T15:15:46.062593+0000","last_became_active":"2023-10-05T15:14:52.244270+0000","last_became_peered":"2023-10-05T15:14:52.244270+0000","last_unstale":"2023-10-05T15:15:46.062593+0000","last_undegraded":"2023-10-05T15:15:46.062593+0000","last_fullsized":"2023-10-05T15:15:46.062593+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:41:11.583214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064299+0000","last_change":"2023-10-05T15:14:47.203696+0000","last_active":"2023-10-05T15:15:46.064299+0000","last_peered":"2023-10-05T15:15:46.064299+0000","last_clean":"2023-10-05T15:15:46.064299+0000","last_became_active":"2023-10-05T15:14:47.203361+0000","last_became_peered":"2023-10-05T15:14:47.203361+0000","last_unstale":"2023-10-05T15:15:46.064299+0000","last_undegraded":"2023-10-05T15:15:46.064299+0000","last_fullsized":"2023-10-05T15:15:46.064299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:12:55.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211465+0000","last_change":"2023-10-05T15:14:48.002782+0000","last_active":"2023-10-05T15:16:15.211465+0000","last_peered":"2023-10-05T15:16:15.211465+0000","last_clean":"2023-10-05T15:16:15.211465+0000","last_became_active":"2023-10-05T15:14:48.001582+0000","last_became_peered":"2023-10-05T15:14:48.001582+0000","last_unstale":"2023-10-05T15:16:15.211465+0000","last_undegraded":"2023-10-05T15:16:15.211465+0000","last_fullsized":"2023-10-05T15:16:15.211465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:11:05.711356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063976+0000","last_change":"2023-10-05T15:14:52.254643+0000","last_active":"2023-10-05T15:15:46.063976+0000","last_peered":"2023-10-05T15:15:46.063976+0000","last_clean":"2023-10-05T15:15:46.063976+0000","last_became_active":"2023-10-05T15:14:52.254238+0000","last_became_peered":"2023-10-05T15:14:52.254238+0000","last_unstale":"2023-10-05T15:15:46.063976+0000","last_undegraded":"2023-10-05T15:15:46.063976+0000","last_fullsized":"2023-10-05T15:15:46.063976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:01.994208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058304+0000","last_change":"2023-10-05T15:14:47.197467+0000","last_active":"2023-10-05T15:15:46.058304+0000","last_peered":"2023-10-05T15:15:46.058304+0000","last_clean":"2023-10-05T15:15:46.058304+0000","last_became_active":"2023-10-05T15:14:47.197135+0000","last_became_peered":"2023-10-05T15:14:47.197135+0000","last_unstale":"2023-10-05T15:15:46.058304+0000","last_undegraded":"2023-10-05T15:15:46.058304+0000","last_fullsized":"2023-10-05T15:15:46.058304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:15:54.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210452+0000","last_change":"2023-10-05T15:14:48.006421+0000","last_active":"2023-10-05T15:16:15.210452+0000","last_peered":"2023-10-05T15:16:15.210452+0000","last_clean":"2023-10-05T15:16:15.210452+0000","last_became_active":"2023-10-05T15:14:48.006122+0000","last_became_peered":"2023-10-05T15:14:48.006122+0000","last_unstale":"2023-10-05T15:16:15.210452+0000","last_undegraded":"2023-10-05T15:16:15.210452+0000","last_fullsized":"2023-10-05T15:16:15.210452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:40:08.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063886+0000","last_change":"2023-10-05T15:14:52.241315+0000","last_active":"2023-10-05T15:15:46.063886+0000","last_peered":"2023-10-05T15:15:46.063886+0000","last_clean":"2023-10-05T15:15:46.063886+0000","last_became_active":"2023-10-05T15:14:52.240920+0000","last_became_peered":"2023-10-05T15:14:52.240920+0000","last_unstale":"2023-10-05T15:15:46.063886+0000","last_undegraded":"2023-10-05T15:15:46.063886+0000","last_fullsized":"2023-10-05T15:15:46.063886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:29:30.534214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:34.152144+0000","last_change":"2023-10-05T15:14:47.204367+0000","last_active":"2023-10-05T15:16:34.152144+0000","last_peered":"2023-10-05T15:16:34.152144+0000","last_clean":"2023-10-05T15:16:34.152144+0000","last_became_active":"2023-10-05T15:14:47.203955+0000","last_became_peered":"2023-10-05T15:14:47.203955+0000","last_unstale":"2023-10-05T15:16:34.152144+0000","last_undegraded":"2023-10-05T15:16:34.152144+0000","last_fullsized":"2023-10-05T15:16:34.152144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:19:23.797936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207552+0000","last_change":"2023-10-05T15:14:48.007999+0000","last_active":"2023-10-05T15:16:15.207552+0000","last_peered":"2023-10-05T15:16:15.207552+0000","last_clean":"2023-10-05T15:16:15.207552+0000","last_became_active":"2023-10-05T15:14:48.007635+0000","last_became_peered":"2023-10-05T15:14:48.007635+0000","last_unstale":"2023-10-05T15:16:15.207552+0000","last_undegraded":"2023-10-05T15:16:15.207552+0000","last_fullsized":"2023-10-05T15:16:15.207552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:56:01.296724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065857+0000","last_change":"2023-10-05T15:14:52.253246+0000","last_active":"2023-10-05T15:15:46.065857+0000","last_peered":"2023-10-05T15:15:46.065857+0000","last_clean":"2023-10-05T15:15:46.065857+0000","last_became_active":"2023-10-05T15:14:52.252814+0000","last_became_peered":"2023-10-05T15:14:52.252814+0000","last_unstale":"2023-10-05T15:15:46.065857+0000","last_undegraded":"2023-10-05T15:15:46.065857+0000","last_fullsized":"2023-10-05T15:15:46.065857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:49.554345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211731+0000","last_change":"2023-10-05T15:14:47.998086+0000","last_active":"2023-10-05T15:16:15.211731+0000","last_peered":"2023-10-05T15:16:15.211731+0000","last_clean":"2023-10-05T15:16:15.211731+0000","last_became_active":"2023-10-05T15:14:47.997802+0000","last_became_peered":"2023-10-05T15:14:47.997802+0000","last_unstale":"2023-10-05T15:16:15.211731+0000","last_undegraded":"2023-10-05T15:16:15.211731+0000","last_fullsized":"2023-10-05T15:16:15.211731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:19.921432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'7","reported_seq":112,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:34.158143+0000","last_change":"2023-10-05T15:14:47.203965+0000","last_active":"2023-10-05T15:16:34.158143+0000","last_peered":"2023-10-05T15:16:34.158143+0000","last_clean":"2023-10-05T15:16:34.158143+0000","last_became_active":"2023-10-05T15:14:47.203315+0000","last_became_peered":"2023-10-05T15:14:47.203315+0000","last_unstale":"2023-10-05T15:16:34.158143+0000","last_undegraded":"2023-10-05T15:16:34.158143+0000","last_fullsized":"2023-10-05T15:16:34.158143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:07:29.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058004+0000","last_change":"2023-10-05T15:14:52.243228+0000","last_active":"2023-10-05T15:15:46.058004+0000","last_peered":"2023-10-05T15:15:46.058004+0000","last_clean":"2023-10-05T15:15:46.058004+0000","last_became_active":"2023-10-05T15:14:52.242864+0000","last_became_peered":"2023-10-05T15:14:52.242864+0000","last_unstale":"2023-10-05T15:15:46.058004+0000","last_undegraded":"2023-10-05T15:15:46.058004+0000","last_fullsized":"2023-10-05T15:15:46.058004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:52:28.885432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.196784+0000","last_change":"2023-10-05T15:15:47.094134+0000","last_active":"2023-10-05T15:16:15.196784+0000","last_peered":"2023-10-05T15:16:15.196784+0000","last_clean":"2023-10-05T15:16:15.196784+0000","last_became_active":"2023-10-05T15:15:47.093826+0000","last_became_peered":"2023-10-05T15:15:47.093826+0000","last_unstale":"2023-10-05T15:16:15.196784+0000","last_undegraded":"2023-10-05T15:16:15.196784+0000","last_fullsized":"2023-10-05T15:16:15.196784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:16:26.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060721+0000","last_change":"2023-10-05T15:14:47.197161+0000","last_active":"2023-10-05T15:15:46.060721+0000","last_peered":"2023-10-05T15:15:46.060721+0000","last_clean":"2023-10-05T15:15:46.060721+0000","last_became_active":"2023-10-05T15:14:47.196808+0000","last_became_peered":"2023-10-05T15:14:47.196808+0000","last_unstale":"2023-10-05T15:15:46.060721+0000","last_undegraded":"2023-10-05T15:15:46.060721+0000","last_fullsized":"2023-10-05T15:15:46.060721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:34:33.864852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057603+0000","last_change":"2023-10-05T15:13:48.465152+0000","last_active":"2023-10-05T15:15:46.057603+0000","last_peered":"2023-10-05T15:15:46.057603+0000","last_clean":"2023-10-05T15:15:46.057603+0000","last_became_active":"2023-10-05T15:13:48.464625+0000","last_became_peered":"2023-10-05T15:13:48.464625+0000","last_unstale":"2023-10-05T15:15:46.057603+0000","last_undegraded":"2023-10-05T15:15:46.057603+0000","last_fullsized":"2023-10-05T15:15:46.057603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:10:55.790450+0000","last_clean_scrub_stamp":"2023-10-05T15:10:55.790450+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:02.833503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.089429+0000","last_change":"2023-10-05T15:15:47.089429+0000","last_active":"2023-10-05T15:15:47.089429+0000","last_peered":"2023-10-05T15:15:47.089429+0000","last_clean":"2023-10-05T15:15:47.089429+0000","last_became_active":"2023-10-05T15:15:47.088950+0000","last_became_peered":"2023-10-05T15:15:47.088950+0000","last_unstale":"2023-10-05T15:15:47.089429+0000","last_undegraded":"2023-10-05T15:15:47.089429+0000","last_fullsized":"2023-10-05T15:15:47.089429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:36:14.592094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212172+0000","last_change":"2023-10-05T15:14:48.004276+0000","last_active":"2023-10-05T15:16:15.212172+0000","last_peered":"2023-10-05T15:16:15.212172+0000","last_clean":"2023-10-05T15:16:15.212172+0000","last_became_active":"2023-10-05T15:14:48.003622+0000","last_became_peered":"2023-10-05T15:14:48.003622+0000","last_unstale":"2023-10-05T15:16:15.212172+0000","last_undegraded":"2023-10-05T15:16:15.212172+0000","last_fullsized":"2023-10-05T15:16:15.212172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:21.057775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057731+0000","last_change":"2023-10-05T15:14:47.197771+0000","last_active":"2023-10-05T15:15:46.057731+0000","last_peered":"2023-10-05T15:15:46.057731+0000","last_clean":"2023-10-05T15:15:46.057731+0000","last_became_active":"2023-10-05T15:14:47.197438+0000","last_became_peered":"2023-10-05T15:14:47.197438+0000","last_unstale":"2023-10-05T15:15:46.057731+0000","last_undegraded":"2023-10-05T15:15:46.057731+0000","last_fullsized":"2023-10-05T15:15:46.057731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:22.050867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.062666+0000","last_change":"2023-10-05T15:14:52.241215+0000","last_active":"2023-10-05T15:15:46.062666+0000","last_peered":"2023-10-05T15:15:46.062666+0000","last_clean":"2023-10-05T15:15:46.062666+0000","last_became_active":"2023-10-05T15:14:52.240760+0000","last_became_peered":"2023-10-05T15:14:52.240760+0000","last_unstale":"2023-10-05T15:15:46.062666+0000","last_undegraded":"2023-10-05T15:15:46.062666+0000","last_fullsized":"2023-10-05T15:15:46.062666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:00:34.383263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064250+0000","last_change":"2023-10-05T15:14:47.201121+0000","last_active":"2023-10-05T15:15:46.064250+0000","last_peered":"2023-10-05T15:15:46.064250+0000","last_clean":"2023-10-05T15:15:46.064250+0000","last_became_active":"2023-10-05T15:14:47.200751+0000","last_became_peered":"2023-10-05T15:14:47.200751+0000","last_unstale":"2023-10-05T15:15:46.064250+0000","last_undegraded":"2023-10-05T15:15:46.064250+0000","last_fullsized":"2023-10-05T15:15:46.064250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:37:19.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.204382+0000","last_change":"2023-10-05T15:14:48.007684+0000","last_active":"2023-10-05T15:16:15.204382+0000","last_peered":"2023-10-05T15:16:15.204382+0000","last_clean":"2023-10-05T15:16:15.204382+0000","last_became_active":"2023-10-05T15:14:48.007379+0000","last_became_peered":"2023-10-05T15:14:48.007379+0000","last_unstale":"2023-10-05T15:16:15.204382+0000","last_undegraded":"2023-10-05T15:16:15.204382+0000","last_fullsized":"2023-10-05T15:16:15.204382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:32:16.032041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065067+0000","last_change":"2023-10-05T15:14:52.255140+0000","last_active":"2023-10-05T15:15:46.065067+0000","last_peered":"2023-10-05T15:15:46.065067+0000","last_clean":"2023-10-05T15:15:46.065067+0000","last_became_active":"2023-10-05T15:14:52.254736+0000","last_became_peered":"2023-10-05T15:14:52.254736+0000","last_unstale":"2023-10-05T15:15:46.065067+0000","last_undegraded":"2023-10-05T15:15:46.065067+0000","last_fullsized":"2023-10-05T15:15:46.065067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:16:00.049994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:17.657319+0000","last_change":"2023-10-05T15:14:47.206384+0000","last_active":"2023-10-05T15:16:17.657319+0000","last_peered":"2023-10-05T15:16:17.657319+0000","last_clean":"2023-10-05T15:16:17.657319+0000","last_became_active":"2023-10-05T15:14:47.203438+0000","last_became_peered":"2023-10-05T15:14:47.203438+0000","last_unstale":"2023-10-05T15:16:17.657319+0000","last_undegraded":"2023-10-05T15:16:17.657319+0000","last_fullsized":"2023-10-05T15:16:17.657319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:25:48.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219296+0000","last_change":"2023-10-05T15:14:47.999151+0000","last_active":"2023-10-05T15:16:15.219296+0000","last_peered":"2023-10-05T15:16:15.219296+0000","last_clean":"2023-10-05T15:16:15.219296+0000","last_became_active":"2023-10-05T15:14:47.998277+0000","last_became_peered":"2023-10-05T15:14:47.998277+0000","last_unstale":"2023-10-05T15:16:15.219296+0000","last_undegraded":"2023-10-05T15:16:15.219296+0000","last_fullsized":"2023-10-05T15:16:15.219296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:59:47.542317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057131+0000","last_change":"2023-10-05T15:14:52.242115+0000","last_active":"2023-10-05T15:15:46.057131+0000","last_peered":"2023-10-05T15:15:46.057131+0000","last_clean":"2023-10-05T15:15:46.057131+0000","last_became_active":"2023-10-05T15:14:52.241682+0000","last_became_peered":"2023-10-05T15:14:52.241682+0000","last_unstale":"2023-10-05T15:15:46.057131+0000","last_undegraded":"2023-10-05T15:15:46.057131+0000","last_fullsized":"2023-10-05T15:15:46.057131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:28:04.477809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060702+0000","last_change":"2023-10-05T15:14:47.194967+0000","last_active":"2023-10-05T15:15:46.060702+0000","last_peered":"2023-10-05T15:15:46.060702+0000","last_clean":"2023-10-05T15:15:46.060702+0000","last_became_active":"2023-10-05T15:14:47.194616+0000","last_became_peered":"2023-10-05T15:14:47.194616+0000","last_unstale":"2023-10-05T15:15:46.060702+0000","last_undegraded":"2023-10-05T15:15:46.060702+0000","last_fullsized":"2023-10-05T15:15:46.060702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:30.115880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.214108+0000","last_change":"2023-10-05T15:14:48.000280+0000","last_active":"2023-10-05T15:16:15.214108+0000","last_peered":"2023-10-05T15:16:15.214108+0000","last_clean":"2023-10-05T15:16:15.214108+0000","last_became_active":"2023-10-05T15:14:47.999780+0000","last_became_peered":"2023-10-05T15:14:47.999780+0000","last_unstale":"2023-10-05T15:16:15.214108+0000","last_undegraded":"2023-10-05T15:16:15.214108+0000","last_fullsized":"2023-10-05T15:16:15.214108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:37.698118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060211+0000","last_change":"2023-10-05T15:14:52.255201+0000","last_active":"2023-10-05T15:15:46.060211+0000","last_peered":"2023-10-05T15:15:46.060211+0000","last_clean":"2023-10-05T15:15:46.060211+0000","last_became_active":"2023-10-05T15:14:52.254697+0000","last_became_peered":"2023-10-05T15:14:52.254697+0000","last_unstale":"2023-10-05T15:15:46.060211+0000","last_undegraded":"2023-10-05T15:15:46.060211+0000","last_fullsized":"2023-10-05T15:15:46.060211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:43:14.287841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067424+0000","last_change":"2023-10-05T15:14:47.193492+0000","last_active":"2023-10-05T15:15:46.067424+0000","last_peered":"2023-10-05T15:15:46.067424+0000","last_clean":"2023-10-05T15:15:46.067424+0000","last_became_active":"2023-10-05T15:14:47.192980+0000","last_became_peered":"2023-10-05T15:14:47.192980+0000","last_unstale":"2023-10-05T15:15:46.067424+0000","last_undegraded":"2023-10-05T15:15:46.067424+0000","last_fullsized":"2023-10-05T15:15:46.067424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:40:06.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.174876+0000","last_change":"2023-10-05T15:14:47.996226+0000","last_active":"2023-10-05T15:16:15.174876+0000","last_peered":"2023-10-05T15:16:15.174876+0000","last_clean":"2023-10-05T15:16:15.174876+0000","last_became_active":"2023-10-05T15:14:47.995904+0000","last_became_peered":"2023-10-05T15:14:47.995904+0000","last_unstale":"2023-10-05T15:16:15.174876+0000","last_undegraded":"2023-10-05T15:16:15.174876+0000","last_fullsized":"2023-10-05T15:16:15.174876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:14:45.815760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.058609+0000","last_change":"2023-10-05T15:14:52.245009+0000","last_active":"2023-10-05T15:15:46.058609+0000","last_peered":"2023-10-05T15:15:46.058609+0000","last_clean":"2023-10-05T15:15:46.058609+0000","last_became_active":"2023-10-05T15:14:52.243271+0000","last_became_peered":"2023-10-05T15:14:52.243271+0000","last_unstale":"2023-10-05T15:15:46.058609+0000","last_undegraded":"2023-10-05T15:15:46.058609+0000","last_fullsized":"2023-10-05T15:15:46.058609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:51:32.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.064579+0000","last_change":"2023-10-05T15:14:47.201014+0000","last_active":"2023-10-05T15:15:46.064579+0000","last_peered":"2023-10-05T15:15:46.064579+0000","last_clean":"2023-10-05T15:15:46.064579+0000","last_became_active":"2023-10-05T15:14:47.200686+0000","last_became_peered":"2023-10-05T15:14:47.200686+0000","last_unstale":"2023-10-05T15:15:46.064579+0000","last_undegraded":"2023-10-05T15:15:46.064579+0000","last_fullsized":"2023-10-05T15:15:46.064579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:53.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209977+0000","last_change":"2023-10-05T15:14:48.002642+0000","last_active":"2023-10-05T15:16:15.209977+0000","last_peered":"2023-10-05T15:16:15.209977+0000","last_clean":"2023-10-05T15:16:15.209977+0000","last_became_active":"2023-10-05T15:14:48.002267+0000","last_became_peered":"2023-10-05T15:14:48.002267+0000","last_unstale":"2023-10-05T15:16:15.209977+0000","last_undegraded":"2023-10-05T15:16:15.209977+0000","last_fullsized":"2023-10-05T15:16:15.209977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:47.070124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:15:47.095591+0000","last_change":"2023-10-05T15:15:47.095591+0000","last_active":"2023-10-05T15:15:47.095591+0000","last_peered":"2023-10-05T15:15:47.095591+0000","last_clean":"2023-10-05T15:15:47.095591+0000","last_became_active":"2023-10-05T15:15:47.090503+0000","last_became_peered":"2023-10-05T15:15:47.090503+0000","last_unstale":"2023-10-05T15:15:47.095591+0000","last_undegraded":"2023-10-05T15:15:47.095591+0000","last_fullsized":"2023-10-05T15:15:47.095591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:35.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.057335+0000","last_change":"2023-10-05T15:14:47.202133+0000","last_active":"2023-10-05T15:15:46.057335+0000","last_peered":"2023-10-05T15:15:46.057335+0000","last_clean":"2023-10-05T15:15:46.057335+0000","last_became_active":"2023-10-05T15:14:47.201823+0000","last_became_peered":"2023-10-05T15:14:47.201823+0000","last_unstale":"2023-10-05T15:15:46.057335+0000","last_undegraded":"2023-10-05T15:15:46.057335+0000","last_fullsized":"2023-10-05T15:15:46.057335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:21:41.849988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212801+0000","last_change":"2023-10-05T15:14:48.005158+0000","last_active":"2023-10-05T15:16:15.212801+0000","last_peered":"2023-10-05T15:16:15.212801+0000","last_clean":"2023-10-05T15:16:15.212801+0000","last_became_active":"2023-10-05T15:14:48.003106+0000","last_became_peered":"2023-10-05T15:14:48.003106+0000","last_unstale":"2023-10-05T15:16:15.212801+0000","last_undegraded":"2023-10-05T15:16:15.212801+0000","last_fullsized":"2023-10-05T15:16:15.212801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:10:06.115535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060452+0000","last_change":"2023-10-05T15:14:52.255275+0000","last_active":"2023-10-05T15:15:46.060452+0000","last_peered":"2023-10-05T15:15:46.060452+0000","last_clean":"2023-10-05T15:15:46.060452+0000","last_became_active":"2023-10-05T15:14:52.254789+0000","last_became_peered":"2023-10-05T15:14:52.254789+0000","last_unstale":"2023-10-05T15:15:46.060452+0000","last_undegraded":"2023-10-05T15:15:46.060452+0000","last_fullsized":"2023-10-05T15:15:46.060452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:56:32.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063970+0000","last_change":"2023-10-05T15:14:47.202920+0000","last_active":"2023-10-05T15:15:46.063970+0000","last_peered":"2023-10-05T15:15:46.063970+0000","last_clean":"2023-10-05T15:15:46.063970+0000","last_became_active":"2023-10-05T15:14:47.202601+0000","last_became_peered":"2023-10-05T15:14:47.202601+0000","last_unstale":"2023-10-05T15:15:46.063970+0000","last_undegraded":"2023-10-05T15:15:46.063970+0000","last_fullsized":"2023-10-05T15:15:46.063970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:26:24.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217129+0000","last_change":"2023-10-05T15:14:48.007930+0000","last_active":"2023-10-05T15:16:15.217129+0000","last_peered":"2023-10-05T15:16:15.217129+0000","last_clean":"2023-10-05T15:16:15.217129+0000","last_became_active":"2023-10-05T15:14:48.007695+0000","last_became_peered":"2023-10-05T15:14:48.007695+0000","last_unstale":"2023-10-05T15:16:15.217129+0000","last_undegraded":"2023-10-05T15:16:15.217129+0000","last_fullsized":"2023-10-05T15:16:15.217129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:43.922923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.067523+0000","last_change":"2023-10-05T15:14:52.239580+0000","last_active":"2023-10-05T15:15:46.067523+0000","last_peered":"2023-10-05T15:15:46.067523+0000","last_clean":"2023-10-05T15:15:46.067523+0000","last_became_active":"2023-10-05T15:14:52.239152+0000","last_became_peered":"2023-10-05T15:14:52.239152+0000","last_unstale":"2023-10-05T15:15:46.067523+0000","last_undegraded":"2023-10-05T15:15:46.067523+0000","last_fullsized":"2023-10-05T15:15:46.067523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:06:35.606800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:33.156630+0000","last_change":"2023-10-05T15:14:47.192769+0000","last_active":"2023-10-05T15:16:33.156630+0000","last_peered":"2023-10-05T15:16:33.156630+0000","last_clean":"2023-10-05T15:16:33.156630+0000","last_became_active":"2023-10-05T15:14:47.192469+0000","last_became_peered":"2023-10-05T15:14:47.192469+0000","last_unstale":"2023-10-05T15:16:33.156630+0000","last_undegraded":"2023-10-05T15:16:33.156630+0000","last_fullsized":"2023-10-05T15:16:33.156630+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:24:49.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.220009+0000","last_change":"2023-10-05T15:14:48.007370+0000","last_active":"2023-10-05T15:16:15.220009+0000","last_peered":"2023-10-05T15:16:15.220009+0000","last_clean":"2023-10-05T15:16:15.220009+0000","last_became_active":"2023-10-05T15:14:48.006915+0000","last_became_peered":"2023-10-05T15:14:48.006915+0000","last_unstale":"2023-10-05T15:16:15.220009+0000","last_undegraded":"2023-10-05T15:16:15.220009+0000","last_fullsized":"2023-10-05T15:16:15.220009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:28:22.557508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.063292+0000","last_change":"2023-10-05T15:14:52.250267+0000","last_active":"2023-10-05T15:15:46.063292+0000","last_peered":"2023-10-05T15:15:46.063292+0000","last_clean":"2023-10-05T15:15:46.063292+0000","last_became_active":"2023-10-05T15:14:52.249769+0000","last_became_peered":"2023-10-05T15:14:52.249769+0000","last_unstale":"2023-10-05T15:15:46.063292+0000","last_undegraded":"2023-10-05T15:15:46.063292+0000","last_fullsized":"2023-10-05T15:15:46.063292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:28:43.403478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.061487+0000","last_change":"2023-10-05T15:14:47.199026+0000","last_active":"2023-10-05T15:15:46.061487+0000","last_peered":"2023-10-05T15:15:46.061487+0000","last_clean":"2023-10-05T15:15:46.061487+0000","last_became_active":"2023-10-05T15:14:47.198573+0000","last_became_peered":"2023-10-05T15:14:47.198573+0000","last_unstale":"2023-10-05T15:15:46.061487+0000","last_undegraded":"2023-10-05T15:15:46.061487+0000","last_fullsized":"2023-10-05T15:15:46.061487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:36:19.225728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.217154+0000","last_change":"2023-10-05T15:14:48.004746+0000","last_active":"2023-10-05T15:16:15.217154+0000","last_peered":"2023-10-05T15:16:15.217154+0000","last_clean":"2023-10-05T15:16:15.217154+0000","last_became_active":"2023-10-05T15:14:48.004327+0000","last_became_peered":"2023-10-05T15:14:48.004327+0000","last_unstale":"2023-10-05T15:16:15.217154+0000","last_undegraded":"2023-10-05T15:16:15.217154+0000","last_fullsized":"2023-10-05T15:16:15.217154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:09:54.280811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.060696+0000","last_change":"2023-10-05T15:14:52.241026+0000","last_active":"2023-10-05T15:15:46.060696+0000","last_peered":"2023-10-05T15:15:46.060696+0000","last_clean":"2023-10-05T15:15:46.060696+0000","last_became_active":"2023-10-05T15:14:52.240602+0000","last_became_peered":"2023-10-05T15:14:52.240602+0000","last_unstale":"2023-10-05T15:15:46.060696+0000","last_undegraded":"2023-10-05T15:15:46.060696+0000","last_fullsized":"2023-10-05T15:15:46.060696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:51.213867+0000","last_clean_scrub_stamp":"2023-10-05T15:14:51.213867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:01:23.858514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:15:46.065946+0000","last_change":"2023-10-05T15:14:47.203189+0000","last_active":"2023-10-05T15:15:46.065946+0000","last_peered":"2023-10-05T15:15:46.065946+0000","last_clean":"2023-10-05T15:15:46.065946+0000","last_became_active":"2023-10-05T15:14:47.202846+0000","last_became_peered":"2023-10-05T15:14:47.202846+0000","last_unstale":"2023-10-05T15:15:46.065946+0000","last_undegraded":"2023-10-05T15:15:46.065946+0000","last_fullsized":"2023-10-05T15:15:46.065946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:46.171858+0000","last_clean_scrub_stamp":"2023-10-05T15:14:46.171858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:15:00.387817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216870+0000","last_change":"2023-10-05T15:14:48.002838+0000","last_active":"2023-10-05T15:16:15.216870+0000","last_peered":"2023-10-05T15:16:15.216870+0000","last_clean":"2023-10-05T15:16:15.216870+0000","last_became_active":"2023-10-05T15:14:48.001310+0000","last_became_peered":"2023-10-05T15:14:48.001310+0000","last_unstale":"2023-10-05T15:16:15.216870+0000","last_undegraded":"2023-10-05T15:16:15.216870+0000","last_fullsized":"2023-10-05T15:16:15.216870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:13:50.903615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209827+0000","last_change":"2023-10-05T15:14:48.000829+0000","last_active":"2023-10-05T15:16:15.209827+0000","last_peered":"2023-10-05T15:16:15.209827+0000","last_clean":"2023-10-05T15:16:15.209827+0000","last_became_active":"2023-10-05T15:14:48.000467+0000","last_became_peered":"2023-10-05T15:14:48.000467+0000","last_unstale":"2023-10-05T15:16:15.209827+0000","last_undegraded":"2023-10-05T15:16:15.209827+0000","last_fullsized":"2023-10-05T15:16:15.209827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:09:53.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.209385+0000","last_change":"2023-10-05T15:15:47.094198+0000","last_active":"2023-10-05T15:16:15.209385+0000","last_peered":"2023-10-05T15:16:15.209385+0000","last_clean":"2023-10-05T15:16:15.209385+0000","last_became_active":"2023-10-05T15:15:47.093766+0000","last_became_peered":"2023-10-05T15:15:47.093766+0000","last_unstale":"2023-10-05T15:16:15.209385+0000","last_undegraded":"2023-10-05T15:16:15.209385+0000","last_fullsized":"2023-10-05T15:16:15.209385+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:48:59.949643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.210923+0000","last_change":"2023-10-05T15:14:48.002097+0000","last_active":"2023-10-05T15:16:15.210923+0000","last_peered":"2023-10-05T15:16:15.210923+0000","last_clean":"2023-10-05T15:16:15.210923+0000","last_became_active":"2023-10-05T15:14:48.001802+0000","last_became_peered":"2023-10-05T15:14:48.001802+0000","last_unstale":"2023-10-05T15:16:15.210923+0000","last_undegraded":"2023-10-05T15:16:15.210923+0000","last_fullsized":"2023-10-05T15:16:15.210923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:05:25.303316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.218232+0000","last_change":"2023-10-05T15:15:47.088923+0000","last_active":"2023-10-05T15:16:15.218232+0000","last_peered":"2023-10-05T15:16:15.218232+0000","last_clean":"2023-10-05T15:16:15.218232+0000","last_became_active":"2023-10-05T15:15:47.088562+0000","last_became_peered":"2023-10-05T15:15:47.088562+0000","last_unstale":"2023-10-05T15:16:15.218232+0000","last_undegraded":"2023-10-05T15:16:15.218232+0000","last_fullsized":"2023-10-05T15:16:15.218232+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:25.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211925+0000","last_change":"2023-10-05T15:14:48.004572+0000","last_active":"2023-10-05T15:16:15.211925+0000","last_peered":"2023-10-05T15:16:15.211925+0000","last_clean":"2023-10-05T15:16:15.211925+0000","last_became_active":"2023-10-05T15:14:48.003609+0000","last_became_peered":"2023-10-05T15:14:48.003609+0000","last_unstale":"2023-10-05T15:16:15.211925+0000","last_undegraded":"2023-10-05T15:16:15.211925+0000","last_fullsized":"2023-10-05T15:16:15.211925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:51:34.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207863+0000","last_change":"2023-10-05T15:15:47.065363+0000","last_active":"2023-10-05T15:16:15.207863+0000","last_peered":"2023-10-05T15:16:15.207863+0000","last_clean":"2023-10-05T15:16:15.207863+0000","last_became_active":"2023-10-05T15:15:47.064990+0000","last_became_peered":"2023-10-05T15:15:47.064990+0000","last_unstale":"2023-10-05T15:16:15.207863+0000","last_undegraded":"2023-10-05T15:16:15.207863+0000","last_fullsized":"2023-10-05T15:16:15.207863+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:31.355817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.207667+0000","last_change":"2023-10-05T15:14:48.000616+0000","last_active":"2023-10-05T15:16:15.207667+0000","last_peered":"2023-10-05T15:16:15.207667+0000","last_clean":"2023-10-05T15:16:15.207667+0000","last_became_active":"2023-10-05T15:14:48.000321+0000","last_became_peered":"2023-10-05T15:14:48.000321+0000","last_unstale":"2023-10-05T15:16:15.207667+0000","last_undegraded":"2023-10-05T15:16:15.207667+0000","last_fullsized":"2023-10-05T15:16:15.207667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:06.253334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211612+0000","last_change":"2023-10-05T15:14:47.999350+0000","last_active":"2023-10-05T15:16:15.211612+0000","last_peered":"2023-10-05T15:16:15.211612+0000","last_clean":"2023-10-05T15:16:15.211612+0000","last_became_active":"2023-10-05T15:14:47.998850+0000","last_became_peered":"2023-10-05T15:14:47.998850+0000","last_unstale":"2023-10-05T15:16:15.211612+0000","last_undegraded":"2023-10-05T15:16:15.211612+0000","last_fullsized":"2023-10-05T15:16:15.211612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:05:38.894344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.206529+0000","last_change":"2023-10-05T15:14:47.997577+0000","last_active":"2023-10-05T15:16:15.206529+0000","last_peered":"2023-10-05T15:16:15.206529+0000","last_clean":"2023-10-05T15:16:15.206529+0000","last_became_active":"2023-10-05T15:14:47.997276+0000","last_became_peered":"2023-10-05T15:14:47.997276+0000","last_unstale":"2023-10-05T15:16:15.206529+0000","last_undegraded":"2023-10-05T15:16:15.206529+0000","last_fullsized":"2023-10-05T15:16:15.206529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:50:32.395561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.212422+0000","last_change":"2023-10-05T15:14:48.003305+0000","last_active":"2023-10-05T15:16:15.212422+0000","last_peered":"2023-10-05T15:16:15.212422+0000","last_clean":"2023-10-05T15:16:15.212422+0000","last_became_active":"2023-10-05T15:14:48.002961+0000","last_became_peered":"2023-10-05T15:14:48.002961+0000","last_unstale":"2023-10-05T15:16:15.212422+0000","last_undegraded":"2023-10-05T15:16:15.212422+0000","last_fullsized":"2023-10-05T15:16:15.212422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:42:15.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.219057+0000","last_change":"2023-10-05T15:14:48.002232+0000","last_active":"2023-10-05T15:16:15.219057+0000","last_peered":"2023-10-05T15:16:15.219057+0000","last_clean":"2023-10-05T15:16:15.219057+0000","last_became_active":"2023-10-05T15:14:48.000715+0000","last_became_peered":"2023-10-05T15:14:48.000715+0000","last_unstale":"2023-10-05T15:16:15.219057+0000","last_undegraded":"2023-10-05T15:16:15.219057+0000","last_fullsized":"2023-10-05T15:16:15.219057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:13:46.236308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.216405+0000","last_change":"2023-10-05T15:14:48.004802+0000","last_active":"2023-10-05T15:16:15.216405+0000","last_peered":"2023-10-05T15:16:15.216405+0000","last_clean":"2023-10-05T15:16:15.216405+0000","last_became_active":"2023-10-05T15:14:48.003455+0000","last_became_peered":"2023-10-05T15:14:48.003455+0000","last_unstale":"2023-10-05T15:16:15.216405+0000","last_undegraded":"2023-10-05T15:16:15.216405+0000","last_fullsized":"2023-10-05T15:16:15.216405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:48.765238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:16:15.211710+0000","last_change":"2023-10-05T15:14:48.001791+0000","last_active":"2023-10-05T15:16:15.211710+0000","last_peered":"2023-10-05T15:16:15.211710+0000","last_clean":"2023-10-05T15:16:15.211710+0000","last_became_active":"2023-10-05T15:14:48.001400+0000","last_became_peered":"2023-10-05T15:14:48.001400+0000","last_unstale":"2023-10-05T15:16:15.211710+0000","last_undegraded":"2023-10-05T15:16:15.211710+0000","last_fullsized":"2023-10-05T15:16:15.211710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:14:47.178038+0000","last_clean_scrub_stamp":"2023-10-05T15:14:47.178038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:09:41.680443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72347,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":886,"num_read_kb":525,"num_write":250,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416418,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":491395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.58299999999999996,"15min":0.59399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":1.264,"15min":1.264},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":1.304,"15min":1.304},"last":0.377}]},{"osd":1,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.32600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.79200000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":1.069,"15min":1.069},"last":0.505}]},{"osd":6,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85399999999999998,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74399999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82499999999999996,"15min":0.83299999999999996},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.91400000000000003,"5min":1.621,"15min":1.621},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96599999999999997,"5min":1.492,"15min":1.492},"last":0.80400000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.58899999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92300000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94399999999999995,"5min":1.74,"15min":1.74},"last":0.75900000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1708032,"data_stored":1147370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82099999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.625},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69199999999999995,"5min":1.335,"15min":1.335},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79200000000000004,"5min":0.874,"15min":0.874},"last":0.44}]},{"osd":5,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.89700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91800000000000004,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0009999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67300000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96199999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80000000000000004,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78700000000000003,"15min":0.79100000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0169999999999999,"5min":1.196,"15min":1.196},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97599999999999998,"5min":1.167,"15min":1.167},"last":0.80200000000000005}]}]},{"osd":9,"up_from":67,"seq":287762808873,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":491325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.372},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.84299999999999997,"5min":1.986,"15min":1.986},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.876,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65600000000000003,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.84899999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.99299999999999999,"5min":1.216,"15min":1.216},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.30499999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.91900000000000004,"5min":2.794,"15min":2.794},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":0.65200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.004,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":1.141,"15min":1.141},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.45800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1419999999999999,"5min":1.407,"15min":1.407},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.74399999999999999},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.266,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.49399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0409999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.196,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78200000000000003,"15min":0.83399999999999996},"min":{"1min":0.49199999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61599999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.94899999999999995,"5min":1.327,"15min":1.327},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2969999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65400000000000003}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.628},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66400000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070509,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":491703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.871,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65900000000000003,"15min":0.63300000000000001},"min":{"1min":0.46200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46200000000000002,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66900000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.496},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.46500000000000002,"15min":0.44700000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84599999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65200000000000002,"15min":0.623},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":2.073,"15min":2.073},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.0170000000000003,"15min":4.0170000000000003},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.57599999999999996,"15min":0.54800000000000004},"min":{"1min":0.40100000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.752}]},{"osd":6,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.71299999999999997,"15min":0.67300000000000004},"min":{"1min":0.51300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.69599999999999995},"min":{"1min":0.54500000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.746,"15min":0.70199999999999996},"min":{"1min":0.59599999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":2.109,"15min":2.109},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.05,"5min":1.583,"15min":1.583},"last":0.95199999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.72399999999999998,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.749},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.038,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.67300000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.65400000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.73199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0109999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.84199999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1089189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.97899999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.996}]},{"osd":9,"last update":"Thu Oct 5 15:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.61199999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.95499999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.88300000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":1.006},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":1.042}]}]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":486829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42099999999999999,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.23,"15min":1.23},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.40999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.502}]},{"osd":5,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.0960000000000001,"5min":1.147,"15min":1.147},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97299999999999998,"5min":1.296,"15min":1.296},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.264,"15min":1.264},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.242,"15min":1.242},"last":0.56299999999999994}]},{"osd":8,"last update":"Thu Oct 5 15:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93899999999999995,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":0.80900000000000005},"min":{"1min":0.55100000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":1.181,"15min":1.181},"last":0.72099999999999997}]},{"osd":9,"last update":"Thu Oct 5 15:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.77100000000000002,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":1.323,"15min":1.323},"last":0.626},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.44,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89600000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60199999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.64700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0629999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.748}]},{"osd":11,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":552131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.58999999999999997,"15min":0.52700000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59499999999999997,"15min":0.54900000000000004},"min":{"1min":0.51400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83699999999999997,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":11.920999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64600000000000002,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.752}]},{"osd":5,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.63400000000000001,"15min":0.59399999999999997},"min":{"1min":0.59799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.87},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.879,"5min":0.995,"15min":0.995},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":0.66600000000000004},"min":{"1min":0.46999999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":10.085000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":5.3010000000000002,"15min":5.3010000000000002},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93300000000000005,"5min":1.038,"15min":1.038},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.96399999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.71399999999999997,"15min":0.68400000000000005},"min":{"1min":0.55200000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95999999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.66300000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.54400000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.129},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80300000000000005,"15min":0.77500000000000002},"min":{"1min":0.60699999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":4.6630000000000003,"15min":4.6630000000000003},"last":0.998}]},{"osd":10,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89000000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:50 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.97899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":488012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.69799999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":11.119999999999999,"5min":11.119999999999999,"15min":11.119999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Oct 5 15:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58099999999999996,"15min":0.51500000000000001},"min":{"1min":0.438,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.64100000000000001,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.048,"5min":11.048,"15min":11.048},"last":0.621}]},{"osd":5,"last update":"Thu Oct 5 15:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.63300000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77900000000000003,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.084,"5min":11.084,"15min":11.084},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.745}]},{"osd":8,"last update":"Thu Oct 5 15:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.871,"15min":0.85499999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5620000000000001,"5min":6.3150000000000004,"15min":6.3150000000000004},"last":0.76600000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.75900000000000001,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":11.151999999999999,"15min":11.151999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.72599999999999998,"15min":0.73699999999999999},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78900000000000003,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.82199999999999995,"15min":0.76000000000000001},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":10.984999999999999,"5min":10.984999999999999,"15min":10.984999999999999},"last":0.67300000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.61599999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.72799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":553155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55200000000000005,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.58899999999999997,"15min":0.52100000000000002},"min":{"1min":0.40200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.4429999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.50900000000000001},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56799999999999995,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.59199999999999997,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.438},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.46600000000000003,"15min":0.42999999999999999},"min":{"1min":0.31900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.45500000000000002},"min":{"1min":0.35499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Thu Oct 5 15:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":3.831,"15min":3.831},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.63400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.878,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.88500000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.56000000000000005,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.753},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.628}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.745},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":0.747},"min":{"1min":0.63900000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91800000000000004,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.68400000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.72799999999999998,"15min":0.71299999999999997},"min":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85199999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":486206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29199999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61799999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.30399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.55500000000000005},"min":{"1min":0.51400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80700000000000005,"5min":1.097,"15min":1.097},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66900000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77600000000000002,"5min":1.087,"15min":1.087},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76300000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":1.097,"15min":1.097},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77400000000000002,"5min":1.149,"15min":1.149},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90400000000000003,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82499999999999996,"5min":1.04,"15min":1.04},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Oct 5 15:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94799999999999995,"5min":1.044,"15min":1.044},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66800000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.71499999999999997,"15min":0.78100000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.878,"5min":1.605,"15min":1.605},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.69399999999999995,"15min":0.76000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.47199999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.081,"15min":1.081},"last":0.63300000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54600000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":491479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:14:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.379},"min":{"1min":0.317,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38}]},{"osd":2,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61899999999999999,"15min":0.57699999999999996},"min":{"1min":0.505,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89700000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.87},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.57099999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.76300000000000001,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4750000000000001,"5min":1.528,"15min":1.528},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.452,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.73199999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.88600000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724602,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1083591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78900000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.63800000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.41499999999999998},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59299999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55700000000000005,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.75900000000000001,"5min":1.044,"15min":1.044},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.45000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70899999999999996,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.57699999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.028,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.675,"15min":1.675},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:16:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80500000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60499999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2849999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8759999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:16:37.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:37 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3708253410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:37 smithi135 ceph-mon[103360]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:37.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:37 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3708253410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:37.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:37 smithi092 ceph-mon[102944]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:37.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 -- 172.21.15.60:0/412706178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c600ffc50 msgr2=0x7f5c60100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 --2- 172.21.15.60:0/412706178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c600ffc50 0x7f5c60100070 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5c500099c0 tx=0x7f5c50009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 -- 172.21.15.60:0/412706178 shutdown_connections 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 --2- 172.21.15.60:0/412706178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 0x7f5c60108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 --2- 172.21.15.60:0/412706178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c600ffc50 0x7f5c60100070 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 --2- 172.21.15.60:0/412706178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c60100e40 0x7f5c601012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.686+0000 7f5c6519f700 1 -- 172.21.15.60:0/412706178 >> 172.21.15.60:0/412706178 conn(0x7f5c600fb1c0 msgr2=0x7f5c600fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.687+0000 7f5c6519f700 1 -- 172.21.15.60:0/412706178 shutdown_connections 2023-10-05T15:16:37.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.687+0000 7f5c6519f700 1 -- 172.21.15.60:0/412706178 wait complete. 2023-10-05T15:16:37.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.687+0000 7f5c6519f700 1 Processor -- start 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.687+0000 7f5c6519f700 1 -- start start 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6519f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c600ffc50 0x7f5c601968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6519f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 0x7f5c60196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6519f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 0x7f5c6019de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6519f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6019e430 con 0x7f5c60100e40 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6519f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6019e570 con 0x7f5c601017e0 2023-10-05T15:16:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6519f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6019e700 con 0x7f5c600ffc50 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 0x7f5c60196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 0x7f5c60196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38014/0 (socket says 172.21.15.60:38014) 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 -- 172.21.15.60:0/2289086157 learned_addr learned my addr 172.21.15.60:0/2289086157 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6499e700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 0x7f5c6019de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5ffff700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c600ffc50 0x7f5c601968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 -- 172.21.15.60:0/2289086157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c600ffc50 msgr2=0x7f5c601968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c600ffc50 0x7f5c601968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 -- 172.21.15.60:0/2289086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 msgr2=0x7f5c6019de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 0x7f5c6019de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 -- 172.21.15.60:0/2289086157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500095f0 con 0x7f5c60100e40 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5ffff700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c600ffc50 0x7f5c601968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c6499e700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 0x7f5c6019de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5f7fe700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 0x7f5c60196df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400d950 tx=0x7f5c5400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.688+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54009b40 con 0x7f5c60100e40 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.689+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c54009ca0 con 0x7f5c60100e40 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.689+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6019e9e0 con 0x7f5c60100e40 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.689+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400f620 con 0x7f5c60100e40 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.689+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6019eef0 con 0x7f5c60100e40 2023-10-05T15:16:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.690+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c601070d0 con 0x7f5c60100e40 2023-10-05T15:16:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.691+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5c54010460 con 0x7f5c60100e40 2023-10-05T15:16:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.691+0000 7f5c5d7fa700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5c480a1570 0x7f5c480a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.692+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f5c540cd3f0 con 0x7f5c60100e40 2023-10-05T15:16:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.692+0000 7f5c5ffff700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5c480a1570 0x7f5c480a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.692+0000 7f5c5ffff700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5c480a1570 0x7f5c480a3a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5c50006010 tx=0x7f5c50019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.695+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c54096750 con 0x7f5c60100e40 2023-10-05T15:16:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.896+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c6010c5d0 con 0x7f5c60100e40 2023-10-05T15:16:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.898+0000 7f5c5d7fa700 1 -- 172.21.15.60:0/2289086157 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f5c54016090 con 0x7f5c60100e40 2023-10-05T15:16:37.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:37.902 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:37.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5c480a1570 msgr2=0x7f5c480a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5c480a1570 0x7f5c480a3a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5c50006010 tx=0x7f5c50019040 comp rx=0 tx=0).stop 2023-10-05T15:16:37.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 msgr2=0x7f5c60196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:37.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 0x7f5c60196df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400d950 tx=0x7f5c5400dd10 comp rx=0 tx=0).stop 2023-10-05T15:16:37.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 shutdown_connections 2023-10-05T15:16:37.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c601017e0 0x7f5c6019de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c600ffc50 0x7f5c601968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f5c480a1570 0x7f5c480a3a30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 --2- 172.21.15.60:0/2289086157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c60100e40 0x7f5c60196df0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:37.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 >> 172.21.15.60:0/2289086157 conn(0x7f5c600fb1c0 msgr2=0x7f5c60104210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:37.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 shutdown_connections 2023-10-05T15:16:37.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:37.900+0000 7f5c6519f700 1 -- 172.21.15.60:0/2289086157 wait complete. 2023-10-05T15:16:37.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:16:37.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:16:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 -- 172.21.15.60:0/3892729498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 msgr2=0x7f9298108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 --2- 172.21.15.60:0/3892729498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f9298108200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f929000b0d0 tx=0x7f929000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 -- 172.21.15.60:0/3892729498 shutdown_connections 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 --2- 172.21.15.60:0/3892729498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f9298108200 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 --2- 172.21.15.60:0/3892729498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92980ffdc0 0x7f92981001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 --2- 172.21.15.60:0/3892729498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9298100fb0 0x7f9298101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.042+0000 7f929df8b700 1 -- 172.21.15.60:0/3892729498 >> 172.21.15.60:0/3892729498 conn(0x7f92980fb330 msgr2=0x7f92980fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.043+0000 7f929df8b700 1 -- 172.21.15.60:0/3892729498 shutdown_connections 2023-10-05T15:16:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.043+0000 7f929df8b700 1 -- 172.21.15.60:0/3892729498 wait complete. 2023-10-05T15:16:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.043+0000 7f929df8b700 1 Processor -- start 2023-10-05T15:16:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.043+0000 7f929df8b700 1 -- start start 2023-10-05T15:16:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.043+0000 7f929df8b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92980ffdc0 0x7f9298103d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.043+0000 7f929df8b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9298100fb0 0x7f9298102390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f929df8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f92981028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f929df8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298103070 con 0x7f9298101950 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f929df8b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92981031e0 con 0x7f92980ffdc0 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f929df8b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92981a0ca0 con 0x7f9298100fb0 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f92981028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f92981028d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38030/0 (socket says 172.21.15.60:38030) 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 -- 172.21.15.60:0/1679076027 learned_addr learned my addr 172.21.15.60:0/1679076027 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f92977fe700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92980ffdc0 0x7f9298103d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9296ffd700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9298100fb0 0x7f9298102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 -- 172.21.15.60:0/1679076027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9298100fb0 msgr2=0x7f9298102390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9298100fb0 0x7f9298102390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 -- 172.21.15.60:0/1679076027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92980ffdc0 msgr2=0x7f9298103d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92980ffdc0 0x7f9298103d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 -- 172.21.15.60:0/1679076027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009d00 con 0x7f9298101950 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f92977fe700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92980ffdc0 0x7f9298103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9296ffd700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9298100fb0 0x7f9298102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9297fff700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f92981028d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9290008f10 tx=0x7f9290008ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000e040 con 0x7f9298101950 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9290003c00 con 0x7f9298101950 2023-10-05T15:16:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92981a0f20 con 0x7f9298101950 2023-10-05T15:16:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929001b7d0 con 0x7f9298101950 2023-10-05T15:16:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.044+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92981a12e0 con 0x7f9298101950 2023-10-05T15:16:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.045+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929810b5e0 con 0x7f9298101950 2023-10-05T15:16:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.046+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9290005090 con 0x7f9298101950 2023-10-05T15:16:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.047+0000 7f9294ff9700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f92800a1480 0x7f92800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.047+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f92900ceb00 con 0x7f9298101950 2023-10-05T15:16:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.047+0000 7f92977fe700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f92800a1480 0x7f92800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.048+0000 7f92977fe700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f92800a1480 0x7f92800a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9298100e10 tx=0x7f928800b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.050+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9290097ef0 con 0x7f9298101950 2023-10-05T15:16:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.253+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92981a14d0 con 0x7f9298101950 2023-10-05T15:16:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.253+0000 7f9294ff9700 1 -- 172.21.15.60:0/1679076027 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f929009b510 con 0x7f9298101950 2023-10-05T15:16:38.256 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:16:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.255+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f92800a1480 msgr2=0x7f92800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.255+0000 7f929df8b700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f92800a1480 0x7f92800a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9298100e10 tx=0x7f928800b670 comp rx=0 tx=0).stop 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.255+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 msgr2=0x7f92981028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.255+0000 7f929df8b700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f92981028d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9290008f10 tx=0x7f9290008ff0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 shutdown_connections 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f92800a1480 0x7f92800a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9298101950 0x7f92981028d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92980ffdc0 0x7f9298103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 --2- 172.21.15.60:0/1679076027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9298100fb0 0x7f9298102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 >> 172.21.15.60:0/1679076027 conn(0x7f92980fb330 msgr2=0x7f9298068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 shutdown_connections 2023-10-05T15:16:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.256+0000 7f929df8b700 1 -- 172.21.15.60:0/1679076027 wait complete. 2023-10-05T15:16:38.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:16:38.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.397+0000 7f7c28b4a700 1 -- 172.21.15.60:0/2933074063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c24100fb0 msgr2=0x7f7c24101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.397+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/2933074063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c24100fb0 0x7f7c24101410 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7c140099c0 tx=0x7f7c14009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 -- 172.21.15.60:0/2933074063 shutdown_connections 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/2933074063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c24101950 0x7f7c24108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/2933074063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c240ffdc0 0x7f7c241001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/2933074063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c24100fb0 0x7f7c24101410 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 -- 172.21.15.60:0/2933074063 >> 172.21.15.60:0/2933074063 conn(0x7f7c240fb330 msgr2=0x7f7c240fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 -- 172.21.15.60:0/2933074063 shutdown_connections 2023-10-05T15:16:38.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 -- 172.21.15.60:0/2933074063 wait complete. 2023-10-05T15:16:38.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 Processor -- start 2023-10-05T15:16:38.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.398+0000 7f7c28b4a700 1 -- start start 2023-10-05T15:16:38.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 0x7f7c24068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24100fb0 0x7f7c2419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c24101950 0x7f7c2419df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2419e6e0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2419e850 con 0x7f7c24101950 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2419ea10 con 0x7f7c24100fb0 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 0x7f7c24068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 0x7f7c24068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38040/0 (socket says 172.21.15.60:38040) 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 -- 172.21.15.60:0/275294992 learned_addr learned my addr 172.21.15.60:0/275294992 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c21d9b700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24100fb0 0x7f7c2419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c22d9d700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c24101950 0x7f7c2419df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 -- 172.21.15.60:0/275294992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24100fb0 msgr2=0x7f7c2419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24100fb0 0x7f7c2419b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 -- 172.21.15.60:0/275294992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c24101950 msgr2=0x7f7c2419df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c24101950 0x7f7c2419df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 -- 172.21.15.60:0/275294992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140095f0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c2259c700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 0x7f7c24068bb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e970 tx=0x7f7c1800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18009790 con 0x7f7c240ffdc0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2419ecf0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c1800c7e0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.399+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18003c70 con 0x7f7c240ffdc0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.400+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2419f1b0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.401+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c24106d40 con 0x7f7c240ffdc0 2023-10-05T15:16:38.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.402+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7c1800cc50 con 0x7f7c240ffdc0 2023-10-05T15:16:38.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.402+0000 7f7c137fe700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7c0c0a1480 0x7f7c0c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.403+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f7c18014070 con 0x7f7c240ffdc0 2023-10-05T15:16:38.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.403+0000 7f7c21d9b700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7c0c0a1480 0x7f7c0c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.403+0000 7f7c21d9b700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7c0c0a1480 0x7f7c0c0a3940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400b580 tx=0x7f7c14005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:38.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.406+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7c18096660 con 0x7f7c240ffdc0 2023-10-05T15:16:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:38 smithi135 ceph-mon[103360]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:38 smithi135 ceph-mon[103360]: pgmap v316: 129 pgs: 129 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-05T15:16:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:38 smithi135 ceph-mon[103360]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:38 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2289086157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:38 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1679076027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:38.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.609+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c240008d0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.610+0000 7f7c137fe700 1 -- 172.21.15.60:0/275294992 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c18003dd0 con 0x7f7c240ffdc0 2023-10-05T15:16:38.615 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7c0c0a1480 msgr2=0x7f7c0c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7c0c0a1480 0x7f7c0c0a3940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400b580 tx=0x7f7c14005fb0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 msgr2=0x7f7c24068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 0x7f7c24068bb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e970 tx=0x7f7c1800ec80 comp rx=0 tx=0).stop 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 shutdown_connections 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c24101950 0x7f7c2419df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f7c0c0a1480 0x7f7c0c0a3940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c240ffdc0 0x7f7c24068bb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 --2- 172.21.15.60:0/275294992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24100fb0 0x7f7c2419b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 >> 172.21.15.60:0/275294992 conn(0x7f7c240fb330 msgr2=0x7f7c240fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 shutdown_connections 2023-10-05T15:16:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.612+0000 7f7c28b4a700 1 -- 172.21.15.60:0/275294992 wait complete. 2023-10-05T15:16:38.626 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:38 smithi060 ceph-mon[99238]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:38.627 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:38 smithi060 ceph-mon[99238]: pgmap v316: 129 pgs: 129 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-05T15:16:38.627 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:38 smithi060 ceph-mon[99238]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:38.627 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:38 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2289086157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:38.627 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:38 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1679076027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:38.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:16:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:38 smithi092 ceph-mon[102944]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:38 smithi092 ceph-mon[102944]: pgmap v316: 129 pgs: 129 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-05T15:16:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:38 smithi092 ceph-mon[102944]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:16:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:38 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2289086157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:38 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1679076027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:16:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 -- 172.21.15.60:0/3832984270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258106be0 msgr2=0x7f7258109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 --2- 172.21.15.60:0/3832984270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258106be0 0x7f7258109050 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f725000b0a0 tx=0x7f725000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 -- 172.21.15.60:0/3832984270 shutdown_connections 2023-10-05T15:16:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 --2- 172.21.15.60:0/3832984270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258106be0 0x7f7258109050 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 --2- 172.21.15.60:0/3832984270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7258101980 0x7f7258103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 --2- 172.21.15.60:0/3832984270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72581042b0 0x7f72581066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 -- 172.21.15.60:0/3832984270 >> 172.21.15.60:0/3832984270 conn(0x7f72580fb3b0 msgr2=0x7f72580fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 -- 172.21.15.60:0/3832984270 shutdown_connections 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.755+0000 7f725db2d700 1 -- 172.21.15.60:0/3832984270 wait complete. 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 Processor -- start 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 -- start start 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 0x7f7258196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72581042b0 0x7f72581971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258106be0 0x7f725819e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725819e810 con 0x7f7258101980 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725819e980 con 0x7f72581042b0 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.756+0000 7f725db2d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725819eb40 con 0x7f7258106be0 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 0x7f7258196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 0x7f7258196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38054/0 (socket says 172.21.15.60:38054) 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 -- 172.21.15.60:0/4273891223 learned_addr learned my addr 172.21.15.60:0/4273891223 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7256ffd700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72581042b0 0x7f72581971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7257fff700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258106be0 0x7f725819e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 -- 172.21.15.60:0/4273891223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258106be0 msgr2=0x7f725819e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258106be0 0x7f725819e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 -- 172.21.15.60:0/4273891223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72581042b0 msgr2=0x7f72581971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72581042b0 0x7f72581971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 -- 172.21.15.60:0/4273891223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009d00 con 0x7f7258101980 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7257fff700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258106be0 0x7f725819e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7256ffd700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72581042b0 0x7f72581971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f72577fe700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 0x7f7258196ca0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f724800e9a0 tx=0x7f724800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248009790 con 0x7f7258101980 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724800cbd0 con 0x7f7258101980 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725819ee20 con 0x7f7258101980 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248018680 con 0x7f7258101980 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.757+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725819f2a0 con 0x7f7258101980 2023-10-05T15:16:38.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.758+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580fcf30 con 0x7f7258101980 2023-10-05T15:16:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.759+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f724800cd40 con 0x7f7258101980 2023-10-05T15:16:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.760+0000 7f7254ff9700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f72400a1500 0x7f72400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.760+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f7248014070 con 0x7f7258101980 2023-10-05T15:16:38.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.760+0000 7f7256ffd700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f72400a1500 0x7f72400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:38.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.761+0000 7f7256ffd700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f72400a1500 0x7f72400a39c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f724c005950 tx=0x7f724c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:38.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.763+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7248096af0 con 0x7f7258101980 2023-10-05T15:16:38.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.962+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f725810c930 con 0x7f7258101980 2023-10-05T15:16:38.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.963+0000 7f7254ff9700 1 -- 172.21.15.60:0/4273891223 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f724809a110 con 0x7f7258101980 2023-10-05T15:16:38.966 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:16:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f72400a1500 msgr2=0x7f72400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f72400a1500 0x7f72400a39c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f724c005950 tx=0x7f724c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 msgr2=0x7f7258196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 0x7f7258196ca0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f724800e9a0 tx=0x7f724800ed60 comp rx=0 tx=0).stop 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 shutdown_connections 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258106be0 0x7f725819e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f72400a1500 0x7f72400a39c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258101980 0x7f7258196ca0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 --2- 172.21.15.60:0/4273891223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72581042b0 0x7f72581971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 >> 172.21.15.60:0/4273891223 conn(0x7f72580fb3b0 msgr2=0x7f7258102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 shutdown_connections 2023-10-05T15:16:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:38.965+0000 7f725db2d700 1 -- 172.21.15.60:0/4273891223 wait complete. 2023-10-05T15:16:38.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:16:39.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2997818430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 msgr2=0x7f83c4109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2997818430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c4109010 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b0a0 tx=0x7f83bc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2997818430 shutdown_connections 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2997818430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c4109010 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2997818430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c41019a0 0x7f83c4103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2997818430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 0x7f83c41066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2997818430 >> 172.21.15.60:0/2997818430 conn(0x7f83c40fb330 msgr2=0x7f83c40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2997818430 shutdown_connections 2023-10-05T15:16:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.108+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2997818430 wait complete. 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 Processor -- start 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 -- start start 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c41019a0 0x7f83c4101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 0x7f83c40ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c40ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4100630 con 0x7f83c4106c00 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c41007a0 con 0x7f83c41019a0 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83cb6f7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c41a0d10 con 0x7f83c41042d0 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c40ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c40ffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38072/0 (socket says 172.21.15.60:38072) 2023-10-05T15:16:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 -- 172.21.15.60:0/2626110158 learned_addr learned my addr 172.21.15.60:0/2626110158 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9493700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c41019a0 0x7f83c4101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c8c92700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 0x7f83c40ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 -- 172.21.15.60:0/2626110158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 msgr2=0x7f83c40ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 0x7f83c40ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 -- 172.21.15.60:0/2626110158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c41019a0 msgr2=0x7f83c4101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c41019a0 0x7f83c4101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 -- 172.21.15.60:0/2626110158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009d00 con 0x7f83c4106c00 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c8c92700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 0x7f83c40ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.109+0000 7f83c9c94700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c40ffe90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b780 tx=0x7f83bc00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.110+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00e040 con 0x7f83c4106c00 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.110+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c41a0f90 con 0x7f83c4106c00 2023-10-05T15:16:39.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.110+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83bc004c50 con 0x7f83c4106c00 2023-10-05T15:16:39.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.110+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0053b0 con 0x7f83c4106c00 2023-10-05T15:16:39.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.110+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c41a1360 con 0x7f83c4106c00 2023-10-05T15:16:39.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.111+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c40fceb0 con 0x7f83c4106c00 2023-10-05T15:16:39.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.112+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f83bc01d9c0 con 0x7f83c4106c00 2023-10-05T15:16:39.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.112+0000 7f83ba7fc700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83b00a1480 0x7f83b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.112+0000 7f83c9493700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83b00a1480 0x7f83b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.112+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f83bc0ceaf0 con 0x7f83c4106c00 2023-10-05T15:16:39.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.113+0000 7f83c9493700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83b00a1480 0x7f83b00a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009c60 tx=0x7f83b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:39.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.116+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83bc097ee0 con 0x7f83c4106c00 2023-10-05T15:16:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.322+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f83c410c8f0 con 0x7f83c4106c00 2023-10-05T15:16:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.322+0000 7f83ba7fc700 1 -- 172.21.15.60:0/2626110158 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f83bc09b500 con 0x7f83c4106c00 2023-10-05T15:16:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:16:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83b00a1480 msgr2=0x7f83b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83b00a1480 0x7f83b00a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009c60 tx=0x7f83b4009260 comp rx=0 tx=0).stop 2023-10-05T15:16:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 msgr2=0x7f83c40ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c40ffe90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b780 tx=0x7f83bc00bab0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 shutdown_connections 2023-10-05T15:16:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f83b00a1480 0x7f83b00a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83c4106c00 0x7f83c40ffe90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c41019a0 0x7f83c4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 --2- 172.21.15.60:0/2626110158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c41042d0 0x7f83c40ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 >> 172.21.15.60:0/2626110158 conn(0x7f83c40fb330 msgr2=0x7f83c4102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:39.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 shutdown_connections 2023-10-05T15:16:39.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.324+0000 7f83cb6f7700 1 -- 172.21.15.60:0/2626110158 wait complete. 2023-10-05T15:16:39.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:16:39.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 -- 172.21.15.60:0/46623509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c1000b0 msgr2=0x7f2b3c100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/46623509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c1000b0 0x7f2b3c100510 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009990 tx=0x7f2b38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 -- 172.21.15.60:0/46623509 shutdown_connections 2023-10-05T15:16:39.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/46623509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b3c100a50 0x7f2b3c108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/46623509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c101380 0x7f2b3c1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/46623509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c1000b0 0x7f2b3c100510 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 -- 172.21.15.60:0/46623509 >> 172.21.15.60:0/46623509 conn(0x7f2b3c0faac0 msgr2=0x7f2b3c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:39.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 -- 172.21.15.60:0/46623509 shutdown_connections 2023-10-05T15:16:39.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.463+0000 7f2b43ff3700 1 -- 172.21.15.60:0/46623509 wait complete. 2023-10-05T15:16:39.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 Processor -- start 2023-10-05T15:16:39.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 -- start start 2023-10-05T15:16:39.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b3c1000b0 0x7f2b3c0ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c100a50 0x7f2b3c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 0x7f2b3c19df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c19e710 con 0x7f2b3c101380 2023-10-05T15:16:39.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c19e880 con 0x7f2b3c100a50 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b43ff3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c19ea40 con 0x7f2b3c1000b0 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 0x7f2b3c19df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 0x7f2b3c19df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38086/0 (socket says 172.21.15.60:38086) 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 -- 172.21.15.60:0/3059209053 learned_addr learned my addr 172.21.15.60:0/3059209053 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b41d8f700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b3c1000b0 0x7f2b3c0ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b4158e700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c100a50 0x7f2b3c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 -- 172.21.15.60:0/3059209053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b3c1000b0 msgr2=0x7f2b3c0ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b3c1000b0 0x7f2b3c0ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 -- 172.21.15.60:0/3059209053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c100a50 msgr2=0x7f2b3c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c100a50 0x7f2b3c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b42590700 1 -- 172.21.15.60:0/3059209053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380095f0 con 0x7f2b3c101380 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.464+0000 7f2b4158e700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c100a50 0x7f2b3c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.465+0000 7f2b42590700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 0x7f2b3c19df40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b34007ee0 tx=0x7f2b3400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.465+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34017070 con 0x7f2b3c101380 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.465+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b3400f040 con 0x7f2b3c101380 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.465+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c19ed20 con 0x7f2b3c101380 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.465+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34005740 con 0x7f2b3c101380 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.465+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c19f1d0 con 0x7f2b3c101380 2023-10-05T15:16:39.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.466+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c107480 con 0x7f2b3c101380 2023-10-05T15:16:39.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.467+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2b3400dc60 con 0x7f2b3c101380 2023-10-05T15:16:39.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.468+0000 7f2b32ffd700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b280a1550 0x7f2b280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.468+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2b340ccda0 con 0x7f2b3c101380 2023-10-05T15:16:39.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.468+0000 7f2b41d8f700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b280a1550 0x7f2b280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.468+0000 7f2b41d8f700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b280a1550 0x7f2b280a3a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c068fe0 tx=0x7f2b2c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:39.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.471+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2b34096100 con 0x7f2b3c101380 2023-10-05T15:16:39.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:39 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/275294992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:39.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:39 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/4273891223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:39.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:39 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/275294992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:39.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:39 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/4273891223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:39.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:39 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/275294992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:16:39.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:39 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/4273891223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:16:39.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.720+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b3c02d2e0 con 0x7f2b3c101380 2023-10-05T15:16:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.720+0000 7f2b32ffd700 1 -- 172.21.15.60:0/3059209053 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7f2b34099720 con 0x7f2b3c101380 2023-10-05T15:16:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:39.723 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b280a1550 msgr2=0x7f2b280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b280a1550 0x7f2b280a3a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c068fe0 tx=0x7f2b2c00b410 comp rx=0 tx=0).stop 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 msgr2=0x7f2b3c19df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 0x7f2b3c19df40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b34007ee0 tx=0x7f2b3400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 shutdown_connections 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f2b280a1550 0x7f2b280a3a10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c101380 0x7f2b3c19df40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b3c1000b0 0x7f2b3c0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 --2- 172.21.15.60:0/3059209053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b3c100a50 0x7f2b3c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 >> 172.21.15.60:0/3059209053 conn(0x7f2b3c0faac0 msgr2=0x7f2b3c1045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:39.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 shutdown_connections 2023-10-05T15:16:39.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.723+0000 7f2b43ff3700 1 -- 172.21.15.60:0/3059209053 wait complete. 2023-10-05T15:16:39.727 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:16:39.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:16:39.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 -- 172.21.15.60:0/419935939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102080 msgr2=0x7f38c0102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 --2- 172.21.15.60:0/419935939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102080 0x7f38c0102500 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009990 tx=0x7f38b4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 -- 172.21.15.60:0/419935939 shutdown_connections 2023-10-05T15:16:39.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 --2- 172.21.15.60:0/419935939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0102a40 0x7f38c0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 --2- 172.21.15.60:0/419935939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38c0100ea0 0x7f38c01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 --2- 172.21.15.60:0/419935939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102080 0x7f38c0102500 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 -- 172.21.15.60:0/419935939 >> 172.21.15.60:0/419935939 conn(0x7f38c00fc420 msgr2=0x7f38c00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:39.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 -- 172.21.15.60:0/419935939 shutdown_connections 2023-10-05T15:16:39.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.862+0000 7f38c727b700 1 -- 172.21.15.60:0/419935939 wait complete. 2023-10-05T15:16:39.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 Processor -- start 2023-10-05T15:16:39.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 -- start start 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38c0100ea0 0x7f38c0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0102080 0x7f38c01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 0x7f38c019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c019e720 con 0x7f38c0102a40 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c019e860 con 0x7f38c0102080 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c727b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c019e9f0 con 0x7f38c0100ea0 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c5818700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 0x7f38c019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c5818700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 0x7f38c019e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38100/0 (socket says 172.21.15.60:38100) 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c5818700 1 -- 172.21.15.60:0/1575745113 learned_addr learned my addr 172.21.15.60:0/1575745113 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:39.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.863+0000 7f38c4816700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0102080 0x7f38c01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5017700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38c0100ea0 0x7f38c0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5818700 1 -- 172.21.15.60:0/1575745113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38c0100ea0 msgr2=0x7f38c0196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5818700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38c0100ea0 0x7f38c0196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5818700 1 -- 172.21.15.60:0/1575745113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0102080 msgr2=0x7f38c01970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5818700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0102080 0x7f38c01970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5818700 1 -- 172.21.15.60:0/1575745113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40095f0 con 0x7f38c0102a40 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c5818700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 0x7f38c019e150 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f38b800d980 tx=0x7f38b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8004a30 con 0x7f38c0102a40 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38b800b5c0 con 0x7f38c0102a40 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c019ecd0 con 0x7f38c0102a40 2023-10-05T15:16:39.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8009b50 con 0x7f38c0102a40 2023-10-05T15:16:39.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.864+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c019f190 con 0x7f38c0102a40 2023-10-05T15:16:39.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.865+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c010c710 con 0x7f38c0102a40 2023-10-05T15:16:39.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.866+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f38b8009cb0 con 0x7f38c0102a40 2023-10-05T15:16:39.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.867+0000 7f38be7fc700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38a80a14d0 0x7f38a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:39.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.867+0000 7f38c5017700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38a80a14d0 0x7f38a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:39.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.867+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f38b80cd260 con 0x7f38c0102a40 2023-10-05T15:16:39.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.868+0000 7f38c5017700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38a80a14d0 0x7f38a80a3990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f38c0101bf0 tx=0x7f38b000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:39.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:39.871+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38b80965c0 con 0x7f38c0102a40 2023-10-05T15:16:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.079+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c0107e40 con 0x7f38c0102a40 2023-10-05T15:16:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.081+0000 7f38be7fc700 1 -- 172.21.15.60:0/1575745113 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24318 (secure 0 0 0) 0x7f38b8017070 con 0x7f38c0102a40 2023-10-05T15:16:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:16:40.084 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:15:47.054432+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:16:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38a80a14d0 msgr2=0x7f38a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38a80a14d0 0x7f38a80a3990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f38c0101bf0 tx=0x7f38b000b040 comp rx=0 tx=0).stop 2023-10-05T15:16:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 msgr2=0x7f38c019e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 0x7f38c019e150 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f38b800d980 tx=0x7f38b800dc90 comp rx=0 tx=0).stop 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 shutdown_connections 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f38a80a14d0 0x7f38a80a3990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c0102a40 0x7f38c019e150 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38c0100ea0 0x7f38c0196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 --2- 172.21.15.60:0/1575745113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0102080 0x7f38c01970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 >> 172.21.15.60:0/1575745113 conn(0x7f38c00fc420 msgr2=0x7f38c00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 shutdown_connections 2023-10-05T15:16:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.083+0000 7f38c727b700 1 -- 172.21.15.60:0/1575745113 wait complete. 2023-10-05T15:16:40.099 DEBUG:tasks.fwd_scrub:Yielding 2023-10-05T15:16:40.099 INFO:teuthology.run_tasks:Running task exec... 2023-10-05T15:16:40.111 INFO:teuthology.task.exec:Executing custom commands... 2023-10-05T15:16:40.111 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:16:40.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-10-05T15:16:40.112 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-05T15:16:40.112 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:16:40.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:16:40.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 -- 172.21.15.60:0/2474539140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7281042a0 msgr2=0x7fa728106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 --2- 172.21.15.60:0/2474539140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7281042a0 0x7fa728106690 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009990 tx=0x7fa71c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 -- 172.21.15.60:0/2474539140 shutdown_connections 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 --2- 172.21.15.60:0/2474539140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa728106bd0 0x7fa728109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 --2- 172.21.15.60:0/2474539140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa728101970 0x7fa728103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 --2- 172.21.15.60:0/2474539140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7281042a0 0x7fa728106690 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 -- 172.21.15.60:0/2474539140 >> 172.21.15.60:0/2474539140 conn(0x7fa7280fb340 msgr2=0x7fa7280fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 -- 172.21.15.60:0/2474539140 shutdown_connections 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.245+0000 7fa72e27f700 1 -- 172.21.15.60:0/2474539140 wait complete. 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 Processor -- start 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 -- start start 2023-10-05T15:16:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 0x7fa728198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7281042a0 0x7fa728199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa728106bd0 0x7fa72819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72819a8e0 con 0x7fa728101970 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.246+0000 7fa72e27f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72819aa50 con 0x7fa728106bd0 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa72e27f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72819ac10 con 0x7fa7281042a0 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 0x7fa728198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 0x7fa728198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38116/0 (socket says 172.21.15.60:38116) 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 -- 172.21.15.60:0/1906500203 learned_addr learned my addr 172.21.15.60:0/1906500203 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa72c81c700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa728106bd0 0x7fa72819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa7277fe700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7281042a0 0x7fa728199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 -- 172.21.15.60:0/1906500203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7281042a0 msgr2=0x7fa728199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7281042a0 0x7fa728199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 -- 172.21.15.60:0/1906500203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa728106bd0 msgr2=0x7fa72819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa728106bd0 0x7fa72819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 -- 172.21.15.60:0/1906500203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0095f0 con 0x7fa728101970 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa727fff700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 0x7fa728198ef0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa71800e9a0 tx=0x7fa71800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718009790 con 0x7fa728101970 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72819aef0 con 0x7fa728101970 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa71800cbd0 con 0x7fa728101970 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718018680 con 0x7fa728101970 2023-10-05T15:16:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.247+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7281a1660 con 0x7fa728101970 2023-10-05T15:16:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 -- 172.21.15.60:0/2052887163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4106c00 msgr2=0x7f82c4109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/2052887163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4106c00 0x7f82c4109010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009f90 tx=0x7f82bc00b330 comp rx=0 tx=0).stop 2023-10-05T15:16:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 -- 172.21.15.60:0/2052887163 shutdown_connections 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/2052887163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4106c00 0x7f82c4109010 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/2052887163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82c41019a0 0x7f82c4103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/2052887163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41042d0 0x7f82c41066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 -- 172.21.15.60:0/2052887163 >> 172.21.15.60:0/2052887163 conn(0x7f82c40fb330 msgr2=0x7f82c40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 -- 172.21.15.60:0/2052887163 shutdown_connections 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.248+0000 7f82ca2a1700 1 -- 172.21.15.60:0/2052887163 wait complete. 2023-10-05T15:16:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.249+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7281087a0 con 0x7fa728101970 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.249+0000 7f82ca2a1700 1 Processor -- start 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.249+0000 7f82ca2a1700 1 -- start start 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82ca2a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 0x7f82c4101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82ca2a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c41042d0 0x7f82c40ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82ca2a1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82c4106c00 0x7f82c40ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82ca2a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4100630 con 0x7f82c41019a0 2023-10-05T15:16:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82ca2a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c41007a0 con 0x7f82c41042d0 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82ca2a1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c41a0d60 con 0x7f82c4106c00 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 0x7f82c4101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 0x7f82c4101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38122/0 (socket says 172.21.15.60:38122) 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 -- 172.21.15.60:0/1444417848 learned_addr learned my addr 172.21.15.60:0/1444417848 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c37fe700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c41042d0 0x7f82c40ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c883e700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82c4106c00 0x7f82c40ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 -- 172.21.15.60:0/1444417848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82c4106c00 msgr2=0x7f82c40ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82c4106c00 0x7f82c40ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 -- 172.21.15.60:0/1444417848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c41042d0 msgr2=0x7f82c40ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c41042d0 0x7f82c40ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c3fff700 1 -- 172.21.15.60:0/1444417848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc009c40 con 0x7f82c41019a0 2023-10-05T15:16:40.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7f82c37fe700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c41042d0 0x7f82c40ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:40.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.251+0000 7f82c3fff700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 0x7f82c4101310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f82b400d950 tx=0x7f82b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.250+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa71800cd40 con 0x7fa728101970 2023-10-05T15:16:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.251+0000 7fa7257fa700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa7100a1480 0x7fa7100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.251+0000 7fa7277fe700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa7100a1480 0x7fa7100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.251+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fa718014070 con 0x7fa728101970 2023-10-05T15:16:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.251+0000 7fa7277fe700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa7100a1480 0x7fa7100a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa71c006010 tx=0x7fa71c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.254+0000 7f82c17fa700 1 -- 172.21.15.60:0/1444417848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4009930 con 0x7f82c41019a0 2023-10-05T15:16:40.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.254+0000 7f82c17fa700 1 -- 172.21.15.60:0/1444417848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82b4010460 con 0x7f82c41019a0 2023-10-05T15:16:40.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.254+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c41a0fe0 con 0x7f82c41019a0 2023-10-05T15:16:40.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.254+0000 7f82c17fa700 1 -- 172.21.15.60:0/1444417848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400f620 con 0x7f82c41019a0 2023-10-05T15:16:40.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.254+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa7180968b0 con 0x7fa728101970 2023-10-05T15:16:40.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.254+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c41a14b0 con 0x7f82c41019a0 2023-10-05T15:16:40.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.256+0000 7f82c17fa700 1 -- 172.21.15.60:0/1444417848 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f82b40108d0 con 0x7f82c41019a0 2023-10-05T15:16:40.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.257+0000 7f82c17fa700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f82ac0a1500 0x7f82ac0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.257+0000 7f82c37fe700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f82ac0a1500 0x7f82ac0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.257+0000 7f82c17fa700 1 -- 172.21.15.60:0/1444417848 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f82b40ccd00 con 0x7f82c41019a0 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82c37fe700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f82ac0a1500 0x7f82ac0a39c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005fd0 tx=0x7f82b8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 Processor -- start 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 -- start start 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5ef700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d5574e0 con 0x55820d5f0ae0 2023-10-05T15:16:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d548ca0 con 0x55820d5ef2e0 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.258+0000 7f82d648bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d5465c0 con 0x55820d5efc40 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38136/0 (socket says 172.21.15.60:38136) 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 -- 172.21.15.60:0/293592670 learned_addr learned my addr 172.21.15.60:0/293592670 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c3fff700 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c37fe700 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 -- 172.21.15.60:0/293592670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 msgr2=0x55820d5f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 -- 172.21.15.60:0/293592670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 msgr2=0x55820d5ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5ef700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 -- 172.21.15.60:0/293592670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55820d36ce60 con 0x55820d5f0ae0 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c3fff700 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82c883e700 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f0f60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f82bc015000 tx=0x7f82bc0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f40fbdeaa0ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82aa7fc700 1 -- 172.21.15.60:0/293592670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00e040 con 0x55820d5f0ae0 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82aa7fc700 1 -- 172.21.15.60:0/293592670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82bc0076a0 con 0x55820d5f0ae0 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.259+0000 7f82aa7fc700 1 -- 172.21.15.60:0/293592670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00bdb0 con 0x55820d5f0ae0 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 -- 172.21.15.60:0/293592670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 msgr2=0x55820d5f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f0f60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f82bc015000 tx=0x7f82bc0093e0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 -- 172.21.15.60:0/293592670 shutdown_connections 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f0f60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 --2- 172.21.15.60:0/293592670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 -- 172.21.15.60:0/293592670 >> 172.21.15.60:0/293592670 conn(0x55820d5632e0 msgr2=0x55820d5ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 -- 172.21.15.60:0/293592670 shutdown_connections 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 -- 172.21.15.60:0/293592670 wait complete. 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.260+0000 7f82d648bb80 1 -- start start 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 Processor -- start 2023-10-05T15:16:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d6005c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d541eb0 con 0x55820d5f0ae0 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d4de790 con 0x55820d5ef2e0 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d4de430 con 0x55820d5efc40 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82d648bb80 10 client.0 _ll_register_callbacks cb 0x55820d33b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d6005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d6005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38142/0 (socket says 172.21.15.60:38142) 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 -- 172.21.15.60:0/973662315 learned_addr learned my addr 172.21.15.60:0/973662315 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c37fe700 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 -- 172.21.15.60:0/973662315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 msgr2=0x55820d5f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 -- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 msgr2=0x55820d5f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.261+0000 7f82c883e700 1 -- 172.21.15.60:0/973662315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c41a14b0 con 0x55820d5f0ae0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82c883e700 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d6005c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00b6c0 tx=0x7f82bc00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6040e1370601e9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82a37fe700 1 -- 172.21.15.60:0/973662315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00e040 con 0x55820d5f0ae0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55820d5e1f90 con 0x55820d5f0ae0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82a37fe700 1 -- 172.21.15.60:0/973662315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f82bc007ad0 con 0x55820d5f0ae0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82a37fe700 1 -- 172.21.15.60:0/973662315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82bc007c90 con 0x55820d5f0ae0 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 10 client.15627 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f82c4109c00 con 0x55820d5f0ae0 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82a37fe700 1 -- 172.21.15.60:0/973662315 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55820d5e1f90 con 0x55820d5f0ae0 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82a37fe700 1 -- 172.21.15.60:0/973662315 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f82bc019030 con 0x55820d5f0ae0 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 20 client.15627 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d604940 0x55820d606d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 4 client.15627 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.262+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55820d53ae90 con 0x55820d604940 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.263+0000 7f82c3fff700 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d604940 0x55820d606d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.263+0000 7f82a37fe700 10 client.15627 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.263+0000 7f82c3fff700 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d604940 0x55820d606d60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c58776c16bc4c7 server_cookie=f835c029c0e2dae1 in_seq=0 out_seq=0 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82a37fe700 1 -- 172.21.15.60:0/973662315 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55820d53ae90 con 0x55820d604940 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82a37fe700 10 client.15627 handle_command_reply: tid=0 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 client.15627 shutdown 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 msgr2=0x55820d6005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d6005c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00b6c0 tx=0x7f82bc00bf00 comp rx=0 tx=0).stop 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 shutdown_connections 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d604940 0x55820d606d60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d6005c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 --2- 172.21.15.60:0/973662315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d5f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82a37fe700 0 client.15627 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 >> 172.21.15.60:0/973662315 conn(0x55820d5632e0 msgr2=0x55820d5e9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 shutdown_connections 2023-10-05T15:16:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 1 -- 172.21.15.60:0/973662315 wait complete. 2023-10-05T15:16:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.264+0000 7f82d648bb80 20 client.15627 trim_cache size 0 max 16384 2023-10-05T15:16:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 Processor -- start 2023-10-05T15:16:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 -- start start 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d600580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d5f8a50 con 0x55820d5f0ae0 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d3c29a0 con 0x55820d5ef2e0 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82d648bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d5f84f0 con 0x55820d5efc40 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38150/0 (socket says 172.21.15.60:38150) 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 -- 172.21.15.60:0/4177928752 learned_addr learned my addr 172.21.15.60:0/4177928752 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c37fe700 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d600580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c3fff700 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 -- 172.21.15.60:0/4177928752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 msgr2=0x55820d600580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d600580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 -- 172.21.15.60:0/4177928752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 msgr2=0x55820d5f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.282+0000 7f82c883e700 1 -- 172.21.15.60:0/4177928752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55820d60b950 con 0x55820d5f0ae0 2023-10-05T15:16:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.283+0000 7f82c883e700 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f9560 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f82bc000f80 tx=0x7f82bc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72d226babac525e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.285+0000 7f82aaffd700 1 -- 172.21.15.60:0/4177928752 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00e040 con 0x55820d5f0ae0 2023-10-05T15:16:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.285+0000 7f82aaffd700 1 -- 172.21.15.60:0/4177928752 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82bc029070 con 0x55820d5f0ae0 2023-10-05T15:16:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.285+0000 7f82aaffd700 1 -- 172.21.15.60:0/4177928752 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc005300 con 0x55820d5f0ae0 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 -- 172.21.15.60:0/4177928752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 msgr2=0x55820d5f9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f9560 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f82bc000f80 tx=0x7f82bc0021d0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 -- 172.21.15.60:0/4177928752 shutdown_connections 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5f0ae0 0x55820d5f9560 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 --2- 172.21.15.60:0/4177928752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5efc40 0x55820d600580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 -- 172.21.15.60:0/4177928752 >> 172.21.15.60:0/4177928752 conn(0x55820d5632e0 msgr2=0x55820d5f39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 -- 172.21.15.60:0/4177928752 shutdown_connections 2023-10-05T15:16:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 -- 172.21.15.60:0/4177928752 wait complete. 2023-10-05T15:16:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.286+0000 7f82d648bb80 1 -- start start 2023-10-05T15:16:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 Processor -- start 2023-10-05T15:16:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5fd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 0x55820d5fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5f0ae0 0x55820d658720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d5fdeb0 con 0x55820d5efc40 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d658c60 con 0x55820d5ef2e0 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820d658da0 con 0x55820d5f0ae0 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82d648bb80 10 client.0 _ll_register_callbacks cb 0x7f82b4096060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 0x55820d5fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 0x55820d5fd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38154/0 (socket says 172.21.15.60:38154) 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 -- 172.21.15.60:0/715004800 learned_addr learned my addr 172.21.15.60:0/715004800 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c883e700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5f0ae0 0x55820d658720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c3fff700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 -- 172.21.15.60:0/715004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5f0ae0 msgr2=0x55820d658720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5f0ae0 0x55820d658720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 -- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 msgr2=0x55820d5fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c37fe700 1 -- 172.21.15.60:0/715004800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c4109c00 con 0x55820d5efc40 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.287+0000 7f82c3fff700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82c37fe700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 0x55820d5fd8d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f82b8003e70 tx=0x7f82b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f525566678053ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82a37fe700 1 -- 172.21.15.60:0/715004800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8024070 con 0x55820d5efc40 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82a37fe700 1 -- 172.21.15.60:0/715004800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f82b801ed90 con 0x55820d5efc40 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82bc0076a0 con 0x55820d5efc40 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82a37fe700 1 -- 172.21.15.60:0/715004800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b8029400 con 0x55820d5efc40 2023-10-05T15:16:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 10 client.15633 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55820d5f7fc0 con 0x55820d5efc40 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82a37fe700 1 -- 172.21.15.60:0/715004800 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82bc0076a0 con 0x55820d5efc40 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82a37fe700 1 -- 172.21.15.60:0/715004800 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f82b80324d0 con 0x55820d5efc40 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 10 client.15633 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 20 client.15633 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d65a8b0 0x55820d65ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 4 client.15633 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.288+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55820d53abb0 con 0x55820d65a8b0 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.289+0000 7f82c3fff700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d65a8b0 0x55820d65ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.289+0000 7f82a37fe700 10 client.15633 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.289+0000 7f82c3fff700 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d65a8b0 0x55820d65ccd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b79bf366e0a4da4d server_cookie=7030ce6ae7be2741 in_seq=0 out_seq=0 2023-10-05T15:16:40.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.290+0000 7f82a37fe700 1 -- 172.21.15.60:0/715004800 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55820d53abb0 con 0x55820d65a8b0 2023-10-05T15:16:40.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.290+0000 7f82a37fe700 10 client.15633 handle_command_reply: tid=0 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 client.15633 shutdown 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 msgr2=0x55820d5fd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 0x55820d5fd8d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f82b8003e70 tx=0x7f82b80047c0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 shutdown_connections 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55820d65a8b0 0x55820d65ccd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55820d5f0ae0 0x55820d658720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55820d5ef2e0 0x55820d5fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 --2- 172.21.15.60:0/715004800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55820d5efc40 0x55820d5fd8d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82a37fe700 0 client.15633 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 >> 172.21.15.60:0/715004800 conn(0x55820d5632e0 msgr2=0x55820d5f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 shutdown_connections 2023-10-05T15:16:40.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 1 -- 172.21.15.60:0/715004800 wait complete. 2023-10-05T15:16:40.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82d648bb80 20 client.15633 trim_cache size 0 max 16384 2023-10-05T15:16:40.298 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:40.298 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2023-10-05T15:16:40.298 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "577ea873-b529-47c6-b8aa-7dc4b548ecb5", 2023-10-05T15:16:40.298 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2023-10-05T15:16:40.298 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f82ac0a1500 msgr2=0x7f82ac0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f82ac0a1500 0x7f82ac0a39c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005fd0 tx=0x7f82b8009310 comp rx=0 tx=0).stop 2023-10-05T15:16:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 msgr2=0x7f82c4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.291+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 0x7f82c4101310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f82b400d950 tx=0x7f82b400dc60 comp rx=0 tx=0).stop 2023-10-05T15:16:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 shutdown_connections 2023-10-05T15:16:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82c4106c00 0x7f82c40ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f82ac0a1500 0x7f82ac0a39c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82c41019a0 0x7f82c4101310 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 --2- 172.21.15.60:0/1444417848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c41042d0 0x7f82c40ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 >> 172.21.15.60:0/1444417848 conn(0x7f82c40fb330 msgr2=0x7f82c4102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 shutdown_connections 2023-10-05T15:16:40.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.292+0000 7f82ca2a1700 1 -- 172.21.15.60:0/1444417848 wait complete. 2023-10-05T15:16:40.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:16:40.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:40 smithi060 ceph-mon[99238]: pgmap v317: 129 pgs: 129 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-10-05T15:16:40.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:40 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2626110158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:40.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:40 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3059209053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:40.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:40 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1575745113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 -- 172.21.15.60:0/3530189266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444101860 msgr2=0x7f2444103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 --2- 172.21.15.60:0/3530189266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444101860 0x7f2444103c50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2434009990 tx=0x7f2434009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 -- 172.21.15.60:0/3530189266 shutdown_connections 2023-10-05T15:16:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 --2- 172.21.15.60:0/3530189266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2444106ac0 0x7f2444108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 --2- 172.21.15.60:0/3530189266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444101860 0x7f2444103c50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 --2- 172.21.15.60:0/3530189266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2444104190 0x7f2444106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 -- 172.21.15.60:0/3530189266 >> 172.21.15.60:0/3530189266 conn(0x7f24440fb190 msgr2=0x7f24440fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 -- 172.21.15.60:0/3530189266 shutdown_connections 2023-10-05T15:16:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.433+0000 7f2443fff700 1 -- 172.21.15.60:0/3530189266 wait complete. 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 Processor -- start 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 -- start start 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2444101860 0x7f24441011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2444104190 0x7f24440ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 0x7f24440ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441004f0 con 0x7f2444106ac0 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444100660 con 0x7f2444104190 2023-10-05T15:16:40.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2443fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441a0940 con 0x7f2444101860 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f24437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 0x7f24440ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f24437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 0x7f24440ffd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38170/0 (socket says 172.21.15.60:38170) 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f24437fe700 1 -- 172.21.15.60:0/502870267 learned_addr learned my addr 172.21.15.60:0/502870267 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f24427fc700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2444104190 0x7f24440ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.434+0000 7f2442ffd700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2444101860 0x7f24441011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f24437fe700 1 -- 172.21.15.60:0/502870267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2444101860 msgr2=0x7f24441011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f24437fe700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2444101860 0x7f24441011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f24437fe700 1 -- 172.21.15.60:0/502870267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2444104190 msgr2=0x7f24440ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f24437fe700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2444104190 0x7f24440ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f24437fe700 1 -- 172.21.15.60:0/502870267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340095f0 con 0x7f2444106ac0 2023-10-05T15:16:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f24437fe700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 0x7f24440ffd50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ef30 tx=0x7f243c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f242bfff700 1 -- 172.21.15.60:0/502870267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c018070 con 0x7f2444106ac0 2023-10-05T15:16:40.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24441a0bc0 con 0x7f2444106ac0 2023-10-05T15:16:40.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f242bfff700 1 -- 172.21.15.60:0/502870267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f243c00f040 con 0x7f2444106ac0 2023-10-05T15:16:40.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f242bfff700 1 -- 172.21.15.60:0/502870267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00cd00 con 0x7f2444106ac0 2023-10-05T15:16:40.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.435+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441a10d0 con 0x7f2444106ac0 2023-10-05T15:16:40.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.438+0000 7f242bfff700 1 -- 172.21.15.60:0/502870267 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f243c003a00 con 0x7f2444106ac0 2023-10-05T15:16:40.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.438+0000 7f242bfff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f242c0a1520 0x7f242c0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f242bfff700 1 -- 172.21.15.60:0/502870267 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f243c0ccba0 con 0x7f2444106ac0 2023-10-05T15:16:40.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f2442ffd700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f242c0a1520 0x7f242c0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f2442ffd700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f242c0a1520 0x7f242c0a39e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f243400b2e0 tx=0x7f2434005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f24559eab80 1 Processor -- start 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f24559eab80 1 -- start start 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f24559eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf3f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f24559eab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf3fd70 0x55f9edf40680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.439+0000 7f24559eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 0x55f9edf410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24559eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edea7460 con 0x55f9edf40c60 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24559eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ede98c20 con 0x55f9edf3f410 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24559eab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ede96540 con 0x55f9edf3fd70 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 0x55f9edf410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 0x55f9edf410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38178/0 (socket says 172.21.15.60:38178) 2023-10-05T15:16:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 -- 172.21.15.60:0/44259810 learned_addr learned my addr 172.21.15.60:0/44259810 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f2442ffd700 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf3f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24427fc700 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf3fd70 0x55f9edf40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 -- 172.21.15.60:0/44259810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf3fd70 msgr2=0x55f9edf40680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf3fd70 0x55f9edf40680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 -- 172.21.15.60:0/44259810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 msgr2=0x55f9edf3f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf3f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 -- 172.21.15.60:0/44259810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9edcbcde0 con 0x55f9edf40c60 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24437fe700 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 0x55f9edf410e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f243c0960f0 tx=0x7f243c099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac05dcfab9c8cd8d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.440+0000 7f24297fa700 1 -- 172.21.15.60:0/44259810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c004ad0 con 0x55f9edf40c60 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24297fa700 1 -- 172.21.15.60:0/44259810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f243c00ce80 con 0x55f9edf40c60 2023-10-05T15:16:40.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24297fa700 1 -- 172.21.15.60:0/44259810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0b2210 con 0x55f9edf40c60 2023-10-05T15:16:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 -- 172.21.15.60:0/44259810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 msgr2=0x55f9edf410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 0x55f9edf410e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f243c0960f0 tx=0x7f243c099af0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 -- 172.21.15.60:0/44259810 shutdown_connections 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf40c60 0x55f9edf410e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf3f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 --2- 172.21.15.60:0/44259810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf3fd70 0x55f9edf40680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 -- 172.21.15.60:0/44259810 >> 172.21.15.60:0/44259810 conn(0x55f9edeb3260 msgr2=0x55f9edf3a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 -- 172.21.15.60:0/44259810 shutdown_connections 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.441+0000 7f24559eab80 1 -- 172.21.15.60:0/44259810 wait complete. 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 -- start start 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 Processor -- start 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf492e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf49820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ede91e30 con 0x55f9edf3fd70 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ede2e710 con 0x55f9edf3f410 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ede2e3b0 con 0x55f9edf40c60 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24559eab80 10 client.0 _ll_register_callbacks cb 0x55f9edc8b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf49820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf49820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38182/0 (socket says 172.21.15.60:38182) 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24427fc700 1 -- 172.21.15.60:0/2614162650 learned_addr learned my addr 172.21.15.60:0/2614162650 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24437fe700 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24427fc700 1 -- 172.21.15.60:0/2614162650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 msgr2=0x55f9edf50860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.442+0000 7f24427fc700 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf50860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24427fc700 1 -- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 msgr2=0x55f9edf492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24427fc700 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24427fc700 1 -- 172.21.15.60:0/2614162650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441a10d0 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24427fc700 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf49820 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2438013710 tx=0x7f2438013a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e065b809ea97c78e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f2426ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f2426ff5700 1 -- 172.21.15.60:0/2614162650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438004520 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9edf32160 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f2426ff5700 1 -- 172.21.15.60:0/2614162650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2438003680 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f2426ff5700 1 -- 172.21.15.60:0/2614162650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2438003840 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 10 client.15645 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f9edca5c60 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f2426ff5700 1 -- 172.21.15.60:0/2614162650 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f9edf32160 con 0x55f9edf3fd70 2023-10-05T15:16:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f2426ff5700 1 -- 172.21.15.60:0/2614162650 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f243801cb10 con 0x55f9edf3fd70 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 10 client.15645 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 20 client.15645 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edf551c0 0x55f9edf575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.443+0000 7f24559eab80 4 client.15645 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.444+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9ede8ae10 con 0x55f9edf551c0 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.444+0000 7f2442ffd700 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edf551c0 0x55f9edf575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.444+0000 7f2426ff5700 10 client.15645 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.444+0000 7f2442ffd700 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edf551c0 0x55f9edf575e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dada9d48a1b14315 server_cookie=991ca4e66aac06ba in_seq=0 out_seq=0 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f2426ff5700 1 -- 172.21.15.60:0/2614162650 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f9ede8ae10 con 0x55f9edf551c0 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f2426ff5700 10 client.15645 handle_command_reply: tid=0 2023-10-05T15:16:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 client.15645 shutdown 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 msgr2=0x55f9edf49820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf49820 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2438013710 tx=0x7f2438013a20 comp rx=0 tx=0).stop 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 shutdown_connections 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edf551c0 0x55f9edf575e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf50860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f2426ff5700 0 client.15645 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 --2- 172.21.15.60:0/2614162650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf49820 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 >> 172.21.15.60:0/2614162650 conn(0x55f9edeb3260 msgr2=0x55f9edf3a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 shutdown_connections 2023-10-05T15:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 1 -- 172.21.15.60:0/2614162650 wait complete. 2023-10-05T15:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.445+0000 7f24559eab80 20 client.15645 trim_cache size 0 max 16384 2023-10-05T15:16:40.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 Processor -- start 2023-10-05T15:16:40.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 -- start start 2023-10-05T15:16:40.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 0x55f9edf38de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3fd70 0x55f9edf50820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf39ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edd12920 con 0x55f9edf3f410 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edf41510 con 0x55f9edf3fd70 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24559eab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edf3b040 con 0x55f9edf40c60 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 0x55f9edf38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 0x55f9edf38de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38188/0 (socket says 172.21.15.60:38188) 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 -- 172.21.15.60:0/1910916732 learned_addr learned my addr 172.21.15.60:0/1910916732 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24437fe700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf39ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24427fc700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3fd70 0x55f9edf50820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 -- 172.21.15.60:0/1910916732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 msgr2=0x55f9edf39ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf39ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 -- 172.21.15.60:0/1910916732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3fd70 msgr2=0x55f9edf50820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3fd70 0x55f9edf50820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 -- 172.21.15.60:0/1910916732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9edce3250 con 0x55f9edf3f410 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24437fe700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf39ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f24427fc700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3fd70 0x55f9edf50820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:16:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.477+0000 7f2442ffd700 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 0x55f9edf38de0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2434009990 tx=0x7f2434020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7edba487140d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f2429ffb700 1 -- 172.21.15.60:0/1910916732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243402b040 con 0x55f9edf3f410 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f2429ffb700 1 -- 172.21.15.60:0/1910916732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f243402c040 con 0x55f9edf3f410 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f2429ffb700 1 -- 172.21.15.60:0/1910916732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434004e40 con 0x55f9edf3f410 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 -- 172.21.15.60:0/1910916732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 msgr2=0x55f9edf38de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 0x55f9edf38de0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2434009990 tx=0x7f2434020000 comp rx=0 tx=0).stop 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 -- 172.21.15.60:0/1910916732 shutdown_connections 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf39ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3f410 0x55f9edf38de0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 --2- 172.21.15.60:0/1910916732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3fd70 0x55f9edf50820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 -- 172.21.15.60:0/1910916732 >> 172.21.15.60:0/1910916732 conn(0x55f9edeb3260 msgr2=0x55f9edf43170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 -- 172.21.15.60:0/1910916732 shutdown_connections 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.478+0000 7f24559eab80 1 -- 172.21.15.60:0/1910916732 wait complete. 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 -- start start 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 Processor -- start 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf4c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf4cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf4ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edf50460 con 0x55f9edf3fd70 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edf505d0 con 0x55f9edf3f410 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9edf50790 con 0x55f9edf40c60 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24559eab80 10 client.0 _ll_register_callbacks cb 0x7f2438009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:16:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf4cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf4cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38196/0 (socket says 172.21.15.60:38196) 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 -- 172.21.15.60:0/986831699 learned_addr learned my addr 172.21.15.60:0/986831699 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24437fe700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf4ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f2442ffd700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf4c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 -- 172.21.15.60:0/986831699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 msgr2=0x55f9edf4ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf4ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 -- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 msgr2=0x55f9edf4c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf4c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f24427fc700 1 -- 172.21.15.60:0/986831699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444109a80 con 0x55f9edf3fd70 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.479+0000 7f2442ffd700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf4c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24427fc700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf4cf10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2438009db0 tx=0x7f2438003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2b38028c2aeba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f2426ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f2426ff5700 1 -- 172.21.15.60:0/986831699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380092d0 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f2426ff5700 1 -- 172.21.15.60:0/986831699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2438000e40 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f243c00ce80 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f2426ff5700 1 -- 172.21.15.60:0/986831699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243801c440 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 10 client.15651 fetch_fsmap learned FSMap version 27 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f9edcbb2b0 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f2426ff5700 1 -- 172.21.15.60:0/986831699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f243c00ce80 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f2426ff5700 1 -- 172.21.15.60:0/986831699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2438010920 con 0x55f9edf3fd70 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 10 client.15651 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 20 client.15651 populate_metadata read hostname 'smithi060' 2023-10-05T15:16:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edfaa410 0x55f9edfac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 4 client.15651 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.480+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f9ede8ab30 con 0x55f9edfaa410 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f2442ffd700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edfaa410 0x55f9edfac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f2426ff5700 10 client.15651 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f2442ffd700 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edfaa410 0x55f9edfac830 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43cd2aee9647c096 server_cookie=df0c33b938025567 in_seq=0 out_seq=0 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f2426ff5700 1 -- 172.21.15.60:0/986831699 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f9ede8ab30 con 0x55f9edfaa410 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f2426ff5700 10 client.15651 handle_command_reply: tid=0 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 client.15651 shutdown 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 msgr2=0x55f9edf4cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf4cf10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2438009db0 tx=0x7f2438003930 comp rx=0 tx=0).stop 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 shutdown_connections 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f9edfaa410 0x55f9edfac830 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9edf40c60 0x55f9edf4ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9edf3f410 0x55f9edf4c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f2426ff5700 0 client.15651 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 --2- 172.21.15.60:0/986831699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f9edf3fd70 0x55f9edf4cf10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 >> 172.21.15.60:0/986831699 conn(0x55f9edeb3260 msgr2=0x55f9edf38de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 shutdown_connections 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.481+0000 7f24559eab80 1 -- 172.21.15.60:0/986831699 wait complete. 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f24559eab80 20 client.15651 trim_cache size 0 max 16384 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:16:40.493 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: "577ea873-b529-47c6-b8aa-7dc4b548ecb5": { 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "577ea873-b529-47c6-b8aa-7dc4b548ecb5", 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:16:40.494 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f242c0a1520 msgr2=0x7f242c0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f242c0a1520 0x7f242c0a39e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f243400b2e0 tx=0x7f2434005fb0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 msgr2=0x7f24440ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 0x7f24440ffd50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ef30 tx=0x7f243c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 shutdown_connections 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f242c0a1520 0x7f242c0a39e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2444106ac0 0x7f24440ffd50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2444101860 0x7f24441011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 --2- 172.21.15.60:0/502870267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2444104190 0x7f24440ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 >> 172.21.15.60:0/502870267 conn(0x7f24440fb190 msgr2=0x7f24441024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:40.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 shutdown_connections 2023-10-05T15:16:40.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.482+0000 7f2443fff700 1 -- 172.21.15.60:0/502870267 wait complete. 2023-10-05T15:16:40.497 INFO:tasks.cephfs.filesystem:scrub status for tag:577ea873-b529-47c6-b8aa-7dc4b548ecb5 - {'path': '/', 'tag': '577ea873-b529-47c6-b8aa-7dc4b548ecb5', 'options': 'recursive,force'} 2023-10-05T15:16:40.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:40.548+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa72810c6e0 con 0x7fa728101970 2023-10-05T15:16:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:40 smithi135 ceph-mon[103360]: pgmap v317: 129 pgs: 129 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-10-05T15:16:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:40 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2626110158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:40 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3059209053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:40 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1575745113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:40 smithi092 ceph-mon[102944]: pgmap v317: 129 pgs: 129 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-10-05T15:16:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:40 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2626110158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:16:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:40 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3059209053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:16:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:40 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1575745113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:16:41.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.291+0000 7fa7257fa700 1 -- 172.21.15.60:0/1906500203 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa718099ed0 con 0x7fa728101970 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.296+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa7100a1480 msgr2=0x7fa7100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.296+0000 7fa72e27f700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa7100a1480 0x7fa7100a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa71c006010 tx=0x7fa71c00b260 comp rx=0 tx=0).stop 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.296+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 msgr2=0x7fa728198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.296+0000 7fa72e27f700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 0x7fa728198ef0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa71800e9a0 tx=0x7fa71800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.297+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 shutdown_connections 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.297+0000 7fa72e27f700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa728106bd0 0x7fa72819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.297+0000 7fa72e27f700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7fa7100a1480 0x7fa7100a3940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.297+0000 7fa72e27f700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa728101970 0x7fa728198ef0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.297+0000 7fa72e27f700 1 --2- 172.21.15.60:0/1906500203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7281042a0 0x7fa728199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.297+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 >> 172.21.15.60:0/1906500203 conn(0x7fa7280fb340 msgr2=0x7fa7281025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.298+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 shutdown_connections 2023-10-05T15:16:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.299+0000 7fa72e27f700 1 -- 172.21.15.60:0/1906500203 wait complete. 2023-10-05T15:16:41.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-10-05T15:16:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 -- 172.21.15.60:0/4136410584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288101970 msgr2=0x7f1288103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 --2- 172.21.15.60:0/4136410584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288101970 0x7f1288103d60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1278009990 tx=0x7f1278009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 -- 172.21.15.60:0/4136410584 shutdown_connections 2023-10-05T15:16:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 --2- 172.21.15.60:0/4136410584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1288106bd0 0x7f1288109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 --2- 172.21.15.60:0/4136410584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288101970 0x7f1288103d60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 --2- 172.21.15.60:0/4136410584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12881042a0 0x7f1288106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 -- 172.21.15.60:0/4136410584 >> 172.21.15.60:0/4136410584 conn(0x7f12880fb340 msgr2=0x7f12880fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 -- 172.21.15.60:0/4136410584 shutdown_connections 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.453+0000 7f128e5b9700 1 -- 172.21.15.60:0/4136410584 wait complete. 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 Processor -- start 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 -- start start 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 0x7f1288196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12881042a0 0x7f1288197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 0x7f1288197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881986c0 con 0x7f1288106bd0 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288198830 con 0x7f1288101970 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128e5b9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881989f0 con 0x7f12881042a0 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128cb56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 0x7f1288197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f1287fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 0x7f1288196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128cb56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 0x7f1288197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38236/0 (socket says 172.21.15.60:38236) 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f128cb56700 1 -- 172.21.15.60:0/1392920127 learned_addr learned my addr 172.21.15.60:0/1392920127 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f1287fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 0x7f1288196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:51654/0 (socket says 172.21.15.60:51654) 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.454+0000 7f12877fe700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12881042a0 0x7f1288197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f1287fff700 1 -- 172.21.15.60:0/1392920127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12881042a0 msgr2=0x7f1288197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f1287fff700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12881042a0 0x7f1288197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f1287fff700 1 -- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 msgr2=0x7f1288197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f1287fff700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 0x7f1288197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f1287fff700 1 -- 172.21.15.60:0/1392920127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780095f0 con 0x7f1288101970 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f128cb56700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 0x7f1288197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f1287fff700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 0x7f1288196d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f127800b680 tx=0x7f1278009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127801d070 con 0x7f1288101970 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1278021410 con 0x7f1288101970 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1288198c70 con 0x7f1288101970 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278017650 con 0x7f1288101970 2023-10-05T15:16:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.455+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128819f3f0 con 0x7f1288101970 2023-10-05T15:16:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.456+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12880fcec0 con 0x7f1288101970 2023-10-05T15:16:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.457+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f1278021810 con 0x7f1288101970 2023-10-05T15:16:41.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.458+0000 7f12857fa700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 0x7f12700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.458+0000 7f12877fe700 1 -- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 msgr2=0x7f12700a3a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:41.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.458+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f12780ce4d0 con 0x7f1288101970 2023-10-05T15:16:41.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.458+0000 7f12877fe700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 0x7f12700a3a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:16:41.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.461+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1278097980 con 0x7f1288101970 2023-10-05T15:16:41.550 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-mon[103360]: scrub queued for path: / 2023-10-05T15:16:41.550 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:16:41.550 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:16:41.550 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:16:41.550 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1906500203' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-05T15:16:41.551 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: ignoring --setuser ceph since I am not root 2023-10-05T15:16:41.551 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: ignoring --setgroup ceph since I am not root 2023-10-05T15:16:41.551 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-mgr[105507]: -- 172.21.15.135:0/2026058468 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56431a5731e0 con 0x56431a548c00 2023-10-05T15:16:41.551 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:41.466+0000 7fee2d9d9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:16:41.551 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:41.548+0000 7fee2d9d9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: ignoring --setuser ceph since I am not root 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: ignoring --setgroup ceph since I am not root 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:41.469+0000 7fddcfefd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:41.549+0000 7fddcfefd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-mon[102944]: scrub queued for path: / 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:16:41.552 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1906500203' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-05T15:16:41.600 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-mon[99238]: scrub queued for path: / 2023-10-05T15:16:41.601 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:16:41.601 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:16:41.601 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:16:41.601 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1906500203' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-05T15:16:41.601 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: ignoring --setuser ceph since I am not root 2023-10-05T15:16:41.601 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: ignoring --setgroup ceph since I am not root 2023-10-05T15:16:41.602 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:41.500+0000 7f284021e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:16:41.602 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:41.597+0000 7f284021e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:16:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.659+0000 7f12877fe700 1 -- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 msgr2=0x7f12700a3a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.659+0000 7f12877fe700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 0x7f12700a3a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:16:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.666+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f128810c9a0 con 0x7f1288101970 2023-10-05T15:16:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.671+0000 7f12857fa700 1 -- 172.21.15.60:0/1392920127 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f12780260d0 con 0x7f1288101970 2023-10-05T15:16:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.673+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 msgr2=0x7f12700a3a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:16:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.673+0000 7f128e5b9700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 0x7f12700a3a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.673+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 msgr2=0x7f1288196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.673+0000 7f128e5b9700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 0x7f1288196d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f127800b680 tx=0x7f1278009580 comp rx=0 tx=0).stop 2023-10-05T15:16:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 shutdown_connections 2023-10-05T15:16:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f12700a1550 0x7f12700a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1288106bd0 0x7f1288197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1288101970 0x7f1288196d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 --2- 172.21.15.60:0/1392920127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12881042a0 0x7f1288197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 >> 172.21.15.60:0/1392920127 conn(0x7f12880fb340 msgr2=0x7f12881025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 shutdown_connections 2023-10-05T15:16:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.674+0000 7f128e5b9700 1 -- 172.21.15.60:0/1392920127 wait complete. 2023-10-05T15:16:41.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-10-05T15:16:41.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 -- 172.21.15.60:0/743522638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ffdf0 msgr2=0x7f808c100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 --2- 172.21.15.60:0/743522638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ffdf0 0x7f808c100210 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f80800099c0 tx=0x7f8080009cd0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 -- 172.21.15.60:0/743522638 shutdown_connections 2023-10-05T15:16:41.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 --2- 172.21.15.60:0/743522638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c101980 0x7f808c108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 --2- 172.21.15.60:0/743522638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ffdf0 0x7f808c100210 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 --2- 172.21.15.60:0/743522638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f808c100fe0 0x7f808c101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 -- 172.21.15.60:0/743522638 >> 172.21.15.60:0/743522638 conn(0x7f808c0fb340 msgr2=0x7f808c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 -- 172.21.15.60:0/743522638 shutdown_connections 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.815+0000 7f8092b5b700 1 -- 172.21.15.60:0/743522638 wait complete. 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 Processor -- start 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 -- start start 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c0ffdf0 0x7f808c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f808c100fe0 0x7f808c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 0x7f808c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1a0c90 con 0x7f808c101980 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1a0dd0 con 0x7f808c100fe0 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f8092b5b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1a0f10 con 0x7f808c0ffdf0 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f80910f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 0x7f808c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f80908f7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c0ffdf0 0x7f808c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f80910f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 0x7f808c1031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38296/0 (socket says 172.21.15.60:38296) 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f80910f8700 1 -- 172.21.15.60:0/1861474362 learned_addr learned my addr 172.21.15.60:0/1861474362 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.816+0000 7f808bfff700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f808c100fe0 0x7f808c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:41.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80908f7700 1 -- 172.21.15.60:0/1861474362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f808c100fe0 msgr2=0x7f808c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80908f7700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f808c100fe0 0x7f808c102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80908f7700 1 -- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 msgr2=0x7f808c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80908f7700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 0x7f808c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80908f7700 1 -- 172.21.15.60:0/1861474362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800095f0 con 0x7f808c0ffdf0 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80910f8700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 0x7f808c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f80908f7700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c0ffdf0 0x7f808c102770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80800058e0 tx=0x7f808000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808001d070 con 0x7f808c0ffdf0 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c1a1140 con 0x7f808c0ffdf0 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8080005020 con 0x7f808c0ffdf0 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080004a90 con 0x7f808c0ffdf0 2023-10-05T15:16:41.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.817+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1a1560 con 0x7f808c0ffdf0 2023-10-05T15:16:41.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.818+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c107f70 con 0x7f808c0ffdf0 2023-10-05T15:16:41.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.819+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8080005400 con 0x7f808c0ffdf0 2023-10-05T15:16:41.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.820+0000 7f8089ffb700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 0x7f807c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:41.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.820+0000 7f808bfff700 1 -- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 msgr2=0x7f807c0a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:41.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.820+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f80800cdc00 con 0x7f808c0ffdf0 2023-10-05T15:16:41.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.820+0000 7f808bfff700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 0x7f807c0a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:16:41.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:41.823+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8080096ff0 con 0x7f808c0ffdf0 2023-10-05T15:16:41.831 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:41.640+0000 7fee2d9d9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:16:41.831 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:41.734+0000 7fee2d9d9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:16:41.905 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:41.639+0000 7fddcfefd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:16:41.905 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:41.733+0000 7fddcfefd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:16:41.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:41.711+0000 7f284021e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:16:41.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:41.831+0000 7f284021e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:16:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.021+0000 7f808bfff700 1 -- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 msgr2=0x7f807c0a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.021+0000 7f808bfff700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 0x7f807c0a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:16:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.027+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f808c04ec90 con 0x7f808c0ffdf0 2023-10-05T15:16:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.032+0000 7f8089ffb700 1 -- 172.21.15.60:0/1861474362 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8080005190 con 0x7f808c0ffdf0 2023-10-05T15:16:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.034+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 msgr2=0x7f807c0a3990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.034+0000 7f8092b5b700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 0x7f807c0a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c0ffdf0 msgr2=0x7f808c102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c0ffdf0 0x7f808c102770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80800058e0 tx=0x7f808000f690 comp rx=0 tx=0).stop 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 shutdown_connections 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f807c0a14d0 0x7f807c0a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c101980 0x7f808c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c0ffdf0 0x7f808c102770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 --2- 172.21.15.60:0/1861474362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f808c100fe0 0x7f808c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 >> 172.21.15.60:0/1861474362 conn(0x7f808c0fb340 msgr2=0x7f808c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 shutdown_connections 2023-10-05T15:16:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.035+0000 7f8092b5b700 1 -- 172.21.15.60:0/1861474362 wait complete. 2023-10-05T15:16:42.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-05T15:16:42.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:41.902+0000 7fddcfefd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:16:42.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.177+0000 7f8556fca700 1 -- 172.21.15.60:0/1717971781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85500ff760 msgr2=0x7f85500ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:42.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.177+0000 7f8556fca700 1 --2- 172.21.15.60:0/1717971781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85500ff760 0x7f85500ffb80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8544009990 tx=0x7f8544009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- 172.21.15.60:0/1717971781 shutdown_connections 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 --2- 172.21.15.60:0/1717971781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8550100a80 0x7f8550100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 --2- 172.21.15.60:0/1717971781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85500ff760 0x7f85500ffb80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 --2- 172.21.15.60:0/1717971781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85501000c0 0x7f8550100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- 172.21.15.60:0/1717971781 >> 172.21.15.60:0/1717971781 conn(0x7f85500fb340 msgr2=0x7f85500fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- 172.21.15.60:0/1717971781 shutdown_connections 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- 172.21.15.60:0/1717971781 wait complete. 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 Processor -- start 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- start start 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85500ff760 0x7f8550198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85501000c0 0x7f8550199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8550100a80 0x7f855019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855019a8d0 con 0x7f85501000c0 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855019aa40 con 0x7f8550100a80 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.178+0000 7f8556fca700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855019ac00 con 0x7f85500ff760 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f854ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85501000c0 0x7f8550199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85500ff760 0x7f8550198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85500ff760 0x7f8550198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:51884/0 (socket says 172.21.15.60:51884) 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8555567700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8550100a80 0x7f855019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 -- 172.21.15.60:0/1554618457 learned_addr learned my addr 172.21.15.60:0/1554618457 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f854ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85501000c0 0x7f8550199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38356/0 (socket says 172.21.15.60:38356) 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8550100a80 msgr2=0x7f855019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8550100a80 0x7f855019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85501000c0 msgr2=0x7f8550199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85501000c0 0x7f8550199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 -- 172.21.15.60:0/1554618457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440095f0 con 0x7f85500ff760 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8555567700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8550100a80 0x7f855019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8554d66700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85500ff760 0x7f8550198ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8544000c00 tx=0x7f85440057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854401d070 con 0x7f85500ff760 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855019ae80 con 0x7f85500ff760 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f854400fb90 con 0x7f85500ff760 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.179+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440173f0 con 0x7f85500ff760 2023-10-05T15:16:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.180+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85501a15f0 con 0x7f85500ff760 2023-10-05T15:16:42.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.180+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855010a540 con 0x7f85500ff760 2023-10-05T15:16:42.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.182+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8544021410 con 0x7f85500ff760 2023-10-05T15:16:42.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.182+0000 7f854dffb700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:42.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.182+0000 7f854ffff700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:42.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.182+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f85440ce560 con 0x7f85500ff760 2023-10-05T15:16:42.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.182+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:16:42.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.185+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8544097950 con 0x7f85500ff760 2023-10-05T15:16:42.273 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:41.905+0000 7fee2d9d9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:16:42.273 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:42.271+0000 7fee2d9d9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:16:42.295 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:42.042+0000 7f284021e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:16:42.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1906500203' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-05T15:16:42.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-mon[99238]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-10-05T15:16:42.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' 2023-10-05T15:16:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.383+0000 7f854ffff700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.383+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:16:42.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.414+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 --> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f85500612f0 con 0x7f85400a14d0 2023-10-05T15:16:42.581 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:42.403+0000 7fee2d9d9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:16:42.581 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:42.491+0000 7fee2d9d9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:16:42.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1906500203' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-05T15:16:42.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-mon[103360]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-10-05T15:16:42.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' 2023-10-05T15:16:42.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' 2023-10-05T15:16:42.582 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1906500203' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-05T15:16:42.582 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-mon[102944]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-10-05T15:16:42.582 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' 2023-10-05T15:16:42.582 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' 2023-10-05T15:16:42.583 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:42.268+0000 7fddcfefd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:16:42.583 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:42.399+0000 7fddcfefd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:16:42.583 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:42.486+0000 7fddcfefd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:16:42.583 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:42.579+0000 7fddcfefd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:16:42.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' 2023-10-05T15:16:42.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:42.526+0000 7f284021e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:16:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.784+0000 7f854ffff700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:42.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:42.784+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-05T15:16:43.008 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:42.586+0000 7fee2d9d9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:16:43.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:42.681+0000 7f284021e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:16:43.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:42.790+0000 7f284021e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:16:43.165 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:42.906+0000 7f284021e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:16:43.331 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:43.006+0000 7fee2d9d9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:16:43.426 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:42.999+0000 7fddcfefd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:16:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:43.585+0000 7f854ffff700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:43.585+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-05T15:16:43.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:43.421+0000 7f284021e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:16:43.926 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:43.651+0000 7fddcfefd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:16:43.926 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:43.732+0000 7fddcfefd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:16:44.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:43.667+0000 7fee2d9d9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:16:44.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:43.749+0000 7fee2d9d9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:16:44.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:44.206+0000 7f284021e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:16:44.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:44.308+0000 7f284021e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:16:44.772 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:44.507+0000 7fddcfefd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:16:44.772 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:44.597+0000 7fddcfefd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:16:44.789 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:44.525+0000 7fee2d9d9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:16:44.789 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:44.616+0000 7fee2d9d9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:16:45.051 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:44.769+0000 7fddcfefd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:16:45.067 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:44.788+0000 7fee2d9d9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:16:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:45.186+0000 7f854ffff700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:45.186+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-05T15:16:45.331 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:45.065+0000 7fee2d9d9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:16:45.331 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:45.295+0000 7fee2d9d9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:16:45.425 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:45.049+0000 7fddcfefd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:16:45.425 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:45.274+0000 7fddcfefd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:16:45.632 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:45 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:45.291+0000 7f284021e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:16:45.632 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:45 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:45.404+0000 7f284021e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:16:45.632 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:45 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:45.629+0000 7f284021e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:16:45.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:45.422+0000 7fddcfefd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:16:45.708 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:45.443+0000 7fee2d9d9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:16:46.081 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:45.706+0000 7fee2d9d9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:16:46.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:45.688+0000 7fddcfefd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:16:46.247 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:45 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:45.989+0000 7f284021e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:16:46.247 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:46 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:46.245+0000 7f284021e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:16:46.664 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:46 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:46.431+0000 7f284021e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:16:46.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:46.385+0000 7fddcfefd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:16:46.676 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:46.516+0000 7fddcfefd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:16:46.738 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:46.413+0000 7fee2d9d9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:16:46.738 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:46.543+0000 7fee2d9d9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:16:47.043 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:46.710+0000 7fddcfefd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:16:47.043 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:46.824+0000 7fddcfefd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:16:47.068 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:46.736+0000 7fee2d9d9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:16:47.068 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:46.850+0000 7fee2d9d9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:16:47.164 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:46 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:46.770+0000 7f284021e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:16:47.426 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:47.040+0000 7fddcfefd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:16:47.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:47.607+0000 7f284021e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:16:47.915 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:47.769+0000 7f284021e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:16:47.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:47.978+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8544097d20 con 0x7f85500ff760 2023-10-05T15:16:48.176 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y[104394]: 2023-10-05T15:16:47.901+0000 7fddcfefd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:16:48.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: Standby manager daemon y restarted 2023-10-05T15:16:48.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: Standby manager daemon y started 2023-10-05T15:16:48.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:16:48.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:16:48.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: Standby manager daemon z restarted 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: Standby manager daemon z started 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:16:48.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:47 smithi092 ceph-mon[102944]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:16:48.331 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:47.066+0000 7fee2d9d9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:16:48.331 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-z[105483]: 2023-10-05T15:16:47.935+0000 7fee2d9d9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:16:48.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: Standby manager daemon y restarted 2023-10-05T15:16:48.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: Standby manager daemon y started 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: Standby manager daemon z restarted 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: Standby manager daemon z started 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:16:48.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:47 smithi135 ceph-mon[103360]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:16:48.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:48.391+0000 7f854ffff700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3043189857 2023-10-05T15:16:48.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:48.391+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-05T15:16:48.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:48 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:48.028+0000 7f284021e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:16:48.414 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:48 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:48.169+0000 7f284021e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: Standby manager daemon y restarted 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: Standby manager daemon y started 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.92:0/1451828983' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: Standby manager daemon z restarted 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: Standby manager daemon z started 2023-10-05T15:16:48.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:16:48.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:16:48.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:16:48.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:47 smithi060 ceph-mon[99238]: from='mgr.? 172.21.15.135:0/402560571' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:16:48.914 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:48 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:48.451+0000 7f284021e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:16:49.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:48 smithi135 ceph-mon[103360]: mgrmap e20: x(active, since 8m), standbys: z, y 2023-10-05T15:16:49.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:48 smithi060 ceph-mon[99238]: mgrmap e20: x(active, since 8m), standbys: z, y 2023-10-05T15:16:49.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:48 smithi092 ceph-mon[102944]: mgrmap e20: x(active, since 8m), standbys: z, y 2023-10-05T15:16:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:49.542+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 21) v1 ==== 135688+0+0 (secure 0 0 0) 0x7f85440cbdb0 con 0x7f85500ff760 2023-10-05T15:16:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:49.543+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 msgr2=0x7f85400a3990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:16:49.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:49.543+0000 7f854dffb700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/3043189857,v1:172.21.15.60:6801/3043189857] conn(0x7f85400a14d0 0x7f85400a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:49.909 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.516+0000 7f284021e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:16:49.909 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a02fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a02fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a02fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a02fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a02fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a3303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a3303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a3303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.910 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a3303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:49.911 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:16:49.754+0000 7f27a3303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: Active manager daemon x restarted 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: Activating manager daemon x 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: osdmap e91: 12 total, 12 up, 12 in 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: mgrmap e21: x(active, starting, since 0.0121705s), standbys: z, y 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:16:50.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:16:50.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:16:50.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: Manager daemon x is now available 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:16:50.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:49 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:16:50.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: Active manager daemon x restarted 2023-10-05T15:16:50.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: Activating manager daemon x 2023-10-05T15:16:50.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: osdmap e91: 12 total, 12 up, 12 in 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: mgrmap e21: x(active, starting, since 0.0121705s), standbys: z, y 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:16:50.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:16:50.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:16:50.336 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: Manager daemon x is now available 2023-10-05T15:16:50.371 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:50.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:50.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:16:50.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:49 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: Active manager daemon x restarted 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: Activating manager daemon x 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: osdmap e91: 12 total, 12 up, 12 in 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: mgrmap e21: x(active, starting, since 0.0121705s), standbys: z, y 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:16:50.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:16:50.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:16:50.429 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: Manager daemon x is now available 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:16:50.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:49 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:16:50.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.544+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mon.1 v2:172.21.15.135:3300/0 9 ==== mgrmap(e 22) v1 ==== 135815+0+0 (secure 0 0 0) 0x7f854409ab00 con 0x7f85500ff760 2023-10-05T15:16:50.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.545+0000 7f854dffb700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8540026350 0x7f8540026730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:50.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.545+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 --> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f85500612f0 con 0x7f8540026350 2023-10-05T15:16:50.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.547+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8540026350 0x7f8540026730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:50.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.551+0000 7f854ffff700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8540026350 0x7f8540026730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f853c009880 tx=0x7f853c009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:50.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.606+0000 7f854dffb700 1 -- 172.21.15.60:0/1554618457 <== mgr.15663 v2:172.21.15.60:6800/139103647 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f85500612f0 con 0x7f8540026350 2023-10-05T15:16:50.608 INFO:teuthology.orchestra.run.smithi060.stdout:Schedule set for path / 2023-10-05T15:16:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8540026350 msgr2=0x7f8540026730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8540026350 0x7f8540026730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f853c009880 tx=0x7f853c009260 comp rx=0 tx=0).stop 2023-10-05T15:16:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85500ff760 msgr2=0x7f8550198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 --2- 172.21.15.60:0/1554618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85500ff760 0x7f8550198ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8544000c00 tx=0x7f85440057a0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8555567700 1 -- 172.21.15.60:0/1554618457 reap_dead start 2023-10-05T15:16:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 shutdown_connections 2023-10-05T15:16:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 >> 172.21.15.60:0/1554618457 conn(0x7f85500fb340 msgr2=0x7f85500fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 shutdown_connections 2023-10-05T15:16:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.608+0000 7f8556fca700 1 -- 172.21.15.60:0/1554618457 wait complete. 2023-10-05T15:16:50.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-05T15:16:50.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 -- 172.21.15.60:0/2860425908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 msgr2=0x7f0594108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 --2- 172.21.15.60:0/2860425908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f0594108230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f058400b0d0 tx=0x7f058400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 -- 172.21.15.60:0/2860425908 shutdown_connections 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 --2- 172.21.15.60:0/2860425908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f0594108230 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 --2- 172.21.15.60:0/2860425908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05940ffdf0 0x7f0594100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 --2- 172.21.15.60:0/2860425908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594100fe0 0x7f0594101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 -- 172.21.15.60:0/2860425908 >> 172.21.15.60:0/2860425908 conn(0x7f05940fb340 msgr2=0x7f05940fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 -- 172.21.15.60:0/2860425908 shutdown_connections 2023-10-05T15:16:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.760+0000 7f059953b700 1 -- 172.21.15.60:0/2860425908 wait complete. 2023-10-05T15:16:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.761+0000 7f059953b700 1 Processor -- start 2023-10-05T15:16:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.761+0000 7f059953b700 1 -- start start 2023-10-05T15:16:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05940ffdf0 0x7f0594199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594100fe0 0x7f059419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f059419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419e9f0 con 0x7f0594101980 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419eb30 con 0x7f0594100fe0 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419ecf0 con 0x7f05940ffdf0 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f059419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f059419e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38646/0 (socket says 172.21.15.60:38646) 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 -- 172.21.15.60:0/1159905782 learned_addr learned my addr 172.21.15.60:0/1159905782 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f0592ffd700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05940ffdf0 0x7f0594199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05927fc700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594100fe0 0x7f059419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 -- 172.21.15.60:0/1159905782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05940ffdf0 msgr2=0x7f0594199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05940ffdf0 0x7f0594199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 -- 172.21.15.60:0/1159905782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594100fe0 msgr2=0x7f059419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594100fe0 0x7f059419bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 -- 172.21.15.60:0/1159905782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584009d00 con 0x7f0594101980 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f05937fe700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f059419e420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0584007a00 tx=0x7f05840094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058400e040 con 0x7f0594101980 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0584003e10 con 0x7f0594101980 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059419ef70 con 0x7f0594101980 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.762+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058401b9e0 con 0x7f0594101980 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.763+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059419f330 con 0x7f0594101980 2023-10-05T15:16:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.764+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059404ec90 con 0x7f0594101980 2023-10-05T15:16:50.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.765+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) v1 ==== 135815+0+0 (secure 0 0 0) 0x7f0584005630 con 0x7f0594101980 2023-10-05T15:16:50.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.765+0000 7f057bfff700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f057c0a1280 0x7f057c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:50.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.765+0000 7f0592ffd700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f057c0a1280 0x7f057c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:50.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.765+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f05840ce310 con 0x7f0594101980 2023-10-05T15:16:50.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.766+0000 7f0592ffd700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f057c0a1280 0x7f057c0a3740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0594068d90 tx=0x7f058c00a3b0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:50.770+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05840978f0 con 0x7f0594101980 2023-10-05T15:16:51.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.024+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 --> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f0594061390 con 0x7f057c0a1280 2023-10-05T15:16:51.081 INFO:teuthology.orchestra.run.smithi060.stdout:Retention added to path / 2023-10-05T15:16:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.079+0000 7f057bfff700 1 -- 172.21.15.60:0/1159905782 <== mgr.15663 v2:172.21.15.60:6800/139103647 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f0594061390 con 0x7f057c0a1280 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f057c0a1280 msgr2=0x7f057c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f057c0a1280 0x7f057c0a3740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0594068d90 tx=0x7f058c00a3b0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 msgr2=0x7f059419e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f059419e420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0584007a00 tx=0x7f05840094c0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 shutdown_connections 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0594101980 0x7f059419e420 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05940ffdf0 0x7f0594199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f057c0a1280 0x7f057c0a3740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 --2- 172.21.15.60:0/1159905782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594100fe0 0x7f059419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.082+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 >> 172.21.15.60:0/1159905782 conn(0x7f05940fb340 msgr2=0x7f05940fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:51.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.084+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 shutdown_connections 2023-10-05T15:16:51.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.084+0000 7f059953b700 1 -- 172.21.15.60:0/1159905782 wait complete. 2023-10-05T15:16:51.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-05T15:16:51.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 -- 172.21.15.60:0/775250068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 msgr2=0x7fba7c1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 --2- 172.21.15.60:0/775250068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c1026a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba78009990 tx=0x7fba78009ca0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 -- 172.21.15.60:0/775250068 shutdown_connections 2023-10-05T15:16:51.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 --2- 172.21.15.60:0/775250068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c102be0 0x7fba7c109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 --2- 172.21.15.60:0/775250068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c0ff1d0 0x7fba7c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 --2- 172.21.15.60:0/775250068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c1026a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 -- 172.21.15.60:0/775250068 >> 172.21.15.60:0/775250068 conn(0x7fba7c0faac0 msgr2=0x7fba7c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:51.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 -- 172.21.15.60:0/775250068 shutdown_connections 2023-10-05T15:16:51.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.231+0000 7fba83dcb700 1 -- 172.21.15.60:0/775250068 wait complete. 2023-10-05T15:16:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 Processor -- start 2023-10-05T15:16:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 -- start start 2023-10-05T15:16:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c0ff1d0 0x7fba7c196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c102be0 0x7fba7c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c198660 con 0x7fba7c102240 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1987d0 con 0x7fba7c102be0 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba83dcb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c198990 con 0x7fba7c0ff1d0 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba81366700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba81366700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38658/0 (socket says 172.21.15.60:38658) 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba81366700 1 -- 172.21.15.60:0/1791832250 learned_addr learned my addr 172.21.15.60:0/1791832250 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba81b67700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c0ff1d0 0x7fba7c196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.232+0000 7fba82368700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c102be0 0x7fba7c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba81366700 1 -- 172.21.15.60:0/1791832250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c0ff1d0 msgr2=0x7fba7c196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba81366700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c0ff1d0 0x7fba7c196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba81366700 1 -- 172.21.15.60:0/1791832250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c102be0 msgr2=0x7fba7c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba81366700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c102be0 0x7fba7c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba81366700 1 -- 172.21.15.60:0/1791832250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780095f0 con 0x7fba7c102240 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba82368700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c102be0 0x7fba7c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba81366700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c197220 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fba780059d0 tx=0x7fba780047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7801d070 con 0x7fba7c102240 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c198c10 con 0x7fba7c102240 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba7800fc40 con 0x7fba7c102240 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78017650 con 0x7fba7c102240 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.233+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c19f390 con 0x7fba7c102240 2023-10-05T15:16:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.234+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c107fd0 con 0x7fba7c102240 2023-10-05T15:16:51.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.235+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) v1 ==== 135815+0+0 (secure 0 0 0) 0x7fba78022470 con 0x7fba7c102240 2023-10-05T15:16:51.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.235+0000 7fba6effd700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba680a1280 0x7fba680a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.236+0000 7fba81b67700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba680a1280 0x7fba680a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.236+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fba780ce370 con 0x7fba7c102240 2023-10-05T15:16:51.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.236+0000 7fba81b67700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba680a1280 0x7fba680a3740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba7c068010 tx=0x7fba70007400 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:51.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.240+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fba78097910 con 0x7fba7c102240 2023-10-05T15:16:51.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:50 smithi135 ceph-mon[103360]: [05/Oct/2023:15:16:50] ENGINE Bus STARTING 2023-10-05T15:16:51.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:50 smithi135 ceph-mon[103360]: [05/Oct/2023:15:16:50] ENGINE Serving on http://172.21.15.60:8765 2023-10-05T15:16:51.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:50 smithi135 ceph-mon[103360]: mgrmap e22: x(active, since 1.0184s), standbys: z, y 2023-10-05T15:16:51.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:50 smithi060 ceph-mon[99238]: [05/Oct/2023:15:16:50] ENGINE Bus STARTING 2023-10-05T15:16:51.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:50 smithi060 ceph-mon[99238]: [05/Oct/2023:15:16:50] ENGINE Serving on http://172.21.15.60:8765 2023-10-05T15:16:51.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:50 smithi060 ceph-mon[99238]: mgrmap e22: x(active, since 1.0184s), standbys: z, y 2023-10-05T15:16:51.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:50 smithi092 ceph-mon[102944]: [05/Oct/2023:15:16:50] ENGINE Bus STARTING 2023-10-05T15:16:51.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:50 smithi092 ceph-mon[102944]: [05/Oct/2023:15:16:50] ENGINE Serving on http://172.21.15.60:8765 2023-10-05T15:16:51.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:50 smithi092 ceph-mon[102944]: mgrmap e22: x(active, since 1.0184s), standbys: z, y 2023-10-05T15:16:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.478+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 --> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fba7c0612f0 con 0x7fba680a1280 2023-10-05T15:16:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.486+0000 7fba6effd700 1 -- 172.21.15.60:0/1791832250 <== mgr.15663 v2:172.21.15.60:6800/139103647 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fba7c0612f0 con 0x7fba680a1280 2023-10-05T15:16:51.488 INFO:teuthology.orchestra.run.smithi060.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-05T00:00:00", "created": "2023-10-05T15:16:50", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-05T15:16:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba680a1280 msgr2=0x7fba680a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba680a1280 0x7fba680a3740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba7c068010 tx=0x7fba70007400 comp rx=0 tx=0).stop 2023-10-05T15:16:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 msgr2=0x7fba7c197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c197220 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fba780059d0 tx=0x7fba780047a0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 shutdown_connections 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba680a1280 0x7fba680a3740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba7c102be0 0x7fba7c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c0ff1d0 0x7fba7c196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 --2- 172.21.15.60:0/1791832250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c102240 0x7fba7c197220 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 >> 172.21.15.60:0/1791832250 conn(0x7fba7c0faac0 msgr2=0x7fba7c0fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 shutdown_connections 2023-10-05T15:16:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.488+0000 7fba83dcb700 1 -- 172.21.15.60:0/1791832250 wait complete. 2023-10-05T15:16:51.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-05T15:16:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 -- 172.21.15.60:0/1534747209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018102080 msgr2=0x7f1018102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1534747209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018102080 0x7f1018102500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f100c0098f0 tx=0x7f100c009c00 comp rx=0 tx=0).stop 2023-10-05T15:16:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 -- 172.21.15.60:0/1534747209 shutdown_connections 2023-10-05T15:16:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1534747209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102a40 0x7f1018109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1534747209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018100ea0 0x7f10181012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1534747209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018102080 0x7f1018102500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 -- 172.21.15.60:0/1534747209 >> 172.21.15.60:0/1534747209 conn(0x7f10180fc460 msgr2=0x7f10180fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:51.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 -- 172.21.15.60:0/1534747209 shutdown_connections 2023-10-05T15:16:51.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.638+0000 7f101cd7c700 1 -- 172.21.15.60:0/1534747209 wait complete. 2023-10-05T15:16:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 Processor -- start 2023-10-05T15:16:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 -- start start 2023-10-05T15:16:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 0x7f1018196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018102080 0x7f10181973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102a40 0x7f1018198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018198870 con 0x7f1018102a40 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10181989e0 con 0x7f1018100ea0 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101cd7c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018198ba0 con 0x7f1018102080 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 0x7f1018196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f1016d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102a40 0x7f1018198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 0x7f1018196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52106/0 (socket says 172.21.15.60:52106) 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f101659c700 1 -- 172.21.15.60:0/1789202541 learned_addr learned my addr 172.21.15.60:0/1789202541 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.639+0000 7f1015d9b700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018102080 0x7f10181973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101659c700 1 -- 172.21.15.60:0/1789202541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018102080 msgr2=0x7f10181973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101659c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018102080 0x7f10181973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101659c700 1 -- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102a40 msgr2=0x7f1018198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101659c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102a40 0x7f1018198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101659c700 1 -- 172.21.15.60:0/1789202541 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080095f0 con 0x7f1018100ea0 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101659c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 0x7f1018196e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f100801fc00 tx=0x7f100801ff10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008009a10 con 0x7f1018100ea0 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f100801dc80 con 0x7f1018100ea0 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c009520 con 0x7f1018100ea0 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080297e0 con 0x7f1018100ea0 2023-10-05T15:16:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.640+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101806aab0 con 0x7f1018100ea0 2023-10-05T15:16:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.641+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101804ec90 con 0x7f1018100ea0 2023-10-05T15:16:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.643+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 135815+0+0 (secure 0 0 0) 0x7f1008021440 con 0x7f1018100ea0 2023-10-05T15:16:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.643+0000 7f10077fe700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f10000a1300 0x7f10000a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:16:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.643+0000 7f1015d9b700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f10000a1300 0x7f10000a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:16:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.643+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f1008025070 con 0x7f1018100ea0 2023-10-05T15:16:51.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.644+0000 7f1015d9b700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f10000a1300 0x7f10000a37c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f100c0098c0 tx=0x7f100c019040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:16:51.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.647+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10080a7f40 con 0x7f1018100ea0 2023-10-05T15:16:51.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.901+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 --> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f10180612f0 con 0x7f10000a1300 2023-10-05T15:16:51.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.908+0000 7f10077fe700 1 -- 172.21.15.60:0/1789202541 <== mgr.15663 v2:172.21.15.60:6800/139103647 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f10180612f0 con 0x7f10000a1300 2023-10-05T15:16:51.910 INFO:teuthology.orchestra.run.smithi060.stdout:/ 1m 6m3h 2023-10-05T15:16:51.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f10000a1300 msgr2=0x7f10000a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f10000a1300 0x7f10000a37c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f100c0098c0 tx=0x7f100c019040 comp rx=0 tx=0).stop 2023-10-05T15:16:51.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 msgr2=0x7f1018196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 0x7f1018196e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f100801fc00 tx=0x7f100801ff10 comp rx=0 tx=0).stop 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 shutdown_connections 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102a40 0x7f1018198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f10000a1300 0x7f10000a37c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018100ea0 0x7f1018196e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 --2- 172.21.15.60:0/1789202541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018102080 0x7f10181973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.910+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 >> 172.21.15.60:0/1789202541 conn(0x7f10180fc460 msgr2=0x7f10180fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.911+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 shutdown_connections 2023-10-05T15:16:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:16:51.911+0000 7f101cd7c700 1 -- 172.21.15.60:0/1789202541 wait complete. 2023-10-05T15:16:51.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-05T15:16:51.953 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-05T15:16:51.993 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-05T15:16:52.035 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:16:52.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-05T15:16:52.037 INFO:teuthology.run_tasks:Running task workunit... 2023-10-05T15:16:52.050 INFO:tasks.workunit:Pulling workunits from ref 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:16:52.051 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-05T15:16:52.051 INFO:tasks.workunit:timeout=3h 2023-10-05T15:16:52.051 INFO:tasks.workunit:cleanup=True 2023-10-05T15:16:52.051 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-05T15:16:52.070 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-10-05T15:16:52.071 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:16:52.071 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-05T15:16:52.071 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-05 15:15:11.157498111 +0000 2023-10-05T15:16:52.071 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-05 15:15:11.157498111 +0000 2023-10-05T15:16:52.071 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-05 15:16:31.976031426 +0000 2023-10-05T15:16:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-10-05 15:15:11.157498111 +0000 2023-10-05T15:16:52.071 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-05T15:16:52.071 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-05T15:16:52.190 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:52 smithi060 ceph-mon[99238]: [05/Oct/2023:15:16:50] ENGINE Serving on https://172.21.15.60:7150 2023-10-05T15:16:52.190 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:52 smithi060 ceph-mon[99238]: [05/Oct/2023:15:16:50] ENGINE Bus STARTED 2023-10-05T15:16:52.191 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:52 smithi060 ceph-mon[99238]: from='client.25336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:52.191 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:52 smithi060 ceph-mon[99238]: pgmap v3: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:52.191 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:52 smithi060 ceph-mon[99238]: from='client.15723 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:52.192 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:16:52.211 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-05T15:16:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:52 smithi135 ceph-mon[103360]: [05/Oct/2023:15:16:50] ENGINE Serving on https://172.21.15.60:7150 2023-10-05T15:16:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:52 smithi135 ceph-mon[103360]: [05/Oct/2023:15:16:50] ENGINE Bus STARTED 2023-10-05T15:16:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:52 smithi135 ceph-mon[103360]: from='client.25336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:52 smithi135 ceph-mon[103360]: pgmap v3: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:52.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:52 smithi135 ceph-mon[103360]: from='client.15723 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:52 smithi092 ceph-mon[102944]: [05/Oct/2023:15:16:50] ENGINE Serving on https://172.21.15.60:7150 2023-10-05T15:16:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:52 smithi092 ceph-mon[102944]: [05/Oct/2023:15:16:50] ENGINE Bus STARTED 2023-10-05T15:16:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:52 smithi092 ceph-mon[102944]: from='client.25336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:52 smithi092 ceph-mon[102944]: pgmap v3: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:52.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:52 smithi092 ceph-mon[102944]: from='client.15723 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='client.15729 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:53.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='client.25502 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: mgrmap e23: x(active, since 3s), standbys: z, y 2023-10-05T15:16:53.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: scrub summary: idle 2023-10-05T15:16:53.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:53 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='client.15729 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='client.25502 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: mgrmap e23: x(active, since 3s), standbys: z, y 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: scrub summary: idle 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:53 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='client.15729 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='client.25502 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:16:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: mgrmap e23: x(active, since 3s), standbys: z, y 2023-10-05T15:16:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: scrub summary: idle 2023-10-05T15:16:53.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:53.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:53 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi135 to 196.2M 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Unable to set osd_memory_target on smithi135 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-05T15:16:55.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: mgrmap e24: x(active, since 4s), standbys: z, y 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:54 smithi135 ceph-mon[103360]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi135 to 196.2M 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Unable to set osd_memory_target on smithi135 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: mgrmap e24: x(active, since 4s), standbys: z, y 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:54 smithi060 ceph-mon[99238]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:16:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi135 to 196.2M 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Unable to set osd_memory_target on smithi135 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:16:55.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi135:/etc/ceph/ceph.conf 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: mgrmap e24: x(active, since 4s), standbys: z, y 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:55.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:54 smithi092 ceph-mon[102944]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:56.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:16:56.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:16:56.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:55 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:16:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:16:56.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:55 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: Updating smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: Updating smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: Updating smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:16:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:16:56.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:55 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:16:57.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:57 smithi060 ceph-mon[99238]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 91 KiB/s wr, 60 op/s 2023-10-05T15:16:57.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:57 smithi092 ceph-mon[102944]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 91 KiB/s wr, 60 op/s 2023-10-05T15:16:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:57 smithi135 ceph-mon[103360]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 91 KiB/s wr, 60 op/s 2023-10-05T15:16:59.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:16:59 smithi060 ceph-mon[99238]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-10-05T15:16:59.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:16:59 smithi092 ceph-mon[102944]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-10-05T15:16:59.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:16:59 smithi135 ceph-mon[103360]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-10-05T15:17:00.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:17:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:17:00.091+0000 7f2780eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:17:00.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:17:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:17:00.091+0000 7f2780eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:17:00.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:17:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:17:00.091+0000 7f2780eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:17:00.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:17:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:17:00.091+0000 7f2780eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:17:00.415 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:17:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:17:00.091+0000 7f2780eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:17:01.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:01 smithi060 ceph-mon[99238]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-10-05T15:17:01.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:01 smithi092 ceph-mon[102944]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-10-05T15:17:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:01 smithi135 ceph-mon[103360]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-10-05T15:17:03.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:03 smithi060 ceph-mon[99238]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 109 KiB/s wr, 64 op/s 2023-10-05T15:17:03.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:03 smithi060 ceph-mon[99238]: mgrmap e25: x(active, since 12s), standbys: z, y 2023-10-05T15:17:03.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:03 smithi092 ceph-mon[102944]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 109 KiB/s wr, 64 op/s 2023-10-05T15:17:03.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:03 smithi092 ceph-mon[102944]: mgrmap e25: x(active, since 12s), standbys: z, y 2023-10-05T15:17:03.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:03 smithi135 ceph-mon[103360]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 109 KiB/s wr, 64 op/s 2023-10-05T15:17:03.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:03 smithi135 ceph-mon[103360]: mgrmap e25: x(active, since 12s), standbys: z, y 2023-10-05T15:17:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 -- 172.21.15.60:0/2300196427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 msgr2=0x7f67c010dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 --2- 172.21.15.60:0/2300196427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c010dd60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f67b800b0a0 tx=0x7f67b800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 -- 172.21.15.60:0/2300196427 shutdown_connections 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 --2- 172.21.15.60:0/2300196427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c010dd60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 --2- 172.21.15.60:0/2300196427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01010c0 0x7f67c01014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 --2- 172.21.15.60:0/2300196427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67c0101a70 0x7f67c0105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 -- 172.21.15.60:0/2300196427 >> 172.21.15.60:0/2300196427 conn(0x7f67c00fc940 msgr2=0x7f67c00fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 -- 172.21.15.60:0/2300196427 shutdown_connections 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.207+0000 7f67c79be700 1 -- 172.21.15.60:0/2300196427 wait complete. 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 Processor -- start 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 -- start start 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67c01010c0 0x7f67c0073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c00738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01a32b0 0x7f67c01a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c01a5be0 con 0x7f67c01061e0 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c01a5d20 con 0x7f67c01010c0 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c79be700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c01a5e90 con 0x7f67c01a32b0 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.208+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c00738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c00738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38728/0 (socket says 172.21.15.60:38728) 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 -- 172.21.15.60:0/2198036887 learned_addr learned my addr 172.21.15.60:0/2198036887 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c575a700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67c01010c0 0x7f67c0073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01a32b0 0x7f67c01a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 -- 172.21.15.60:0/2198036887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01a32b0 msgr2=0x7f67c01a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01a32b0 0x7f67c01a56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 -- 172.21.15.60:0/2198036887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67c01010c0 msgr2=0x7f67c0073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67c01010c0 0x7f67c0073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 -- 172.21.15.60:0/2198036887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b8009d00 con 0x7f67c01061e0 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01a32b0 0x7f67c01a56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c00738d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f67b000d980 tx=0x7f67b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67b67fc700 1 -- 172.21.15.60:0/2198036887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0009930 con 0x7f67c01061e0 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67b67fc700 1 -- 172.21.15.60:0/2198036887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b0010460 con 0x7f67c01061e0 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67b67fc700 1 -- 172.21.15.60:0/2198036887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b000f620 con 0x7f67c01061e0 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c01a6170 con 0x7f67c01061e0 2023-10-05T15:17:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.209+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c01a6680 con 0x7f67c01061e0 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.212+0000 7f67b67fc700 1 -- 172.21.15.60:0/2198036887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f67b00108d0 con 0x7f67c01061e0 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.212+0000 7f67b67fc700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67ac0a1790 0x7f67ac0a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.212+0000 7f67c575a700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67ac0a1790 0x7f67ac0a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.212+0000 7f67b67fc700 1 -- 172.21.15.60:0/2198036887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f67b00cd050 con 0x7f67c01061e0 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.213+0000 7f67c575a700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67ac0a1790 0x7f67ac0a3c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67bc005950 tx=0x7f67bc00b410 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.213+0000 7f67d3ba8b80 1 Processor -- start 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.213+0000 7f67d3ba8b80 1 -- start start 2023-10-05T15:17:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c150400 con 0x55cc7c1e7520 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c141bc0 con 0x55cc7c1e6c00 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c13f4e0 con 0x55cc7c1f23d0 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38736/0 (socket says 172.21.15.60:38736) 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 -- 172.21.15.60:0/1757118871 learned_addr learned my addr 172.21.15.60:0/1757118871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c575a700 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 -- 172.21.15.60:0/1757118871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 msgr2=0x55cc7c1f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 -- 172.21.15.60:0/1757118871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 msgr2=0x55cc7c1e6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1e6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 -- 172.21.15.60:0/1757118871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc7bf65d80 con 0x55cc7c1e7520 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67c4f59700 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f1e90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f67b000d950 tx=0x7f67b009a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8374f9fd5bbf0c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67ab7fe700 1 -- 172.21.15.60:0/1757118871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b00a1e90 con 0x55cc7c1e7520 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67ab7fe700 1 -- 172.21.15.60:0/1757118871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b0009a90 con 0x55cc7c1e7520 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.214+0000 7f67ab7fe700 1 -- 172.21.15.60:0/1757118871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0099250 con 0x55cc7c1e7520 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/1757118871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 msgr2=0x55cc7c1f1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f1e90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f67b000d950 tx=0x7f67b009a200 comp rx=0 tx=0).stop 2023-10-05T15:17:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/1757118871 shutdown_connections 2023-10-05T15:17:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1e6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/1757118871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f1e90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/1757118871 >> 172.21.15.60:0/1757118871 conn(0x55cc7c15c200 msgr2=0x55cc7c1e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/1757118871 shutdown_connections 2023-10-05T15:17:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.215+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/1757118871 wait complete. 2023-10-05T15:17:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 -- start start 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 Processor -- start 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c13add0 con 0x55cc7c1f23d0 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c0d76b0 con 0x55cc7c1e7520 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c0d7350 con 0x55cc7c1e6c00 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67d3ba8b80 10 client.0 _ll_register_callbacks cb 0x55cc7bf347a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67c5f5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67c5f5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38744/0 (socket says 172.21.15.60:38744) 2023-10-05T15:17:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67c5f5b700 1 -- 172.21.15.60:0/3684977111 learned_addr learned my addr 172.21.15.60:0/3684977111 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.216+0000 7f67c4f59700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c575a700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c5f5b700 1 -- 172.21.15.60:0/3684977111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1e6c00 msgr2=0x55cc7c1f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c5f5b700 1 -- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e7520 msgr2=0x55cc7c1ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c5f5b700 1 -- 172.21.15.60:0/3684977111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c01a6680 con 0x55cc7c1f23d0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ef7b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f67b8004c90 tx=0x7f67b8004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97154ea59369d2db server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67a8ff9700 1 -- 172.21.15.60:0/3684977111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b800e040 con 0x55cc7c1f23d0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67a8ff9700 1 -- 172.21.15.60:0/3684977111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f67b80078f0 con 0x55cc7c1f23d0 2023-10-05T15:17:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc7c1dad50 con 0x55cc7c1f23d0 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67a8ff9700 1 -- 172.21.15.60:0/3684977111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67b8009b80 con 0x55cc7c1f23d0 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67d3ba8b80 10 client.15756 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cc7bf4ec00 con 0x55cc7c1f23d0 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.217+0000 7f67a8ff9700 1 -- 172.21.15.60:0/3684977111 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cc7c1dad50 con 0x55cc7c1f23d0 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67a8ff9700 1 -- 172.21.15.60:0/3684977111 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f67b8019050 con 0x55cc7c1f23d0 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67d3ba8b80 10 client.15756 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67d3ba8b80 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67d3ba8b80 20 client.15756 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c201d40 0x55cc7c204160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67d3ba8b80 4 client.15756 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc7c133db0 con 0x55cc7c201d40 2023-10-05T15:17:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67c575a700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c201d40 0x55cc7c204160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67a8ff9700 10 client.15756 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.218+0000 7f67c575a700 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c201d40 0x55cc7c204160 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c614a50ed2717d5c server_cookie=4b7fb187aac2fbb5 in_seq=0 out_seq=0 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67a8ff9700 1 -- 172.21.15.60:0/3684977111 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc7c133db0 con 0x55cc7c201d40 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67a8ff9700 10 client.15756 handle_command_reply: tid=0 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 client.15756 shutdown 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 msgr2=0x55cc7c1ef7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ef7b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f67b8004c90 tx=0x7f67b8004cc0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 shutdown_connections 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c201d40 0x55cc7c204160 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ef7b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/3684977111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67a8ff9700 0 client.15756 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 >> 172.21.15.60:0/3684977111 conn(0x55cc7c15c200 msgr2=0x55cc7c1e2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.219+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 shutdown_connections 2023-10-05T15:17:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.220+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/3684977111 wait complete. 2023-10-05T15:17:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.220+0000 7f67d3ba8b80 20 client.15756 trim_cache size 0 max 16384 2023-10-05T15:17:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 Processor -- start 2023-10-05T15:17:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 -- start start 2023-10-05T15:17:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ea970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7bfbb8c0 con 0x55cc7c1e7520 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c1e7e20 con 0x55cc7c1e6c00 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c1e1e30 con 0x55cc7c1f23d0 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ea430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38750/0 (socket says 172.21.15.60:38750) 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 -- 172.21.15.60:0/2205195297 learned_addr learned my addr 172.21.15.60:0/2205195297 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 -- 172.21.15.60:0/2205195297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 msgr2=0x55cc7c1ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 -- 172.21.15.60:0/2205195297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 msgr2=0x55cc7c1f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c575a700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c4f59700 1 -- 172.21.15.60:0/2205195297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc7bf8c1f0 con 0x55cc7c1e7520 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.235+0000 7f67c575a700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ea430 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f67b0097e50 tx=0x7f67b0099640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4495e2fa86b54f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67abfff700 1 -- 172.21.15.60:0/2205195297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b00a1e90 con 0x55cc7c1e7520 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67abfff700 1 -- 172.21.15.60:0/2205195297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b0097ea0 con 0x55cc7c1e7520 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67abfff700 1 -- 172.21.15.60:0/2205195297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0099250 con 0x55cc7c1e7520 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2205195297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 msgr2=0x55cc7c1ea430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ea430 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f67b0097e50 tx=0x7f67b0099640 comp rx=0 tx=0).stop 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2205195297 shutdown_connections 2023-10-05T15:17:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c1ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2205195297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1ea430 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2205195297 >> 172.21.15.60:0/2205195297 conn(0x55cc7c15c200 msgr2=0x55cc7c1fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2205195297 shutdown_connections 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.236+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2205195297 wait complete. 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 -- start start 2023-10-05T15:17:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 Processor -- start 2023-10-05T15:17:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c254b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c1f8d20 con 0x55cc7c1e7520 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c1f8e90 con 0x55cc7c1e6c00 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7c2550e0 con 0x55cc7c1f23d0 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67d3ba8b80 10 client.0 _ll_register_callbacks cb 0x7f67b80094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67c4f59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38756/0 (socket says 172.21.15.60:38756) 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67c4f59700 1 -- 172.21.15.60:0/2870334736 learned_addr learned my addr 172.21.15.60:0/2870334736 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.237+0000 7f67c575a700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c5f5b700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c254b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c4f59700 1 -- 172.21.15.60:0/2870334736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 msgr2=0x55cc7c254b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c254b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c4f59700 1 -- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 msgr2=0x55cc7c1f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c4f59700 1 -- 172.21.15.60:0/2870334736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc7bf65d80 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67c4f59700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f8550 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f67b00996b0 tx=0x7f67b0005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a45dcfab8486949 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67a8ff9700 1 -- 172.21.15.60:0/2870334736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0099f60 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67a8ff9700 1 -- 172.21.15.60:0/2870334736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f67b00a1e90 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67b0009a90 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67a8ff9700 1 -- 172.21.15.60:0/2870334736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67b0098ff0 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67d3ba8b80 10 client.15762 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cc7bf64250 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.238+0000 7f67a8ff9700 1 -- 172.21.15.60:0/2870334736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b0009a90 con 0x55cc7c1e7520 2023-10-05T15:17:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67a8ff9700 1 -- 172.21.15.60:0/2870334736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f67b00ca620 con 0x55cc7c1e7520 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67d3ba8b80 10 client.15762 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67d3ba8b80 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67d3ba8b80 20 client.15762 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c2563d0 0x55cc7c2587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67d3ba8b80 4 client.15762 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc7c133ad0 con 0x55cc7c2563d0 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67c575a700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c2563d0 0x55cc7c2587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67c575a700 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c2563d0 0x55cc7c2587c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ecf76ae71f0f32 server_cookie=3cdc7b36eac984a0 in_seq=0 out_seq=0 2023-10-05T15:17:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.239+0000 7f67a8ff9700 10 client.15762 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67a8ff9700 1 -- 172.21.15.60:0/2870334736 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc7c133ad0 con 0x55cc7c2563d0 2023-10-05T15:17:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67a8ff9700 10 client.15762 handle_command_reply: tid=0 2023-10-05T15:17:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 client.15762 shutdown 2023-10-05T15:17:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 msgr2=0x55cc7c1f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f8550 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f67b00996b0 tx=0x7f67b0005c80 comp rx=0 tx=0).stop 2023-10-05T15:17:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 shutdown_connections 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc7c2563d0 0x55cc7c2587c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc7c1f23d0 0x55cc7c254b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc7c1e6c00 0x55cc7c1f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 --2- 172.21.15.60:0/2870334736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc7c1e7520 0x55cc7c1f8550 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67a8ff9700 0 client.15762 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 >> 172.21.15.60:0/2870334736 conn(0x55cc7c15c200 msgr2=0x55cc7c1ea430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 shutdown_connections 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 1 -- 172.21.15.60:0/2870334736 wait complete. 2023-10-05T15:17:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.253+0000 7f67d3ba8b80 20 client.15762 trim_cache size 0 max 16384 2023-10-05T15:17:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:17:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:17:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:17:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67ac0a1790 msgr2=0x7f67ac0a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67ac0a1790 0x7f67ac0a3c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67bc005950 tx=0x7f67bc00b410 comp rx=0 tx=0).stop 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 msgr2=0x7f67c00738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c00738d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f67b000d980 tx=0x7f67b000dc90 comp rx=0 tx=0).stop 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 shutdown_connections 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67c01a32b0 0x7f67c01a56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67ac0a1790 0x7f67ac0a3c50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67c01010c0 0x7f67c0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 --2- 172.21.15.60:0/2198036887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67c01061e0 0x7f67c00738d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 >> 172.21.15.60:0/2198036887 conn(0x7f67c00fc940 msgr2=0x7f67c00fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 shutdown_connections 2023-10-05T15:17:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:05.254+0000 7f67c79be700 1 -- 172.21.15.60:0/2198036887 wait complete. 2023-10-05T15:17:05.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:05 smithi060 ceph-mon[99238]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 99 KiB/s wr, 58 op/s 2023-10-05T15:17:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:05 smithi092 ceph-mon[102944]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 99 KiB/s wr, 58 op/s 2023-10-05T15:17:05.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:05 smithi135 ceph-mon[103360]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 99 KiB/s wr, 58 op/s 2023-10-05T15:17:07.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:07 smithi060 ceph-mon[99238]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 102 KiB/s wr, 64 op/s 2023-10-05T15:17:07.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:07 smithi092 ceph-mon[102944]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 102 KiB/s wr, 64 op/s 2023-10-05T15:17:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:07 smithi135 ceph-mon[103360]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 102 KiB/s wr, 64 op/s 2023-10-05T15:17:09.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:09 smithi060 ceph-mon[99238]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 KiB/s wr, 42 op/s 2023-10-05T15:17:09.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:09 smithi092 ceph-mon[102944]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 KiB/s wr, 42 op/s 2023-10-05T15:17:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:09 smithi135 ceph-mon[103360]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 KiB/s wr, 42 op/s 2023-10-05T15:17:10.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:17:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 -- 172.21.15.60:0/1040139576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1488100960 msgr2=0x7f14881049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 --2- 172.21.15.60:0/1040139576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1488100960 0x7f14881049a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1484009990 tx=0x7f1484009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 -- 172.21.15.60:0/1040139576 shutdown_connections 2023-10-05T15:17:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 --2- 172.21.15.60:0/1040139576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14881050d0 0x7f148810cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 --2- 172.21.15.60:0/1040139576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14880fffb0 0x7f1488100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 --2- 172.21.15.60:0/1040139576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1488100960 0x7f14881049a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 -- 172.21.15.60:0/1040139576 >> 172.21.15.60:0/1040139576 conn(0x7f14880fb810 msgr2=0x7f14880fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 -- 172.21.15.60:0/1040139576 shutdown_connections 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.654+0000 7f14901b5700 1 -- 172.21.15.60:0/1040139576 wait complete. 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 Processor -- start 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 -- start start 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14880fffb0 0x7f1488197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 0x7f1488198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1488198930 0x7f14881a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14881a3610 con 0x7f14881050d0 2023-10-05T15:17:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14881a3780 con 0x7f1488198930 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f14901b5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14881a3940 con 0x7f14880fffb0 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 0x7f1488198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 0x7f1488198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38770/0 (socket says 172.21.15.60:38770) 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 -- 172.21.15.60:0/1445811931 learned_addr learned my addr 172.21.15.60:0/1445811931 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148e752700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1488198930 0x7f14881a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148df51700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14880fffb0 0x7f1488197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 -- 172.21.15.60:0/1445811931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14880fffb0 msgr2=0x7f1488197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14880fffb0 0x7f1488197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 -- 172.21.15.60:0/1445811931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1488198930 msgr2=0x7f14881a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1488198930 0x7f14881a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 -- 172.21.15.60:0/1445811931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840095f0 con 0x7f14881050d0 2023-10-05T15:17:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148df51700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14880fffb0 0x7f1488197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.655+0000 7f148d750700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 0x7f1488198350 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1484000c00 tx=0x7f1484009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.656+0000 7f147effd700 1 -- 172.21.15.60:0/1445811931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148401d070 con 0x7f14881050d0 2023-10-05T15:17:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.656+0000 7f147effd700 1 -- 172.21.15.60:0/1445811931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1484004060 con 0x7f14881050d0 2023-10-05T15:17:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.656+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14881a3bc0 con 0x7f14881050d0 2023-10-05T15:17:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.656+0000 7f147effd700 1 -- 172.21.15.60:0/1445811931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484022d80 con 0x7f14881050d0 2023-10-05T15:17:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.656+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14881a40c0 con 0x7f14881050d0 2023-10-05T15:17:10.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.658+0000 7f147effd700 1 -- 172.21.15.60:0/1445811931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f1484003ba0 con 0x7f14881050d0 2023-10-05T15:17:10.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.659+0000 7f147effd700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f14740a1790 0x7f14740a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.659+0000 7f147effd700 1 -- 172.21.15.60:0/1445811931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f14840ce880 con 0x7f14881050d0 2023-10-05T15:17:10.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.659+0000 7f148df51700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f14740a1790 0x7f14740a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f148df51700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f14740a1790 0x7f14740a3c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1478005fd0 tx=0x7f1478005e20 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:10.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 Processor -- start 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 -- start start 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x5623973034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397310c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239726c460 con 0x5623973039e0 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239725dc20 con 0x5623973030c0 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f149c39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239725b540 con 0x56239730e890 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f148d750700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f148d750700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38778/0 (socket says 172.21.15.60:38778) 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.660+0000 7f148d750700 1 -- 172.21.15.60:0/2210934741 learned_addr learned my addr 172.21.15.60:0/2210934741 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148df51700 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x5623973034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148e752700 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397310c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148d750700 1 -- 172.21.15.60:0/2210934741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 msgr2=0x562397310c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148d750700 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397310c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148d750700 1 -- 172.21.15.60:0/2210934741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 msgr2=0x5623973034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148d750700 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x5623973034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148d750700 1 -- 172.21.15.60:0/2210934741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562397081de0 con 0x5623973039e0 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148e752700 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397310c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f148d750700 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730e350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1484005f50 tx=0x7f148409b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518e6b43f41027e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f1473fff700 1 -- 172.21.15.60:0/2210934741 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840041d0 con 0x5623973039e0 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f1473fff700 1 -- 172.21.15.60:0/2210934741 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f148409bac0 con 0x5623973039e0 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.661+0000 7f1473fff700 1 -- 172.21.15.60:0/2210934741 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840997f0 con 0x5623973039e0 2023-10-05T15:17:10.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 -- 172.21.15.60:0/2210934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 msgr2=0x56239730e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730e350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1484005f50 tx=0x7f148409b280 comp rx=0 tx=0).stop 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 -- 172.21.15.60:0/2210934741 shutdown_connections 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397310c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x5623973034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2210934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730e350 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 -- 172.21.15.60:0/2210934741 >> 172.21.15.60:0/2210934741 conn(0x562397278260 msgr2=0x5623972ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 -- 172.21.15.60:0/2210934741 shutdown_connections 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 -- 172.21.15.60:0/2210934741 wait complete. 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 -- start start 2023-10-05T15:17:10.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.662+0000 7f149c39fb80 1 Processor -- start 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x56239730ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x56239730f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562397256e30 con 0x5623973039e0 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623971f3710 con 0x5623973030c0 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623971f33b0 con 0x56239730e890 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f149c39fb80 10 client.0 _ll_register_callbacks cb 0x562397050800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148d750700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148df51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x56239730ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148d750700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38784/0 (socket says 172.21.15.60:38784) 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148d750700 1 -- 172.21.15.60:0/2225351600 learned_addr learned my addr 172.21.15.60:0/2225351600 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148e752700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x56239730f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148df51700 1 -- 172.21.15.60:0/2225351600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 msgr2=0x56239730f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148df51700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x56239730f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148df51700 1 -- 172.21.15.60:0/2225351600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 msgr2=0x56239730f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148df51700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148df51700 1 -- 172.21.15.60:0/2225351600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14881a40c0 con 0x5623973030c0 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.663+0000 7f148d750700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f148df51700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x56239730ec70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f147800d620 tx=0x7f1478004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31aabbbab99ffba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f14717fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f14717fa700 1 -- 172.21.15.60:0/2225351600 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478026670 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623972f6f10 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f14717fa700 1 -- 172.21.15.60:0/2225351600 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f14780267d0 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f14717fa700 1 -- 172.21.15.60:0/2225351600 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1478026990 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 10 client.25532 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56239706ac60 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f14717fa700 1 -- 172.21.15.60:0/2225351600 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623972f6f10 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f14717fa700 1 -- 172.21.15.60:0/2225351600 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f147801c570 con 0x5623973030c0 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 10 client.25532 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 20 client.25532 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x5623973203e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 4 client.25532 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.664+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56239724fe10 con 0x56239731dfc0 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.665+0000 7f148d750700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x5623973203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.665+0000 7f148d750700 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x5623973203e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c1cf038af4b5c70 server_cookie=3cb2c448861e9804 in_seq=0 out_seq=0 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.665+0000 7f14717fa700 10 client.25532 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f14717fa700 1 -- 172.21.15.60:0/2225351600 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56239724fe10 con 0x56239731dfc0 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f14717fa700 10 client.25532 handle_command_reply: tid=0 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 client.25532 shutdown 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 msgr2=0x56239730ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x56239730ec70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f147800d620 tx=0x7f1478004750 comp rx=0 tx=0).stop 2023-10-05T15:17:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 shutdown_connections 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x5623973203e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x56239730f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f14717fa700 0 client.25532 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973030c0 0x56239730ec70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 --2- 172.21.15.60:0/2225351600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973039e0 0x56239730f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 >> 172.21.15.60:0/2225351600 conn(0x562397278260 msgr2=0x5623972fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 shutdown_connections 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 1 -- 172.21.15.60:0/2225351600 wait complete. 2023-10-05T15:17:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.666+0000 7f149c39fb80 20 client.25532 trim_cache size 0 max 16384 2023-10-05T15:17:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 Processor -- start 2023-10-05T15:17:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 -- start start 2023-10-05T15:17:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397308ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x5623973091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397307300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623970d7920 con 0x5623973030c0 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623973087e0 con 0x5623973039e0 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f149c39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623972f9520 con 0x56239730e890 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397308ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397308ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38790/0 (socket says 172.21.15.60:38790) 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 -- 172.21.15.60:0/818519560 learned_addr learned my addr 172.21.15.60:0/818519560 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148d750700 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x5623973091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 -- 172.21.15.60:0/818519560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 msgr2=0x562397307300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397307300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 -- 172.21.15.60:0/818519560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 msgr2=0x5623973091e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x5623973091e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.683+0000 7f148df51700 1 -- 172.21.15.60:0/818519560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623970a8250 con 0x5623973030c0 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f148df51700 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397308ca0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f147801c900 tx=0x7f147800d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42025715473e3560 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f147cff9700 1 -- 172.21.15.60:0/818519560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147801ccf0 con 0x5623973030c0 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f147cff9700 1 -- 172.21.15.60:0/818519560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f147800fb20 con 0x5623973030c0 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f147cff9700 1 -- 172.21.15.60:0/818519560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780053c0 con 0x5623973030c0 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 -- 172.21.15.60:0/818519560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 msgr2=0x562397308ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397308ca0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f147801c900 tx=0x7f147800d830 comp rx=0 tx=0).stop 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 -- 172.21.15.60:0/818519560 shutdown_connections 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397307300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397308ca0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 --2- 172.21.15.60:0/818519560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x5623973091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 -- 172.21.15.60:0/818519560 >> 172.21.15.60:0/818519560 conn(0x562397278260 msgr2=0x56239730d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:10.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 -- 172.21.15.60:0/818519560 shutdown_connections 2023-10-05T15:17:10.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.684+0000 7f149c39fb80 1 -- 172.21.15.60:0/818519560 wait complete. 2023-10-05T15:17:10.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 -- start start 2023-10-05T15:17:10.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 Processor -- start 2023-10-05T15:17:10.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397310980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x562397310ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397375200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562397311610 con 0x5623973030c0 2023-10-05T15:17:10.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562397375740 con 0x5623973039e0 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562397375900 con 0x56239730e890 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f149c39fb80 10 client.0 _ll_register_callbacks cb 0x562397050800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f148df51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397310980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f148df51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397310980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38796/0 (socket says 172.21.15.60:38796) 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f148df51700 1 -- 172.21.15.60:0/742011842 learned_addr learned my addr 172.21.15.60:0/742011842 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f148d750700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x562397310ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.685+0000 7f148e752700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397375200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f148df51700 1 -- 172.21.15.60:0/742011842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 msgr2=0x562397375200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f148df51700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397375200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f148df51700 1 -- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 msgr2=0x562397310ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f148df51700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x562397310ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f148df51700 1 -- 172.21.15.60:0/742011842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56239706ac60 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f148df51700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397310980 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1478005f20 tx=0x7f147800d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfbabef49bdbeb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f14717fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f14717fa700 1 -- 172.21.15.60:0/742011842 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478004e20 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f14717fa700 1 -- 172.21.15.60:0/742011842 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f1478005040 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f148409bac0 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f14717fa700 1 -- 172.21.15.60:0/742011842 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1478005200 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f149c39fb80 10 client.15780 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5623970802b0 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f14717fa700 1 -- 172.21.15.60:0/742011842 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f148409bac0 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f14717fa700 1 -- 172.21.15.60:0/742011842 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1478026c50 con 0x5623973030c0 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f149c39fb80 10 client.15780 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f149c39fb80 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.686+0000 7f149c39fb80 20 client.15780 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f149c39fb80 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x562397378b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f149c39fb80 4 client.15780 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56239724fb30 con 0x56239731dfc0 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f148d750700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x562397378b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f14717fa700 10 client.15780 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f148d750700 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x562397378b50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71d9656727bcc1cc server_cookie=9dd1710bcb663ee5 in_seq=0 out_seq=0 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f14717fa700 1 -- 172.21.15.60:0/742011842 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56239724fb30 con 0x56239731dfc0 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f14717fa700 10 client.15780 handle_command_reply: tid=0 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f149c39fb80 1 client.15780 shutdown 2023-10-05T15:17:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 msgr2=0x562397310980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.687+0000 7f149c39fb80 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397310980 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1478005f20 tx=0x7f147800d8a0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 shutdown_connections 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56239731dfc0 0x562397378b50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239730e890 0x562397375200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623973030c0 0x562397310980 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 --2- 172.21.15.60:0/742011842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5623973039e0 0x562397310ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14717fa700 0 client.15780 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 >> 172.21.15.60:0/742011842 conn(0x562397278260 msgr2=0x5623972fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 shutdown_connections 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 1 -- 172.21.15.60:0/742011842 wait complete. 2023-10-05T15:17:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f149c39fb80 20 client.15780 trim_cache size 0 max 16384 2023-10-05T15:17:10.697 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:17:10.697 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2023-10-05T15:17:10.697 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2023-10-05T15:17:10.697 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f14740a1790 msgr2=0x7f14740a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f14740a1790 0x7f14740a3c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1478005fd0 tx=0x7f1478005e20 comp rx=0 tx=0).stop 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 msgr2=0x7f1488198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 0x7f1488198350 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1484000c00 tx=0x7f1484009580 comp rx=0 tx=0).stop 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 shutdown_connections 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f14740a1790 0x7f14740a3c50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1488198930 0x7f14881a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14880fffb0 0x7f1488197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 --2- 172.21.15.60:0/1445811931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14881050d0 0x7f1488198350 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 >> 172.21.15.60:0/1445811931 conn(0x7f14880fb810 msgr2=0x7f14880fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 shutdown_connections 2023-10-05T15:17:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.688+0000 7f14901b5700 1 -- 172.21.15.60:0/1445811931 wait complete. 2023-10-05T15:17:10.702 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-05T15:17:10.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:17:10.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.825+0000 7febd2ba1700 1 -- 172.21.15.60:0/502971493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 msgr2=0x7febcc1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.825+0000 7febd2ba1700 1 --2- 172.21.15.60:0/502971493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc1001d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febc00098f0 tx=0x7febc0009c00 comp rx=0 tx=0).stop 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- 172.21.15.60:0/502971493 shutdown_connections 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 --2- 172.21.15.60:0/502971493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc10ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 --2- 172.21.15.60:0/502971493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc1001d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 --2- 172.21.15.60:0/502971493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1007a0 0x7febcc1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- 172.21.15.60:0/502971493 >> 172.21.15.60:0/502971493 conn(0x7febcc0fb670 msgr2=0x7febcc0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- 172.21.15.60:0/502971493 shutdown_connections 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- 172.21.15.60:0/502971493 wait complete. 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 Processor -- start 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- start start 2023-10-05T15:17:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1959f0 0x7febcc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc196470 con 0x7febcc104f10 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1965b0 con 0x7febcc0ffdf0 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.826+0000 7febd2ba1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc196770 con 0x7febcc1959f0 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38812/0 (socket says 172.21.15.60:38812) 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 -- 172.21.15.60:0/526466987 learned_addr learned my addr 172.21.15.60:0/526466987 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd1b9f700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd23a0700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1959f0 0x7febcc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 -- 172.21.15.60:0/526466987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1959f0 msgr2=0x7febcc195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1959f0 0x7febcc195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 -- 172.21.15.60:0/526466987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 msgr2=0x7febcc19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 -- 172.21.15.60:0/526466987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009d00 con 0x7febcc104f10 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd23a0700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1959f0 0x7febcc195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd1b9f700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd139e700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc19bec0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7febc800d950 tx=0x7febc800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8009b40 con 0x7febcc104f10 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febc800de30 con 0x7febcc104f10 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc0009520 con 0x7febcc104f10 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8005580 con 0x7febcc104f10 2023-10-05T15:17:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.827+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc1a2b20 con 0x7febcc104f10 2023-10-05T15:17:12.006 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:11 smithi135 ceph-mon[103360]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2023-10-05T15:17:12.006 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:11 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/526466987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:17:12.007 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:11 smithi092 ceph-mon[102944]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2023-10-05T15:17:12.007 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:11 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/526466987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:17:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.828+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc068040 con 0x7febcc104f10 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.829+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7febc8004750 con 0x7febcc104f10 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.830+0000 7febbeffd700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7febb80a1800 0x7febb80a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.830+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7febc80cd090 con 0x7febcc104f10 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.830+0000 7febd1b9f700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7febb80a1800 0x7febb80a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.830+0000 7febd1b9f700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7febb80a1800 0x7febb80a3cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febc0009fd0 tx=0x7febc0019040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:10.834+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7febc8095e20 con 0x7febcc104f10 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.081+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febcc196f00 con 0x7febcc104f10 2023-10-05T15:17:12.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.081+0000 7febbeffd700 1 -- 172.21.15.60:0/526466987 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7febc8099440 con 0x7febcc104f10 2023-10-05T15:17:12.009 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:17:12.009 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:17:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.083+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7febb80a1800 msgr2=0x7febb80a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.083+0000 7febd2ba1700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7febb80a1800 0x7febb80a3cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febc0009fd0 tx=0x7febc0019040 comp rx=0 tx=0).stop 2023-10-05T15:17:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 msgr2=0x7febcc19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc19bec0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7febc800d950 tx=0x7febc800dd10 comp rx=0 tx=0).stop 2023-10-05T15:17:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 shutdown_connections 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febcc1959f0 0x7febcc195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7febb80a1800 0x7febb80a3cc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febcc0ffdf0 0x7febcc19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 --2- 172.21.15.60:0/526466987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febcc104f10 0x7febcc19bec0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 >> 172.21.15.60:0/526466987 conn(0x7febcc0fb670 msgr2=0x7febcc1037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 shutdown_connections 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:11.084+0000 7febd2ba1700 1 -- 172.21.15.60:0/526466987 wait complete. 2023-10-05T15:17:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:17:12.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-05T15:17:12.012 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:11 smithi060 ceph-mon[99238]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2023-10-05T15:17:12.012 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:11 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/526466987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:17:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 -- 172.21.15.60:0/1759746764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 msgr2=0x7faff4101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 --2- 172.21.15.60:0/1759746764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4101470 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009990 tx=0x7fafe4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 -- 172.21.15.60:0/1759746764 shutdown_connections 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 --2- 172.21.15.60:0/1759746764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faff41061b0 0x7faff410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 --2- 172.21.15.60:0/1759746764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4101470 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 --2- 172.21.15.60:0/1759746764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faff4101a40 0x7faff4105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 -- 172.21.15.60:0/1759746764 >> 172.21.15.60:0/1759746764 conn(0x7faff40fc930 msgr2=0x7faff40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 -- 172.21.15.60:0/1759746764 shutdown_connections 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 -- 172.21.15.60:0/1759746764 wait complete. 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.150+0000 7faffa4fa700 1 Processor -- start 2023-10-05T15:17:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 -- start start 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faff41061b0 0x7faff4197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faff419b8e0 0x7faff419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff419c360 con 0x7faff4101090 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff419c4d0 con 0x7faff41061b0 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faffa4fa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff419c690 con 0x7faff419b8e0 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38824/0 (socket says 172.21.15.60:38824) 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 -- 172.21.15.60:0/2160218321 learned_addr learned my addr 172.21.15.60:0/2160218321 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff37fe700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faff41061b0 0x7faff4197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff8a97700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faff419b8e0 0x7faff419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 -- 172.21.15.60:0/2160218321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faff419b8e0 msgr2=0x7faff419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faff419b8e0 0x7faff419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 -- 172.21.15.60:0/2160218321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faff41061b0 msgr2=0x7faff4197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faff41061b0 0x7faff4197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.151+0000 7faff3fff700 1 -- 172.21.15.60:0/2160218321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40095f0 con 0x7faff4101090 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.152+0000 7faff3fff700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4196f40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004760 tx=0x7fafe4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.152+0000 7faff17fa700 1 -- 172.21.15.60:0/2160218321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe401d070 con 0x7faff4101090 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.152+0000 7faff17fa700 1 -- 172.21.15.60:0/2160218321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe4004cc0 con 0x7faff4101090 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.152+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff41a3b90 con 0x7faff4101090 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.152+0000 7faff17fa700 1 -- 172.21.15.60:0/2160218321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4003d00 con 0x7faff4101090 2023-10-05T15:17:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.152+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff41a4010 con 0x7faff4101090 2023-10-05T15:17:12.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.155+0000 7faff17fa700 1 -- 172.21.15.60:0/2160218321 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7fafe4005000 con 0x7faff4101090 2023-10-05T15:17:12.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.155+0000 7faff17fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fafdc0a1710 0x7fafdc0a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.155+0000 7faff17fa700 1 -- 172.21.15.60:0/2160218321 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fafe40ce330 con 0x7faff4101090 2023-10-05T15:17:12.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.155+0000 7faff37fe700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fafdc0a1710 0x7fafdc0a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 Processor -- start 2023-10-05T15:17:12.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7faff37fe700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fafdc0a1710 0x7fafdc0a3bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faff4198550 tx=0x7fafe800b410 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 -- start start 2023-10-05T15:17:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d82350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d84c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615ce0460 con 0x55d615d770c0 2023-10-05T15:17:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615cd1c20 con 0x55d615d779e0 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615ccf540 con 0x55d615d82890 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d774a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38832/0 (socket says 172.21.15.60:38832) 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.156+0000 7faff3fff700 1 -- 172.21.15.60:0/3746886899 learned_addr learned my addr 172.21.15.60:0/3746886899 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff37fe700 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d82350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff8a97700 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d84c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff3fff700 1 -- 172.21.15.60:0/3746886899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 msgr2=0x55d615d84c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff3fff700 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d84c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff3fff700 1 -- 172.21.15.60:0/3746886899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 msgr2=0x55d615d82350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff3fff700 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d82350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff3fff700 1 -- 172.21.15.60:0/3746886899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d615af5de0 con 0x55d615d770c0 2023-10-05T15:17:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7faff3fff700 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d774a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004730 tx=0x7fafe400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a8a2130db0f78c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7fafda7fc700 1 -- 172.21.15.60:0/3746886899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40a10f0 con 0x55d615d770c0 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7fafda7fc700 1 -- 172.21.15.60:0/3746886899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe409b570 con 0x55d615d770c0 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.157+0000 7fafda7fc700 1 -- 172.21.15.60:0/3746886899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe409a360 con 0x55d615d770c0 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3746886899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 msgr2=0x55d615d774a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d774a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004730 tx=0x7fafe400b540 comp rx=0 tx=0).stop 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3746886899 shutdown_connections 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d84c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d774a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3746886899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d82350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3746886899 >> 172.21.15.60:0/3746886899 conn(0x55d615cec260 msgr2=0x55d615d73450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3746886899 shutdown_connections 2023-10-05T15:17:12.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3746886899 wait complete. 2023-10-05T15:17:12.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.158+0000 7fb0066e4b80 1 -- start start 2023-10-05T15:17:12.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 Processor -- start 2023-10-05T15:17:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d82c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d779e0 0x55d615d831b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d82890 0x55d615d8dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615ccae30 con 0x55d615d770c0 2023-10-05T15:17:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615c67710 con 0x55d615d82890 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615c673b0 con 0x55d615d779e0 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d82c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7fb0066e4b80 10 client.0 _ll_register_callbacks cb 0x55d615ac4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d82c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38838/0 (socket says 172.21.15.60:38838) 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7faff3fff700 1 -- 172.21.15.60:0/3332473109 learned_addr learned my addr 172.21.15.60:0/3332473109 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7faff37fe700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d779e0 0x55d615d831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7faff8a97700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d82890 0x55d615d8dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.159+0000 7faff3fff700 1 -- 172.21.15.60:0/3332473109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d779e0 msgr2=0x55d615d831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7faff3fff700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d779e0 0x55d615d831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7faff3fff700 1 -- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d82890 msgr2=0x55d615d8dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7faff3fff700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d82890 0x55d615d8dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7faff3fff700 1 -- 172.21.15.60:0/3332473109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff41a4010 con 0x55d615d770c0 2023-10-05T15:17:12.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7faff8a97700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d82890 0x55d615d8dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7faff3fff700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d82c70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fafe409b4d0 tx=0x7fafe4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a911b1b86d118372 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fafd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fafd37fe700 1 -- 172.21.15.60:0/3332473109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40a3170 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fafd37fe700 1 -- 172.21.15.60:0/3332473109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fafe40ce040 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d615d6af10 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fafd37fe700 1 -- 172.21.15.60:0/3332473109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafe409a360 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 10 client.15798 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d615adec60 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fafd37fe700 1 -- 172.21.15.60:0/3332473109 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d615d6af10 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fafd37fe700 1 -- 172.21.15.60:0/3332473109 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fafe40aebc0 con 0x55d615d770c0 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 10 client.15798 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 10 client.15798 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 20 client.15798 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615d91ad0 0x55d615d93ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 4 client.15798 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.160+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d615cc3e10 con 0x55d615d91ad0 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.161+0000 7faff37fe700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615d91ad0 0x55d615d93ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.161+0000 7fafd37fe700 10 client.15798 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.161+0000 7faff37fe700 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615d91ad0 0x55d615d93ef0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b0754beb07caa00 server_cookie=27846ee13105dbdf in_seq=0 out_seq=0 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fafd37fe700 1 -- 172.21.15.60:0/3332473109 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d615cc3e10 con 0x55d615d91ad0 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fafd37fe700 10 client.15798 handle_command_reply: tid=0 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 client.15798 shutdown 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 msgr2=0x55d615d82c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d82c70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fafe409b4d0 tx=0x7fafe4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 shutdown_connections 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d82890 0x55d615d8dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615d91ad0 0x55d615d93ef0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d82c70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3332473109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d779e0 0x55d615d831b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 >> 172.21.15.60:0/3332473109 conn(0x55d615cec260 msgr2=0x55d615d73040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fafd37fe700 0 client.15798 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 shutdown_connections 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.162+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3332473109 wait complete. 2023-10-05T15:17:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.163+0000 7fb0066e4b80 20 client.15798 trim_cache size 0 max 16384 2023-10-05T15:17:12.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.175+0000 7fb0066e4b80 1 Processor -- start 2023-10-05T15:17:12.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 -- start start 2023-10-05T15:17:12.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d93ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d7cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d82c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615b4b920 con 0x55d615d770c0 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615d7d820 con 0x55d615d779e0 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615d6f0c0 con 0x55d615d82890 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d93ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d93ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38846/0 (socket says 172.21.15.60:38846) 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 -- 172.21.15.60:0/2073208883 learned_addr learned my addr 172.21.15.60:0/2073208883 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 -- 172.21.15.60:0/2073208883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 msgr2=0x55d615d82c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d82c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 -- 172.21.15.60:0/2073208883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 msgr2=0x55d615d7cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff37fe700 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d7cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d7cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 -- 172.21.15.60:0/2073208883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d615b1c250 con 0x55d615d770c0 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff37fe700 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d7cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7faff3fff700 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d93ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fafe40991c0 tx=0x7fafe400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49d4ced73d92fbb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.176+0000 7fafdaffd700 1 -- 172.21.15.60:0/2073208883 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40cbbb0 con 0x55d615d770c0 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fafdaffd700 1 -- 172.21.15.60:0/2073208883 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe40a3170 con 0x55d615d770c0 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fafdaffd700 1 -- 172.21.15.60:0/2073208883 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe409a360 con 0x55d615d770c0 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 -- 172.21.15.60:0/2073208883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 msgr2=0x55d615d93ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d93ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fafe40991c0 tx=0x7fafe400b540 comp rx=0 tx=0).stop 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 -- 172.21.15.60:0/2073208883 shutdown_connections 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d82c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d93ae0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/2073208883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d7cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 -- 172.21.15.60:0/2073208883 >> 172.21.15.60:0/2073208883 conn(0x55d615cec260 msgr2=0x55d615d71bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 -- 172.21.15.60:0/2073208883 shutdown_connections 2023-10-05T15:17:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 -- 172.21.15.60:0/2073208883 wait complete. 2023-10-05T15:17:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.177+0000 7fb0066e4b80 1 -- start start 2023-10-05T15:17:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 Processor -- start 2023-10-05T15:17:12.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d83b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d84080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615de48f0 con 0x55d615d770c0 2023-10-05T15:17:12.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615de4a30 con 0x55d615d779e0 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d615de4bf0 con 0x55d615d82890 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7fb0066e4b80 10 client.0 _ll_register_callbacks cb 0x55d615ac4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d83b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d83b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38852/0 (socket says 172.21.15.60:38852) 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 -- 172.21.15.60:0/3758104937 learned_addr learned my addr 172.21.15.60:0/3758104937 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff37fe700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d84080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff8a97700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 -- 172.21.15.60:0/3758104937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 msgr2=0x55d615d845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 -- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 msgr2=0x55d615d84080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d84080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff3fff700 1 -- 172.21.15.60:0/3758104937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d615adec60 con 0x55d615d770c0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.178+0000 7faff8a97700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7faff3fff700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d83b40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004790 tx=0x7fafe409afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980980cecfab9055 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fafd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fafd37fe700 1 -- 172.21.15.60:0/3758104937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40a2ee0 con 0x55d615d770c0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fafd37fe700 1 -- 172.21.15.60:0/3758104937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fafe409a360 con 0x55d615d770c0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fafe409b570 con 0x55d615d770c0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fafd37fe700 1 -- 172.21.15.60:0/3758104937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafe4099310 con 0x55d615d770c0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 10 client.15804 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d615af42b0 con 0x55d615d770c0 2023-10-05T15:17:12.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fafd37fe700 1 -- 172.21.15.60:0/3758104937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe409b570 con 0x55d615d770c0 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fafd37fe700 1 -- 172.21.15.60:0/3758104937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fafe4003f80 con 0x55d615d770c0 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 10 client.15804 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 10 client.15804 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 20 client.15804 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615de5d70 0x55d615de8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 4 client.15804 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d615cc3b30 con 0x55d615de5d70 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.179+0000 7faff37fe700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615de5d70 0x55d615de8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fafd37fe700 10 client.15804 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7faff37fe700 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615de5d70 0x55d615de8160 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13ce3108bcb21d92 server_cookie=1b2bdd6e4cfdeaf7 in_seq=0 out_seq=0 2023-10-05T15:17:12.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fafd37fe700 1 -- 172.21.15.60:0/3758104937 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d615cc3b30 con 0x55d615de5d70 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fafd37fe700 10 client.15804 handle_command_reply: tid=0 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 client.15804 shutdown 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 msgr2=0x55d615d83b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d83b40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004790 tx=0x7fafe409afd0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 shutdown_connections 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d615d82890 0x55d615d845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55d615de5d70 0x55d615de8160 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d615d770c0 0x55d615d83b40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fafd37fe700 0 client.15804 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 --2- 172.21.15.60:0/3758104937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d615d779e0 0x55d615d84080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 >> 172.21.15.60:0/3758104937 conn(0x55d615cec260 msgr2=0x55d615d93ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 shutdown_connections 2023-10-05T15:17:12.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 1 -- 172.21.15.60:0/3758104937 wait complete. 2023-10-05T15:17:12.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.180+0000 7fb0066e4b80 20 client.15804 trim_cache size 0 max 16384 2023-10-05T15:17:12.190 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fafdc0a1710 msgr2=0x7fafdc0a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fafdc0a1710 0x7fafdc0a3bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faff4198550 tx=0x7fafe800b410 comp rx=0 tx=0).stop 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 msgr2=0x7faff4196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4196f40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004760 tx=0x7fafe4009580 comp rx=0 tx=0).stop 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 shutdown_connections 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faff419b8e0 0x7faff419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faff4101090 0x7faff4196f40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fafdc0a1710 0x7fafdc0a3bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 --2- 172.21.15.60:0/2160218321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faff41061b0 0x7faff4197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 >> 172.21.15.60:0/2160218321 conn(0x7faff40fc930 msgr2=0x7faff40fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 shutdown_connections 2023-10-05T15:17:12.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.181+0000 7faffa4fa700 1 -- 172.21.15.60:0/2160218321 wait complete. 2023-10-05T15:17:12.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-05T15:17:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 -- 172.21.15.60:0/1659943197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c1061b0 msgr2=0x7f196c10dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 --2- 172.21.15.60:0/1659943197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c1061b0 0x7f196c10dd30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f196400b0a0 tx=0x7f196400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 -- 172.21.15.60:0/1659943197 shutdown_connections 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 --2- 172.21.15.60:0/1659943197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c1061b0 0x7f196c10dd30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 --2- 172.21.15.60:0/1659943197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c101090 0x7f196c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 --2- 172.21.15.60:0/1659943197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c101a40 0x7f196c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 -- 172.21.15.60:0/1659943197 >> 172.21.15.60:0/1659943197 conn(0x7f196c0fc930 msgr2=0x7f196c0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 -- 172.21.15.60:0/1659943197 shutdown_connections 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.321+0000 7f197294e700 1 -- 172.21.15.60:0/1659943197 wait complete. 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 Processor -- start 2023-10-05T15:17:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 -- start start 2023-10-05T15:17:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 0x7f196c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1061b0 0x7f196c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c19b970 0x7f196c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c19c3f0 con 0x7f196c101090 2023-10-05T15:17:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c19c560 con 0x7f196c19b970 2023-10-05T15:17:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f197294e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c19c720 con 0x7f196c1061b0 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 0x7f196c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 0x7f196c196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38866/0 (socket says 172.21.15.60:38866) 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 -- 172.21.15.60:0/1705202836 learned_addr learned my addr 172.21.15.60:0/1705202836 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f1970eeb700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c19b970 0x7f196c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196b7fe700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1061b0 0x7f196c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 -- 172.21.15.60:0/1705202836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1061b0 msgr2=0x7f196c197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1061b0 0x7f196c197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 -- 172.21.15.60:0/1705202836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c19b970 msgr2=0x7f196c19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c19b970 0x7f196c19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.322+0000 7f196bfff700 1 -- 172.21.15.60:0/1705202836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009d00 con 0x7f196c101090 2023-10-05T15:17:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.323+0000 7f196bfff700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 0x7f196c196fd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c9b0 tx=0x7f195c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.323+0000 7f19697fa700 1 -- 172.21.15.60:0/1705202836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c007b00 con 0x7f196c101090 2023-10-05T15:17:12.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.323+0000 7f19697fa700 1 -- 172.21.15.60:0/1705202836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f195c00ce50 con 0x7f196c101090 2023-10-05T15:17:12.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.323+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c1a3c80 con 0x7f196c101090 2023-10-05T15:17:12.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.323+0000 7f19697fa700 1 -- 172.21.15.60:0/1705202836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c018660 con 0x7f196c101090 2023-10-05T15:17:12.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.323+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c1a41b0 con 0x7f196c101090 2023-10-05T15:17:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.325+0000 7f19697fa700 1 -- 172.21.15.60:0/1705202836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f195c00f450 con 0x7f196c101090 2023-10-05T15:17:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.325+0000 7f19697fa700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19580a1790 0x7f19580a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.326+0000 7f19697fa700 1 -- 172.21.15.60:0/1705202836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f195c0cd510 con 0x7f196c101090 2023-10-05T15:17:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.326+0000 7f196b7fe700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19580a1790 0x7f19580a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.326+0000 7f196b7fe700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19580a1790 0x7f19580a3c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f196c1985e0 tx=0x7f195400b410 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.326+0000 7f197eb38b80 1 Processor -- start 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.326+0000 7f197eb38b80 1 -- start start 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 0x5600897844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089793760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560089793ca0 0x560089796090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f197eb38b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600896ed460 con 0x5600897840c0 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f197eb38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600896dec20 con 0x5600897849e0 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f197eb38b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600896dc540 con 0x560089793ca0 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 0x5600897844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 0x5600897844a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38874/0 (socket says 172.21.15.60:38874) 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 -- 172.21.15.60:0/4026316794 learned_addr learned my addr 172.21.15.60:0/4026316794 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196b7fe700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089793760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f1970eeb700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560089793ca0 0x560089796090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 -- 172.21.15.60:0/4026316794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560089793ca0 msgr2=0x560089796090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560089793ca0 0x560089796090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 -- 172.21.15.60:0/4026316794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 msgr2=0x560089793760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089793760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 -- 172.21.15.60:0/4026316794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560089502de0 con 0x5600897840c0 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f1970eeb700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560089793ca0 0x560089796090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196b7fe700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089793760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:12.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f196bfff700 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 0x5600897844a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f195c099f50 tx=0x7f195c099ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5379e9f783fbf9c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.327+0000 7f19627fc700 1 -- 172.21.15.60:0/4026316794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c007c60 con 0x5600897840c0 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f19627fc700 1 -- 172.21.15.60:0/4026316794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f195c099fc0 con 0x5600897840c0 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f19627fc700 1 -- 172.21.15.60:0/4026316794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c09a220 con 0x5600897840c0 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 -- 172.21.15.60:0/4026316794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 msgr2=0x5600897844a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 0x5600897844a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f195c099f50 tx=0x7f195c099ec0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 -- 172.21.15.60:0/4026316794 shutdown_connections 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560089793ca0 0x560089796090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897840c0 0x5600897844a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 --2- 172.21.15.60:0/4026316794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089793760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 -- 172.21.15.60:0/4026316794 >> 172.21.15.60:0/4026316794 conn(0x5600896f9260 msgr2=0x560089780450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 -- 172.21.15.60:0/4026316794 shutdown_connections 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.328+0000 7f197eb38b80 1 -- 172.21.15.60:0/4026316794 wait complete. 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 -- start start 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 Processor -- start 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089790980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897910c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600896d7e30 con 0x560089793ca0 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560089674710 con 0x5600897849e0 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600896743b0 con 0x5600897840c0 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f197eb38b80 10 client.0 _ll_register_callbacks cb 0x5600894d1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f1970eeb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f1970eeb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897910c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38884/0 (socket says 172.21.15.60:38884) 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f1970eeb700 1 -- 172.21.15.60:0/2314954487 learned_addr learned my addr 172.21.15.60:0/2314954487 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f196b7fe700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089790980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.329+0000 7f196bfff700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f1970eeb700 1 -- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 msgr2=0x560089793700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f1970eeb700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f1970eeb700 1 -- 172.21.15.60:0/2314954487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 msgr2=0x560089790980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f1970eeb700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089790980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f1970eeb700 1 -- 172.21.15.60:0/2314954487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1954010a20 con 0x560089793ca0 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f196bfff700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f1970eeb700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897910c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1964003d50 tx=0x7f1964003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c98b3f4683b87c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f194b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f194b7fe700 1 -- 172.21.15.60:0/2314954487 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400e040 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f194b7fe700 1 -- 172.21.15.60:0/2314954487 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f1964005040 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560089777f10 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f194b7fe700 1 -- 172.21.15.60:0/2314954487 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1964005220 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f197eb38b80 10 client.15816 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f196c1a41b0 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f194b7fe700 1 -- 172.21.15.60:0/2314954487 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560089777f10 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.330+0000 7f194b7fe700 1 -- 172.21.15.60:0/2314954487 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1964019070 con 0x560089793ca0 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f197eb38b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f197eb38b80 10 client.15816 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f197eb38b80 20 client.15816 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f197eb38b80 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897a3770 0x5600897a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f197eb38b80 4 client.15816 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600896d0e10 con 0x5600897a3770 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.331+0000 7f196bfff700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897a3770 0x5600897a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f194b7fe700 10 client.15816 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:12.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f196bfff700 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897a3770 0x5600897a5b90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b30a2922f3ff91f5 server_cookie=9efc7f77aa39af50 in_seq=0 out_seq=0 2023-10-05T15:17:12.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f194b7fe700 1 -- 172.21.15.60:0/2314954487 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5600896d0e10 con 0x5600897a3770 2023-10-05T15:17:12.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f194b7fe700 10 client.15816 handle_command_reply: tid=0 2023-10-05T15:17:12.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 client.15816 shutdown 2023-10-05T15:17:12.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 msgr2=0x5600897910c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897910c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1964003d50 tx=0x7f1964003d80 comp rx=0 tx=0).stop 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 shutdown_connections 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897a3770 0x5600897a5b90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897910c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f194b7fe700 0 client.15816 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 --2- 172.21.15.60:0/2314954487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x560089790980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.332+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 >> 172.21.15.60:0/2314954487 conn(0x5600896f9260 msgr2=0x56008977ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.333+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 shutdown_connections 2023-10-05T15:17:12.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.333+0000 7f197eb38b80 1 -- 172.21.15.60:0/2314954487 wait complete. 2023-10-05T15:17:12.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.333+0000 7f197eb38b80 20 client.15816 trim_cache size 0 max 16384 2023-10-05T15:17:12.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 Processor -- start 2023-10-05T15:17:12.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 -- start start 2023-10-05T15:17:12.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 0x56008978bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560089793ca0 0x56008978c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560089558920 con 0x5600897849e0 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008978c7d0 con 0x560089793ca0 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f197eb38b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560089785020 con 0x5600897840c0 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 0x56008978bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 0x56008978bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38890/0 (socket says 172.21.15.60:38890) 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 -- 172.21.15.60:0/1513577224 learned_addr learned my addr 172.21.15.60:0/1513577224 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196bfff700 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f1970eeb700 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560089793ca0 0x56008978c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 -- 172.21.15.60:0/1513577224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 msgr2=0x560089793330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 -- 172.21.15.60:0/1513577224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560089793ca0 msgr2=0x56008978c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560089793ca0 0x56008978c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f196b7fe700 1 -- 172.21.15.60:0/1513577224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600894ebc60 con 0x5600897849e0 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.346+0000 7f1970eeb700 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560089793ca0 0x56008978c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f196b7fe700 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 0x56008978bc60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1954011790 tx=0x7f1954013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa07f3ed38368c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f1962ffd700 1 -- 172.21.15.60:0/1513577224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954024070 con 0x5600897849e0 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f1962ffd700 1 -- 172.21.15.60:0/1513577224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1954015070 con 0x5600897849e0 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f1962ffd700 1 -- 172.21.15.60:0/1513577224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540056c0 con 0x5600897849e0 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 -- 172.21.15.60:0/1513577224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 msgr2=0x56008978bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 0x56008978bc60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1954011790 tx=0x7f1954013000 comp rx=0 tx=0).stop 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 -- 172.21.15.60:0/1513577224 shutdown_connections 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560089793ca0 0x56008978c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x560089793330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 --2- 172.21.15.60:0/1513577224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5600897849e0 0x56008978bc60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 -- 172.21.15.60:0/1513577224 >> 172.21.15.60:0/1513577224 conn(0x5600896f9260 msgr2=0x56008979fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 -- 172.21.15.60:0/1513577224 shutdown_connections 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.347+0000 7f197eb38b80 1 -- 172.21.15.60:0/1513577224 wait complete. 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 -- start start 2023-10-05T15:17:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 Processor -- start 2023-10-05T15:17:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x56008979a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x56008979a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560089798ec0 con 0x560089793ca0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560089799030 con 0x5600897849e0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600897991f0 con 0x5600897840c0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f197eb38b80 10 client.0 _ll_register_callbacks cb 0x7f19640093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f1970eeb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f1970eeb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38898/0 (socket says 172.21.15.60:38898) 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f1970eeb700 1 -- 172.21.15.60:0/969654917 learned_addr learned my addr 172.21.15.60:0/969654917 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f196b7fe700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x56008979a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.348+0000 7f196bfff700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x56008979a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f1970eeb700 1 -- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 msgr2=0x56008979a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f1970eeb700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x56008979a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f1970eeb700 1 -- 172.21.15.60:0/969654917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 msgr2=0x56008979a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f1970eeb700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x56008979a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f1970eeb700 1 -- 172.21.15.60:0/969654917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1954011440 con 0x560089793ca0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f196b7fe700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x56008979a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f1970eeb700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897987b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1964009a20 tx=0x7f196401da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2299de5e3d4507f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f194b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f194b7fe700 1 -- 172.21.15.60:0/969654917 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964003ea0 con 0x560089793ca0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f195c099fc0 con 0x560089793ca0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f194b7fe700 1 -- 172.21.15.60:0/969654917 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f196401d420 con 0x560089793ca0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f194b7fe700 1 -- 172.21.15.60:0/969654917 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1964006120 con 0x560089793ca0 2023-10-05T15:17:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f197eb38b80 10 client.15822 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560089529250 con 0x560089793ca0 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f194b7fe700 1 -- 172.21.15.60:0/969654917 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f196403b080 con 0x560089793ca0 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f194b7fe700 1 -- 172.21.15.60:0/969654917 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f196400b4d0 con 0x560089793ca0 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.349+0000 7f197eb38b80 10 client.15822 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f197eb38b80 10 client.15822 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f197eb38b80 20 client.15822 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f197eb38b80 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897f85d0 0x5600897fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f197eb38b80 4 client.15822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5600896d0b30 con 0x5600897f85d0 2023-10-05T15:17:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f196bfff700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897f85d0 0x5600897fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f194b7fe700 10 client.15822 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f196bfff700 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897f85d0 0x5600897fa9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=29192bf6c2c68635 server_cookie=44b1698624495fcb in_seq=0 out_seq=0 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f194b7fe700 1 -- 172.21.15.60:0/969654917 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5600896d0b30 con 0x5600897f85d0 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f194b7fe700 10 client.15822 handle_command_reply: tid=0 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.350+0000 7f197eb38b80 1 client.15822 shutdown 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 msgr2=0x5600897987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897987b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1964009a20 tx=0x7f196401da20 comp rx=0 tx=0).stop 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 shutdown_connections 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x5600897f85d0 0x5600897fa9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560089793ca0 0x5600897987b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f194b7fe700 0 client.15822 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600897840c0 0x56008979a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 --2- 172.21.15.60:0/969654917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5600897849e0 0x56008979a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 >> 172.21.15.60:0/969654917 conn(0x5600896f9260 msgr2=0x56008978bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 shutdown_connections 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 1 -- 172.21.15.60:0/969654917 wait complete. 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197eb38b80 20 client.15822 trim_cache size 0 max 16384 2023-10-05T15:17:12.360 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:12.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19580a1790 msgr2=0x7f19580a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19580a1790 0x7f19580a3c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f196c1985e0 tx=0x7f195400b410 comp rx=0 tx=0).stop 2023-10-05T15:17:12.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 msgr2=0x7f196c196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 0x7f196c196fd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c9b0 tx=0x7f195c00ccc0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 shutdown_connections 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19580a1790 0x7f19580a3c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c19b970 0x7f196c19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c101090 0x7f196c196fd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 --2- 172.21.15.60:0/1705202836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1061b0 0x7f196c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 >> 172.21.15.60:0/1705202836 conn(0x7f196c0fc930 msgr2=0x7f196c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 shutdown_connections 2023-10-05T15:17:12.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.351+0000 7f197294e700 1 -- 172.21.15.60:0/1705202836 wait complete. 2023-10-05T15:17:12.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-05T15:17:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 -- 172.21.15.60:0/1111441613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7701001b0 msgr2=0x7fa770100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 --2- 172.21.15.60:0/1111441613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7701001b0 0x7fa770100590 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa764009990 tx=0x7fa764009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 -- 172.21.15.60:0/1111441613 shutdown_connections 2023-10-05T15:17:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 --2- 172.21.15.60:0/1111441613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770105140 0x7fa77010ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 --2- 172.21.15.60:0/1111441613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7701001b0 0x7fa770100590 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 --2- 172.21.15.60:0/1111441613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa770100b60 0x7fa770104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 -- 172.21.15.60:0/1111441613 >> 172.21.15.60:0/1111441613 conn(0x7fa770077cb0 msgr2=0x7fa7700780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 -- 172.21.15.60:0/1111441613 shutdown_connections 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.491+0000 7fa777322700 1 -- 172.21.15.60:0/1111441613 wait complete. 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 Processor -- start 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 -- start start 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7701001b0 0x7fa770195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 0x7fa770196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77019a8f0 0x7fa77019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77019b370 con 0x7fa770105140 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77019b4e0 con 0x7fa7701001b0 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa777322700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77019b6a0 con 0x7fa77019a8f0 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 0x7fa770196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 0x7fa770196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38910/0 (socket says 172.21.15.60:38910) 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 -- 172.21.15.60:0/1087339435 learned_addr learned my addr 172.21.15.60:0/1087339435 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7750be700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7701001b0 0x7fa770195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 -- 172.21.15.60:0/1087339435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77019a8f0 msgr2=0x7fa77019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77019a8f0 0x7fa77019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 -- 172.21.15.60:0/1087339435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7701001b0 msgr2=0x7fa770195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7701001b0 0x7fa770195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 -- 172.21.15.60:0/1087339435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640095f0 con 0x7fa770105140 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.492+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 0x7fa770196490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0098f0 tx=0x7fa76c009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.493+0000 7fa7627fc700 1 -- 172.21.15.60:0/1087339435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c012070 con 0x7fa770105140 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.493+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700692f0 con 0x7fa770105140 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.493+0000 7fa7627fc700 1 -- 172.21.15.60:0/1087339435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76c00d850 con 0x7fa770105140 2023-10-05T15:17:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.493+0000 7fa7627fc700 1 -- 172.21.15.60:0/1087339435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00c750 con 0x7fa770105140 2023-10-05T15:17:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.493+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa770069800 con 0x7fa770105140 2023-10-05T15:17:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.495+0000 7fa7627fc700 1 -- 172.21.15.60:0/1087339435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7fa76c016070 con 0x7fa770105140 2023-10-05T15:17:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.495+0000 7fa7627fc700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa75c0a1710 0x7fa75c0a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.495+0000 7fa7627fc700 1 -- 172.21.15.60:0/1087339435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fa76c0ce6a0 con 0x7fa770105140 2023-10-05T15:17:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.495+0000 7fa7750be700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa75c0a1710 0x7fa75c0a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa7750be700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa75c0a1710 0x7fa75c0a3bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b5c0 tx=0x7fa764005fb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 Processor -- start 2023-10-05T15:17:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 -- start start 2023-10-05T15:17:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed60c0 0x55ad1eed64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1eee1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eee3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1ee3f460 con 0x55ad1eee1890 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1ee30c20 con 0x55ad1eed69e0 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.496+0000 7fa78350cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1ee2e540 con 0x55ad1eed60c0 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7758bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eee3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1eee1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7758bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eee3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38920/0 (socket says 172.21.15.60:38920) 2023-10-05T15:17:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1eee1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52340/0 (socket says 172.21.15.60:52340) 2023-10-05T15:17:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7758bf700 1 -- 172.21.15.60:0/3315668246 learned_addr learned my addr 172.21.15.60:0/3315668246 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7750be700 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed60c0 0x55ad1eed64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 -- 172.21.15.60:0/3315668246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed60c0 msgr2=0x55ad1eed64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed60c0 0x55ad1eed64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 -- 172.21.15.60:0/3315668246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 msgr2=0x55ad1eee3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eee3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 -- 172.21.15.60:0/3315668246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad1ec54de0 con 0x55ad1eed69e0 2023-10-05T15:17:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7758bf700 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eee3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa7748bd700 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1eee1350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0cb990 tx=0x7fa76c096e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32cce7f909f03062 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa75b7fe700 1 -- 172.21.15.60:0/3315668246 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c09b850 con 0x55ad1eed69e0 2023-10-05T15:17:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa75b7fe700 1 -- 172.21.15.60:0/3315668246 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76c09b150 con 0x55ad1eed69e0 2023-10-05T15:17:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.497+0000 7fa75b7fe700 1 -- 172.21.15.60:0/3315668246 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0ce540 con 0x55ad1eed69e0 2023-10-05T15:17:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 -- 172.21.15.60:0/3315668246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 msgr2=0x55ad1eee1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1eee1350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0cb990 tx=0x7fa76c096e90 comp rx=0 tx=0).stop 2023-10-05T15:17:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 -- 172.21.15.60:0/3315668246 shutdown_connections 2023-10-05T15:17:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eee3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed60c0 0x55ad1eed64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 --2- 172.21.15.60:0/3315668246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1eee1350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 -- 172.21.15.60:0/3315668246 >> 172.21.15.60:0/3315668246 conn(0x55ad1ee4b260 msgr2=0x55ad1eed2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 -- 172.21.15.60:0/3315668246 shutdown_connections 2023-10-05T15:17:12.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 -- 172.21.15.60:0/3315668246 wait complete. 2023-10-05T15:17:12.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 -- start start 2023-10-05T15:17:12.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.498+0000 7fa78350cb80 1 Processor -- start 2023-10-05T15:17:12.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eede570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1ee29e30 con 0x55ad1eee1890 2023-10-05T15:17:12.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1edc6710 con 0x55ad1eed60c0 2023-10-05T15:17:12.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1edc63b0 con 0x55ad1eed69e0 2023-10-05T15:17:12.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa78350cb80 10 client.0 _ll_register_callbacks cb 0x55ad1ec23800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38926/0 (socket says 172.21.15.60:38926) 2023-10-05T15:17:12.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 -- 172.21.15.60:0/2097212898 learned_addr learned my addr 172.21.15.60:0/2097212898 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7748bd700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7750be700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eede570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 -- 172.21.15.60:0/2097212898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 msgr2=0x55ad1eedeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 -- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 msgr2=0x55ad1eede570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eede570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7758bf700 1 -- 172.21.15.60:0/2097212898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7680098c0 con 0x55ad1eee1890 2023-10-05T15:17:12.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7748bd700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.499+0000 7fa7750be700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eede570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa7758bf700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedeff0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa7680079f0 tx=0x7fa768007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3a9e795c0dc21f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa758ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa758ff9700 1 -- 172.21.15.60:0/2097212898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768010ac0 con 0x55ad1eee1890 2023-10-05T15:17:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa758ff9700 1 -- 172.21.15.60:0/2097212898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fa768010c20 con 0x55ad1eee1890 2023-10-05T15:17:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad1eec9f10 con 0x55ad1eee1890 2023-10-05T15:17:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa758ff9700 1 -- 172.21.15.60:0/2097212898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa768010de0 con 0x55ad1eee1890 2023-10-05T15:17:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 10 client.15834 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa770069800 con 0x55ad1eee1890 2023-10-05T15:17:12.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa758ff9700 1 -- 172.21.15.60:0/2097212898 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ad1eec9f10 con 0x55ad1eee1890 2023-10-05T15:17:12.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa758ff9700 1 -- 172.21.15.60:0/2097212898 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa7680144f0 con 0x55ad1eee1890 2023-10-05T15:17:12.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 10 client.15834 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 10 client.15834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:17:12.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 20 client.15834 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1eef13d0 0x55ad1eef37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 4 client.15834 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:12.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.500+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad1ee22e10 con 0x55ad1eef13d0 2023-10-05T15:17:12.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.501+0000 7fa7750be700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1eef13d0 0x55ad1eef37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.501+0000 7fa758ff9700 10 client.15834 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:12.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.501+0000 7fa7750be700 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1eef13d0 0x55ad1eef37f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=396d19cf6dbf62af server_cookie=5298f407a517bbfd in_seq=0 out_seq=0 2023-10-05T15:17:12.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa758ff9700 1 -- 172.21.15.60:0/2097212898 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ad1ee22e10 con 0x55ad1eef13d0 2023-10-05T15:17:12.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa758ff9700 10 client.15834 handle_command_reply: tid=0 2023-10-05T15:17:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 client.15834 shutdown 2023-10-05T15:17:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 msgr2=0x55ad1eedeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedeff0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa7680079f0 tx=0x7fa768007db0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 shutdown_connections 2023-10-05T15:17:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1eef13d0 0x55ad1eef37f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedeff0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eede570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 --2- 172.21.15.60:0/2097212898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 >> 172.21.15.60:0/2097212898 conn(0x55ad1ee4b260 msgr2=0x55ad1eed1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa758ff9700 0 client.15834 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:12.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 shutdown_connections 2023-10-05T15:17:12.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 1 -- 172.21.15.60:0/2097212898 wait complete. 2023-10-05T15:17:12.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.502+0000 7fa78350cb80 20 client.15834 trim_cache size 0 max 16384 2023-10-05T15:17:12.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 Processor -- start 2023-10-05T15:17:12.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 -- start start 2023-10-05T15:17:12.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eee83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1ecaa920 con 0x55ad1eee1890 2023-10-05T15:17:12.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1eecc520 con 0x55ad1eed60c0 2023-10-05T15:17:12.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa78350cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1eee8920 con 0x55ad1eed69e0 2023-10-05T15:17:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38934/0 (socket says 172.21.15.60:38934) 2023-10-05T15:17:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 -- 172.21.15.60:0/4281349492 learned_addr learned my addr 172.21.15.60:0/4281349492 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7748bd700 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7750be700 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eee83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 -- 172.21.15.60:0/4281349492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 msgr2=0x55ad1eedeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 -- 172.21.15.60:0/4281349492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 msgr2=0x55ad1eee83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eee83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7758bf700 1 -- 172.21.15.60:0/4281349492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad1ec3dc60 con 0x55ad1eee1890 2023-10-05T15:17:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.515+0000 7fa7750be700 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eee83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa7758bf700 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedf020 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa768014850 tx=0x7fa7680105c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e78dcce6825236 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa75bfff700 1 -- 172.21.15.60:0/4281349492 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680144d0 con 0x55ad1eee1890 2023-10-05T15:17:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa75bfff700 1 -- 172.21.15.60:0/4281349492 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76800f040 con 0x55ad1eee1890 2023-10-05T15:17:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa75bfff700 1 -- 172.21.15.60:0/4281349492 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768010b20 con 0x55ad1eee1890 2023-10-05T15:17:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 -- 172.21.15.60:0/4281349492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 msgr2=0x55ad1eedf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedf020 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa768014850 tx=0x7fa7680105c0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 -- 172.21.15.60:0/4281349492 shutdown_connections 2023-10-05T15:17:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eee1890 0x55ad1eedf020 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed60c0 0x55ad1eee83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 --2- 172.21.15.60:0/4281349492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eed69e0 0x55ad1eedeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 -- 172.21.15.60:0/4281349492 >> 172.21.15.60:0/4281349492 conn(0x55ad1ee4b260 msgr2=0x55ad1eed9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 -- 172.21.15.60:0/4281349492 shutdown_connections 2023-10-05T15:17:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.516+0000 7fa78350cb80 1 -- 172.21.15.60:0/4281349492 wait complete. 2023-10-05T15:17:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 -- start start 2023-10-05T15:17:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 Processor -- start 2023-10-05T15:17:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 0x55ad1ef42250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1ef42790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eee1890 0x55ad1eee78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1eee7eb0 con 0x55ad1eed60c0 2023-10-05T15:17:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1eee8020 con 0x55ad1eed69e0 2023-10-05T15:17:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad1eee81e0 con 0x55ad1eee1890 2023-10-05T15:17:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa78350cb80 10 client.0 _ll_register_callbacks cb 0x7fa768009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa7750be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 0x55ad1ef42250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa7750be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 0x55ad1ef42250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38936/0 (socket says 172.21.15.60:38936) 2023-10-05T15:17:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa7750be700 1 -- 172.21.15.60:0/1837445508 learned_addr learned my addr 172.21.15.60:0/1837445508 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.517+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1ef42790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7758bf700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eee1890 0x55ad1eee78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7750be700 1 -- 172.21.15.60:0/1837445508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eee1890 msgr2=0x55ad1eee78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7750be700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eee1890 0x55ad1eee78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7750be700 1 -- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 msgr2=0x55ad1ef42790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7750be700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1ef42790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7750be700 1 -- 172.21.15.60:0/1837445508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa770069800 con 0x55ad1eed60c0 2023-10-05T15:17:12.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1ef42790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa7750be700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 0x55ad1ef42250 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa764009990 tx=0x7fa764009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aada8cad39471c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa758ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa758ff9700 1 -- 172.21.15.60:0/1837445508 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76402b040 con 0x55ad1eed60c0 2023-10-05T15:17:12.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa76c09b150 con 0x55ad1eed60c0 2023-10-05T15:17:12.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa758ff9700 1 -- 172.21.15.60:0/1837445508 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fa764034e30 con 0x55ad1eed60c0 2023-10-05T15:17:12.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa758ff9700 1 -- 172.21.15.60:0/1837445508 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7640340e0 con 0x55ad1eed60c0 2023-10-05T15:17:12.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa78350cb80 10 client.15840 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ad1ec7b250 con 0x55ad1eed60c0 2023-10-05T15:17:12.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa758ff9700 1 -- 172.21.15.60:0/1837445508 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76c09b150 con 0x55ad1eed60c0 2023-10-05T15:17:12.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.518+0000 7fa758ff9700 1 -- 172.21.15.60:0/1837445508 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa764004500 con 0x55ad1eed60c0 2023-10-05T15:17:12.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa78350cb80 10 client.15840 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa78350cb80 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:17:12.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa78350cb80 20 client.15840 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa78350cb80 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1ef4a040 0x55ad1ef4c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa78350cb80 4 client.15840 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:12.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad1ee22b30 con 0x55ad1ef4a040 2023-10-05T15:17:12.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1ef4a040 0x55ad1ef4c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa758ff9700 10 client.15840 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:12.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa7748bd700 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1ef4a040 0x55ad1ef4c460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75a52e6f88843ba6 server_cookie=8d0fb4afd004f60 in_seq=0 out_seq=0 2023-10-05T15:17:12.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.519+0000 7fa758ff9700 1 -- 172.21.15.60:0/1837445508 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ad1ee22b30 con 0x55ad1ef4a040 2023-10-05T15:17:12.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa758ff9700 10 client.15840 handle_command_reply: tid=0 2023-10-05T15:17:12.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 client.15840 shutdown 2023-10-05T15:17:12.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 msgr2=0x55ad1ef42250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 0x55ad1ef42250 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa764009990 tx=0x7fa764009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 shutdown_connections 2023-10-05T15:17:12.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55ad1ef4a040 0x55ad1ef4c460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad1eee1890 0x55ad1eee78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa758ff9700 0 client.15840 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ad1eed60c0 0x55ad1ef42250 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 --2- 172.21.15.60:0/1837445508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ad1eed69e0 0x55ad1ef42790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 >> 172.21.15.60:0/1837445508 conn(0x55ad1ee4b260 msgr2=0x55ad1eed9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 shutdown_connections 2023-10-05T15:17:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 1 -- 172.21.15.60:0/1837445508 wait complete. 2023-10-05T15:17:12.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa78350cb80 20 client.15840 trim_cache size 0 max 16384 2023-10-05T15:17:12.551 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:12.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa75c0a1710 msgr2=0x7fa75c0a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa75c0a1710 0x7fa75c0a3bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b5c0 tx=0x7fa764005fb0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 msgr2=0x7fa770196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 0x7fa770196490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0098f0 tx=0x7fa76c009cb0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 shutdown_connections 2023-10-05T15:17:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa77019a8f0 0x7fa77019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa75c0a1710 0x7fa75c0a3bd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7701001b0 0x7fa770195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 --2- 172.21.15.60:0/1087339435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa770105140 0x7fa770196490 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.520+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 >> 172.21.15.60:0/1087339435 conn(0x7fa770077cb0 msgr2=0x7fa770104280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.521+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 shutdown_connections 2023-10-05T15:17:12.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.521+0000 7fa777322700 1 -- 172.21.15.60:0/1087339435 wait complete. 2023-10-05T15:17:12.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-05T15:17:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 -- 172.21.15.60:0/710357925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 msgr2=0x7f80a0105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 --2- 172.21.15.60:0/710357925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a0105130 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8090009990 tx=0x7f8090009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 -- 172.21.15.60:0/710357925 shutdown_connections 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 --2- 172.21.15.60:0/710357925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a0100900 0x7f80a010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 --2- 172.21.15.60:0/710357925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a0105130 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 --2- 172.21.15.60:0/710357925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00fff40 0x7f80a01003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 -- 172.21.15.60:0/710357925 >> 172.21.15.60:0/710357925 conn(0x7f80a0077c20 msgr2=0x7f80a0078030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 -- 172.21.15.60:0/710357925 shutdown_connections 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.681+0000 7f80a5bad700 1 -- 172.21.15.60:0/710357925 wait complete. 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 Processor -- start 2023-10-05T15:17:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 -- start start 2023-10-05T15:17:12.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00fff40 0x7f80a01970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a0100900 0x7f80a0197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a019c0b0 con 0x7f80a0104d50 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a019c220 con 0x7f80a00fff40 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f80a5bad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a019c3e0 con 0x7f80a0100900 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f809ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f809ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a019ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38952/0 (socket says 172.21.15.60:38952) 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f809ffff700 1 -- 172.21.15.60:0/4279875544 learned_addr learned my addr 172.21.15.60:0/4279875544 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f809f7fe700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00fff40 0x7f80a01970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.682+0000 7f809effd700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a0100900 0x7f80a0197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809ffff700 1 -- 172.21.15.60:0/4279875544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a0100900 msgr2=0x7f80a0197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809ffff700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a0100900 0x7f80a0197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809ffff700 1 -- 172.21.15.60:0/4279875544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00fff40 msgr2=0x7f80a01970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809ffff700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00fff40 0x7f80a01970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809ffff700 1 -- 172.21.15.60:0/4279875544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900095f0 con 0x7f80a0104d50 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809ffff700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a019ba70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8098007ee0 tx=0x7f809800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809cff9700 1 -- 172.21.15.60:0/4279875544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098017070 con 0x7f80a0104d50 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809cff9700 1 -- 172.21.15.60:0/4279875544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f809800f040 con 0x7f80a0104d50 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f809cff9700 1 -- 172.21.15.60:0/4279875544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098005740 con 0x7f80a0104d50 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a019c6c0 con 0x7f80a0104d50 2023-10-05T15:17:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.683+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a01a3f00 con 0x7f80a0104d50 2023-10-05T15:17:12.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.686+0000 7f809cff9700 1 -- 172.21.15.60:0/4279875544 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f809800dc60 con 0x7f80a0104d50 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.686+0000 7f809cff9700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f808c0a1710 0x7f808c0a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.686+0000 7f809cff9700 1 -- 172.21.15.60:0/4279875544 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f80980cce20 con 0x7f80a0104d50 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f809f7fe700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f808c0a1710 0x7f808c0a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 Processor -- start 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f809f7fe700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f808c0a1710 0x7f808c0a3bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f809000b5c0 tx=0x7f8090005fd0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 -- start start 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e029e0 0x564105e11760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105d6b460 con 0x564105e020c0 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105d5cc20 con 0x564105e11ca0 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105d5a540 con 0x564105e029e0 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f809f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f809f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38956/0 (socket says 172.21.15.60:38956) 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f809f7fe700 1 -- 172.21.15.60:0/3197693092 learned_addr learned my addr 172.21.15.60:0/3197693092 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.687+0000 7f809effd700 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e029e0 0x564105e11760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809ffff700 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809f7fe700 1 -- 172.21.15.60:0/3197693092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e029e0 msgr2=0x564105e11760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e029e0 0x564105e11760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809f7fe700 1 -- 172.21.15.60:0/3197693092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 msgr2=0x564105e14090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e14090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809f7fe700 1 -- 172.21.15.60:0/3197693092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564105b80de0 con 0x564105e020c0 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 0x564105e024a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8090003730 tx=0x7f8090020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9d2dc3f1dbdeeb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f8095ffb700 1 -- 172.21.15.60:0/3197693092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809002a070 con 0x564105e020c0 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f8095ffb700 1 -- 172.21.15.60:0/3197693092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f809001e040 con 0x564105e020c0 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.688+0000 7f8095ffb700 1 -- 172.21.15.60:0/3197693092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090023860 con 0x564105e020c0 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3197693092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 msgr2=0x564105e024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 0x564105e024a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8090003730 tx=0x7f8090020000 comp rx=0 tx=0).stop 2023-10-05T15:17:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3197693092 shutdown_connections 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3197693092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e029e0 0x564105e11760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3197693092 >> 172.21.15.60:0/3197693092 conn(0x564105d77260 msgr2=0x564105dfe450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3197693092 shutdown_connections 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3197693092 wait complete. 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 -- start start 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.689+0000 7f80b1d97b80 1 Processor -- start 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e0ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e0ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e0f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105d55e30 con 0x564105e029e0 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105cf2710 con 0x564105e11ca0 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105cf23b0 con 0x564105e020c0 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f80b1d97b80 10 client.0 _ll_register_callbacks cb 0x564105b4f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e0ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e0ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38964/0 (socket says 172.21.15.60:38964) 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 -- 172.21.15.60:0/3757738792 learned_addr learned my addr 172.21.15.60:0/3757738792 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e0ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809ffff700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e0f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 -- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 msgr2=0x564105e0ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e0ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 -- 172.21.15.60:0/3757738792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 msgr2=0x564105e0f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e0f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 -- 172.21.15.60:0/3757738792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a010d5b0 con 0x564105e029e0 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f809effd700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e0ef60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8088012480 tx=0x7f8088012790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02e570f23f4993e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f807effd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.690+0000 7f807effd700 1 -- 172.21.15.60:0/3757738792 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880107e0 con 0x564105e029e0 2023-10-05T15:17:12.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f807effd700 1 -- 172.21.15.60:0/3757738792 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f8088010940 con 0x564105e029e0 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564105df5f10 con 0x564105e029e0 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f807effd700 1 -- 172.21.15.60:0/3757738792 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8088010b00 con 0x564105e029e0 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 10 client.15852 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564105b69c60 con 0x564105e029e0 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f807effd700 1 -- 172.21.15.60:0/3757738792 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564105df5f10 con 0x564105e029e0 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f807effd700 1 -- 172.21.15.60:0/3757738792 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f808801a3e0 con 0x564105e029e0 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 10 client.15852 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 10 client.15852 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 20 client.15852 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e23cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 4 client.15852 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:12.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564105d4ee10 con 0x564105e218b0 2023-10-05T15:17:12.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.691+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e23cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.692+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e23cd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0b97098fa3ca049 server_cookie=fd43ad1b5728f25f in_seq=0 out_seq=0 2023-10-05T15:17:12.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.692+0000 7f807effd700 10 client.15852 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:12.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.692+0000 7f807effd700 1 -- 172.21.15.60:0/3757738792 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564105d4ee10 con 0x564105e218b0 2023-10-05T15:17:12.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.692+0000 7f807effd700 10 client.15852 handle_command_reply: tid=0 2023-10-05T15:17:12.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.692+0000 7f80b1d97b80 1 client.15852 shutdown 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 msgr2=0x564105e0ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e0ef60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8088012480 tx=0x7f8088012790 comp rx=0 tx=0).stop 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 shutdown_connections 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e23cd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e0f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e0ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f807effd700 0 client.15852 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3757738792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e0ef60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 >> 172.21.15.60:0/3757738792 conn(0x564105d77260 msgr2=0x564105dfdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 shutdown_connections 2023-10-05T15:17:12.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3757738792 wait complete. 2023-10-05T15:17:12.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.693+0000 7f80b1d97b80 20 client.15852 trim_cache size 0 max 16384 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 Processor -- start 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 -- start start 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e18730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e11ca0 0x564105e1d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105bd6920 con 0x564105e029e0 2023-10-05T15:17:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105e18c70 con 0x564105e020c0 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105e0cfa0 con 0x564105e11ca0 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e18730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e18730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38972/0 (socket says 172.21.15.60:38972) 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 -- 172.21.15.60:0/2453981765 learned_addr learned my addr 172.21.15.60:0/2453981765 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809ffff700 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e11ca0 0x564105e1d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 -- 172.21.15.60:0/2453981765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e11ca0 msgr2=0x564105e1d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809f7fe700 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e11ca0 0x564105e1d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 -- 172.21.15.60:0/2453981765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e020c0 msgr2=0x564105e024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 -- 172.21.15.60:0/2453981765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564105ba7250 con 0x564105e029e0 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.706+0000 7f809effd700 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e18730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f808801a810 tx=0x7f8088005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5fc72b949e8c56 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80967fc700 1 -- 172.21.15.60:0/2453981765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808801a5e0 con 0x564105e029e0 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80967fc700 1 -- 172.21.15.60:0/2453981765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f808801aec0 con 0x564105e029e0 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80967fc700 1 -- 172.21.15.60:0/2453981765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880054d0 con 0x564105e029e0 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 -- 172.21.15.60:0/2453981765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 msgr2=0x564105e18730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e18730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f808801a810 tx=0x7f8088005860 comp rx=0 tx=0).stop 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 -- 172.21.15.60:0/2453981765 shutdown_connections 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e11ca0 0x564105e1d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e020c0 0x564105e024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/2453981765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e18730 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 -- 172.21.15.60:0/2453981765 >> 172.21.15.60:0/2453981765 conn(0x564105d77260 msgr2=0x564105e1ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 -- 172.21.15.60:0/2453981765 shutdown_connections 2023-10-05T15:17:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.707+0000 7f80b1d97b80 1 -- 172.21.15.60:0/2453981765 wait complete. 2023-10-05T15:17:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 -- start start 2023-10-05T15:17:12.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 Processor -- start 2023-10-05T15:17:12.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e69b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e6a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105e74830 con 0x564105e029e0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105e749a0 con 0x564105e11ca0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564105e74b60 con 0x564105e020c0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f80b1d97b80 10 client.0 _ll_register_callbacks cb 0x7f808800bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e69b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e69b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38978/0 (socket says 172.21.15.60:38978) 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 -- 172.21.15.60:0/3180048301 learned_addr learned my addr 172.21.15.60:0/3180048301 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809ffff700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e6a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 -- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 msgr2=0x564105e69630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e69630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 -- 172.21.15.60:0/3180048301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 msgr2=0x564105e6a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e6a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.708+0000 7f809effd700 1 -- 172.21.15.60:0/3180048301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564105b69c60 con 0x564105e029e0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f809effd700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e69b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f808802c040 tx=0x7f808800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a824224317fd6d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f807effd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f807effd700 1 -- 172.21.15.60:0/3180048301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088005040 con 0x564105e029e0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f807effd700 1 -- 172.21.15.60:0/3180048301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f80880051a0 con 0x564105e029e0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f809001e040 con 0x564105e029e0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f807effd700 1 -- 172.21.15.60:0/3180048301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8088005360 con 0x564105e029e0 2023-10-05T15:17:12.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 10 client.15858 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564105b7f2b0 con 0x564105e029e0 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f807effd700 1 -- 172.21.15.60:0/3180048301 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f809001e040 con 0x564105e029e0 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f807effd700 1 -- 172.21.15.60:0/3180048301 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8088003680 con 0x564105e029e0 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 10 client.15858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 20 client.15858 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e78000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 4 client.15858 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.709+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564105d4eb30 con 0x564105e218b0 2023-10-05T15:17:12.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e78000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f807effd700 10 client.15858 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f809f7fe700 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e78000 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c0cf7009e25fc40 server_cookie=c8a51b8e7cd740fe in_seq=0 out_seq=0 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f807effd700 1 -- 172.21.15.60:0/3180048301 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564105d4eb30 con 0x564105e218b0 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f807effd700 10 client.15858 handle_command_reply: tid=0 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f80b1d97b80 1 client.15858 shutdown 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 msgr2=0x564105e69b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e69b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f808802c040 tx=0x7f808800bb90 comp rx=0 tx=0).stop 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.710+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 shutdown_connections 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564105e218b0 0x564105e78000 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564105e11ca0 0x564105e6a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564105e020c0 0x564105e69630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f807effd700 0 client.15858 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 --2- 172.21.15.60:0/3180048301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564105e029e0 0x564105e69b70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 >> 172.21.15.60:0/3180048301 conn(0x564105d77260 msgr2=0x564105e1d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 shutdown_connections 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 1 -- 172.21.15.60:0/3180048301 wait complete. 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80b1d97b80 20 client.15858 trim_cache size 0 max 16384 2023-10-05T15:17:12.720 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f808c0a1710 msgr2=0x7f808c0a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f808c0a1710 0x7f808c0a3bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f809000b5c0 tx=0x7f8090005fd0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 msgr2=0x7f80a019ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a019ba70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8098007ee0 tx=0x7f809800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 shutdown_connections 2023-10-05T15:17:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a0104d50 0x7f80a019ba70 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f808c0a1710 0x7f808c0a3bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00fff40 0x7f80a01970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 --2- 172.21.15.60:0/4279875544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a0100900 0x7f80a0197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 >> 172.21.15.60:0/4279875544 conn(0x7f80a0077c20 msgr2=0x7f80a00693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 shutdown_connections 2023-10-05T15:17:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.711+0000 7f80a5bad700 1 -- 172.21.15.60:0/4279875544 wait complete. 2023-10-05T15:17:12.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-05T15:17:12.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 -- 172.21.15.60:0/2232776824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 msgr2=0x7faabc105170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 --2- 172.21.15.60:0/2232776824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc105170 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faaa40099c0 tx=0x7faaa4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 -- 172.21.15.60:0/2232776824 shutdown_connections 2023-10-05T15:17:12.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 --2- 172.21.15.60:0/2232776824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faabc100e30 0x7faabc10cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 --2- 172.21.15.60:0/2232776824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc105170 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 --2- 172.21.15.60:0/2232776824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100470 0x7faabc1008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 -- 172.21.15.60:0/2232776824 >> 172.21.15.60:0/2232776824 conn(0x7faabc077330 msgr2=0x7faabc0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 -- 172.21.15.60:0/2232776824 shutdown_connections 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 -- 172.21.15.60:0/2232776824 wait complete. 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.851+0000 7faac274f700 1 Processor -- start 2023-10-05T15:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 -- start start 2023-10-05T15:17:12.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faabc100470 0x7faabc1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100e30 0x7faabc199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc19e0d0 con 0x7faabc104d90 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc19e240 con 0x7faabc100470 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac274f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc19e400 con 0x7faabc100e30 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc19da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38994/0 (socket says 172.21.15.60:38994) 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 -- 172.21.15.60:0/2622736887 learned_addr learned my addr 172.21.15.60:0/2622736887 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faabbfff700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faabc100470 0x7faabc1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100e30 0x7faabc199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 -- 172.21.15.60:0/2622736887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100e30 msgr2=0x7faabc199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100e30 0x7faabc199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 -- 172.21.15.60:0/2622736887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faabc100470 msgr2=0x7faabc1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faabc100470 0x7faabc1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faac0cec700 1 -- 172.21.15.60:0/2622736887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40095f0 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.852+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100e30 0x7faabc199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.853+0000 7faac0cec700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc19da90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7faab4007ee0 tx=0x7faab400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.853+0000 7faab97fa700 1 -- 172.21.15.60:0/2622736887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.853+0000 7faab97fa700 1 -- 172.21.15.60:0/2622736887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faab400f040 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.853+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc19e6e0 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.853+0000 7faab97fa700 1 -- 172.21.15.60:0/2622736887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4005740 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.853+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc1a5f20 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.855+0000 7faab97fa700 1 -- 172.21.15.60:0/2622736887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7faab400dc60 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faab97fa700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faaa80a1710 0x7faaa80a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faab97fa700 1 -- 172.21.15.60:0/2622736887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7faab40ccea0 con 0x7faabc104d90 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faabbfff700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faaa80a1710 0x7faaa80a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faabbfff700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faaa80a1710 0x7faaa80a3bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faaa4000c00 tx=0x7faaa4003680 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faace939b80 1 Processor -- start 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faace939b80 1 -- start start 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.856+0000 7faace939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 0x563cd471a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faace939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4725350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faace939b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 0x563cd4727c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faace939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd4683460 con 0x563cd471a0c0 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faace939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd4674c20 con 0x563cd471a9e0 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faace939b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd4672540 con 0x563cd4725890 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 0x563cd471a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 0x563cd471a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38998/0 (socket says 172.21.15.60:38998) 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 -- 172.21.15.60:0/2445562091 learned_addr learned my addr 172.21.15.60:0/2445562091 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4725350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 -- 172.21.15.60:0/2445562091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 msgr2=0x563cd4727c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 0x563cd4727c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 -- 172.21.15.60:0/2445562091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 msgr2=0x563cd4725350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4725350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 -- 172.21.15.60:0/2445562091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cd4498de0 con 0x563cd471a0c0 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faabbfff700 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 0x563cd471a4a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7faaa40095c0 tx=0x7faaa4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2082e69de1d9e6ac server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faab27fc700 1 -- 172.21.15.60:0/2445562091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400bea0 con 0x563cd471a0c0 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faab27fc700 1 -- 172.21.15.60:0/2445562091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faaa401e040 con 0x563cd471a0c0 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.857+0000 7faab27fc700 1 -- 172.21.15.60:0/2445562091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4004880 con 0x563cd471a0c0 2023-10-05T15:17:12.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 -- 172.21.15.60:0/2445562091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 msgr2=0x563cd471a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 0x563cd471a4a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7faaa40095c0 tx=0x7faaa4020000 comp rx=0 tx=0).stop 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 -- 172.21.15.60:0/2445562091 shutdown_connections 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 0x563cd4727c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a0c0 0x563cd471a4a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 --2- 172.21.15.60:0/2445562091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4725350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 -- 172.21.15.60:0/2445562091 >> 172.21.15.60:0/2445562091 conn(0x563cd468f260 msgr2=0x563cd4716450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 -- 172.21.15.60:0/2445562091 shutdown_connections 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 -- 172.21.15.60:0/2445562091 wait complete. 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.858+0000 7faace939b80 1 -- start start 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 Processor -- start 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd47225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4722b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 0x563cd4723050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd466de30 con 0x563cd4725890 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd460a710 con 0x563cd471a9e0 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd460a3b0 con 0x563cd471a0c0 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faace939b80 10 client.0 _ll_register_callbacks cb 0x563cd4467800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faac0cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 0x563cd4723050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faac0cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 0x563cd4723050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39008/0 (socket says 172.21.15.60:39008) 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faac0cec700 1 -- 172.21.15.60:0/2447142787 learned_addr learned my addr 172.21.15.60:0/2447142787 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4722b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.859+0000 7faabbfff700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd47225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faac0cec700 1 -- 172.21.15.60:0/2447142787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 msgr2=0x563cd47225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faac0cec700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd47225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faac0cec700 1 -- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 msgr2=0x563cd4722b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faac0cec700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4722b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faac0cec700 1 -- 172.21.15.60:0/2447142787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc10d4b0 con 0x563cd4725890 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4722b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faac0cec700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 0x563cd4723050 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faab40ca910 tx=0x7faab40992b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a2a711e6853952 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faa9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2447142787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4099db0 con 0x563cd4725890 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2447142787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7faab40b92e0 con 0x563cd4725890 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cd470df10 con 0x563cd4725890 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2447142787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faab409daa0 con 0x563cd4725890 2023-10-05T15:17:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faace939b80 10 client.15870 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563cd4481c60 con 0x563cd4725890 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.860+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2447142787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563cd470df10 con 0x563cd4725890 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2447142787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faab40a1850 con 0x563cd4725890 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faace939b80 10 client.15870 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faace939b80 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faace939b80 20 client.15870 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faace939b80 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd47352e0 0x563cd4737700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faace939b80 4 client.15870 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cd4666e10 con 0x563cd47352e0 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faabbfff700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd47352e0 0x563cd4737700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faabbfff700 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd47352e0 0x563cd4737700 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c6732e284defbc2 server_cookie=57d34b7a02b49ff3 in_seq=0 out_seq=0 2023-10-05T15:17:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.861+0000 7faa9b7fe700 10 client.15870 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2447142787 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563cd4666e10 con 0x563cd47352e0 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faa9b7fe700 10 client.15870 handle_command_reply: tid=0 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 client.15870 shutdown 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 msgr2=0x563cd4723050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 0x563cd4723050 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faab40ca910 tx=0x7faab40992b0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 shutdown_connections 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd47352e0 0x563cd4737700 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd4725890 0x563cd4723050 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faa9b7fe700 0 client.15870 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd47225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 --2- 172.21.15.60:0/2447142787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a9e0 0x563cd4722b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 >> 172.21.15.60:0/2447142787 conn(0x563cd468f260 msgr2=0x563cd4716040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 shutdown_connections 2023-10-05T15:17:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 1 -- 172.21.15.60:0/2447142787 wait complete. 2023-10-05T15:17:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.862+0000 7faace939b80 20 client.15870 trim_cache size 0 max 16384 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 Processor -- start 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 -- start start 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a0c0 0x563cd4722e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd471c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 0x563cd471cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd44ee920 con 0x563cd471a9e0 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd471e280 con 0x563cd471a0c0 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.875+0000 7faace939b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd471e4a0 con 0x563cd4725890 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd471c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd471c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39014/0 (socket says 172.21.15.60:39014) 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 -- 172.21.15.60:0/2118499130 learned_addr learned my addr 172.21.15.60:0/2118499130 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabbfff700 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a0c0 0x563cd4722e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 -- 172.21.15.60:0/2118499130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 msgr2=0x563cd471cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 0x563cd471cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 -- 172.21.15.60:0/2118499130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a0c0 msgr2=0x563cd4722e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a0c0 0x563cd4722e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 -- 172.21.15.60:0/2118499130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cd4715250 con 0x563cd471a9e0 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd471c660 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faaac00d000 tx=0x7faaac011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a47f419cab6eea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faab2ffd700 1 -- 172.21.15.60:0/2118499130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac016070 con 0x563cd471a9e0 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faab2ffd700 1 -- 172.21.15.60:0/2118499130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faaac0044e0 con 0x563cd471a9e0 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.876+0000 7faab2ffd700 1 -- 172.21.15.60:0/2118499130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0038e0 con 0x563cd471a9e0 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 -- 172.21.15.60:0/2118499130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 msgr2=0x563cd471c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd471c660 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faaac00d000 tx=0x7faaac011720 comp rx=0 tx=0).stop 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 -- 172.21.15.60:0/2118499130 shutdown_connections 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd4725890 0x563cd471cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd471a0c0 0x563cd4722e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 --2- 172.21.15.60:0/2118499130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd471c660 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 -- 172.21.15.60:0/2118499130 >> 172.21.15.60:0/2118499130 conn(0x563cd468f260 msgr2=0x563cd471bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 -- 172.21.15.60:0/2118499130 shutdown_connections 2023-10-05T15:17:12.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 -- 172.21.15.60:0/2118499130 wait complete. 2023-10-05T15:17:12.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 -- start start 2023-10-05T15:17:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.877+0000 7faace939b80 1 Processor -- start 2023-10-05T15:17:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd472bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd472c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd4725890 0x563cd472a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd472ab90 con 0x563cd471a9e0 2023-10-05T15:17:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd472ad00 con 0x563cd4725890 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd472aec0 con 0x563cd471a0c0 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 10 client.0 _ll_register_callbacks cb 0x7faab40997f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd472c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd472c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39020/0 (socket says 172.21.15.60:39020) 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 -- 172.21.15.60:0/2490899899 learned_addr learned my addr 172.21.15.60:0/2490899899 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faac0cec700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd4725890 0x563cd472a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 -- 172.21.15.60:0/2490899899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 msgr2=0x563cd472bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd472bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 -- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd4725890 msgr2=0x563cd472a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd4725890 0x563cd472a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 -- 172.21.15.60:0/2490899899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac00cce0 con 0x563cd471a9e0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faac0cec700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd4725890 0x563cd472a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faabb7fe700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd472c4d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7faaac011a70 tx=0x7faaac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fed835224f41da server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faa9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2490899899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac016070 con 0x563cd471a9e0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2490899899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7faaac010990 con 0x563cd471a9e0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.878+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faaa401e040 con 0x563cd471a9e0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2490899899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaac020070 con 0x563cd471a9e0 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 10 client.15876 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563cd44bf250 con 0x563cd471a9e0 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2490899899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faaa401e040 con 0x563cd471a9e0 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2490899899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faaac003680 con 0x563cd471a9e0 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 10 client.15876 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 20 client.15876 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd478a400 0x563cd478c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 4 client.15876 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563cd4666b30 con 0x563cd478a400 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.879+0000 7faabbfff700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd478a400 0x563cd478c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faa9b7fe700 10 client.15876 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faabbfff700 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd478a400 0x563cd478c820 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d7f27db182737dc server_cookie=e0d2cb615b0525c9 in_seq=0 out_seq=0 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faa9b7fe700 1 -- 172.21.15.60:0/2490899899 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563cd4666b30 con 0x563cd478a400 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faa9b7fe700 10 client.15876 handle_command_reply: tid=0 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 client.15876 shutdown 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 msgr2=0x563cd472c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd472c4d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7faaac011a70 tx=0x7faaac00cc40 comp rx=0 tx=0).stop 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 shutdown_connections 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563cd478a400 0x563cd478c820 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563cd4725890 0x563cd472a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faa9b7fe700 0 client.15876 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cd471a0c0 0x563cd472bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 --2- 172.21.15.60:0/2490899899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563cd471a9e0 0x563cd472c4d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 >> 172.21.15.60:0/2490899899 conn(0x563cd468f260 msgr2=0x563cd471c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 shutdown_connections 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 1 -- 172.21.15.60:0/2490899899 wait complete. 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.880+0000 7faace939b80 20 client.15876 trim_cache size 0 max 16384 2023-10-05T15:17:12.890 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faaa80a1710 msgr2=0x7faaa80a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faaa80a1710 0x7faaa80a3bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faaa4000c00 tx=0x7faaa4003680 comp rx=0 tx=0).stop 2023-10-05T15:17:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 msgr2=0x7faabc19da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc19da90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7faab4007ee0 tx=0x7faab400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 shutdown_connections 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faabc104d90 0x7faabc19da90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faaa80a1710 0x7faaa80a3bd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faabc100470 0x7faabc1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 --2- 172.21.15.60:0/2622736887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc100e30 0x7faabc199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 >> 172.21.15.60:0/2622736887 conn(0x7faabc077330 msgr2=0x7faabc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 shutdown_connections 2023-10-05T15:17:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:12.881+0000 7faac274f700 1 -- 172.21.15.60:0/2622736887 wait complete. 2023-10-05T15:17:13.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:13 smithi060 ceph-mon[99238]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 30 op/s 2023-10-05T15:17:13.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:13 smithi092 ceph-mon[102944]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 30 op/s 2023-10-05T15:17:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:13 smithi135 ceph-mon[103360]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 30 op/s 2023-10-05T15:17:13.895 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:17:13.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.038+0000 7f6f0de36700 1 -- 172.21.15.60:0/1525537935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 msgr2=0x7f6f081003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.038+0000 7f6f0de36700 1 --2- 172.21.15.60:0/1525537935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f081003d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009990 tx=0x7f6ef8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 -- 172.21.15.60:0/1525537935 shutdown_connections 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 --2- 172.21.15.60:0/1525537935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08105110 0x7f6f0810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 --2- 172.21.15.60:0/1525537935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f081003d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 --2- 172.21.15.60:0/1525537935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081009a0 0x7f6f081049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 -- 172.21.15.60:0/1525537935 >> 172.21.15.60:0/1525537935 conn(0x7f6f080fb890 msgr2=0x7f6f080fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 -- 172.21.15.60:0/1525537935 shutdown_connections 2023-10-05T15:17:14.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 -- 172.21.15.60:0/1525537935 wait complete. 2023-10-05T15:17:14.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 Processor -- start 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.039+0000 7f6f0de36700 1 -- start start 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f0de36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f08197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f0de36700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08105110 0x7f6f08198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f0de36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08198a10 0x7f6f081a2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f0de36700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f081a36f0 con 0x7f6f080ffff0 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f0de36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f081a3860 con 0x7f6f08198a10 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f0de36700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f081a3a20 con 0x7f6f08105110 2023-10-05T15:17:14.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f08197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f08197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39032/0 (socket says 172.21.15.60:39032) 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 -- 172.21.15.60:0/3355101386 learned_addr learned my addr 172.21.15.60:0/3355101386 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08105110 0x7f6f08198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f07fff700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08198a10 0x7f6f081a2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 -- 172.21.15.60:0/3355101386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08105110 msgr2=0x7f6f08198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08105110 0x7f6f08198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 -- 172.21.15.60:0/3355101386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08198a10 msgr2=0x7f6f081a2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08198a10 0x7f6f081a2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 -- 172.21.15.60:0/3355101386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80095f0 con 0x7f6f080ffff0 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f07fff700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08198a10 0x7f6f081a2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08105110 0x7f6f08198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f077fe700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f08197ef0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8005910 tx=0x7f6ef80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.040+0000 7f6f04ff9700 1 -- 172.21.15.60:0/3355101386 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef801d070 con 0x7f6f080ffff0 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.041+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f081a3ca0 con 0x7f6f080ffff0 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.041+0000 7f6f04ff9700 1 -- 172.21.15.60:0/3355101386 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ef80040e0 con 0x7f6f080ffff0 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.041+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f081a4120 con 0x7f6f080ffff0 2023-10-05T15:17:14.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.041+0000 7f6f04ff9700 1 -- 172.21.15.60:0/3355101386 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800f460 con 0x7f6f080ffff0 2023-10-05T15:17:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.043+0000 7f6f04ff9700 1 -- 172.21.15.60:0/3355101386 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f6ef8003c20 con 0x7f6f080ffff0 2023-10-05T15:17:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f04ff9700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6ef00a1710 0x7f6ef00a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6ef00a1710 0x7f6ef00a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f04ff9700 1 -- 172.21.15.60:0/3355101386 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f6ef80cea90 con 0x7f6f080ffff0 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6ef00a1710 0x7f6ef00a3bd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6efc005fd0 tx=0x7f6efc005e20 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f1a020b80 1 Processor -- start 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f1a020b80 1 -- start start 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6659520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.044+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b66643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6666d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b65c24e0 con 0x5565b6659a60 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b65b3ca0 con 0x5565b6659140 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b65b15c0 con 0x5565b6664910 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b66643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b66643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39042/0 (socket says 172.21.15.60:39042) 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 -- 172.21.15.60:0/3645317463 learned_addr learned my addr 172.21.15.60:0/3645317463 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f077fe700 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6659520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f07fff700 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6666d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 -- 172.21.15.60:0/3645317463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 msgr2=0x5565b6666d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6666d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 -- 172.21.15.60:0/3645317463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 msgr2=0x5565b6659520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6659520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 -- 172.21.15.60:0/3645317463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565b63d7e60 con 0x5565b6659a60 2023-10-05T15:17:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f07fff700 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6666d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b66643d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00dbf0 tx=0x7f6efc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143b8e5cd311144a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6eedffb700 1 -- 172.21.15.60:0/3645317463 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00f8b0 con 0x5565b6659a60 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6eedffb700 1 -- 172.21.15.60:0/3645317463 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6efc01c450 con 0x5565b6659a60 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.045+0000 7f6eedffb700 1 -- 172.21.15.60:0/3645317463 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc01b610 con 0x5565b6659a60 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 -- 172.21.15.60:0/3645317463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 msgr2=0x5565b66643d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b66643d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00dbf0 tx=0x7f6efc010000 comp rx=0 tx=0).stop 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 -- 172.21.15.60:0/3645317463 shutdown_connections 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6666d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6659520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/3645317463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b66643d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 -- 172.21.15.60:0/3645317463 >> 172.21.15.60:0/3645317463 conn(0x5565b65ce2e0 msgr2=0x5565b66554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 -- 172.21.15.60:0/3645317463 shutdown_connections 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.046+0000 7f6f1a020b80 1 -- 172.21.15.60:0/3645317463 wait complete. 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 -- start start 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 Processor -- start 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6664390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b6661610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6661d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b65aceb0 con 0x5565b6659a60 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b6549790 con 0x5565b6659140 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b6549430 con 0x5565b6664910 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f1a020b80 10 client.0 _ll_register_callbacks cb 0x5565b63a6880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b6661610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b6661610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39048/0 (socket says 172.21.15.60:39048) 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f06ffd700 1 -- 172.21.15.60:0/2409000856 learned_addr learned my addr 172.21.15.60:0/2409000856 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f07fff700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6661d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.047+0000 7f6f077fe700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6664390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f06ffd700 1 -- 172.21.15.60:0/2409000856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 msgr2=0x5565b6661d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6661d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f06ffd700 1 -- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 msgr2=0x5565b6664390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6664390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f06ffd700 1 -- 172.21.15.60:0/2409000856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc00d8a0 con 0x5565b6659a60 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b6661610 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01cd30 tx=0x7f6efc00f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7842093a8fba24 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6ee6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/2409000856 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc02b070 con 0x5565b6659a60 2023-10-05T15:17:14.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/2409000856 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f6efc00fd10 con 0x5565b6659a60 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565b664cf90 con 0x5565b6659a60 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/2409000856 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6efc0088a0 con 0x5565b6659a60 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f1a020b80 10 client.15888 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5565b63c0ce0 con 0x5565b6659a60 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.048+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/2409000856 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565b664cf90 con 0x5565b6659a60 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/2409000856 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6efc02e370 con 0x5565b6659a60 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f1a020b80 10 client.15888 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f1a020b80 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f1a020b80 20 client.15888 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b6674360 0x5565b6676780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f1a020b80 4 client.15888 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:14.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565b65a5e90 con 0x5565b6674360 2023-10-05T15:17:14.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f077fe700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b6674360 0x5565b6676780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6ee6ffd700 10 client.15888 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.049+0000 7f6f077fe700 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b6674360 0x5565b6676780 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5646eb6dbafab6e5 server_cookie=49429e23c42f3281 in_seq=0 out_seq=0 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/2409000856 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5565b65a5e90 con 0x5565b6674360 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6ee6ffd700 10 client.15888 handle_command_reply: tid=0 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 client.15888 shutdown 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 msgr2=0x5565b6661610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b6661610 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01cd30 tx=0x7f6efc00f8e0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 shutdown_connections 2023-10-05T15:17:14.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b6674360 0x5565b6676780 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6661d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6ee6ffd700 0 client.15888 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b6664390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/2409000856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b6661610 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.050+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 >> 172.21.15.60:0/2409000856 conn(0x5565b65ce2e0 msgr2=0x5565b6655060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.051+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 shutdown_connections 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.051+0000 7f6f1a020b80 1 -- 172.21.15.60:0/2409000856 wait complete. 2023-10-05T15:17:14.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.051+0000 7f6f1a020b80 20 client.15888 trim_cache size 0 max 16384 2023-10-05T15:17:14.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 Processor -- start 2023-10-05T15:17:14.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 -- start start 2023-10-05T15:17:14.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 0x5565b665c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659a60 0x5565b666b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6660dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b642d9a0 con 0x5565b6659140 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b666b990 con 0x5565b6659a60 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b665fb70 con 0x5565b6664910 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 0x5565b665c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 0x5565b665c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39054/0 (socket says 172.21.15.60:39054) 2023-10-05T15:17:14.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.068+0000 7f6f077fe700 1 -- 172.21.15.60:0/1501466625 learned_addr learned my addr 172.21.15.60:0/1501466625 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f07fff700 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6660dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659a60 0x5565b666b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f077fe700 1 -- 172.21.15.60:0/1501466625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 msgr2=0x5565b6660dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f077fe700 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6660dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f077fe700 1 -- 172.21.15.60:0/1501466625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659a60 msgr2=0x5565b666b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f077fe700 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659a60 0x5565b666b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f077fe700 1 -- 172.21.15.60:0/1501466625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565b66511c0 con 0x5565b6659140 2023-10-05T15:17:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6f077fe700 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 0x5565b665c090 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009f90 tx=0x7f6ef801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236971ca31b5ea03 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6eee7fc700 1 -- 172.21.15.60:0/1501466625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef809b570 con 0x5565b6659140 2023-10-05T15:17:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6eee7fc700 1 -- 172.21.15.60:0/1501466625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ef809f6c0 con 0x5565b6659140 2023-10-05T15:17:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.069+0000 7f6eee7fc700 1 -- 172.21.15.60:0/1501466625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef809aa60 con 0x5565b6659140 2023-10-05T15:17:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 -- 172.21.15.60:0/1501466625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 msgr2=0x5565b665c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 0x5565b665c090 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009f90 tx=0x7f6ef801a040 comp rx=0 tx=0).stop 2023-10-05T15:17:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 -- 172.21.15.60:0/1501466625 shutdown_connections 2023-10-05T15:17:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b6660dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659140 0x5565b665c090 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/1501466625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659a60 0x5565b666b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 -- 172.21.15.60:0/1501466625 >> 172.21.15.60:0/1501466625 conn(0x5565b65ce2e0 msgr2=0x5565b665c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 -- 172.21.15.60:0/1501466625 shutdown_connections 2023-10-05T15:17:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 -- 172.21.15.60:0/1501466625 wait complete. 2023-10-05T15:17:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 -- start start 2023-10-05T15:17:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.070+0000 7f6f1a020b80 1 Processor -- start 2023-10-05T15:17:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b665de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b665e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b665e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b66c8170 con 0x5565b6659a60 2023-10-05T15:17:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b66c82b0 con 0x5565b6659140 2023-10-05T15:17:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b66c83f0 con 0x5565b6664910 2023-10-05T15:17:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f1a020b80 10 client.0 _ll_register_callbacks cb 0x7f6efc01c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b665e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b665de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b665e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39062/0 (socket says 172.21.15.60:39062) 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 -- 172.21.15.60:0/15856682 learned_addr learned my addr 172.21.15.60:0/15856682 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f07fff700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b665e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 -- 172.21.15.60:0/15856682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 msgr2=0x5565b665e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b665e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 -- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 msgr2=0x5565b665de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b665de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 -- 172.21.15.60:0/15856682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f081a4120 con 0x5565b6659a60 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f07fff700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b665e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6f06ffd700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b665e3d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01c910 tx=0x7f6efc00ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1582bc7f1e3fd16d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6ee6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/15856682 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc02b040 con 0x5565b6659a60 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.071+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/15856682 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f6efc02ecf0 con 0x5565b6659a60 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6efc01c450 con 0x5565b6659a60 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/15856682 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6efc02eeb0 con 0x5565b6659a60 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 10 client.15894 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5565b63fe2d0 con 0x5565b6659a60 2023-10-05T15:17:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/15856682 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6efc01c450 con 0x5565b6659a60 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/15856682 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6efc038050 con 0x5565b6659a60 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 20 client.15894 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b66c9770 0x5565b66cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 4 client.15894 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5565b65a5bb0 con 0x5565b66c9770 2023-10-05T15:17:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.072+0000 7f6f077fe700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b66c9770 0x5565b66cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.073+0000 7f6f077fe700 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b66c9770 0x5565b66cbb90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bcabaefc64544b9 server_cookie=afe2d68c6b5eabb8 in_seq=0 out_seq=0 2023-10-05T15:17:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.073+0000 7f6ee6ffd700 10 client.15894 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6ee6ffd700 1 -- 172.21.15.60:0/15856682 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5565b65a5bb0 con 0x5565b66c9770 2023-10-05T15:17:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6ee6ffd700 10 client.15894 handle_command_reply: tid=0 2023-10-05T15:17:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 client.15894 shutdown 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 msgr2=0x5565b665e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b665e3d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01c910 tx=0x7f6efc00ff40 comp rx=0 tx=0).stop 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 shutdown_connections 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5565b66c9770 0x5565b66cbb90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565b6664910 0x5565b665e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5565b6659140 0x5565b665de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6ee6ffd700 0 client.15894 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 --2- 172.21.15.60:0/15856682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565b6659a60 0x5565b665e3d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 >> 172.21.15.60:0/15856682 conn(0x5565b65ce2e0 msgr2=0x5565b6662f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 shutdown_connections 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 1 -- 172.21.15.60:0/15856682 wait complete. 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.074+0000 7f6f1a020b80 20 client.15894 trim_cache size 0 max 16384 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "80cbf4ed-6d48-4b3c-a67a-a10ae0ef6d0d", 2023-10-05T15:17:14.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2023-10-05T15:17:14.089 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6ef00a1710 msgr2=0x7f6ef00a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6ef00a1710 0x7f6ef00a3bd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6efc005fd0 tx=0x7f6efc005e20 comp rx=0 tx=0).stop 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 msgr2=0x7f6f08197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f08197ef0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8005910 tx=0x7f6ef80057f0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 shutdown_connections 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6ef00a1710 0x7f6ef00a3bd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f08198a10 0x7f6f081a2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f080ffff0 0x7f6f08197ef0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 --2- 172.21.15.60:0/3355101386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08105110 0x7f6f08198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 >> 172.21.15.60:0/3355101386 conn(0x7f6f080fb890 msgr2=0x7f6f081039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 shutdown_connections 2023-10-05T15:17:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.075+0000 7f6f0de36700 1 -- 172.21.15.60:0/3355101386 wait complete. 2023-10-05T15:17:14.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:17:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 -- 172.21.15.60:0/710543569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc0fff90 msgr2=0x7f59cc100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 --2- 172.21.15.60:0/710543569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc0fff90 0x7f59cc100370 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009990 tx=0x7f59c8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 -- 172.21.15.60:0/710543569 shutdown_connections 2023-10-05T15:17:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 --2- 172.21.15.60:0/710543569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1050b0 0x7f59cc10cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 --2- 172.21.15.60:0/710543569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc0fff90 0x7f59cc100370 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 --2- 172.21.15.60:0/710543569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc100940 0x7f59cc104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 -- 172.21.15.60:0/710543569 >> 172.21.15.60:0/710543569 conn(0x7f59cc0fb830 msgr2=0x7f59cc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 -- 172.21.15.60:0/710543569 shutdown_connections 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.218+0000 7f59d37a2700 1 -- 172.21.15.60:0/710543569 wait complete. 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 Processor -- start 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 -- start start 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0fff90 0x7f59cc196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1050b0 0x7f59cc197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 0x7f59cc19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc19c3f0 con 0x7f59cc19b970 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc19c560 con 0x7f59cc1050b0 2023-10-05T15:17:14.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d37a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc19c720 con 0x7f59cc0fff90 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 0x7f59cc19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 0x7f59cc19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39078/0 (socket says 172.21.15.60:39078) 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 -- 172.21.15.60:0/1357743327 learned_addr learned my addr 172.21.15.60:0/1357743327 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1050b0 0x7f59cc197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d153e700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0fff90 0x7f59cc196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 -- 172.21.15.60:0/1357743327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0fff90 msgr2=0x7f59cc196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0fff90 0x7f59cc196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 -- 172.21.15.60:0/1357743327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1050b0 msgr2=0x7f59cc197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1050b0 0x7f59cc197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d1d3f700 1 -- 172.21.15.60:0/1357743327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80095f0 con 0x7f59cc19b970 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.219+0000 7f59d153e700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0fff90 0x7f59cc196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.220+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 0x7f59cc19bdf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f59c4007ee0 tx=0x7f59c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.220+0000 7f59c27fc700 1 -- 172.21.15.60:0/1357743327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4017070 con 0x7f59cc19b970 2023-10-05T15:17:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.220+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc1a3c80 con 0x7f59cc19b970 2023-10-05T15:17:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.220+0000 7f59c27fc700 1 -- 172.21.15.60:0/1357743327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59c400f040 con 0x7f59cc19b970 2023-10-05T15:17:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.220+0000 7f59c27fc700 1 -- 172.21.15.60:0/1357743327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4005740 con 0x7f59cc19b970 2023-10-05T15:17:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.220+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc1a4160 con 0x7f59cc19b970 2023-10-05T15:17:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.223+0000 7f59c27fc700 1 -- 172.21.15.60:0/1357743327 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f59c400dc60 con 0x7f59cc19b970 2023-10-05T15:17:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.223+0000 7f59c27fc700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59b80a1710 0x7f59b80a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.223+0000 7f59c27fc700 1 -- 172.21.15.60:0/1357743327 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f59c40cce20 con 0x7f59cc19b970 2023-10-05T15:17:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59d153e700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59b80a1710 0x7f59b80a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59d153e700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59b80a1710 0x7f59b80a3bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59c8006010 tx=0x7f59c800b540 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 Processor -- start 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 -- start start 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b1344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b143760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b146090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b09d460 con 0x55dd4b143ca0 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b08ec20 con 0x55dd4b1340c0 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.224+0000 7f59df98cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b08c540 con 0x55dd4b1349e0 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d153e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b1344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39086/0 (socket says 172.21.15.60:39086) 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 -- 172.21.15.60:0/545693679 learned_addr learned my addr 172.21.15.60:0/545693679 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 -- 172.21.15.60:0/545693679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 msgr2=0x55dd4b143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 -- 172.21.15.60:0/545693679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 msgr2=0x55dd4b1344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b1344a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 -- 172.21.15.60:0/545693679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd4aeb2de0 con 0x55dd4b143ca0 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d153e700 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b1344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b146090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f59c40ca890 tx=0x7f59c400df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ac3438b080b70e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59b77fe700 1 -- 172.21.15.60:0/545693679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c409da20 con 0x55dd4b143ca0 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59b77fe700 1 -- 172.21.15.60:0/545693679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59c40a1c60 con 0x55dd4b143ca0 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.225+0000 7f59b77fe700 1 -- 172.21.15.60:0/545693679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4005aa0 con 0x55dd4b143ca0 2023-10-05T15:17:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 -- 172.21.15.60:0/545693679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 msgr2=0x55dd4b146090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b146090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f59c40ca890 tx=0x7f59c400df60 comp rx=0 tx=0).stop 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 -- 172.21.15.60:0/545693679 shutdown_connections 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b146090 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b1344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 --2- 172.21.15.60:0/545693679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 -- 172.21.15.60:0/545693679 >> 172.21.15.60:0/545693679 conn(0x55dd4b0a9260 msgr2=0x55dd4b130450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 -- 172.21.15.60:0/545693679 shutdown_connections 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 -- 172.21.15.60:0/545693679 wait complete. 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 -- start start 2023-10-05T15:17:14.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.226+0000 7f59df98cb80 1 Processor -- start 2023-10-05T15:17:14.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b140a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b1414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b087e30 con 0x55dd4b143ca0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b024710 con 0x55dd4b1340c0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b0243b0 con 0x55dd4b1349e0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59df98cb80 10 client.0 _ll_register_callbacks cb 0x55dd4ae81800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b1414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b1414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39092/0 (socket says 172.21.15.60:39092) 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 -- 172.21.15.60:0/682296038 learned_addr learned my addr 172.21.15.60:0/682296038 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d153e700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 -- 172.21.15.60:0/682296038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 msgr2=0x55dd4b140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 -- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 msgr2=0x55dd4b140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d1d3f700 1 -- 172.21.15.60:0/682296038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc10d4a0 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.227+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b1414f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f59c40ca220 tx=0x7f59c4022530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9030a95094f1fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59b4ff9700 1 -- 172.21.15.60:0/682296038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40b21c0 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59b4ff9700 1 -- 172.21.15.60:0/682296038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f59c4004f10 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd4b127f10 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59b4ff9700 1 -- 172.21.15.60:0/682296038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59c4005ab0 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 10 client.15906 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f59cc1a4160 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59b4ff9700 1 -- 172.21.15.60:0/682296038 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59c4065020 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59b4ff9700 1 -- 172.21.15.60:0/682296038 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f59c4098ee0 con 0x55dd4b143ca0 2023-10-05T15:17:14.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 10 client.15906 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 20 client.15906 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b153470 0x55dd4b155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 4 client.15906 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd4b080e10 con 0x55dd4b153470 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.228+0000 7f59d153e700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b153470 0x55dd4b155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.229+0000 7f59b4ff9700 10 client.15906 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.229+0000 7f59d153e700 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b153470 0x55dd4b155890 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5628f5f15db30b49 server_cookie=5681f61d02835ab7 in_seq=0 out_seq=0 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59b4ff9700 1 -- 172.21.15.60:0/682296038 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dd4b080e10 con 0x55dd4b153470 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59b4ff9700 10 client.15906 handle_command_reply: tid=0 2023-10-05T15:17:14.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 client.15906 shutdown 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 msgr2=0x55dd4b1414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b1414f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f59c40ca220 tx=0x7f59c4022530 comp rx=0 tx=0).stop 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 shutdown_connections 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b153470 0x55dd4b155890 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b143ca0 0x55dd4b1414f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59b4ff9700 0 client.15906 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 --2- 172.21.15.60:0/682296038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 >> 172.21.15.60:0/682296038 conn(0x55dd4b0a9260 msgr2=0x55dd4b12ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 shutdown_connections 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 1 -- 172.21.15.60:0/682296038 wait complete. 2023-10-05T15:17:14.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.230+0000 7f59df98cb80 20 client.15906 trim_cache size 0 max 16384 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 Processor -- start 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 -- start start 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 0x55dd4b141320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b136730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b143ca0 0x55dd4b136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4af08920 con 0x55dd4b1340c0 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b127ae0 con 0x55dd4b143ca0 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59df98cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b150120 con 0x55dd4b1349e0 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59d153e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 0x55dd4b141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59d153e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 0x55dd4b141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39096/0 (socket says 172.21.15.60:39096) 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.247+0000 7f59d153e700 1 -- 172.21.15.60:0/2344521083 learned_addr learned my addr 172.21.15.60:0/2344521083 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b143ca0 0x55dd4b136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d153e700 1 -- 172.21.15.60:0/2344521083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 msgr2=0x55dd4b136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d153e700 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b136730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d153e700 1 -- 172.21.15.60:0/2344521083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b143ca0 msgr2=0x55dd4b136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d153e700 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b143ca0 0x55dd4b136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d153e700 1 -- 172.21.15.60:0/2344521083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd4ae9bc60 con 0x55dd4b1340c0 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59d153e700 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 0x55dd4b141320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f59c8005f50 tx=0x7f59c801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f798c85340b072bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59b7fff700 1 -- 172.21.15.60:0/2344521083 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c802d040 con 0x55dd4b1340c0 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59b7fff700 1 -- 172.21.15.60:0/2344521083 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59c801e040 con 0x55dd4b1340c0 2023-10-05T15:17:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.248+0000 7f59b7fff700 1 -- 172.21.15.60:0/2344521083 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c800f460 con 0x55dd4b1340c0 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 -- 172.21.15.60:0/2344521083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 msgr2=0x55dd4b141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 0x55dd4b141320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f59c8005f50 tx=0x7f59c801f000 comp rx=0 tx=0).stop 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 -- 172.21.15.60:0/2344521083 shutdown_connections 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b143ca0 0x55dd4b136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1340c0 0x55dd4b141320 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 --2- 172.21.15.60:0/2344521083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b1349e0 0x55dd4b136730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 -- 172.21.15.60:0/2344521083 >> 172.21.15.60:0/2344521083 conn(0x55dd4b0a9260 msgr2=0x55dd4b136020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 -- 172.21.15.60:0/2344521083 shutdown_connections 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 -- 172.21.15.60:0/2344521083 wait complete. 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 -- start start 2023-10-05T15:17:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.249+0000 7f59df98cb80 1 Processor -- start 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 0x55dd4b1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b143ca0 0x55dd4b148e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b149350 con 0x55dd4b1349e0 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b1494c0 con 0x55dd4b1340c0 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd4b149680 con 0x55dd4b143ca0 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59df98cb80 10 client.0 _ll_register_callbacks cb 0x7f59c8005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:14.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 0x55dd4b1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 0x55dd4b1488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39104/0 (socket says 172.21.15.60:39104) 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 -- 172.21.15.60:0/3446069 learned_addr learned my addr 172.21.15.60:0/3446069 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d153e700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d1d3f700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b143ca0 0x55dd4b148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 -- 172.21.15.60:0/3446069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b143ca0 msgr2=0x55dd4b148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b143ca0 0x55dd4b148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 -- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 msgr2=0x55dd4b14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b14a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 -- 172.21.15.60:0/3446069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c800b990 con 0x55dd4b1349e0 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d153e700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:14.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59d0d3d700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 0x55dd4b1488d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f59bc005950 tx=0x7f59bc013740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f015e01698021268 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.250+0000 7f59b4ff9700 1 -- 172.21.15.60:0/3446069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc004220 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59c40a1c60 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59b4ff9700 1 -- 172.21.15.60:0/3446069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f59bc004380 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59b4ff9700 1 -- 172.21.15.60:0/3446069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59bc004540 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 10 client.15912 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55dd4aed9250 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59b4ff9700 1 -- 172.21.15.60:0/3446069 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59c40a1c60 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59b4ff9700 1 -- 172.21.15.60:0/3446069 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f59bc010b00 con 0x55dd4b1349e0 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 10 client.15912 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 20 client.15912 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b1a8830 0x55dd4b1aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 4 client.15912 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dd4b080b30 con 0x55dd4b1a8830 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.251+0000 7f59d153e700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b1a8830 0x55dd4b1aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59d153e700 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b1a8830 0x55dd4b1aac50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b86f51844702989 server_cookie=b70d0f7898b3eb49 in_seq=0 out_seq=0 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59b4ff9700 10 client.15912 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59b4ff9700 1 -- 172.21.15.60:0/3446069 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dd4b080b30 con 0x55dd4b1a8830 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59b4ff9700 10 client.15912 handle_command_reply: tid=0 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 client.15912 shutdown 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 msgr2=0x55dd4b1488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 0x55dd4b1488d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f59bc005950 tx=0x7f59bc013740 comp rx=0 tx=0).stop 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 shutdown_connections 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dd4b1a8830 0x55dd4b1aac50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dd4b143ca0 0x55dd4b148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59b4ff9700 0 client.15912 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd4b1340c0 0x55dd4b14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 --2- 172.21.15.60:0/3446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dd4b1349e0 0x55dd4b1488d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 >> 172.21.15.60:0/3446069 conn(0x55dd4b0a9260 msgr2=0x55dd4b1367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 shutdown_connections 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 1 -- 172.21.15.60:0/3446069 wait complete. 2023-10-05T15:17:14.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.252+0000 7f59df98cb80 20 client.15912 trim_cache size 0 max 16384 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: "80cbf4ed-6d48-4b3c-a67a-a10ae0ef6d0d": { 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "80cbf4ed-6d48-4b3c-a67a-a10ae0ef6d0d", 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:17:14.262 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:17:14.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59b80a1710 msgr2=0x7f59b80a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59b80a1710 0x7f59b80a3bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59c8006010 tx=0x7f59c800b540 comp rx=0 tx=0).stop 2023-10-05T15:17:14.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 msgr2=0x7f59cc19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 0x7f59cc19bdf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f59c4007ee0 tx=0x7f59c400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 shutdown_connections 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59cc19b970 0x7f59cc19bdf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0fff90 0x7f59cc196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59b80a1710 0x7f59b80a3bd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 --2- 172.21.15.60:0/1357743327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1050b0 0x7f59cc197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 >> 172.21.15.60:0/1357743327 conn(0x7f59cc0fb830 msgr2=0x7f59cc103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 shutdown_connections 2023-10-05T15:17:14.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:14.253+0000 7f59d37a2700 1 -- 172.21.15.60:0/1357743327 wait complete. 2023-10-05T15:17:14.267 INFO:tasks.cephfs.filesystem:scrub status for tag:80cbf4ed-6d48-4b3c-a67a-a10ae0ef6d0d - {'path': '/', 'tag': '80cbf4ed-6d48-4b3c-a67a-a10ae0ef6d0d', 'options': 'recursive,force'} 2023-10-05T15:17:15.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:15 smithi060 ceph-mon[99238]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-10-05T15:17:15.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:15 smithi060 ceph-mon[99238]: scrub queued for path: / 2023-10-05T15:17:15.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:15 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:15.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:15 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:17:15.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:15 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:15.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:15 smithi092 ceph-mon[102944]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-10-05T15:17:15.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:15 smithi092 ceph-mon[102944]: scrub queued for path: / 2023-10-05T15:17:15.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:15 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:15.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:15 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:17:15.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:15 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:15 smithi135 ceph-mon[103360]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-10-05T15:17:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:15 smithi135 ceph-mon[103360]: scrub queued for path: / 2023-10-05T15:17:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:15 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:15 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:17:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:15 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:17.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:17 smithi060 ceph-mon[99238]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 16 op/s 2023-10-05T15:17:17.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:17 smithi092 ceph-mon[102944]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 16 op/s 2023-10-05T15:17:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:17 smithi135 ceph-mon[103360]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 16 op/s 2023-10-05T15:17:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 -- 172.21.15.60:0/1175216155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c100930 msgr2=0x7ff25c10cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 --2- 172.21.15.60:0/1175216155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c100930 0x7ff25c10cba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b0a0 tx=0x7ff25400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 -- 172.21.15.60:0/1175216155 shutdown_connections 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 --2- 172.21.15.60:0/1175216155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c100930 0x7ff25c10cba0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 --2- 172.21.15.60:0/1175216155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c105ef0 0x7ff25c1062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 --2- 172.21.15.60:0/1175216155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25c0fff70 0x7ff25c1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 -- 172.21.15.60:0/1175216155 >> 172.21.15.60:0/1175216155 conn(0x7ff25c076b70 msgr2=0x7ff25c076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 -- 172.21.15.60:0/1175216155 shutdown_connections 2023-10-05T15:17:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.377+0000 7ff26461d700 1 -- 172.21.15.60:0/1175216155 wait complete. 2023-10-05T15:17:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.378+0000 7ff26461d700 1 Processor -- start 2023-10-05T15:17:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.378+0000 7ff26461d700 1 -- start start 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff26461d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 0x7ff25c197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff26461d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c100930 0x7ff25c1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff26461d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25c105ef0 0x7ff25c19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff26461d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c19c260 con 0x7ff25c0fff70 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff26461d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c19c3d0 con 0x7ff25c100930 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff26461d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c19c590 con 0x7ff25c105ef0 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 0x7ff25c197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 0x7ff25c197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39116/0 (socket says 172.21.15.60:39116) 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 -- 172.21.15.60:0/340045133 learned_addr learned my addr 172.21.15.60:0/340045133 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff261bb8700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c100930 0x7ff25c1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff262bba700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25c105ef0 0x7ff25c19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 -- 172.21.15.60:0/340045133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25c105ef0 msgr2=0x7ff25c19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25c105ef0 0x7ff25c19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 -- 172.21.15.60:0/340045133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c100930 msgr2=0x7ff25c1975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c100930 0x7ff25c1975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 -- 172.21.15.60:0/340045133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009d00 con 0x7ff25c0fff70 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.379+0000 7ff2623b9700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 0x7ff25c197070 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d950 tx=0x7ff25000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.380+0000 7ff24f7fe700 1 -- 172.21.15.60:0/340045133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000f890 con 0x7ff25c0fff70 2023-10-05T15:17:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.380+0000 7ff24f7fe700 1 -- 172.21.15.60:0/340045133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff250010460 con 0x7ff25c0fff70 2023-10-05T15:17:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.380+0000 7ff24f7fe700 1 -- 172.21.15.60:0/340045133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000e610 con 0x7ff25c0fff70 2023-10-05T15:17:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.380+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c19c870 con 0x7ff25c0fff70 2023-10-05T15:17:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.380+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c1a40b0 con 0x7ff25c0fff70 2023-10-05T15:17:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.382+0000 7ff24f7fe700 1 -- 172.21.15.60:0/340045133 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7ff2500108d0 con 0x7ff25c0fff70 2023-10-05T15:17:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.382+0000 7ff24f7fe700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff2480a1790 0x7ff2480a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.383+0000 7ff24f7fe700 1 -- 172.21.15.60:0/340045133 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7ff2500cd310 con 0x7ff25c0fff70 2023-10-05T15:17:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.383+0000 7ff261bb8700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff2480a1790 0x7ff2480a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.383+0000 7ff261bb8700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff2480a1790 0x7ff2480a3c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff25c198890 tx=0x7ff25800a380 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.383+0000 7ff270807b80 1 Processor -- start 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 -- start start 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192102a400 con 0x5619210cc3d0 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192101bbc0 con 0x5619210c0c00 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff270807b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619210194e0 con 0x5619210c1520 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39128/0 (socket says 172.21.15.60:39128) 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 -- 172.21.15.60:0/3308929973 learned_addr learned my addr 172.21.15.60:0/3308929973 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff261bb8700 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff2623b9700 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 -- 172.21.15.60:0/3308929973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 msgr2=0x5619210cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 -- 172.21.15.60:0/3308929973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 msgr2=0x5619210c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210c0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff262bba700 1 -- 172.21.15.60:0/3308929973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561920e3fd80 con 0x5619210cc3d0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.384+0000 7ff2623b9700 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.385+0000 7ff262bba700 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210ce7c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff254015000 tx=0x7ff25400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee57d54a578c8da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.385+0000 7ff24cff9700 1 -- 172.21.15.60:0/3308929973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400e040 con 0x5619210cc3d0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.385+0000 7ff24cff9700 1 -- 172.21.15.60:0/3308929973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff254009350 con 0x5619210cc3d0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.385+0000 7ff24cff9700 1 -- 172.21.15.60:0/3308929973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25401c6a0 con 0x5619210cc3d0 2023-10-05T15:17:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.385+0000 7ff270807b80 1 -- 172.21.15.60:0/3308929973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 msgr2=0x5619210ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.385+0000 7ff270807b80 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210ce7c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff254015000 tx=0x7ff25400cea0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- 172.21.15.60:0/3308929973 shutdown_connections 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210ce7c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 --2- 172.21.15.60:0/3308929973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- 172.21.15.60:0/3308929973 >> 172.21.15.60:0/3308929973 conn(0x561921036200 msgr2=0x5619210bd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- 172.21.15.60:0/3308929973 shutdown_connections 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- 172.21.15.60:0/3308929973 wait complete. 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- start start 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 Processor -- start 2023-10-05T15:17:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 0x5619210c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561921014dd0 con 0x5619210c1520 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561920fb16b0 con 0x5619210c0c00 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.386+0000 7ff270807b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561920fb1350 con 0x5619210cc3d0 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff270807b80 10 client.0 _ll_register_callbacks cb 0x561920e0e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 0x5619210c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 0x5619210c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39132/0 (socket says 172.21.15.60:39132) 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 -- 172.21.15.60:0/2271627645 learned_addr learned my addr 172.21.15.60:0/2271627645 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff262bba700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 -- 172.21.15.60:0/2271627645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 msgr2=0x5619210c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 -- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 msgr2=0x5619210cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 -- 172.21.15.60:0/2271627645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c10d560 con 0x5619210c1520 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff262bba700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 0x5619210c8fd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff258003900 tx=0x7ff2580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1a7cd3ed8b5f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff245ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff245ffb700 1 -- 172.21.15.60:0/2271627645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258010840 con 0x5619210c1520 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff245ffb700 1 -- 172.21.15.60:0/2271627645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7ff2580109a0 con 0x5619210c1520 2023-10-05T15:17:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619210b4d50 con 0x5619210c1520 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff245ffb700 1 -- 172.21.15.60:0/2271627645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff258010b60 con 0x5619210c1520 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff270807b80 10 client.15924 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.387+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561920e28c00 con 0x5619210c1520 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff245ffb700 1 -- 172.21.15.60:0/2271627645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619210b4d50 con 0x5619210c1520 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff245ffb700 1 -- 172.21.15.60:0/2271627645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff25801e410 con 0x5619210c1520 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff270807b80 10 client.15924 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff270807b80 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff270807b80 20 client.15924 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff270807b80 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619210dbe20 0x5619210de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff270807b80 4 client.15924 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56192100ddb0 con 0x5619210dbe20 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.388+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619210dbe20 0x5619210de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff245ffb700 10 client.15924 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619210dbe20 0x5619210de240 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76c28529de98e8 server_cookie=bcc9bdfd4e8c729e in_seq=0 out_seq=0 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff245ffb700 1 -- 172.21.15.60:0/2271627645 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56192100ddb0 con 0x5619210dbe20 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff245ffb700 10 client.15924 handle_command_reply: tid=0 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 client.15924 shutdown 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 msgr2=0x5619210c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 0x5619210c8fd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff258003900 tx=0x7ff2580047c0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 shutdown_connections 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619210dbe20 0x5619210de240 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff245ffb700 0 client.15924 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 --2- 172.21.15.60:0/2271627645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c1520 0x5619210c8fd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 >> 172.21.15.60:0/2271627645 conn(0x561921036200 msgr2=0x5619210bcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 shutdown_connections 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.389+0000 7ff270807b80 1 -- 172.21.15.60:0/2271627645 wait complete. 2023-10-05T15:17:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.390+0000 7ff270807b80 20 client.15924 trim_cache size 0 max 16384 2023-10-05T15:17:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 Processor -- start 2023-10-05T15:17:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 -- start start 2023-10-05T15:17:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561920e958c0 con 0x5619210cc3d0 2023-10-05T15:17:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.404+0000 7ff270807b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619210de210 con 0x5619210c0c00 2023-10-05T15:17:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff270807b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619210d7b50 con 0x5619210c1520 2023-10-05T15:17:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39142/0 (socket says 172.21.15.60:39142) 2023-10-05T15:17:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 -- 172.21.15.60:0/2353983358 learned_addr learned my addr 172.21.15.60:0/2353983358 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 -- 172.21.15.60:0/2353983358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 msgr2=0x5619210cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 -- 172.21.15.60:0/2353983358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 msgr2=0x5619210d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210d7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 -- 172.21.15.60:0/2353983358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561920e661f0 con 0x5619210cc3d0 2023-10-05T15:17:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff262bba700 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210c42f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff25400cf10 tx=0x7ff254006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e402f46aebf0e24d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff24d7fa700 1 -- 172.21.15.60:0/2353983358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400e040 con 0x5619210cc3d0 2023-10-05T15:17:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff24d7fa700 1 -- 172.21.15.60:0/2353983358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2540074a0 con 0x5619210cc3d0 2023-10-05T15:17:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.405+0000 7ff24d7fa700 1 -- 172.21.15.60:0/2353983358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25401c840 con 0x5619210cc3d0 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 -- 172.21.15.60:0/2353983358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 msgr2=0x5619210c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210c42f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff25400cf10 tx=0x7ff254006060 comp rx=0 tx=0).stop 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 -- 172.21.15.60:0/2353983358 shutdown_connections 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210cc3d0 0x5619210c42f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c0c00 0x5619210d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 --2- 172.21.15.60:0/2353983358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210c1520 0x5619210cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 -- 172.21.15.60:0/2353983358 >> 172.21.15.60:0/2353983358 conn(0x561921036200 msgr2=0x5619210bb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 -- 172.21.15.60:0/2353983358 shutdown_connections 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 -- 172.21.15.60:0/2353983358 wait complete. 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 -- start start 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.406+0000 7ff270807b80 1 Processor -- start 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 0x5619210cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c1520 0x5619210cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192112ec80 con 0x5619210c0c00 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192112edc0 con 0x5619210c1520 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192112ef80 con 0x5619210cc3d0 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff270807b80 10 client.0 _ll_register_callbacks cb 0x561920e0e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 0x5619210cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 0x5619210cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39144/0 (socket says 172.21.15.60:39144) 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 -- 172.21.15.60:0/2902705765 learned_addr learned my addr 172.21.15.60:0/2902705765 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c1520 0x5619210cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 -- 172.21.15.60:0/2902705765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 msgr2=0x5619210cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff262bba700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 -- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c1520 msgr2=0x5619210cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c1520 0x5619210cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 -- 172.21.15.60:0/2902705765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561920e3fd80 con 0x5619210c0c00 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff262bba700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff2623b9700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 0x5619210cee90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ca660 tx=0x7ff250000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3b142484664480 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff245ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff245ffb700 1 -- 172.21.15.60:0/2902705765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500b6070 con 0x5619210c0c00 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.407+0000 7ff245ffb700 1 -- 172.21.15.60:0/2902705765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7ff2500b1070 con 0x5619210c0c00 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff254009350 con 0x5619210c0c00 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff245ffb700 1 -- 172.21.15.60:0/2902705765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff250098160 con 0x5619210c0c00 2023-10-05T15:17:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 10 client.15930 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561920e3e250 con 0x5619210c0c00 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff245ffb700 1 -- 172.21.15.60:0/2902705765 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff254009350 con 0x5619210c0c00 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff245ffb700 1 -- 172.21.15.60:0/2902705765 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff2500a1cc0 con 0x5619210c0c00 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 20 client.15930 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619211305a0 0x5619211329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 4 client.15930 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56192100dad0 con 0x5619211305a0 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.408+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619211305a0 0x5619211329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.409+0000 7ff261bb8700 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619211305a0 0x5619211329c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b94156cafc4fc2e5 server_cookie=fe23900fa903ab72 in_seq=0 out_seq=0 2023-10-05T15:17:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.409+0000 7ff245ffb700 10 client.15930 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:18.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:18 smithi060 ceph-mon[99238]: scrub summary: idle 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.415+0000 7ff245ffb700 1 -- 172.21.15.60:0/2902705765 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56192100dad0 con 0x5619211305a0 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.415+0000 7ff245ffb700 10 client.15930 handle_command_reply: tid=0 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.415+0000 7ff270807b80 1 client.15930 shutdown 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 msgr2=0x5619210cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 0x5619210cee90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ca660 tx=0x7ff250000bc0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 shutdown_connections 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5619211305a0 0x5619211329c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619210cc3d0 0x5619210cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5619210c0c00 0x5619210cee90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 --2- 172.21.15.60:0/2902705765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5619210c1520 0x5619210cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff245ffb700 0 client.15930 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 >> 172.21.15.60:0/2902705765 conn(0x561921036200 msgr2=0x5619210c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 shutdown_connections 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 1 -- 172.21.15.60:0/2902705765 wait complete. 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff270807b80 20 client.15930 trim_cache size 0 max 16384 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:17:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:17:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:17:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:17:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff2480a1790 msgr2=0x7ff2480a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff2480a1790 0x7ff2480a3c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff25c198890 tx=0x7ff25800a380 comp rx=0 tx=0).stop 2023-10-05T15:17:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 msgr2=0x7ff25c197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 0x7ff25c197070 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d950 tx=0x7ff25000dc60 comp rx=0 tx=0).stop 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 shutdown_connections 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25c105ef0 0x7ff25c19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff25c0fff70 0x7ff25c197070 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff2480a1790 0x7ff2480a3c50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 --2- 172.21.15.60:0/340045133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c100930 0x7ff25c1975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.416+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 >> 172.21.15.60:0/340045133 conn(0x7ff25c076b70 msgr2=0x7ff25c106be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.417+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 shutdown_connections 2023-10-05T15:17:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:18.417+0000 7ff26461d700 1 -- 172.21.15.60:0/340045133 wait complete. 2023-10-05T15:17:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:18 smithi092 ceph-mon[102944]: scrub summary: idle 2023-10-05T15:17:18.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:18 smithi135 ceph-mon[103360]: scrub summary: idle 2023-10-05T15:17:19.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:19 smithi060 ceph-mon[99238]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s 2023-10-05T15:17:19.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:19 smithi092 ceph-mon[102944]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s 2023-10-05T15:17:19.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:19 smithi135 ceph-mon[103360]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s 2023-10-05T15:17:21.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:21 smithi060 ceph-mon[99238]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-05T15:17:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:21 smithi092 ceph-mon[102944]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-05T15:17:21.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:21 smithi135 ceph-mon[103360]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-05T15:17:23.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:23 smithi060 ceph-mon[99238]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 597 B/s wr, 14 op/s 2023-10-05T15:17:23.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:23 smithi092 ceph-mon[102944]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 597 B/s wr, 14 op/s 2023-10-05T15:17:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:23 smithi135 ceph-mon[103360]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 597 B/s wr, 14 op/s 2023-10-05T15:17:25.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:25 smithi060 ceph-mon[99238]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-05T15:17:25.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:25 smithi092 ceph-mon[102944]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-05T15:17:25.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:25 smithi135 ceph-mon[103360]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-05T15:17:27.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:27 smithi060 ceph-mon[99238]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 597 B/s wr, 14 op/s 2023-10-05T15:17:27.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:27 smithi092 ceph-mon[102944]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 597 B/s wr, 14 op/s 2023-10-05T15:17:27.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:27 smithi135 ceph-mon[103360]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 597 B/s wr, 14 op/s 2023-10-05T15:17:29.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:29 smithi060 ceph-mon[99238]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:17:29.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:29 smithi092 ceph-mon[102944]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:17:29.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:29 smithi135 ceph-mon[103360]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-05T15:17:31.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:31 smithi060 ceph-mon[99238]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-05T15:17:31.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:31 smithi092 ceph-mon[102944]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-05T15:17:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 -- 172.21.15.60:0/2823363490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 msgr2=0x7fb91c107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2823363490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c107340 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009990 tx=0x7fb90c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 -- 172.21.15.60:0/2823363490 shutdown_connections 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2823363490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 0x7fb91c10dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2823363490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c107340 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2823363490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb91c0682d0 0x7fb91c068750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 -- 172.21.15.60:0/2823363490 >> 172.21.15.60:0/2823363490 conn(0x7fb91c076b70 msgr2=0x7fb91c076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 -- 172.21.15.60:0/2823363490 shutdown_connections 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.528+0000 7fb9229b2700 1 -- 172.21.15.60:0/2823363490 wait complete. 2023-10-05T15:17:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 Processor -- start 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 -- start start 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb91c0682d0 0x7fb91c196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 0x7fb91c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c19c180 con 0x7fb91c106f60 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c19c2f0 con 0x7fb91c068c90 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.529+0000 7fb9229b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c19c4b0 con 0x7fb91c0682d0 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39162/0 (socket says 172.21.15.60:39162) 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 -- 172.21.15.60:0/2675563235 learned_addr learned my addr 172.21.15.60:0/2675563235 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb91bfff700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb91c0682d0 0x7fb91c196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 0x7fb91c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 -- 172.21.15.60:0/2675563235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb91c0682d0 msgr2=0x7fb91c196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb91c0682d0 0x7fb91c196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 -- 172.21.15.60:0/2675563235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 msgr2=0x7fb91c1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 0x7fb91c1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 -- 172.21.15.60:0/2675563235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0095f0 con 0x7fb91c106f60 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 0x7fb91c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb920f4f700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c19bb40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb914007f10 tx=0x7fb91400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb9197fa700 1 -- 172.21.15.60:0/2675563235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914017070 con 0x7fb91c106f60 2023-10-05T15:17:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.530+0000 7fb9197fa700 1 -- 172.21.15.60:0/2675563235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91400f040 con 0x7fb91c106f60 2023-10-05T15:17:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.531+0000 7fb9197fa700 1 -- 172.21.15.60:0/2675563235 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140054b0 con 0x7fb91c106f60 2023-10-05T15:17:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.531+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c19c790 con 0x7fb91c106f60 2023-10-05T15:17:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.531+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c100150 con 0x7fb91c106f60 2023-10-05T15:17:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.533+0000 7fb9197fa700 1 -- 172.21.15.60:0/2675563235 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7fb914004ad0 con 0x7fb91c106f60 2023-10-05T15:17:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.534+0000 7fb9197fa700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb9040a1860 0x7fb9040a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb91bfff700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb9040a1860 0x7fb9040a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb9197fa700 1 -- 172.21.15.60:0/2675563235 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fb9140cc2d0 con 0x7fb91c106f60 2023-10-05T15:17:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb91bfff700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb9040a1860 0x7fb9040a3d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00b2e0 tx=0x7fb90c005fb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb92eb9cb80 1 Processor -- start 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb92eb9cb80 1 -- start start 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a72535cc00 0x55a72535cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 0x55a725367e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.535+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7253683d0 0x55a72536a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7252c6400 con 0x55a72535d520 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7252b7bc0 con 0x55a7253683d0 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7252b54e0 con 0x55a72535cc00 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 0x55a725367e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 0x55a725367e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39170/0 (socket says 172.21.15.60:39170) 2023-10-05T15:17:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 -- 172.21.15.60:0/3938151040 learned_addr learned my addr 172.21.15.60:0/3938151040 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb920f4f700 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7253683d0 0x55a72536a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91bfff700 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a72535cc00 0x55a72535cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 -- 172.21.15.60:0/3938151040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a72535cc00 msgr2=0x55a72535cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a72535cc00 0x55a72535cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 -- 172.21.15.60:0/3938151040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7253683d0 msgr2=0x55a72536a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7253683d0 0x55a72536a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 -- 172.21.15.60:0/3938151040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7250dbd80 con 0x55a72535d520 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.536+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 0x55a725367e90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb910009780 tx=0x7fb910009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc604a4df9ded716 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.537+0000 7fb9027fc700 1 -- 172.21.15.60:0/3938151040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910015050 con 0x55a72535d520 2023-10-05T15:17:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.537+0000 7fb9027fc700 1 -- 172.21.15.60:0/3938151040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb910016040 con 0x55a72535d520 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.537+0000 7fb9027fc700 1 -- 172.21.15.60:0/3938151040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91001a660 con 0x55a72535d520 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3938151040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 msgr2=0x55a725367e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 0x55a725367e90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb910009780 tx=0x7fb910009260 comp rx=0 tx=0).stop 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3938151040 shutdown_connections 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7253683d0 0x55a72536a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a72535cc00 0x55a72535cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3938151040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535d520 0x55a725367e90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3938151040 >> 172.21.15.60:0/3938151040 conn(0x55a7252d2200 msgr2=0x55a725359080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3938151040 shutdown_connections 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3938151040 wait complete. 2023-10-05T15:17:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 -- start start 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.538+0000 7fb92eb9cb80 1 Processor -- start 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725365820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7252b0dd0 con 0x55a72535cc00 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72524d6b0 con 0x55a72535d520 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72524d350 con 0x55a7253683d0 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb92eb9cb80 10 client.0 _ll_register_callbacks cb 0x55a7250aa7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39172/0 (socket says 172.21.15.60:39172) 2023-10-05T15:17:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 -- 172.21.15.60:0/306377063 learned_addr learned my addr 172.21.15.60:0/306377063 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb920f4f700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725365820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 -- 172.21.15.60:0/306377063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 msgr2=0x55a725365820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725365820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 -- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 msgr2=0x55a7253650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 -- 172.21.15.60:0/306377063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910010e70 con 0x55a72535cc00 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb920f4f700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725365820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb91bfff700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367e60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb90c015000 tx=0x7fb90c01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a50d6f839949e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.539+0000 7fb8fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/306377063 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c02b070 con 0x55a72535cc00 2023-10-05T15:17:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/306377063 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fb90c031660 con 0x55a72535cc00 2023-10-05T15:17:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a725350d50 con 0x55a72535cc00 2023-10-05T15:17:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/306377063 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb90c031820 con 0x55a72535cc00 2023-10-05T15:17:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 10 client.15942 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a7250c4c00 con 0x55a72535cc00 2023-10-05T15:17:31.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/306377063 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a725350d50 con 0x55a72535cc00 2023-10-05T15:17:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/306377063 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb90c00f930 con 0x55a72535cc00 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 10 client.15942 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 20 client.15942 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a725377f70 0x55a72537a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 4 client.15942 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.540+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7252a9db0 con 0x55a725377f70 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.541+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a725377f70 0x55a72537a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.541+0000 7fb8fb7fe700 10 client.15942 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.541+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a725377f70 0x55a72537a390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f952d3697423eae0 server_cookie=4b91a3eadefbf70b in_seq=0 out_seq=0 2023-10-05T15:17:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/306377063 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7252a9db0 con 0x55a725377f70 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb8fb7fe700 10 client.15942 handle_command_reply: tid=0 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 client.15942 shutdown 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 msgr2=0x55a725367e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367e60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb90c015000 tx=0x7fb90c01a050 comp rx=0 tx=0).stop 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 shutdown_connections 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a725377f70 0x55a72537a390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725365820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367e60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/306377063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253650e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 >> 172.21.15.60:0/306377063 conn(0x55a7252d2200 msgr2=0x55a725358c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb8fb7fe700 0 client.15942 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 shutdown_connections 2023-10-05T15:17:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/306377063 wait complete. 2023-10-05T15:17:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.542+0000 7fb92eb9cb80 20 client.15942 trim_cache size 0 max 16384 2023-10-05T15:17:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 Processor -- start 2023-10-05T15:17:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 -- start start 2023-10-05T15:17:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725364e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7251318c0 con 0x55a72535cc00 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7253666c0 con 0x55a72535d520 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.560+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a725355890 con 0x55a7253683d0 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39180/0 (socket says 172.21.15.60:39180) 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 -- 172.21.15.60:0/3914451416 learned_addr learned my addr 172.21.15.60:0/3914451416 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb920f4f700 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725364e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 -- 172.21.15.60:0/3914451416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 msgr2=0x55a725364e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725364e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 -- 172.21.15.60:0/3914451416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 msgr2=0x55a7253648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 -- 172.21.15.60:0/3914451416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a72537efa0 con 0x55a72535cc00 2023-10-05T15:17:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb91bfff700 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367a00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb90c005f50 tx=0x7fb90c0094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc43ebab6d3e5480 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb902ffd700 1 -- 172.21.15.60:0/3914451416 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c02b040 con 0x55a72535cc00 2023-10-05T15:17:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb902ffd700 1 -- 172.21.15.60:0/3914451416 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb90c02c040 con 0x55a72535cc00 2023-10-05T15:17:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.561+0000 7fb902ffd700 1 -- 172.21.15.60:0/3914451416 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c024ac0 con 0x55a72535cc00 2023-10-05T15:17:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3914451416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 msgr2=0x55a725367a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367a00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb90c005f50 tx=0x7fb90c0094b0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3914451416 shutdown_connections 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a725364e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72535cc00 0x55a725367a00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/3914451416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a7253648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.562+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3914451416 >> 172.21.15.60:0/3914451416 conn(0x55a7252d2200 msgr2=0x55a725360430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3914451416 shutdown_connections 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/3914451416 wait complete. 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 -- start start 2023-10-05T15:17:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 Processor -- start 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a72536cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a72536d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 0x55a7253cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72536f470 con 0x55a72536d980 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7253cb2c0 con 0x55a72535d520 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.563+0000 7fb92eb9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7253cb430 con 0x55a7253683d0 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb92eb9cb80 10 client.0 _ll_register_callbacks cb 0x7fb90c005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 0x55a7253cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 0x55a7253cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39188/0 (socket says 172.21.15.60:39188) 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 -- 172.21.15.60:0/770176694 learned_addr learned my addr 172.21.15.60:0/770176694 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb91bfff700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a72536cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb91b7fe700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a72536d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 -- 172.21.15.60:0/770176694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 msgr2=0x55a72536d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a72536d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 -- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 msgr2=0x55a72536cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a72536cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 -- 172.21.15.60:0/770176694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7250dbd80 con 0x55a72536d980 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb920f4f700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 0x55a7253cad80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb9140c96d0 tx=0x7fb9140995c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbcc63305fe6a11 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb8fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/770176694 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140caea0 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/770176694 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fb9140b0030 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.564+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb910016040 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/770176694 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb91409ced0 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 10 client.15948 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a7250c4c00 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/770176694 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb910016040 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/770176694 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb9140a0c80 con 0x55a72536d980 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 10 client.15948 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 20 client.15948 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a7253ccb50 0x55a7253cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 4 client.15948 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:17:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a7252a9ad0 con 0x55a7253ccb50 2023-10-05T15:17:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.565+0000 7fb91bfff700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a7253ccb50 0x55a7253cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.566+0000 7fb8fb7fe700 10 client.15948 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.566+0000 7fb91bfff700 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a7253ccb50 0x55a7253cef70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b02216185b2bae71 server_cookie=301bdb1a292c5829 in_seq=0 out_seq=0 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.573+0000 7fb8fb7fe700 1 -- 172.21.15.60:0/770176694 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a7252a9ad0 con 0x55a7253ccb50 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.573+0000 7fb8fb7fe700 10 client.15948 handle_command_reply: tid=0 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.573+0000 7fb92eb9cb80 1 client.15948 shutdown 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 msgr2=0x55a7253cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 0x55a7253cad80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb9140c96d0 tx=0x7fb9140995c0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 shutdown_connections 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a7253ccb50 0x55a7253cef70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a72536d980 0x55a7253cad80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb8fb7fe700 0 client.15948 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a72535d520 0x55a72536cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 --2- 172.21.15.60:0/770176694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7253683d0 0x55a72536d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 >> 172.21.15.60:0/770176694 conn(0x55a7252d2200 msgr2=0x55a725358250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 shutdown_connections 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 1 -- 172.21.15.60:0/770176694 wait complete. 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb92eb9cb80 20 client.15948 trim_cache size 0 max 16384 2023-10-05T15:17:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:17:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:17:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:17:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.574+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb9040a1860 msgr2=0x7fb9040a3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb9040a1860 0x7fb9040a3d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00b2e0 tx=0x7fb90c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 msgr2=0x7fb91c19bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c19bb40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb914007f10 tx=0x7fb91400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 shutdown_connections 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c106f60 0x7fb91c19bb40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb91c0682d0 0x7fb91c196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb9040a1860 0x7fb9040a3d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 --2- 172.21.15.60:0/2675563235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91c068c90 0x7fb91c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 >> 172.21.15.60:0/2675563235 conn(0x7fb91c076b70 msgr2=0x7fb91c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 shutdown_connections 2023-10-05T15:17:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:31.575+0000 7fb9229b2700 1 -- 172.21.15.60:0/2675563235 wait complete. 2023-10-05T15:17:31.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:31 smithi135 ceph-mon[103360]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 9 op/s 2023-10-05T15:17:33.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:33 smithi092 ceph-mon[102944]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2023-10-05T15:17:33.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:33 smithi135 ceph-mon[103360]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2023-10-05T15:17:33.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:33 smithi060 ceph-mon[99238]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2023-10-05T15:17:35.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:35 smithi092 ceph-mon[102944]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-10-05T15:17:35.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:35 smithi135 ceph-mon[103360]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-10-05T15:17:35.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:35 smithi060 ceph-mon[99238]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-10-05T15:17:37.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:37 smithi092 ceph-mon[102944]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-10-05T15:17:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:37 smithi135 ceph-mon[103360]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-10-05T15:17:37.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:37 smithi060 ceph-mon[99238]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-10-05T15:17:39.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:39 smithi092 ceph-mon[102944]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-10-05T15:17:39.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:39 smithi135 ceph-mon[103360]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-10-05T15:17:39.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:39 smithi060 ceph-mon[99238]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-10-05T15:17:41.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:41 smithi135 ceph-mon[103360]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-10-05T15:17:41.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:41 smithi060 ceph-mon[99238]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-10-05T15:17:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:41 smithi092 ceph-mon[102944]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-10-05T15:17:43.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:43 smithi135 ceph-mon[103360]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-10-05T15:17:43.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:43 smithi060 ceph-mon[99238]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-10-05T15:17:43.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:43 smithi092 ceph-mon[102944]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-10-05T15:17:44.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:17:44.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 -- 172.21.15.60:0/235981172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f41010c0 msgr2=0x7f33f41014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 --2- 172.21.15.60:0/235981172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f41010c0 0x7f33f41014a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009990 tx=0x7f33e4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 -- 172.21.15.60:0/235981172 shutdown_connections 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 --2- 172.21.15.60:0/235981172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f41061e0 0x7f33f410dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 --2- 172.21.15.60:0/235981172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f41010c0 0x7f33f41014a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 --2- 172.21.15.60:0/235981172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f4101a70 0x7f33f4105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 -- 172.21.15.60:0/235981172 >> 172.21.15.60:0/235981172 conn(0x7f33f40fc960 msgr2=0x7f33f40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 -- 172.21.15.60:0/235981172 shutdown_connections 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.467+0000 7f33fa966700 1 -- 172.21.15.60:0/235981172 wait complete. 2023-10-05T15:17:44.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 Processor -- start 2023-10-05T15:17:44.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 -- start start 2023-10-05T15:17:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41010c0 0x7f33f40731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f41061e0 0x7f33f40736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 0x7f33f41a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41a5960 con 0x7f33f41061e0 2023-10-05T15:17:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41a5ad0 con 0x7f33f41010c0 2023-10-05T15:17:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.468+0000 7f33fa966700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41a5c90 con 0x7f33f4073c30 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 0x7f33f41a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 0x7f33f41a52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52732/0 (socket says 172.21.15.60:52732) 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 -- 172.21.15.60:0/4224937041 learned_addr learned my addr 172.21.15.60:0/4224937041 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 -- 172.21.15.60:0/4224937041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41010c0 msgr2=0x7f33f40731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41010c0 0x7f33f40731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 -- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f41061e0 msgr2=0x7f33f40736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f41061e0 0x7f33f40736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 -- 172.21.15.60:0/4224937041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40095f0 con 0x7f33f4073c30 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.469+0000 7f33f8f03700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 0x7f33f41a52d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b970 tx=0x7f33ec00bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.470+0000 7f33f17fa700 1 -- 172.21.15.60:0/4224937041 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00c9b0 con 0x7f33f4073c30 2023-10-05T15:17:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.470+0000 7f33f17fa700 1 -- 172.21.15.60:0/4224937041 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33ec014440 con 0x7f33f4073c30 2023-10-05T15:17:44.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.470+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f41a5f70 con 0x7f33f4073c30 2023-10-05T15:17:44.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.470+0000 7f33f17fa700 1 -- 172.21.15.60:0/4224937041 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0075d0 con 0x7f33f4073c30 2023-10-05T15:17:44.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.470+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f41a64a0 con 0x7f33f4073c30 2023-10-05T15:17:44.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.475+0000 7f33f17fa700 1 -- 172.21.15.60:0/4224937041 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f33ec0145b0 con 0x7f33f4073c30 2023-10-05T15:17:44.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.475+0000 7f3406b50b80 1 Processor -- start 2023-10-05T15:17:44.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.475+0000 7f3406b50b80 1 -- start start 2023-10-05T15:17:44.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.475+0000 7f33f17fa700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33dc0a1790 0x7f33dc0a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f17fa700 1 -- 172.21.15.60:0/4224937041 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f33ec006e40 con 0x7f33f4073c30 2023-10-05T15:17:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d80350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d82c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f3406b50b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047cde460 con 0x55b047d759e0 2023-10-05T15:17:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f3406b50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047ccfc20 con 0x55b047d80890 2023-10-05T15:17:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f3406b50b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047ccd540 con 0x55b047d750c0 2023-10-05T15:17:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d82c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d82c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52628/0 (socket says 172.21.15.60:52628) 2023-10-05T15:17:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 -- 172.21.15.60:0/4168886207 learned_addr learned my addr 172.21.15.60:0/4168886207 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f37fe700 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d80350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f37fe700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33dc0a1790 0x7f33dc0a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 -- 172.21.15.60:0/4168886207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 msgr2=0x55b047d754a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d754a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 -- 172.21.15.60:0/4168886207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 msgr2=0x55b047d80350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d80350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.476+0000 7f33f8f03700 1 -- 172.21.15.60:0/4168886207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b047af3de0 con 0x55b047d80890 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.477+0000 7f33f8f03700 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d82c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ca100 tx=0x7f33ec099110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351eb0120ef8d4fd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.477+0000 7f33da7fc700 1 -- 172.21.15.60:0/4168886207 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0997b0 con 0x55b047d80890 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.477+0000 7f33da7fc700 1 -- 172.21.15.60:0/4168886207 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33ec09d900 con 0x55b047d80890 2023-10-05T15:17:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.477+0000 7f33da7fc700 1 -- 172.21.15.60:0/4168886207 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec098ca0 con 0x55b047d80890 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 -- 172.21.15.60:0/4168886207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 msgr2=0x55b047d82c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f33f37fe700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33dc0a1790 0x7f33dc0a3c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f33f40749a0 tx=0x7f33e80069b0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d82c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ca100 tx=0x7f33ec099110 comp rx=0 tx=0).stop 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 -- 172.21.15.60:0/4168886207 shutdown_connections 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d82c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 --2- 172.21.15.60:0/4168886207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d80350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 -- 172.21.15.60:0/4168886207 >> 172.21.15.60:0/4168886207 conn(0x55b047cea260 msgr2=0x55b047d71450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 -- 172.21.15.60:0/4168886207 shutdown_connections 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 -- 172.21.15.60:0/4168886207 wait complete. 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.478+0000 7f3406b50b80 1 -- start start 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 Processor -- start 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d7d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d759e0 0x55b047d7db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d7e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047cc8e30 con 0x55b047d80890 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047c65710 con 0x55b047d759e0 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047c653b0 con 0x55b047d750c0 2023-10-05T15:17:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.479+0000 7f3406b50b80 10 client.0 _ll_register_callbacks cb 0x55b047ac2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d7e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d7e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39216/0 (socket says 172.21.15.60:39216) 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 -- 172.21.15.60:0/1218484629 learned_addr learned my addr 172.21.15.60:0/1218484629 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f37fe700 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d759e0 0x55b047d7db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 -- 172.21.15.60:0/1218484629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 msgr2=0x55b047d7d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d7d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 -- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d759e0 msgr2=0x55b047d7db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d759e0 0x55b047d7db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 -- 172.21.15.60:0/1218484629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f41a64a0 con 0x55b047d80890 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33f8f03700 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d7e060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ca660 tx=0x7f33ec014ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fd4b96f0e6832a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33d37fe700 1 -- 172.21.15.60:0/1218484629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec098ea0 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33d37fe700 1 -- 172.21.15.60:0/1218484629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f33ec0997b0 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b047d68f10 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.480+0000 7f33d37fe700 1 -- 172.21.15.60:0/1218484629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33ec0a16b0 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 10 client.15954 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b047adcc60 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f33d37fe700 1 -- 172.21.15.60:0/1218484629 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33ec080030 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f33d37fe700 1 -- 172.21.15.60:0/1218484629 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33ec09aae0 con 0x55b047d80890 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 10 client.15954 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 20 client.15954 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047d90100 0x55b047d92520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 4 client.15954 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.481+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b047cc1e10 con 0x55b047d90100 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.482+0000 7f33f3fff700 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047d90100 0x55b047d92520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.482+0000 7f33d37fe700 10 client.15954 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.482+0000 7f33f3fff700 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047d90100 0x55b047d92520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f91f4b4b0767f6 server_cookie=4d920cbca8bd7a27 in_seq=0 out_seq=0 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f33d37fe700 1 -- 172.21.15.60:0/1218484629 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b047cc1e10 con 0x55b047d90100 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f33d37fe700 10 client.15954 handle_command_reply: tid=0 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 client.15954 shutdown 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 msgr2=0x55b047d7e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d7e060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ca660 tx=0x7f33ec014ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 shutdown_connections 2023-10-05T15:17:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047d90100 0x55b047d92520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d7e060 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d7d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 --2- 172.21.15.60:0/1218484629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d759e0 0x55b047d7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 >> 172.21.15.60:0/1218484629 conn(0x55b047cea260 msgr2=0x55b047d71040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f33d37fe700 0 client.15954 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 shutdown_connections 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 1 -- 172.21.15.60:0/1218484629 wait complete. 2023-10-05T15:17:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.483+0000 7f3406b50b80 20 client.15954 trim_cache size 0 max 16384 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 Processor -- start 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 -- start start 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d78080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d7db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047b49920 con 0x55b047d759e0 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047d830c0 con 0x55b047d80890 2023-10-05T15:17:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f3406b50b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047d70240 con 0x55b047d750c0 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d7db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d7db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39222/0 (socket says 172.21.15.60:39222) 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f33f37fe700 1 -- 172.21.15.60:0/912505549 learned_addr learned my addr 172.21.15.60:0/912505549 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.517+0000 7f33f3fff700 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d78080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f8f03700 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f37fe700 1 -- 172.21.15.60:0/912505549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 msgr2=0x55b047d78080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f37fe700 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d78080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f37fe700 1 -- 172.21.15.60:0/912505549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 msgr2=0x55b047d7e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f37fe700 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d7e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f37fe700 1 -- 172.21.15.60:0/912505549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b047d6d140 con 0x55b047d759e0 2023-10-05T15:17:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f8f03700 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d7e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33f37fe700 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d7db50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f33e800d780 tx=0x7f33e800b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c76ba7edbd63b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33daffd700 1 -- 172.21.15.60:0/912505549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e801e070 con 0x55b047d759e0 2023-10-05T15:17:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33daffd700 1 -- 172.21.15.60:0/912505549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33e800ded0 con 0x55b047d759e0 2023-10-05T15:17:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.518+0000 7f33daffd700 1 -- 172.21.15.60:0/912505549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80245e0 con 0x55b047d759e0 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 -- 172.21.15.60:0/912505549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 msgr2=0x55b047d7db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d7db50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f33e800d780 tx=0x7f33e800b470 comp rx=0 tx=0).stop 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 -- 172.21.15.60:0/912505549 shutdown_connections 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d80890 0x55b047d7e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d750c0 0x55b047d78080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 --2- 172.21.15.60:0/912505549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d759e0 0x55b047d7db50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 -- 172.21.15.60:0/912505549 >> 172.21.15.60:0/912505549 conn(0x55b047cea260 msgr2=0x55b047d788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 -- 172.21.15.60:0/912505549 shutdown_connections 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.519+0000 7f3406b50b80 1 -- 172.21.15.60:0/912505549 wait complete. 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.520+0000 7f3406b50b80 1 -- start start 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.520+0000 7f3406b50b80 1 Processor -- start 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.520+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d750c0 0x55b047d855d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.520+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d759e0 0x55b047d85b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.520+0000 7f3406b50b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d86b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f3406b50b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047d870e0 con 0x55b047d80890 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f3406b50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047d87250 con 0x55b047d750c0 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f3406b50b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b047d87410 con 0x55b047d759e0 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f3406b50b80 10 client.0 _ll_register_callbacks cb 0x7f33e800bc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d86b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d86b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39228/0 (socket says 172.21.15.60:39228) 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 -- 172.21.15.60:0/3438755598 learned_addr learned my addr 172.21.15.60:0/3438755598 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 -- 172.21.15.60:0/3438755598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d759e0 msgr2=0x55b047d85b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d759e0 0x55b047d85b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 -- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d750c0 msgr2=0x55b047d855d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d750c0 0x55b047d855d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 -- 172.21.15.60:0/3438755598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e8015040 con 0x55b047d80890 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33f8f03700 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d86b00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0993e0 tx=0x7f33ec0a1a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f404bd86f6824fa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.521+0000 7f33d37fe700 1 -- 172.21.15.60:0/3438755598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec099110 con 0x55b047d80890 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33ec09d900 con 0x55b047d80890 2023-10-05T15:17:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f33d37fe700 1 -- 172.21.15.60:0/3438755598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f33ec0997b0 con 0x55b047d80890 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f33d37fe700 1 -- 172.21.15.60:0/3438755598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33ec0a1b40 con 0x55b047d80890 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 10 client.15960 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b047b1a250 con 0x55b047d80890 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f33d37fe700 1 -- 172.21.15.60:0/3438755598 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33ec09d900 con 0x55b047d80890 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f33d37fe700 1 -- 172.21.15.60:0/3438755598 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33ec0957d0 con 0x55b047d80890 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 10 client.15960 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 20 client.15960 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047de4c40 0x55b047de7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 4 client.15960 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:17:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.522+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b047cc1b30 con 0x55b047de4c40 2023-10-05T15:17:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f33f3fff700 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047de4c40 0x55b047de7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f33d37fe700 10 client.15960 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f33f3fff700 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047de4c40 0x55b047de7030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecabedcde466ec73 server_cookie=bf10de1b5c8b17a0 in_seq=0 out_seq=0 2023-10-05T15:17:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f33d37fe700 1 -- 172.21.15.60:0/3438755598 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b047cc1b30 con 0x55b047de4c40 2023-10-05T15:17:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f33d37fe700 10 client.15960 handle_command_reply: tid=0 2023-10-05T15:17:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f3406b50b80 1 client.15960 shutdown 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 msgr2=0x55b047d86b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.523+0000 7f3406b50b80 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d86b00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0993e0 tx=0x7f33ec0a1a10 comp rx=0 tx=0).stop 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 shutdown_connections 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f3406b50b80 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b047de4c40 0x55b047de7030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f3406b50b80 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b047d80890 0x55b047d86b00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f3406b50b80 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b047d750c0 0x55b047d855d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f3406b50b80 1 --2- 172.21.15.60:0/3438755598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b047d759e0 0x55b047d85b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 >> 172.21.15.60:0/3438755598 conn(0x55b047cea260 msgr2=0x55b047d7db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.524+0000 7f33d37fe700 0 client.15960 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 shutdown_connections 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f3406b50b80 1 -- 172.21.15.60:0/3438755598 wait complete. 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f3406b50b80 20 client.15960 trim_cache size 0 max 16384 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2023-10-05T15:17:44.531 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:17:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33dc0a1790 msgr2=0x7f33dc0a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f33fa966700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33dc0a1790 0x7f33dc0a3c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f33f40749a0 tx=0x7f33e80069b0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 msgr2=0x7f33f41a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f33fa966700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 0x7f33f41a52d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b970 tx=0x7f33ec00bd30 comp rx=0 tx=0).stop 2023-10-05T15:17:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.525+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 shutdown_connections 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f4073c30 0x7f33f41a52d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33dc0a1790 0x7f33dc0a3c50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41010c0 0x7f33f40731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 --2- 172.21.15.60:0/4224937041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33f41061e0 0x7f33f40736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 >> 172.21.15.60:0/4224937041 conn(0x7f33f40fc960 msgr2=0x7f33f40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 shutdown_connections 2023-10-05T15:17:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.526+0000 7f33fa966700 1 -- 172.21.15.60:0/4224937041 wait complete. 2023-10-05T15:17:44.544 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-05T15:17:44.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:17:44.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 -- 172.21.15.60:0/2534801649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 msgr2=0x7f5048105690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 --2- 172.21.15.60:0/2534801649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 0x7f5048105690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5040009f90 tx=0x7f504000b330 comp rx=0 tx=0).stop 2023-10-05T15:17:44.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 -- 172.21.15.60:0/2534801649 shutdown_connections 2023-10-05T15:17:44.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 --2- 172.21.15.60:0/2534801649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 0x7f5048105690 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 --2- 172.21.15.60:0/2534801649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50480ffde0 0x7f50481001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 --2- 172.21.15.60:0/2534801649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f5048104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.736+0000 7f504f56b700 1 -- 172.21.15.60:0/2534801649 >> 172.21.15.60:0/2534801649 conn(0x7f50480fb7f0 msgr2=0x7f50480fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.739+0000 7f504f56b700 1 -- 172.21.15.60:0/2534801649 shutdown_connections 2023-10-05T15:17:44.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.739+0000 7f504f56b700 1 -- 172.21.15.60:0/2534801649 wait complete. 2023-10-05T15:17:44.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.740+0000 7f504f56b700 1 Processor -- start 2023-10-05T15:17:44.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.740+0000 7f504f56b700 1 -- start start 2023-10-05T15:17:44.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.740+0000 7f504f56b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f504819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.740+0000 7f504f56b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 0x7f504819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504f56b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50481a1fa0 0x7f50481a2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504f56b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481a2a20 con 0x7f5048100700 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504f56b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481a2b60 con 0x7f50481a1fa0 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504f56b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481a2cd0 con 0x7f50481051e0 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f504819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f504819d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39238/0 (socket says 172.21.15.60:39238) 2023-10-05T15:17:44.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 -- 172.21.15.60:0/3063021562 learned_addr learned my addr 172.21.15.60:0/3063021562 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 -- 172.21.15.60:0/3063021562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 msgr2=0x7f504819db40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:17:44.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 0x7f504819db40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 -- 172.21.15.60:0/3063021562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50481a1fa0 msgr2=0x7f50481a2420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:17:44.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50481a1fa0 0x7f50481a2420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 -- 172.21.15.60:0/3063021562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440095f0 con 0x7f5048100700 2023-10-05T15:17:44.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.741+0000 7f504d307700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f504819d600 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f503c00d900 tx=0x7f503c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.742+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c009930 con 0x7f5048100700 2023-10-05T15:17:44.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.742+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f503c010460 con 0x7f5048100700 2023-10-05T15:17:44.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.742+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00f620 con 0x7f5048100700 2023-10-05T15:17:44.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.742+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5040009c40 con 0x7f5048100700 2023-10-05T15:17:44.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.742+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50481064c0 con 0x7f5048100700 2023-10-05T15:17:44.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.744+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048067cd0 con 0x7f5048100700 2023-10-05T15:17:44.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.747+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f503c0108d0 con 0x7f5048100700 2023-10-05T15:17:44.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.747+0000 7f503a7fc700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f50340a17e0 0x7f50340a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f503c0cd070 con 0x7f5048100700 2023-10-05T15:17:44.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f504cb06700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f50340a17e0 0x7f50340a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 -- 172.21.15.60:0/113343491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 msgr2=0x7f0e88105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/113343491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 0x7f0e88105760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009f90 tx=0x7f0e8000b330 comp rx=0 tx=0).stop 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 -- 172.21.15.60:0/113343491 shutdown_connections 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/113343491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 0x7f0e88105760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/113343491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e880ffda0 0x7f0e88100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/113343491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e881006c0 0x7f0e88104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.748+0000 7f0e8ed94700 1 -- 172.21.15.60:0/113343491 >> 172.21.15.60:0/113343491 conn(0x7f0e880fb860 msgr2=0x7f0e880fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.749+0000 7f0e8ed94700 1 -- 172.21.15.60:0/113343491 shutdown_connections 2023-10-05T15:17:44.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.749+0000 7f504cb06700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f50340a17e0 0x7f50340a3ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f504819ec10 tx=0x7f5044009310 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.749+0000 7f0e8ed94700 1 -- 172.21.15.60:0/113343491 wait complete. 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 Processor -- start 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 -- start start 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 0x7f0e8810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e881006c0 0x7f0e881102e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 0x7f0e881139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88113f80 con 0x7f0e880ffda0 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881140f0 con 0x7f0e881006c0 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8ed94700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881142b0 con 0x7f0e881052b0 2023-10-05T15:17:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8cb30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 0x7f0e8810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8cb30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 0x7f0e8810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39252/0 (socket says 172.21.15.60:39252) 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2749121664 learned_addr learned my addr 172.21.15.60:0/2749121664 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.750+0000 7f0e8d331700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 0x7f0e881139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.751+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2749121664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 msgr2=0x7f0e881139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.751+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 0x7f0e881139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.751+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2749121664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e881006c0 msgr2=0x7f0e881102e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.751+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e881006c0 0x7f0e881102e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.751+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2749121664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009c40 con 0x7f0e880ffda0 2023-10-05T15:17:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.751+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 0x7f0e8810fda0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800d980 tx=0x7f0e7800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:44.753+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f503c095ee0 con 0x7f5048100700 2023-10-05T15:17:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.753+0000 7f0e85ffb700 1 -- 172.21.15.60:0/2749121664 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800bb60 con 0x7f0e880ffda0 2023-10-05T15:17:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.753+0000 7f0e85ffb700 1 -- 172.21.15.60:0/2749121664 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e7800de60 con 0x7f0e880ffda0 2023-10-05T15:17:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.754+0000 7f0e85ffb700 1 -- 172.21.15.60:0/2749121664 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78005550 con 0x7f0e880ffda0 2023-10-05T15:17:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.754+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88114590 con 0x7f0e880ffda0 2023-10-05T15:17:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.755+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8806aab0 con 0x7f0e880ffda0 2023-10-05T15:17:44.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.758+0000 7f0e85ffb700 1 -- 172.21.15.60:0/2749121664 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f0e7800bcc0 con 0x7f0e880ffda0 2023-10-05T15:17:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.758+0000 7f0e85ffb700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e6c0a1790 0x7f0e6c0a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.759+0000 7f0e85ffb700 1 -- 172.21.15.60:0/2749121664 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f0e780cce70 con 0x7f0e880ffda0 2023-10-05T15:17:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.759+0000 7f0e87fff700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e6c0a1790 0x7f0e6c0a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.760+0000 7f0e87fff700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e6c0a1790 0x7f0e6c0a3c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e881115c0 tx=0x7f0e7401a320 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.765 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.764+0000 7f0e9af7eb80 1 Processor -- start 2023-10-05T15:17:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 -- start start 2023-10-05T15:17:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a332dc00 0x5591a332dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a332e520 0x5591a3338e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a3297400 con 0x5591a33393d0 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a3288bc0 con 0x5591a332dc00 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a32864e0 con 0x5591a332e520 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e8d331700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e8d331700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39260/0 (socket says 172.21.15.60:39260) 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e8d331700 1 -- 172.21.15.60:0/77720007 learned_addr learned my addr 172.21.15.60:0/77720007 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.765+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a332dc00 0x5591a332dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e8d331700 1 -- 172.21.15.60:0/77720007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a332e520 msgr2=0x5591a3338e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e8d331700 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a332e520 0x5591a3338e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e8d331700 1 -- 172.21.15.60:0/77720007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a332dc00 msgr2=0x5591a332dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e8d331700 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a332dc00 0x5591a332dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e8d331700 1 -- 172.21.15.60:0/77720007 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a30acd80 con 0x5591a33393d0 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e8d331700 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333b7c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e800092e0 tx=0x7f0e80009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc2cfb5569a9b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e7effd700 1 -- 172.21.15.60:0/77720007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000e040 con 0x5591a33393d0 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e7effd700 1 -- 172.21.15.60:0/77720007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e80007b50 con 0x5591a33393d0 2023-10-05T15:17:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.766+0000 7f0e7effd700 1 -- 172.21.15.60:0/77720007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000bc30 con 0x5591a33393d0 2023-10-05T15:17:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/77720007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 msgr2=0x5591a333b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333b7c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e800092e0 tx=0x7f0e80009310 comp rx=0 tx=0).stop 2023-10-05T15:17:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/77720007 shutdown_connections 2023-10-05T15:17:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333b7c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a332dc00 0x5591a332dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/77720007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a332e520 0x5591a3338e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.767+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/77720007 >> 172.21.15.60:0/77720007 conn(0x5591a32a3200 msgr2=0x5591a332a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.768+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/77720007 shutdown_connections 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.768+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/77720007 wait complete. 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.768+0000 7f0e9af7eb80 1 -- start start 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.768+0000 7f0e9af7eb80 1 Processor -- start 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a33393d0 0x5591a3336330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a3336cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a3342fa0 0x5591a3345390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a3281dd0 con 0x5591a3342fa0 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a321e6b0 con 0x5591a3336870 2023-10-05T15:17:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a321e350 con 0x5591a33393d0 2023-10-05T15:17:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e9af7eb80 10 client.0 _ll_register_callbacks cb 0x5591a307b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a3336cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a3336cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52692/0 (socket says 172.21.15.60:52692) 2023-10-05T15:17:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e87fff700 1 -- 172.21.15.60:0/3047332120 learned_addr learned my addr 172.21.15.60:0/3047332120 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.769+0000 7f0e8d331700 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a3342fa0 0x5591a3345390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e87fff700 1 -- 172.21.15.60:0/3047332120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a33393d0 msgr2=0x5591a3336330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e87fff700 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a33393d0 0x5591a3336330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e87fff700 1 -- 172.21.15.60:0/3047332120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a3342fa0 msgr2=0x5591a3345390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e87fff700 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a3342fa0 0x5591a3345390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e87fff700 1 -- 172.21.15.60:0/3047332120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e88114c10 con 0x5591a3336870 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e87fff700 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a3336cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e7401a5d0 tx=0x7f0e740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=864cf06131417457 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e6bfff700 1 -- 172.21.15.60:0/3047332120 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7401ce90 con 0x5591a3336870 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591a3321d50 con 0x5591a3336870 2023-10-05T15:17:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e6bfff700 1 -- 172.21.15.60:0/3047332120 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f0e7400fbe0 con 0x5591a3336870 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e6bfff700 1 -- 172.21.15.60:0/3047332120 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e7400fda0 con 0x5591a3336870 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e9af7eb80 10 client.25688 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.770+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5591a3095c00 con 0x5591a3336870 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e6bfff700 1 -- 172.21.15.60:0/3047332120 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5591a3321d50 con 0x5591a3336870 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e6bfff700 1 -- 172.21.15.60:0/3047332120 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0e7400e470 con 0x5591a3336870 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e9af7eb80 10 client.25688 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e9af7eb80 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e9af7eb80 20 client.25688 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a33499d0 0x5591a334bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e9af7eb80 4 client.25688 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.771+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591a327adb0 con 0x5591a33499d0 2023-10-05T15:17:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.773+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a33499d0 0x5591a334bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.773+0000 7f0e6bfff700 10 client.25688 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.773+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a33499d0 0x5591a334bdf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f54919354f1f785 server_cookie=f36cc56506778a06 in_seq=0 out_seq=0 2023-10-05T15:17:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e6bfff700 1 -- 172.21.15.60:0/3047332120 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591a327adb0 con 0x5591a33499d0 2023-10-05T15:17:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e6bfff700 10 client.25688 handle_command_reply: tid=0 2023-10-05T15:17:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 client.25688 shutdown 2023-10-05T15:17:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 msgr2=0x5591a3336cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a3336cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e7401a5d0 tx=0x7f0e740047c0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 shutdown_connections 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a33499d0 0x5591a334bdf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a3342fa0 0x5591a3345390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a33393d0 0x5591a3336330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/3047332120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a3336cf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 >> 172.21.15.60:0/3047332120 conn(0x5591a32a3200 msgr2=0x5591a3329c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e6bfff700 0 client.25688 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.774+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 shutdown_connections 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.775+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/3047332120 wait complete. 2023-10-05T15:17:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.775+0000 7f0e9af7eb80 20 client.25688 trim_cache size 0 max 16384 2023-10-05T15:17:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.803+0000 7f0e9af7eb80 1 Processor -- start 2023-10-05T15:17:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 -- start start 2023-10-05T15:17:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a3335af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a3342600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a31028c0 con 0x5591a33393d0 2023-10-05T15:17:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a33372f0 con 0x5591a3336870 2023-10-05T15:17:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a3346fe0 con 0x5591a3342fa0 2023-10-05T15:17:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e8cb30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e8cb30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52696/0 (socket says 172.21.15.60:52696) 2023-10-05T15:17:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2268204699 learned_addr learned my addr 172.21.15.60:0/2268204699 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e8d331700 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a3342600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.804+0000 7f0e87fff700 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a3335af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2268204699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 msgr2=0x5591a3342600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a3342600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2268204699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 msgr2=0x5591a3335af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a3335af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e8cb30700 1 -- 172.21.15.60:0/2268204699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88072f50 con 0x5591a3336870 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333b7c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e780998b0 tx=0x7f0e78005020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a16e6dac2c335e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e7f7fe700 1 -- 172.21.15.60:0/2268204699 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780b1070 con 0x5591a3336870 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e7f7fe700 1 -- 172.21.15.60:0/2268204699 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e78099920 con 0x5591a3336870 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.805+0000 7f0e7f7fe700 1 -- 172.21.15.60:0/2268204699 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78097af0 con 0x5591a3336870 2023-10-05T15:17:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2268204699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 msgr2=0x5591a333b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333b7c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e780998b0 tx=0x7f0e78005020 comp rx=0 tx=0).stop 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2268204699 shutdown_connections 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a3342600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333b7c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2268204699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a3335af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2268204699 >> 172.21.15.60:0/2268204699 conn(0x5591a32a3200 msgr2=0x5591a33287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2268204699 shutdown_connections 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.806+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2268204699 wait complete. 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 -- start start 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 Processor -- start 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a333e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a339ca10 con 0x5591a33393d0 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a339cb80 con 0x5591a3336870 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a339cd40 con 0x5591a3342fa0 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.807+0000 7f0e9af7eb80 10 client.0 _ll_register_callbacks cb 0x7f0e7401af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39284/0 (socket says 172.21.15.60:39284) 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 -- 172.21.15.60:0/2272260032 learned_addr learned my addr 172.21.15.60:0/2272260032 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 -- 172.21.15.60:0/2272260032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 msgr2=0x5591a333e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a333e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 -- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 msgr2=0x5591a333d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 -- 172.21.15.60:0/2272260032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8806aab0 con 0x5591a33393d0 2023-10-05T15:17:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.808+0000 7f0e87fff700 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333dcf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0e74005fd0 tx=0x7f0e7400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e5b6f3cd0821c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e6bfff700 1 -- 172.21.15.60:0/2272260032 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400fb30 con 0x5591a33393d0 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e6bfff700 1 -- 172.21.15.60:0/2272260032 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f0e7400fc90 con 0x5591a33393d0 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e80007b50 con 0x5591a33393d0 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e6bfff700 1 -- 172.21.15.60:0/2272260032 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e7400fe50 con 0x5591a33393d0 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e9af7eb80 10 client.15984 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5591a30d31f0 con 0x5591a33393d0 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e6bfff700 1 -- 172.21.15.60:0/2272260032 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e74042030 con 0x5591a33393d0 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.814+0000 7f0e6bfff700 1 -- 172.21.15.60:0/2272260032 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0e7400eb80 con 0x5591a33393d0 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.815+0000 7f0e9af7eb80 10 client.15984 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.815+0000 7f0e9af7eb80 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.815+0000 7f0e9af7eb80 20 client.15984 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.815+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a339e4c0 0x5591a33a0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.815+0000 7f0e9af7eb80 4 client.15984 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:17:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.815+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5591a327aad0 con 0x5591a339e4c0 2023-10-05T15:17:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.816+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a339e4c0 0x5591a33a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.816+0000 7f0e6bfff700 10 client.15984 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.816+0000 7f0e8cb30700 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a339e4c0 0x5591a33a0920 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b58cecf9980f84d server_cookie=b2e7478b9079d586 in_seq=0 out_seq=0 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e6bfff700 1 -- 172.21.15.60:0/2272260032 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5591a327aad0 con 0x5591a339e4c0 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e6bfff700 10 client.15984 handle_command_reply: tid=0 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e9af7eb80 1 client.15984 shutdown 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 msgr2=0x5591a333dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333dcf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0e74005fd0 tx=0x7f0e7400e6c0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 shutdown_connections 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5591a339e4c0 0x5591a33a0920 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.820+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a3342fa0 0x5591a333e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5591a3336870 0x5591a333d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e9af7eb80 1 --2- 172.21.15.60:0/2272260032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a33393d0 0x5591a333dcf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 >> 172.21.15.60:0/2272260032 conn(0x5591a32a3200 msgr2=0x5591a3342600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e6bfff700 0 client.15984 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 shutdown_connections 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e9af7eb80 1 -- 172.21.15.60:0/2272260032 wait complete. 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.821+0000 7f0e9af7eb80 20 client.15984 trim_cache size 0 max 16384 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:17:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:17:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.822+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e6c0a1790 msgr2=0x7f0e6c0a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.822+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e6c0a1790 0x7f0e6c0a3c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e881115c0 tx=0x7f0e7401a320 comp rx=0 tx=0).stop 2023-10-05T15:17:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.822+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 msgr2=0x7f0e8810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.822+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 0x7f0e8810fda0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800d980 tx=0x7f0e7800dd40 comp rx=0 tx=0).stop 2023-10-05T15:17:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 shutdown_connections 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e881052b0 0x7f0e881139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e880ffda0 0x7f0e8810fda0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e6c0a1790 0x7f0e6c0a3c50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 --2- 172.21.15.60:0/2749121664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e881006c0 0x7f0e881102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 >> 172.21.15.60:0/2749121664 conn(0x7f0e880fb860 msgr2=0x7f0e88102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 shutdown_connections 2023-10-05T15:17:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:44.823+0000 7f0e8ed94700 1 -- 172.21.15.60:0/2749121664 wait complete. 2023-10-05T15:17:45.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.245+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50481176d0 con 0x7f5048100700 2023-10-05T15:17:45.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.246+0000 7f503a7fc700 1 -- 172.21.15.60:0/3063021562 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11359 (secure 0 0 0) 0x7f503c021090 con 0x7f5048100700 2023-10-05T15:17:45.248 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:17:45.249 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:15:11.025418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:17:45.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.249+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f50340a17e0 msgr2=0x7f50340a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.249+0000 7f504f56b700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f50340a17e0 0x7f50340a3ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f504819ec10 tx=0x7f5044009310 comp rx=0 tx=0).stop 2023-10-05T15:17:45.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.249+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 msgr2=0x7f504819d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.249+0000 7f504f56b700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f504819d600 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f503c00d900 tx=0x7f503c00dcc0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 shutdown_connections 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f50340a17e0 0x7f50340a3ca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50481a1fa0 0x7f50481a2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5048100700 0x7f504819d600 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 --2- 172.21.15.60:0/3063021562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50481051e0 0x7f504819db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 >> 172.21.15.60:0/3063021562 conn(0x7f50480fb7f0 msgr2=0x7f5048102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 shutdown_connections 2023-10-05T15:17:45.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.250+0000 7f504f56b700 1 -- 172.21.15.60:0/3063021562 wait complete. 2023-10-05T15:17:45.253 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-05T15:17:45.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-05T15:17:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 -- 172.21.15.60:0/1319417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c101a60 msgr2=0x7fc78c105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1319417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c101a60 0x7fc78c105aa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc780009990 tx=0x7fc780009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 -- 172.21.15.60:0/1319417405 shutdown_connections 2023-10-05T15:17:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1319417405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc78c1061d0 0x7fc78c10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1319417405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc78c1010b0 0x7fc78c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1319417405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c101a60 0x7fc78c105aa0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 -- 172.21.15.60:0/1319417405 >> 172.21.15.60:0/1319417405 conn(0x7fc78c0fc970 msgr2=0x7fc78c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 -- 172.21.15.60:0/1319417405 shutdown_connections 2023-10-05T15:17:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.404+0000 7fc790e1e700 1 -- 172.21.15.60:0/1319417405 wait complete. 2023-10-05T15:17:45.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 Processor -- start 2023-10-05T15:17:45.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 -- start start 2023-10-05T15:17:45.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 0x7fc78c196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc78c1061d0 0x7fc78c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc78c19b940 0x7fc78c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c19c3c0 con 0x7fc78c1010b0 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c19c530 con 0x7fc78c1061d0 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc790e1e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c19c6f0 con 0x7fc78c19b940 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 0x7fc78c196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.405+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 0x7fc78c196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39296/0 (socket says 172.21.15.60:39296) 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 -- 172.21.15.60:0/1892207361 learned_addr learned my addr 172.21.15.60:0/1892207361 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78ad9d700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc78c19b940 0x7fc78c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc789d9b700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc78c1061d0 0x7fc78c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 -- 172.21.15.60:0/1892207361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc78c19b940 msgr2=0x7fc78c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc78c19b940 0x7fc78c19bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 -- 172.21.15.60:0/1892207361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc78c1061d0 msgr2=0x7fc78c1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc78c1061d0 0x7fc78c1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 -- 172.21.15.60:0/1892207361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7800095f0 con 0x7fc78c1010b0 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc78a59c700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 0x7fc78c196fa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00e9a0 tx=0x7fc77c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc77b7fe700 1 -- 172.21.15.60:0/1892207361 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00cbd0 con 0x7fc78c1010b0 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c1a3c50 con 0x7fc78c1010b0 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c1a4180 con 0x7fc78c1010b0 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc77b7fe700 1 -- 172.21.15.60:0/1892207361 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc77c00cd30 con 0x7fc78c1010b0 2023-10-05T15:17:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.406+0000 7fc77b7fe700 1 -- 172.21.15.60:0/1892207361 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c018680 con 0x7fc78c1010b0 2023-10-05T15:17:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.410+0000 7fc77b7fe700 1 -- 172.21.15.60:0/1892207361 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7fc77c0187e0 con 0x7fc78c1010b0 2023-10-05T15:17:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.411+0000 7fc77b7fe700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc7740a1790 0x7fc7740a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.411+0000 7fc77b7fe700 1 -- 172.21.15.60:0/1892207361 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fc77c014070 con 0x7fc78c1010b0 2023-10-05T15:17:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.411+0000 7fc789d9b700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc7740a1790 0x7fc7740a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.411+0000 7fc79d008b80 1 Processor -- start 2023-10-05T15:17:45.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc789d9b700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc7740a1790 0x7fc7740a3c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc78000b2e0 tx=0x7fc780005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 -- start start 2023-10-05T15:17:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef50c0 0x5588f0ef54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0f00350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 0x5588f0f02c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0e5e460 con 0x5588f0f00890 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0e4fc20 con 0x5588f0ef50c0 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc79d008b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0e4d540 con 0x5588f0ef59e0 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc78ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 0x5588f0f02c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc78ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 0x5588f0f02c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39304/0 (socket says 172.21.15.60:39304) 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.412+0000 7fc78ad9d700 1 -- 172.21.15.60:0/3576561550 learned_addr learned my addr 172.21.15.60:0/3576561550 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc789d9b700 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0f00350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef50c0 0x5588f0ef54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 -- 172.21.15.60:0/3576561550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 msgr2=0x5588f0f00350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0f00350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 -- 172.21.15.60:0/3576561550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 msgr2=0x5588f0f02c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 0x5588f0f02c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 -- 172.21.15.60:0/3576561550 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588f0c73de0 con 0x5588f0ef50c0 2023-10-05T15:17:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78ad9d700 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 0x5588f0f02c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc78a59c700 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef50c0 0x5588f0ef54a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0cabe0 tx=0x7fc77c099ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8776e631002bf3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc778ff9700 1 -- 172.21.15.60:0/3576561550 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c09aaa0 con 0x5588f0ef50c0 2023-10-05T15:17:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc778ff9700 1 -- 172.21.15.60:0/3576561550 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc77c09a3a0 con 0x5588f0ef50c0 2023-10-05T15:17:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.413+0000 7fc778ff9700 1 -- 172.21.15.60:0/3576561550 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c099890 con 0x5588f0ef50c0 2023-10-05T15:17:45.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 -- 172.21.15.60:0/3576561550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef50c0 msgr2=0x5588f0ef54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef50c0 0x5588f0ef54a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0cabe0 tx=0x7fc77c099ee0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 -- 172.21.15.60:0/3576561550 shutdown_connections 2023-10-05T15:17:45.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0f00890 0x5588f0f02c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef50c0 0x5588f0ef54a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 --2- 172.21.15.60:0/3576561550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0f00350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.414+0000 7fc79d008b80 1 -- 172.21.15.60:0/3576561550 >> 172.21.15.60:0/3576561550 conn(0x5588f0e6a260 msgr2=0x5588f0ef1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.415+0000 7fc79d008b80 1 -- 172.21.15.60:0/3576561550 shutdown_connections 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.415+0000 7fc79d008b80 1 -- 172.21.15.60:0/3576561550 wait complete. 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.415+0000 7fc79d008b80 1 -- start start 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.415+0000 7fc79d008b80 1 Processor -- start 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f00260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0efd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0f00890 0x5588f0efdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0e48e30 con 0x5588f0ef50c0 2023-10-05T15:17:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0de5710 con 0x5588f0f00890 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0de53b0 con 0x5588f0ef59e0 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc79d008b80 10 client.0 _ll_register_callbacks cb 0x5588f0c42800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f00260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f00260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39308/0 (socket says 172.21.15.60:39308) 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 -- 172.21.15.60:0/153118761 learned_addr learned my addr 172.21.15.60:0/153118761 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78ad9d700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0f00890 0x5588f0efdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc789d9b700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0efd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 -- 172.21.15.60:0/153118761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 msgr2=0x5588f0efd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0efd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 -- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0f00890 msgr2=0x5588f0efdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0f00890 0x5588f0efdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 -- 172.21.15.60:0/153118761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784009050 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78ad9d700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0f00890 0x5588f0efdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc789d9b700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0efd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc78a59c700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f00260 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc77c01e000 tx=0x7fc77c09aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d0d179a98f59e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.416+0000 7fc771ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc771ffb700 1 -- 172.21.15.60:0/153118761 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c099aa0 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc771ffb700 1 -- 172.21.15.60:0/153118761 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fc77c0a22a0 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588f0ee8f10 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc771ffb700 1 -- 172.21.15.60:0/153118761 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc77c0a2460 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 10 client.15996 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fc78c1a4180 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc771ffb700 1 -- 172.21.15.60:0/153118761 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5588f0ee8f10 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc771ffb700 1 -- 172.21.15.60:0/153118761 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc77c099420 con 0x5588f0ef50c0 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 10 client.15996 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 10 client.15996 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 20 client.15996 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f0fff0 0x5588f0f12410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 4 client.15996 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588f0e41e10 con 0x5588f0f0fff0 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.417+0000 7fc789d9b700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f0fff0 0x5588f0f12410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.418+0000 7fc771ffb700 10 client.15996 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.418+0000 7fc789d9b700 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f0fff0 0x5588f0f12410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8b09f3ef48b62a3f server_cookie=7fd62a8e0bb10411 in_seq=0 out_seq=0 2023-10-05T15:17:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc771ffb700 1 -- 172.21.15.60:0/153118761 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588f0e41e10 con 0x5588f0f0fff0 2023-10-05T15:17:45.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc771ffb700 10 client.15996 handle_command_reply: tid=0 2023-10-05T15:17:45.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 client.15996 shutdown 2023-10-05T15:17:45.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 msgr2=0x5588f0f00260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f00260 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc77c01e000 tx=0x7fc77c09aaa0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 shutdown_connections 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0f00890 0x5588f0efdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f0fff0 0x5588f0f12410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f00260 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc771ffb700 0 client.15996 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 --2- 172.21.15.60:0/153118761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0ef59e0 0x5588f0efd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 >> 172.21.15.60:0/153118761 conn(0x5588f0e6a260 msgr2=0x5588f0ef0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 shutdown_connections 2023-10-05T15:17:45.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 1 -- 172.21.15.60:0/153118761 wait complete. 2023-10-05T15:17:45.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.419+0000 7fc79d008b80 20 client.15996 trim_cache size 0 max 16384 2023-10-05T15:17:45.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 Processor -- start 2023-10-05T15:17:45.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 -- start start 2023-10-05T15:17:45.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0efcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0effe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0ef8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0cc9920 con 0x5588f0ef50c0 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0ef7fc0 con 0x5588f0ef59e0 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc79d008b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0efd1e0 con 0x5588f0f00890 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0efcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0efcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39316/0 (socket says 172.21.15.60:39316) 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc78a59c700 1 -- 172.21.15.60:0/2075052949 learned_addr learned my addr 172.21.15.60:0/2075052949 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.433+0000 7fc789d9b700 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0effe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78ad9d700 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0ef8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78a59c700 1 -- 172.21.15.60:0/2075052949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 msgr2=0x5588f0ef8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78a59c700 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0ef8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78a59c700 1 -- 172.21.15.60:0/2075052949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 msgr2=0x5588f0effe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78a59c700 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0effe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78a59c700 1 -- 172.21.15.60:0/2075052949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588f0c5cc60 con 0x5588f0ef50c0 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc78a59c700 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0efcca0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c5b0 tx=0x7fc77c099ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69398727dacbfc18 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc7797fa700 1 -- 172.21.15.60:0/2075052949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c018ea0 con 0x5588f0ef50c0 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc7797fa700 1 -- 172.21.15.60:0/2075052949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc77c09e4f0 con 0x5588f0ef50c0 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.434+0000 7fc7797fa700 1 -- 172.21.15.60:0/2075052949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0a2500 con 0x5588f0ef50c0 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 -- 172.21.15.60:0/2075052949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 msgr2=0x5588f0efcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0efcca0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c5b0 tx=0x7fc77c099ee0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 -- 172.21.15.60:0/2075052949 shutdown_connections 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0ef8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0efcca0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 --2- 172.21.15.60:0/2075052949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0effe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 -- 172.21.15.60:0/2075052949 >> 172.21.15.60:0/2075052949 conn(0x5588f0e6a260 msgr2=0x5588f0eefbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 -- 172.21.15.60:0/2075052949 shutdown_connections 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.435+0000 7fc79d008b80 1 -- 172.21.15.60:0/2075052949 wait complete. 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 -- start start 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 Processor -- start 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f07400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0f057b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0f05d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0f06430 con 0x5588f0ef50c0 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0f065a0 con 0x5588f0ef59e0 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588f0f63e30 con 0x5588f0f00890 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc79d008b80 10 client.0 _ll_register_callbacks cb 0x7fc784009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:45.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc789d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0f057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc789d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0f057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52746/0 (socket says 172.21.15.60:52746) 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc789d9b700 1 -- 172.21.15.60:0/1170047093 learned_addr learned my addr 172.21.15.60:0/1170047093 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.436+0000 7fc78ad9d700 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0f05d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc789d9b700 1 -- 172.21.15.60:0/1170047093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 msgr2=0x5588f0f05d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc789d9b700 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0f05d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc789d9b700 1 -- 172.21.15.60:0/1170047093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 msgr2=0x5588f0f07400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc789d9b700 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f07400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc789d9b700 1 -- 172.21.15.60:0/1170047093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c1a4180 con 0x5588f0ef59e0 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc789d9b700 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0f057b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7800055f0 tx=0x7fc780009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c06b61609204ff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc771ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc771ffb700 1 -- 172.21.15.60:0/1170047093 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000be40 con 0x5588f0ef59e0 2023-10-05T15:17:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc771ffb700 1 -- 172.21.15.60:0/1170047093 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7fc780036150 con 0x5588f0ef59e0 2023-10-05T15:17:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588f0e41b30 con 0x5588f0ef59e0 2023-10-05T15:17:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc771ffb700 1 -- 172.21.15.60:0/1170047093 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc780036310 con 0x5588f0ef59e0 2023-10-05T15:17:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc79d008b80 10 client.25709 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.437+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5588f0c9a250 con 0x5588f0ef59e0 2023-10-05T15:17:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc771ffb700 1 -- 172.21.15.60:0/1170047093 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5588f0e41b30 con 0x5588f0ef59e0 2023-10-05T15:17:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc771ffb700 1 -- 172.21.15.60:0/1170047093 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc78000f5f0 con 0x5588f0ef59e0 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc79d008b80 10 client.25709 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc79d008b80 10 client.25709 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc79d008b80 20 client.25709 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc79d008b80 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f65540 0x5588f0f67960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc79d008b80 4 client.25709 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5588f0c94f70 con 0x5588f0f65540 2023-10-05T15:17:45.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc78a59c700 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f65540 0x5588f0f67960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc771ffb700 10 client.25709 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:45.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.438+0000 7fc78a59c700 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f65540 0x5588f0f67960 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=71bee50d9065db6 server_cookie=6f6291a4a307018c in_seq=0 out_seq=0 2023-10-05T15:17:45.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc771ffb700 1 -- 172.21.15.60:0/1170047093 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5588f0c94f70 con 0x5588f0f65540 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc771ffb700 10 client.25709 handle_command_reply: tid=0 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 client.25709 shutdown 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 msgr2=0x5588f0f057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0f057b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7800055f0 tx=0x7fc780009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 shutdown_connections 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588f0f00890 0x5588f0f05d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x5588f0f65540 0x5588f0f67960 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5588f0ef50c0 0x5588f0f07400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 --2- 172.21.15.60:0/1170047093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588f0ef59e0 0x5588f0f057b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 >> 172.21.15.60:0/1170047093 conn(0x5588f0e6a260 msgr2=0x5588f0ef8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc771ffb700 0 client.25709 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:17:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 shutdown_connections 2023-10-05T15:17:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 1 -- 172.21.15.60:0/1170047093 wait complete. 2023-10-05T15:17:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.439+0000 7fc79d008b80 20 client.25709 trim_cache size 0 max 16384 2023-10-05T15:17:45.447 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc7740a1790 msgr2=0x7fc7740a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc7740a1790 0x7fc7740a3c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc78000b2e0 tx=0x7fc780005960 comp rx=0 tx=0).stop 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 msgr2=0x7fc78c196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 0x7fc78c196fa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00e9a0 tx=0x7fc77c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 shutdown_connections 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc78c19b940 0x7fc78c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc78c1010b0 0x7fc78c196fa0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc7740a1790 0x7fc7740a3c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 --2- 172.21.15.60:0/1892207361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc78c1061d0 0x7fc78c1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 >> 172.21.15.60:0/1892207361 conn(0x7fc78c0fc970 msgr2=0x7fc78c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 shutdown_connections 2023-10-05T15:17:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.440+0000 7fc790e1e700 1 -- 172.21.15.60:0/1892207361 wait complete. 2023-10-05T15:17:45.455 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:45 smithi060 ceph-mon[99238]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-05T15:17:45.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-05T15:17:45.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:45 smithi135 ceph-mon[103360]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-05T15:17:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 -- 172.21.15.60:0/304650917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40500fff90 msgr2=0x7f4050100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 --2- 172.21.15.60:0/304650917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40500fff90 0x7f4050100370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4044009990 tx=0x7f4044009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 -- 172.21.15.60:0/304650917 shutdown_connections 2023-10-05T15:17:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 --2- 172.21.15.60:0/304650917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40501050b0 0x7f405010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 --2- 172.21.15.60:0/304650917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40500fff90 0x7f4050100370 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 --2- 172.21.15.60:0/304650917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4050100940 0x7f4050104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 -- 172.21.15.60:0/304650917 >> 172.21.15.60:0/304650917 conn(0x7f40500fb830 msgr2=0x7f40500fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 -- 172.21.15.60:0/304650917 shutdown_connections 2023-10-05T15:17:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.599+0000 7f4055be1700 1 -- 172.21.15.60:0/304650917 wait complete. 2023-10-05T15:17:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 Processor -- start 2023-10-05T15:17:45.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 -- start start 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40500fff90 0x7f4050196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40501050b0 0x7f40501974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 0x7f405019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405019c3c0 con 0x7f405019b940 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405019c530 con 0x7f40501050b0 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f4055be1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405019c6f0 con 0x7f40500fff90 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.600+0000 7f404ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 0x7f405019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40500fff90 0x7f4050196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 0x7f405019bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39340/0 (socket says 172.21.15.60:39340) 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404ffff700 1 -- 172.21.15.60:0/1072023790 learned_addr learned my addr 172.21.15.60:0/1072023790 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404effd700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40501050b0 0x7f40501974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 -- 172.21.15.60:0/1072023790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40501050b0 msgr2=0x7f40501974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40501050b0 0x7f40501974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 -- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 msgr2=0x7f405019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 0x7f405019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 -- 172.21.15.60:0/1072023790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440095f0 con 0x7f40500fff90 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404ffff700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 0x7f405019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404f7fe700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40500fff90 0x7f4050196fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4044006010 tx=0x7f4044004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.601+0000 7f404cff9700 1 -- 172.21.15.60:0/1072023790 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404401d070 con 0x7f40500fff90 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.602+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405010d2e0 con 0x7f40500fff90 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.602+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405010d7e0 con 0x7f40500fff90 2023-10-05T15:17:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.602+0000 7f404cff9700 1 -- 172.21.15.60:0/1072023790 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4044022470 con 0x7f40500fff90 2023-10-05T15:17:45.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.602+0000 7f404cff9700 1 -- 172.21.15.60:0/1072023790 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044017650 con 0x7f40500fff90 2023-10-05T15:17:45.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.605+0000 7f404cff9700 1 -- 172.21.15.60:0/1072023790 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f404400fb10 con 0x7f40500fff90 2023-10-05T15:17:45.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.606+0000 7f404cff9700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f40380a1790 0x7f40380a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.606+0000 7f4061dcbb80 1 Processor -- start 2023-10-05T15:17:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.606+0000 7f404cff9700 1 -- 172.21.15.60:0/1072023790 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f40440ce700 con 0x7f40500fff90 2023-10-05T15:17:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.606+0000 7f4061dcbb80 1 -- start start 2023-10-05T15:17:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.606+0000 7f404effd700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f40380a1790 0x7f40380a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d274a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d32350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d34c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378c90460 con 0x55f378d32890 2023-10-05T15:17:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378c81c20 con 0x55f378d270c0 2023-10-05T15:17:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378c7f540 con 0x55f378d279e0 2023-10-05T15:17:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d274a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52766/0 (socket says 172.21.15.60:52766) 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 -- 172.21.15.60:0/847243858 learned_addr learned my addr 172.21.15.60:0/847243858 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404effd700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f40380a1790 0x7f40380a3c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40501985b0 tx=0x7f4040009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404effd700 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d32350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 -- 172.21.15.60:0/847243858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 msgr2=0x55f378d32350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d32350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 -- 172.21.15.60:0/847243858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 msgr2=0x55f378d34c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d34c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.607+0000 7f404f7fe700 1 -- 172.21.15.60:0/847243858 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f378aa5de0 con 0x55f378d270c0 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.608+0000 7f404f7fe700 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d274a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4044009990 tx=0x7f404409ac20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5611f5f0123654a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.608+0000 7f4035ffb700 1 -- 172.21.15.60:0/847243858 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404409b240 con 0x55f378d270c0 2023-10-05T15:17:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.608+0000 7f4035ffb700 1 -- 172.21.15.60:0/847243858 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f404409f390 con 0x55f378d270c0 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.608+0000 7f4035ffb700 1 -- 172.21.15.60:0/847243858 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404409a730 con 0x55f378d270c0 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 -- 172.21.15.60:0/847243858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 msgr2=0x55f378d274a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d274a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4044009990 tx=0x7f404409ac20 comp rx=0 tx=0).stop 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 -- 172.21.15.60:0/847243858 shutdown_connections 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d34c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d274a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/847243858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d32350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 -- 172.21.15.60:0/847243858 >> 172.21.15.60:0/847243858 conn(0x55f378c9c260 msgr2=0x55f378d23450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 -- 172.21.15.60:0/847243858 shutdown_connections 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 -- 172.21.15.60:0/847243858 wait complete. 2023-10-05T15:17:45.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.609+0000 7f4061dcbb80 1 -- start start 2023-10-05T15:17:45.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 Processor -- start 2023-10-05T15:17:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 0x55f378d379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d279e0 0x55f378d37f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d31860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378c7ae30 con 0x55f378d32890 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378c17710 con 0x55f378d279e0 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378c173b0 con 0x55f378d270c0 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f4061dcbb80 10 client.0 _ll_register_callbacks cb 0x55f378a74800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 0x55f378d379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f404effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d279e0 0x55f378d37f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 0x55f378d379f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52880/0 (socket says 172.21.15.60:52880) 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f404ffff700 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d31860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.610+0000 7f404f7fe700 1 -- 172.21.15.60:0/3700927090 learned_addr learned my addr 172.21.15.60:0/3700927090 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f404f7fe700 1 -- 172.21.15.60:0/3700927090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d279e0 msgr2=0x55f378d37f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f404f7fe700 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d279e0 0x55f378d37f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f404f7fe700 1 -- 172.21.15.60:0/3700927090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 msgr2=0x55f378d31860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f404f7fe700 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d31860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f404f7fe700 1 -- 172.21.15.60:0/3700927090 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405010d7e0 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f404f7fe700 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 0x55f378d379f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4044099590 tx=0x7f40440cb9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864bccf81bce7cfc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f402effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f402effd700 1 -- 172.21.15.60:0/3700927090 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440b7070 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f402effd700 1 -- 172.21.15.60:0/3700927090 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f404400fdc0 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f378d1af10 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f402effd700 1 -- 172.21.15.60:0/3700927090 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f404409b240 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f4061dcbb80 10 client.25573 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.611+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f378a8ec60 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f402effd700 1 -- 172.21.15.60:0/3700927090 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4044080080 con 0x55f378d270c0 2023-10-05T15:17:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f402effd700 1 -- 172.21.15.60:0/3700927090 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f40440a3140 con 0x55f378d270c0 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f4061dcbb80 10 client.25573 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f4061dcbb80 10 client.25573 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f4061dcbb80 20 client.25573 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d419c0 0x55f378d43de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f4061dcbb80 4 client.25573 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f378c73e10 con 0x55f378d419c0 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.612+0000 7f404effd700 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d419c0 0x55f378d43de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.613+0000 7f404effd700 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d419c0 0x55f378d43de0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=16f8082f0fe2c3cc server_cookie=916975d17fc8a3c2 in_seq=0 out_seq=0 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.613+0000 7f402effd700 10 client.25573 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.613+0000 7f402effd700 1 -- 172.21.15.60:0/3700927090 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f378c73e10 con 0x55f378d419c0 2023-10-05T15:17:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.613+0000 7f402effd700 10 client.25573 handle_command_reply: tid=0 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.613+0000 7f4061dcbb80 1 client.25573 shutdown 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 msgr2=0x55f378d379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 0x55f378d379f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4044099590 tx=0x7f40440cb9b0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 shutdown_connections 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d419c0 0x55f378d43de0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d31860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d270c0 0x55f378d379f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3700927090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d279e0 0x55f378d37f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 >> 172.21.15.60:0/3700927090 conn(0x55f378c9c260 msgr2=0x55f378d23040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f402effd700 0 client.25573 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 shutdown_connections 2023-10-05T15:17:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3700927090 wait complete. 2023-10-05T15:17:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.614+0000 7f4061dcbb80 20 client.25573 trim_cache size 0 max 16384 2023-10-05T15:17:45.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.639+0000 7f4061dcbb80 1 Processor -- start 2023-10-05T15:17:45.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 -- start start 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d2cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 0x55f378d2d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d32890 0x55f378d31100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378afb920 con 0x55f378d279e0 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378d23670 con 0x55f378d270c0 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378d237b0 con 0x55f378d32890 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 0x55f378d2d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 0x55f378d2d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39360/0 (socket says 172.21.15.60:39360) 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 -- 172.21.15.60:0/3658718396 learned_addr learned my addr 172.21.15.60:0/3658718396 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404f7fe700 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d2cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404ffff700 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d32890 0x55f378d31100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 -- 172.21.15.60:0/3658718396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d32890 msgr2=0x55f378d31100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d32890 0x55f378d31100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 -- 172.21.15.60:0/3658718396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 msgr2=0x55f378d2cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d2cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.640+0000 7f404effd700 1 -- 172.21.15.60:0/3658718396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f378acc250 con 0x55f378d279e0 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.641+0000 7f404effd700 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 0x55f378d2d0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4040009b20 tx=0x7f4040014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e354c2b6196e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.641+0000 7f40367fc700 1 -- 172.21.15.60:0/3658718396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040022040 con 0x55f378d279e0 2023-10-05T15:17:45.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.641+0000 7f40367fc700 1 -- 172.21.15.60:0/3658718396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4040011d20 con 0x55f378d279e0 2023-10-05T15:17:45.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.641+0000 7f40367fc700 1 -- 172.21.15.60:0/3658718396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040004e60 con 0x55f378d279e0 2023-10-05T15:17:45.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3658718396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 msgr2=0x55f378d2d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 0x55f378d2d0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4040009b20 tx=0x7f4040014000 comp rx=0 tx=0).stop 2023-10-05T15:17:45.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3658718396 shutdown_connections 2023-10-05T15:17:45.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d32890 0x55f378d31100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d2cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/3658718396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d279e0 0x55f378d2d0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3658718396 >> 172.21.15.60:0/3658718396 conn(0x55f378c9c260 msgr2=0x55f378d48740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3658718396 shutdown_connections 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 -- 172.21.15.60:0/3658718396 wait complete. 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.642+0000 7f4061dcbb80 1 -- start start 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 Processor -- start 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d89970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d89eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d94800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378d94d40 con 0x55f378d32890 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378d94eb0 con 0x55f378d270c0 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378d95070 con 0x55f378d279e0 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f4061dcbb80 10 client.0 _ll_register_callbacks cb 0x7f404409ae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f404ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d94800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f404ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d94800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39368/0 (socket says 172.21.15.60:39368) 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f404ffff700 1 -- 172.21.15.60:0/675371595 learned_addr learned my addr 172.21.15.60:0/675371595 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.643+0000 7f404f7fe700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d89970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404ffff700 1 -- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 msgr2=0x55f378d89eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404ffff700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d89eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404ffff700 1 -- 172.21.15.60:0/675371595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 msgr2=0x55f378d89970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404ffff700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d89970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404ffff700 1 -- 172.21.15.60:0/675371595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4040017070 con 0x55f378d32890 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404f7fe700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d89970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f404ffff700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d94800 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4048015330 tx=0x7f4048015410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d4a4b741c3e5b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f402effd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f402effd700 1 -- 172.21.15.60:0/675371595 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048015e10 con 0x55f378d32890 2023-10-05T15:17:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f402effd700 1 -- 172.21.15.60:0/675371595 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f4048004bb0 con 0x55f378d32890 2023-10-05T15:17:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.644+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f404409f390 con 0x55f378d32890 2023-10-05T15:17:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f402effd700 1 -- 172.21.15.60:0/675371595 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4048004d70 con 0x55f378d32890 2023-10-05T15:17:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 10 client.16014 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f378aa42b0 con 0x55f378d32890 2023-10-05T15:17:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f402effd700 1 -- 172.21.15.60:0/675371595 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f404409f390 con 0x55f378d32890 2023-10-05T15:17:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f402effd700 1 -- 172.21.15.60:0/675371595 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f404804b490 con 0x55f378d32890 2023-10-05T15:17:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 10 client.16014 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 10 client.16014 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 20 client.16014 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d967d0 0x55f378d98c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 4 client.16014 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f378c73b30 con 0x55f378d967d0 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.645+0000 7f404f7fe700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d967d0 0x55f378d98c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.646+0000 7f402effd700 10 client.16014 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.646+0000 7f404f7fe700 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d967d0 0x55f378d98c10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=110165812158ad62 server_cookie=e6b2bf0927709260 in_seq=0 out_seq=0 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.646+0000 7f402effd700 1 -- 172.21.15.60:0/675371595 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f378c73b30 con 0x55f378d967d0 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.646+0000 7f402effd700 10 client.16014 handle_command_reply: tid=0 2023-10-05T15:17:45.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.646+0000 7f4061dcbb80 1 client.16014 shutdown 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 msgr2=0x55f378d94800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d94800 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4048015330 tx=0x7f4048015410 comp rx=0 tx=0).stop 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 shutdown_connections 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55f378d967d0 0x55f378d98c10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f378d32890 0x55f378d94800 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f378d270c0 0x55f378d89970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 --2- 172.21.15.60:0/675371595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f378d279e0 0x55f378d89eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 >> 172.21.15.60:0/675371595 conn(0x55f378c9c260 msgr2=0x55f378d317c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f402effd700 0 client.16014 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:17:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 shutdown_connections 2023-10-05T15:17:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 1 -- 172.21.15.60:0/675371595 wait complete. 2023-10-05T15:17:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4061dcbb80 20 client.16014 trim_cache size 0 max 16384 2023-10-05T15:17:45.655 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f40380a1790 msgr2=0x7f40380a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4055be1700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f40380a1790 0x7f40380a3c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40501985b0 tx=0x7f4040009260 comp rx=0 tx=0).stop 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40500fff90 msgr2=0x7f4050196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.647+0000 7f4055be1700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40500fff90 0x7f4050196fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4044006010 tx=0x7f4044004730 comp rx=0 tx=0).stop 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 shutdown_connections 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f405019b940 0x7f405019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40500fff90 0x7f4050196fa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f40380a1790 0x7f40380a3c50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 --2- 172.21.15.60:0/1072023790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40501050b0 0x7f40501974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 >> 172.21.15.60:0/1072023790 conn(0x7f40500fb830 msgr2=0x7f40500fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 shutdown_connections 2023-10-05T15:17:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.648+0000 7f4055be1700 1 -- 172.21.15.60:0/1072023790 wait complete. 2023-10-05T15:17:45.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-05T15:17:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:45 smithi092 ceph-mon[102944]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-05T15:17:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 -- 172.21.15.60:0/2119413656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 msgr2=0x7facd810dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 --2- 172.21.15.60:0/2119413656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd810dd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facd000b0a0 tx=0x7facd000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 -- 172.21.15.60:0/2119413656 shutdown_connections 2023-10-05T15:17:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 --2- 172.21.15.60:0/2119413656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd810dd60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 --2- 172.21.15.60:0/2119413656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd81010c0 0x7facd81014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 --2- 172.21.15.60:0/2119413656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd8101a70 0x7facd8105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 -- 172.21.15.60:0/2119413656 >> 172.21.15.60:0/2119413656 conn(0x7facd80fc960 msgr2=0x7facd80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 -- 172.21.15.60:0/2119413656 shutdown_connections 2023-10-05T15:17:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.863+0000 7facdd4dd700 1 -- 172.21.15.60:0/2119413656 wait complete. 2023-10-05T15:17:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 Processor -- start 2023-10-05T15:17:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 -- start start 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd81010c0 0x7facd8196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd8197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd819b8e0 0x7facd819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd819c360 con 0x7facd81010c0 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd819c4d0 con 0x7facd81061e0 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facdd4dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd819c690 con 0x7facd819b8e0 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd81010c0 0x7facd8196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd81010c0 0x7facd8196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39378/0 (socket says 172.21.15.60:39378) 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.864+0000 7facd6ffd700 1 -- 172.21.15.60:0/4069959705 learned_addr learned my addr 172.21.15.60:0/4069959705 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd8197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 -- 172.21.15.60:0/4069959705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd819b8e0 msgr2=0x7facd819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd819b8e0 0x7facd819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 -- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd81010c0 msgr2=0x7facd8196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd81010c0 0x7facd8196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 -- 172.21.15.60:0/4069959705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0009d00 con 0x7facd81061e0 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.865+0000 7facd67fc700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd8197480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facd8067db0 tx=0x7faccc00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.866+0000 7facbffff700 1 -- 172.21.15.60:0/4069959705 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc009930 con 0x7facd81061e0 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.866+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd8073140 con 0x7facd81061e0 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.866+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd80736a0 con 0x7facd81061e0 2023-10-05T15:17:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.866+0000 7facbffff700 1 -- 172.21.15.60:0/4069959705 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faccc010460 con 0x7facd81061e0 2023-10-05T15:17:45.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.866+0000 7facbffff700 1 -- 172.21.15.60:0/4069959705 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00b5d0 con 0x7facd81061e0 2023-10-05T15:17:45.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.869+0000 7facbffff700 1 -- 172.21.15.60:0/4069959705 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7faccc009a90 con 0x7facd81061e0 2023-10-05T15:17:45.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.870+0000 7facbffff700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7facc00a1790 0x7facc00a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.870+0000 7facd6ffd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7facc00a1790 0x7facc00a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.870+0000 7facbffff700 1 -- 172.21.15.60:0/4069959705 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7faccc0cc650 con 0x7facd81061e0 2023-10-05T15:17:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7facd6ffd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7facc00a1790 0x7facc00a3c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7facc8007c90 tx=0x7facc8007480 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 Processor -- start 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 -- start start 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a35d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a368350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a2c6460 con 0x558e4a35d0c0 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a2b7c20 con 0x558e4a35d9e0 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.871+0000 7face96c7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a2b5540 con 0x558e4a368890 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a35d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a35d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39386/0 (socket says 172.21.15.60:39386) 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 -- 172.21.15.60:0/3384623871 learned_addr learned my addr 172.21.15.60:0/3384623871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd77fe700 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd67fc700 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a368350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 -- 172.21.15.60:0/3384623871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 msgr2=0x558e4a36ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 -- 172.21.15.60:0/3384623871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 msgr2=0x558e4a368350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a368350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 -- 172.21.15.60:0/3384623871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e4a0dbde0 con 0x558e4a35d0c0 2023-10-05T15:17:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facd6ffd700 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a35d4a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7facc8010fa0 tx=0x7facc8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc58de146b7d71d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facbd7fa700 1 -- 172.21.15.60:0/3384623871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8011db0 con 0x558e4a35d0c0 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.872+0000 7facbd7fa700 1 -- 172.21.15.60:0/3384623871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facc8015070 con 0x558e4a35d0c0 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.873+0000 7facbd7fa700 1 -- 172.21.15.60:0/3384623871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc801c610 con 0x558e4a35d0c0 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.873+0000 7face96c7b80 1 -- 172.21.15.60:0/3384623871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 msgr2=0x558e4a35d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.873+0000 7face96c7b80 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a35d4a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7facc8010fa0 tx=0x7facc8013000 comp rx=0 tx=0).stop 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 -- 172.21.15.60:0/3384623871 shutdown_connections 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a35d4a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 --2- 172.21.15.60:0/3384623871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a368350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 -- 172.21.15.60:0/3384623871 >> 172.21.15.60:0/3384623871 conn(0x558e4a2d2260 msgr2=0x558e4a359450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 -- 172.21.15.60:0/3384623871 shutdown_connections 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 -- 172.21.15.60:0/3384623871 wait complete. 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 -- start start 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.874+0000 7face96c7b80 1 Processor -- start 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 0x558e4a3681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d9e0 0x558e4a365440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a368890 0x558e4a365a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a2b0e30 con 0x558e4a35d9e0 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a24d710 con 0x558e4a368890 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a24d3b0 con 0x558e4a35d0c0 2023-10-05T15:17:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7face96c7b80 10 client.0 _ll_register_callbacks cb 0x558e4a0aa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 0x558e4a3681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 0x558e4a3681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52922/0 (socket says 172.21.15.60:52922) 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 -- 172.21.15.60:0/2243572672 learned_addr learned my addr 172.21.15.60:0/2243572672 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 -- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a368890 msgr2=0x558e4a365a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a368890 0x558e4a365a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 -- 172.21.15.60:0/2243572672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d9e0 msgr2=0x558e4a365440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d9e0 0x558e4a365440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.875+0000 7facd6ffd700 1 -- 172.21.15.60:0/2243572672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8010c50 con 0x558e4a35d0c0 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7facd6ffd700 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 0x558e4a3681c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7facc8010f70 tx=0x7facc801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf85a2445ead5aa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7facbaff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:17:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7facbaff5700 1 -- 172.21.15.60:0/2243572672 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc802c070 con 0x558e4a35d0c0 2023-10-05T15:17:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e4a350f10 con 0x558e4a35d0c0 2023-10-05T15:17:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7facbaff5700 1 -- 172.21.15.60:0/2243572672 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7facc8017070 con 0x558e4a35d0c0 2023-10-05T15:17:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7facbaff5700 1 -- 172.21.15.60:0/2243572672 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7facc801e630 con 0x558e4a35d0c0 2023-10-05T15:17:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7face96c7b80 10 client.25585 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558e4a0c4c60 con 0x558e4a35d0c0 2023-10-05T15:17:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.876+0000 7facbaff5700 1 -- 172.21.15.60:0/2243572672 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558e4a350f10 con 0x558e4a35d0c0 2023-10-05T15:17:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7facbaff5700 1 -- 172.21.15.60:0/2243572672 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7facc801a3a0 con 0x558e4a35d0c0 2023-10-05T15:17:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7face96c7b80 10 client.25585 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7face96c7b80 10 client.25585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:17:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7face96c7b80 20 client.25585 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7face96c7b80 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a378250 0x558e4a37a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7face96c7b80 4 client.25585 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e4a2a9e10 con 0x558e4a378250 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.877+0000 7facd67fc700 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a378250 0x558e4a37a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7facbaff5700 10 client.25585 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7facd67fc700 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a378250 0x558e4a37a670 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a5f108d44f59b4b server_cookie=db9da02024845ca8 in_seq=0 out_seq=0 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7facbaff5700 1 -- 172.21.15.60:0/2243572672 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558e4a2a9e10 con 0x558e4a378250 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7facbaff5700 10 client.25585 handle_command_reply: tid=0 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7face96c7b80 1 client.25585 shutdown 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 msgr2=0x558e4a3681c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.878+0000 7face96c7b80 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 0x558e4a3681c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7facc8010f70 tx=0x7facc801ebb0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 shutdown_connections 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a378250 0x558e4a37a670 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a368890 0x558e4a365a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d0c0 0x558e4a3681c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 --2- 172.21.15.60:0/2243572672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d9e0 0x558e4a365440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 >> 172.21.15.60:0/2243572672 conn(0x558e4a2d2260 msgr2=0x558e4a358fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7facbaff5700 0 client.25585 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 shutdown_connections 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 1 -- 172.21.15.60:0/2243572672 wait complete. 2023-10-05T15:17:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.879+0000 7face96c7b80 20 client.25585 trim_cache size 0 max 16384 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 Processor -- start 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 -- start start 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d0c0 0x558e4a36f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d9e0 0x558e4a364c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 0x558e4a367d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a131920 con 0x558e4a368890 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a35ddc0 con 0x558e4a35d0c0 2023-10-05T15:17:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7face96c7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a35e8b0 con 0x558e4a35d9e0 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7facd77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 0x558e4a367d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7facd77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 0x558e4a367d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39402/0 (socket says 172.21.15.60:39402) 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7facd77fe700 1 -- 172.21.15.60:0/2969697287 learned_addr learned my addr 172.21.15.60:0/2969697287 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.904+0000 7facd67fc700 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d9e0 0x558e4a364c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd6ffd700 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d0c0 0x558e4a36f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd77fe700 1 -- 172.21.15.60:0/2969697287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d9e0 msgr2=0x558e4a364c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd77fe700 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d9e0 0x558e4a364c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd77fe700 1 -- 172.21.15.60:0/2969697287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d0c0 msgr2=0x558e4a36f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd77fe700 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d0c0 0x558e4a36f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd77fe700 1 -- 172.21.15.60:0/2969697287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e4a357e90 con 0x558e4a368890 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facd77fe700 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 0x558e4a367d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7facd0015000 tx=0x7facd0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e146b884519333 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facbdffb700 1 -- 172.21.15.60:0/2969697287 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000e040 con 0x558e4a368890 2023-10-05T15:17:45.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facbdffb700 1 -- 172.21.15.60:0/2969697287 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facd00074e0 con 0x558e4a368890 2023-10-05T15:17:45.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.905+0000 7facbdffb700 1 -- 172.21.15.60:0/2969697287 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd001c8a0 con 0x558e4a368890 2023-10-05T15:17:45.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 -- 172.21.15.60:0/2969697287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 msgr2=0x558e4a367d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 0x558e4a367d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7facd0015000 tx=0x7facd0009220 comp rx=0 tx=0).stop 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 -- 172.21.15.60:0/2969697287 shutdown_connections 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a368890 0x558e4a367d60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d0c0 0x558e4a36f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 --2- 172.21.15.60:0/2969697287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a35d9e0 0x558e4a364c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 -- 172.21.15.60:0/2969697287 >> 172.21.15.60:0/2969697287 conn(0x558e4a2d2260 msgr2=0x558e4a365400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 -- 172.21.15.60:0/2969697287 shutdown_connections 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.906+0000 7face96c7b80 1 -- 172.21.15.60:0/2969697287 wait complete. 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 -- start start 2023-10-05T15:17:45.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 Processor -- start 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a36f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a36b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a36bf20 con 0x558e4a35d0c0 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a36c090 con 0x558e4a35d9e0 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4a36c250 con 0x558e4a368890 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7face96c7b80 10 client.0 _ll_register_callbacks cb 0x7facd000b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a36f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a36f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39404/0 (socket says 172.21.15.60:39404) 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.907+0000 7facd6ffd700 1 -- 172.21.15.60:0/688286729 learned_addr learned my addr 172.21.15.60:0/688286729 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd77fe700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd6ffd700 1 -- 172.21.15.60:0/688286729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 msgr2=0x558e4a36b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd6ffd700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd6ffd700 1 -- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 msgr2=0x558e4a36b410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd6ffd700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a36b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd6ffd700 1 -- 172.21.15.60:0/688286729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd810e5d0 con 0x558e4a35d0c0 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd77fe700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:45.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facd6ffd700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a36f110 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7facc801a5d0 tx=0x7facc8011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22818517c08c25fc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facbaff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facbaff5700 1 -- 172.21.15.60:0/688286729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc802c070 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facbaff5700 1 -- 172.21.15.60:0/688286729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7facc8017040 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facc8015070 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7facbaff5700 1 -- 172.21.15.60:0/688286729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7facc801aee0 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7face96c7b80 10 client.16029 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.908+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558e4a102250 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7facbaff5700 1 -- 172.21.15.60:0/688286729 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facc8015070 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7facbaff5700 1 -- 172.21.15.60:0/688286729 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7facc8039040 con 0x558e4a35d0c0 2023-10-05T15:17:45.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7face96c7b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7face96c7b80 10 client.16029 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7face96c7b80 20 client.16029 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7face96c7b80 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a3cd1d0 0x558e4a3cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7face96c7b80 4 client.16029 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558e4a2a9b30 con 0x558e4a3cd1d0 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.909+0000 7facd67fc700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a3cd1d0 0x558e4a3cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7facbaff5700 10 client.16029 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7facd67fc700 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a3cd1d0 0x558e4a3cf5c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af937b32b8af3562 server_cookie=f5cdd18f5ff5b2 in_seq=0 out_seq=0 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7facbaff5700 1 -- 172.21.15.60:0/688286729 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558e4a2a9b30 con 0x558e4a3cd1d0 2023-10-05T15:17:45.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7facbaff5700 10 client.16029 handle_command_reply: tid=0 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 client.16029 shutdown 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 msgr2=0x558e4a36f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a36f110 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7facc801a5d0 tx=0x7facc8011cd0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 shutdown_connections 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x558e4a3cd1d0 0x558e4a3cf5c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e4a368890 0x558e4a36b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e4a35d0c0 0x558e4a36f110 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 --2- 172.21.15.60:0/688286729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e4a35d9e0 0x558e4a36b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 >> 172.21.15.60:0/688286729 conn(0x558e4a2d2260 msgr2=0x558e4a35f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7facbaff5700 0 client.16029 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:17:45.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 shutdown_connections 2023-10-05T15:17:45.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 1 -- 172.21.15.60:0/688286729 wait complete. 2023-10-05T15:17:45.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.910+0000 7face96c7b80 20 client.16029 trim_cache size 0 max 16384 2023-10-05T15:17:45.919 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7facc00a1790 msgr2=0x7facc00a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7facc00a1790 0x7facc00a3c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7facc8007c90 tx=0x7facc8007480 comp rx=0 tx=0).stop 2023-10-05T15:17:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 msgr2=0x7facd8197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd8197480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facd8067db0 tx=0x7faccc00dc30 comp rx=0 tx=0).stop 2023-10-05T15:17:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 shutdown_connections 2023-10-05T15:17:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd819b8e0 0x7facd819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facd81010c0 0x7facd8196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7facc00a1790 0x7facc00a3c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 --2- 172.21.15.60:0/4069959705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facd81061e0 0x7facd8197480 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 >> 172.21.15.60:0/4069959705 conn(0x7facd80fc960 msgr2=0x7facd80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 shutdown_connections 2023-10-05T15:17:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:45.911+0000 7facdd4dd700 1 -- 172.21.15.60:0/4069959705 wait complete. 2023-10-05T15:17:45.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.124+0000 7f9c98f0e700 1 -- 172.21.15.60:0/2368275563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c941010f0 msgr2=0x7f9c94104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.124+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/2368275563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c941010f0 0x7f9c94104a00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009990 tx=0x7f9c88009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 -- 172.21.15.60:0/2368275563 shutdown_connections 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/2368275563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94105130 0x7f9c9410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/2368275563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94100740 0x7f9c94100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/2368275563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c941010f0 0x7f9c94104a00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 -- 172.21.15.60:0/2368275563 >> 172.21.15.60:0/2368275563 conn(0x7f9c94077330 msgr2=0x7f9c940fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 -- 172.21.15.60:0/2368275563 shutdown_connections 2023-10-05T15:17:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.125+0000 7f9c98f0e700 1 -- 172.21.15.60:0/2368275563 wait complete. 2023-10-05T15:17:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 Processor -- start 2023-10-05T15:17:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 -- start start 2023-10-05T15:17:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 0x7f9c94197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94105130 0x7f9c94197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c9419baa0 0x7f9c9419bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9419c520 con 0x7f9c9419baa0 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9419c690 con 0x7f9c94105130 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c98f0e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9419c7d0 con 0x7f9c94100740 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c9259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 0x7f9c94197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c9259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 0x7f9c94197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52946/0 (socket says 172.21.15.60:52946) 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c9259c700 1 -- 172.21.15.60:0/931987043 learned_addr learned my addr 172.21.15.60:0/931987043 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c92d9d700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c9419baa0 0x7f9c9419bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.126+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94105130 0x7f9c94197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c9259c700 1 -- 172.21.15.60:0/931987043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94105130 msgr2=0x7f9c94197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c9259c700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94105130 0x7f9c94197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c9259c700 1 -- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c9419baa0 msgr2=0x7f9c9419bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c9259c700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c9419baa0 0x7f9c9419bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c9259c700 1 -- 172.21.15.60:0/931987043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009520 con 0x7f9c94100740 2023-10-05T15:17:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c92d9d700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c9419baa0 0x7f9c9419bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c9259c700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 0x7f9c94197100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400eb30 tx=0x7f9c8400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c837fe700 1 -- 172.21.15.60:0/931987043 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400cc90 con 0x7f9c94100740 2023-10-05T15:17:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c880095f0 con 0x7f9c94100740 2023-10-05T15:17:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9410d770 con 0x7f9c94100740 2023-10-05T15:17:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c837fe700 1 -- 172.21.15.60:0/931987043 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c840044e0 con 0x7f9c94100740 2023-10-05T15:17:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.127+0000 7f9c837fe700 1 -- 172.21.15.60:0/931987043 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84003dc0 con 0x7f9c94100740 2023-10-05T15:17:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.128+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94105130 0x7f9c94197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.130+0000 7f9c837fe700 1 -- 172.21.15.60:0/931987043 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f9c84004020 con 0x7f9c94100740 2023-10-05T15:17:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.131+0000 7f9c837fe700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9c7c0a1710 0x7f9c7c0a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.131+0000 7f9c837fe700 1 -- 172.21.15.60:0/931987043 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f9c84014070 con 0x7f9c94100740 2023-10-05T15:17:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.131+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9c7c0a1710 0x7f9c7c0a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.132+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9c7c0a1710 0x7f9c7c0a3bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800b2e0 tx=0x7f9c88005fd0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.132+0000 7f9ca50f8b80 1 Processor -- start 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 -- start start 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b350460 con 0x564a6b3e70c0 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b341c20 con 0x564a6b3f2890 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b33f540 con 0x564a6b3e79e0 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39424/0 (socket says 172.21.15.60:39424) 2023-10-05T15:17:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 -- 172.21.15.60:0/2797241187 learned_addr learned my addr 172.21.15.60:0/2797241187 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 -- 172.21.15.60:0/2797241187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 msgr2=0x564a6b3f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 -- 172.21.15.60:0/2797241187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 msgr2=0x564a6b3f4c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:46.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3f4c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.133+0000 7f9c9259c700 1 -- 172.21.15.60:0/2797241187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a6b165de0 con 0x564a6b3e70c0 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.134+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e74a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400eb00 tx=0x7f9c8409a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7aca9a452bbb52e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.134+0000 7f9c80ff9700 1 -- 172.21.15.60:0/2797241187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84003680 con 0x564a6b3e70c0 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.134+0000 7f9c80ff9700 1 -- 172.21.15.60:0/2797241187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c8409acf0 con 0x564a6b3e70c0 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.134+0000 7f9c80ff9700 1 -- 172.21.15.60:0/2797241187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84098990 con 0x564a6b3e70c0 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2797241187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 msgr2=0x564a6b3e74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e74a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400eb00 tx=0x7f9c8409a1b0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2797241187 shutdown_connections 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e74a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2797241187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2797241187 >> 172.21.15.60:0/2797241187 conn(0x564a6b35c260 msgr2=0x564a6b3e3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2797241187 shutdown_connections 2023-10-05T15:17:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2797241187 wait complete. 2023-10-05T15:17:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.135+0000 7f9ca50f8b80 1 -- start start 2023-10-05T15:17:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 Processor -- start 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 0x564a6b3f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b3ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3efc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b33ae30 con 0x564a6b3e79e0 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b2d7710 con 0x564a6b3f2890 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b2d73b0 con 0x564a6b3e70c0 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9ca50f8b80 10 client.0 _ll_register_callbacks cb 0x564a6b134800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9c9259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 0x564a6b3f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9c9259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 0x564a6b3f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52960/0 (socket says 172.21.15.60:52960) 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9c9259c700 1 -- 172.21.15.60:0/2203903118 learned_addr learned my addr 172.21.15.60:0/2203903118 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.136+0000 7f9c92d9d700 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c9259c700 1 -- 172.21.15.60:0/2203903118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 msgr2=0x564a6b3efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3efc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c9259c700 1 -- 172.21.15.60:0/2203903118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 msgr2=0x564a6b3ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b3ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c9259c700 1 -- 172.21.15.60:0/2203903118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9410d770 con 0x564a6b3e70c0 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 0x564a6b3f22d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c840a2450 tx=0x7f9c84003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e121099afb96414 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:17:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c79ffb700 1 -- 172.21.15.60:0/2203903118 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84003680 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c79ffb700 1 -- 172.21.15.60:0/2203903118 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f9c8409a5f0 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a6b3daf10 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9c79ffb700 1 -- 172.21.15.60:0/2203903118 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c84099ae0 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9ca50f8b80 10 client.25600 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.137+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564a6b14ec60 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9c79ffb700 1 -- 172.21.15.60:0/2203903118 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564a6b3daf10 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9c79ffb700 1 -- 172.21.15.60:0/2203903118 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9c840a2610 con 0x564a6b3e70c0 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9ca50f8b80 10 client.25600 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9ca50f8b80 10 client.25600 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9ca50f8b80 20 client.25600 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b40a7d0 0x564a6b40cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9ca50f8b80 4 client.25600 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a6b333e10 con 0x564a6b40a7d0 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.138+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b40a7d0 0x564a6b40cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b40a7d0 0x564a6b40cbf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99bb36e0bd356946 server_cookie=e087b9afdb4433ad in_seq=0 out_seq=0 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9c79ffb700 10 client.25600 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9c79ffb700 1 -- 172.21.15.60:0/2203903118 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a6b333e10 con 0x564a6b40a7d0 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9c79ffb700 10 client.25600 handle_command_reply: tid=0 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9ca50f8b80 1 client.25600 shutdown 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 msgr2=0x564a6b3f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.139+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 0x564a6b3f22d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c840a2450 tx=0x7f9c84003860 comp rx=0 tx=0).stop 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 shutdown_connections 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b40a7d0 0x564a6b40cbf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3efc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e70c0 0x564a6b3f22d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2203903118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b3ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 >> 172.21.15.60:0/2203903118 conn(0x564a6b35c260 msgr2=0x564a6b3e3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9c79ffb700 0 client.25600 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 shutdown_connections 2023-10-05T15:17:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2203903118 wait complete. 2023-10-05T15:17:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.140+0000 7f9ca50f8b80 20 client.25600 trim_cache size 0 max 16384 2023-10-05T15:17:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 Processor -- start 2023-10-05T15:17:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 -- start start 2023-10-05T15:17:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3ea850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b1bb920 con 0x564a6b3e70c0 2023-10-05T15:17:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b3eb3c0 con 0x564a6b3f2890 2023-10-05T15:17:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.165+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b3e4020 con 0x564a6b3e79e0 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52970/0 (socket says 172.21.15.60:52970) 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 -- 172.21.15.60:0/2114313244 learned_addr learned my addr 172.21.15.60:0/2114313244 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c9259c700 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c92d9d700 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 -- 172.21.15.60:0/2114313244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 msgr2=0x564a6b3ea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3ea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 -- 172.21.15.60:0/2114313244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 msgr2=0x564a6b3e9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 -- 172.21.15.60:0/2114313244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a6b3df140 con 0x564a6b3e79e0 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.166+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f1e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800b690 tx=0x7f9c88009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f005a708461f6a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.167+0000 7f9c817fa700 1 -- 172.21.15.60:0/2114313244 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8802b030 con 0x564a6b3e79e0 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.167+0000 7f9c817fa700 1 -- 172.21.15.60:0/2114313244 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c8802c040 con 0x564a6b3e79e0 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.167+0000 7f9c817fa700 1 -- 172.21.15.60:0/2114313244 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8802f730 con 0x564a6b3e79e0 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2114313244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 msgr2=0x564a6b3f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f1e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800b690 tx=0x7f9c88009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2114313244 shutdown_connections 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3f2890 0x564a6b3ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e70c0 0x564a6b3e9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/2114313244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3e79e0 0x564a6b3f1e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2114313244 >> 172.21.15.60:0/2114313244 conn(0x564a6b35c260 msgr2=0x564a6b3fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2114313244 shutdown_connections 2023-10-05T15:17:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/2114313244 wait complete. 2023-10-05T15:17:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 -- start start 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.168+0000 7f9ca50f8b80 1 Processor -- start 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3e70c0 0x564a6b3f9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b459e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3f2890 0x564a6b4565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b456b10 con 0x564a6b3e79e0 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b456c80 con 0x564a6b3e70c0 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6b456e40 con 0x564a6b3f2890 2023-10-05T15:17:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9ca50f8b80 10 client.0 _ll_register_callbacks cb 0x7f9c8409a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b459e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b459e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39446/0 (socket says 172.21.15.60:39446) 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 -- 172.21.15.60:0/3001736933 learned_addr learned my addr 172.21.15.60:0/3001736933 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 -- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3f2890 msgr2=0x564a6b4565d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3f2890 0x564a6b4565d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 -- 172.21.15.60:0/3001736933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3e70c0 msgr2=0x564a6b3f9410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3e70c0 0x564a6b3f9410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.169+0000 7f9c91d9b700 1 -- 172.21.15.60:0/3001736933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c940ff580 con 0x564a6b3e79e0 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9c91d9b700 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b459e90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800bd20 tx=0x7f9c88030c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8e85fa25c4b77d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9c79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9c79ffb700 1 -- 172.21.15.60:0/3001736933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8802b040 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9c79ffb700 1 -- 172.21.15.60:0/3001736933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f9c8802fad0 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c8409acf0 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9c79ffb700 1 -- 172.21.15.60:0/3001736933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c8802fc90 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9ca50f8b80 10 client.16044 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564a6b18c250 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.170+0000 7f9c79ffb700 1 -- 172.21.15.60:0/3001736933 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c8409acf0 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9c79ffb700 1 -- 172.21.15.60:0/3001736933 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9c88036030 con 0x564a6b3e79e0 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9ca50f8b80 10 client.16044 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9ca50f8b80 10 client.16044 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9ca50f8b80 20 client.16044 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b470090 0x564a6b4724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9ca50f8b80 4 client.16044 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.171+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564a6b333b30 con 0x564a6b470090 2023-10-05T15:17:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.172+0000 7f9c9259c700 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b470090 0x564a6b4724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.172+0000 7f9c79ffb700 10 client.16044 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.172+0000 7f9c9259c700 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b470090 0x564a6b4724b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd87f3335ac37d95 server_cookie=ddd02f41a660667 in_seq=0 out_seq=0 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.172+0000 7f9c79ffb700 1 -- 172.21.15.60:0/3001736933 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564a6b333b30 con 0x564a6b470090 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.172+0000 7f9c79ffb700 10 client.16044 handle_command_reply: tid=0 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 client.16044 shutdown 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 msgr2=0x564a6b459e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b459e90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800bd20 tx=0x7f9c88030c10 comp rx=0 tx=0).stop 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 shutdown_connections 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x564a6b470090 0x564a6b4724b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a6b3f2890 0x564a6b4565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9c79ffb700 0 client.16044 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a6b3e70c0 0x564a6b3f9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 --2- 172.21.15.60:0/3001736933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a6b3e79e0 0x564a6b459e90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 >> 172.21.15.60:0/3001736933 conn(0x564a6b35c260 msgr2=0x564a6b3ea850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 shutdown_connections 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 1 -- 172.21.15.60:0/3001736933 wait complete. 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.173+0000 7f9ca50f8b80 20 client.16044 trim_cache size 0 max 16384 2023-10-05T15:17:46.179 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9c7c0a1710 msgr2=0x7f9c7c0a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9c7c0a1710 0x7f9c7c0a3bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800b2e0 tx=0x7f9c88005fd0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 msgr2=0x7f9c94197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 0x7f9c94197100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400eb30 tx=0x7f9c8400ee40 comp rx=0 tx=0).stop 2023-10-05T15:17:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 shutdown_connections 2023-10-05T15:17:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c9419baa0 0x7f9c9419bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c94100740 0x7f9c94197100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9c7c0a1710 0x7f9c7c0a3bd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 --2- 172.21.15.60:0/931987043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c94105130 0x7f9c94197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 >> 172.21.15.60:0/931987043 conn(0x7f9c94077330 msgr2=0x7f9c941047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 shutdown_connections 2023-10-05T15:17:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.174+0000 7f9c98f0e700 1 -- 172.21.15.60:0/931987043 wait complete. 2023-10-05T15:17:46.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 -- 172.21.15.60:0/1792288011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f8105090 msgr2=0x7f96f810cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 --2- 172.21.15.60:0/1792288011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f8105090 0x7f96f810cc10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f96f000b0a0 tx=0x7f96f000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 -- 172.21.15.60:0/1792288011 shutdown_connections 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 --2- 172.21.15.60:0/1792288011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f8105090 0x7f96f810cc10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 --2- 172.21.15.60:0/1792288011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f80fff70 0x7f96f8100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 --2- 172.21.15.60:0/1792288011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f8100920 0x7f96f8104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 -- 172.21.15.60:0/1792288011 >> 172.21.15.60:0/1792288011 conn(0x7f96f80fb810 msgr2=0x7f96f80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 -- 172.21.15.60:0/1792288011 shutdown_connections 2023-10-05T15:17:46.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.389+0000 7f96fd873700 1 -- 172.21.15.60:0/1792288011 wait complete. 2023-10-05T15:17:46.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 Processor -- start 2023-10-05T15:17:46.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 -- start start 2023-10-05T15:17:46.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f80fff70 0x7f96f8199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 0x7f96f8199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f819dbb0 0x7f96f819e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f819e630 con 0x7f96f819dbb0 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f819e7a0 con 0x7f96f8105090 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96fd873700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f819e960 con 0x7f96f80fff70 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f819dbb0 0x7f96f819e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96f6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f80fff70 0x7f96f8199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 0x7f96f8199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96f6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f80fff70 0x7f96f8199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52986/0 (socket says 172.21.15.60:52986) 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.390+0000 7f96f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f819dbb0 0x7f96f819e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39460/0 (socket says 172.21.15.60:39460) 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f6ffd700 1 -- 172.21.15.60:0/3712382916 learned_addr learned my addr 172.21.15.60:0/3712382916 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 0x7f96f8199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52880/0 (socket says 172.21.15.60:52880) 2023-10-05T15:17:46.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 -- 172.21.15.60:0/3712382916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f80fff70 msgr2=0x7f96f8199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f80fff70 0x7f96f8199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 -- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f819dbb0 msgr2=0x7f96f819e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f819dbb0 0x7f96f819e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 -- 172.21.15.60:0/3712382916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009520 con 0x7f96f8105090 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96f67fc700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 0x7f96f8199750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00b3c0 tx=0x7f96ec009ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96fc871700 1 -- 172.21.15.60:0/3712382916 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec010040 con 0x7f96f8105090 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f0009d00 con 0x7f96f8105090 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96fc871700 1 -- 172.21.15.60:0/3712382916 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96ec013c30 con 0x7f96f8105090 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96fc871700 1 -- 172.21.15.60:0/3712382916 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec014e60 con 0x7f96f8105090 2023-10-05T15:17:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.391+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f81a61c0 con 0x7f96f8105090 2023-10-05T15:17:46.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.395+0000 7f96fc871700 1 -- 172.21.15.60:0/3712382916 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f96ec013da0 con 0x7f96f8105090 2023-10-05T15:17:46.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.395+0000 7f96fc871700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f96e00a1710 0x7f96e00a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.396+0000 7f96fc871700 1 -- 172.21.15.60:0/3712382916 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f96ec0ccfc0 con 0x7f96f8105090 2023-10-05T15:17:46.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.396+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f96e00a1710 0x7f96e00a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.396+0000 7f9709a5db80 1 Processor -- start 2023-10-05T15:17:46.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.396+0000 7f9709a5db80 1 -- start start 2023-10-05T15:17:46.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f96e00a1710 0x7f96e00a3bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009ef0 tx=0x7f96e8009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d496bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4968da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d4981f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f9709a5db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d48cc460 con 0x5585d496c1f0 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f9709a5db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d48bdc20 con 0x5585d496b8d0 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f9709a5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d48bb540 con 0x5585d497fb10 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4968da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4968da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39466/0 (socket says 172.21.15.60:39466) 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 -- 172.21.15.60:0/2360507342 learned_addr learned my addr 172.21.15.60:0/2360507342 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 -- 172.21.15.60:0/2360507342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 msgr2=0x5585d4981f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d4981f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 -- 172.21.15.60:0/2360507342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 msgr2=0x5585d496bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d496bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 -- 172.21.15.60:0/2360507342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d46e1de0 con 0x5585d496c1f0 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96f67fc700 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4968da0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000c00 tx=0x7f96ec099450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bef15500b05d015 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.397+0000 7f96ddffb700 1 -- 172.21.15.60:0/2360507342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec099a70 con 0x5585d496c1f0 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.398+0000 7f96ddffb700 1 -- 172.21.15.60:0/2360507342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96ec09dbc0 con 0x5585d496c1f0 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.398+0000 7f96ddffb700 1 -- 172.21.15.60:0/2360507342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0a1c40 con 0x5585d496c1f0 2023-10-05T15:17:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.399+0000 7f9709a5db80 1 -- 172.21.15.60:0/2360507342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 msgr2=0x5585d4968da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.399+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4968da0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000c00 tx=0x7f96ec099450 comp rx=0 tx=0).stop 2023-10-05T15:17:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 -- 172.21.15.60:0/2360507342 shutdown_connections 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d4981f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d496bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2360507342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4968da0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 -- 172.21.15.60:0/2360507342 >> 172.21.15.60:0/2360507342 conn(0x5585d48d8260 msgr2=0x5585d495f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 -- 172.21.15.60:0/2360507342 shutdown_connections 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 -- 172.21.15.60:0/2360507342 wait complete. 2023-10-05T15:17:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 -- start start 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.403+0000 7f9709a5db80 1 Processor -- start 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d497fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 0x5585d4980430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d498af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d48b6e30 con 0x5585d497fb10 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d4853710 con 0x5585d496b8d0 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d48533b0 con 0x5585d496c1f0 2023-10-05T15:17:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f9709a5db80 10 client.0 _ll_register_callbacks cb 0x5585d46b0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 0x5585d4980430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 0x5585d4980430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53002/0 (socket says 172.21.15.60:53002) 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f96f67fc700 1 -- 172.21.15.60:0/2495417995 learned_addr learned my addr 172.21.15.60:0/2495417995 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d497fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.404+0000 7f96f67fc700 1 -- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 msgr2=0x5585d497fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96f67fc700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d497fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96f67fc700 1 -- 172.21.15.60:0/2495417995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 msgr2=0x5585d498af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96f67fc700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d498af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96f67fc700 1 -- 172.21.15.60:0/2495417995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f81a61c0 con 0x5585d496c1f0 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d497fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96f67fc700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 0x5585d4980430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0ca3c0 tx=0x7f96ec099190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c881fdc87a74539e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96d6ffd700 1 -- 172.21.15.60:0/2495417995 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec099a70 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585d4956f10 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96d6ffd700 1 -- 172.21.15.60:0/2495417995 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f96ec0ca590 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96d6ffd700 1 -- 172.21.15.60:0/2495417995 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96ec0ca750 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f9709a5db80 10 client.25612 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5585d46cac60 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.405+0000 7f96d6ffd700 1 -- 172.21.15.60:0/2495417995 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5585d4956f10 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f96d6ffd700 1 -- 172.21.15.60:0/2495417995 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f96ec0b9210 con 0x5585d496c1f0 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f9709a5db80 10 client.25612 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f9709a5db80 10 client.25612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f9709a5db80 20 client.25612 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d498f110 0x5585d4991530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f9709a5db80 4 client.25612 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585d48afe10 con 0x5585d498f110 2023-10-05T15:17:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.406+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d498f110 0x5585d4991530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f96d6ffd700 10 client.25612 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:46.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d498f110 0x5585d4991530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ee6f9f980d3a9b server_cookie=9d61c66506cb752c in_seq=0 out_seq=0 2023-10-05T15:17:46.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f96d6ffd700 1 -- 172.21.15.60:0/2495417995 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5585d48afe10 con 0x5585d498f110 2023-10-05T15:17:46.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f96d6ffd700 10 client.25612 handle_command_reply: tid=0 2023-10-05T15:17:46.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f9709a5db80 1 client.25612 shutdown 2023-10-05T15:17:46.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 msgr2=0x5585d4980430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.407+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 0x5585d4980430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0ca3c0 tx=0x7f96ec099190 comp rx=0 tx=0).stop 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 shutdown_connections 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d498f110 0x5585d4991530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d498af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d497fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 --2- 172.21.15.60:0/2495417995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496c1f0 0x5585d4980430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 >> 172.21.15.60:0/2495417995 conn(0x5585d48d8260 msgr2=0x5585d495efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f96d6ffd700 0 client.25612 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 shutdown_connections 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 1 -- 172.21.15.60:0/2495417995 wait complete. 2023-10-05T15:17:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.408+0000 7f9709a5db80 20 client.25612 trim_cache size 0 max 16384 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 Processor -- start 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 -- start start 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d49637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4963ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d498a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d4737920 con 0x5585d496c1f0 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d4960090 con 0x5585d496b8d0 2023-10-05T15:17:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f9709a5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d495e240 con 0x5585d497fb10 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4963ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4963ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39480/0 (socket says 172.21.15.60:39480) 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.433+0000 7f96f67fc700 1 -- 172.21.15.60:0/3461847099 learned_addr learned my addr 172.21.15.60:0/3461847099 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f77fe700 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d498a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d49637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f67fc700 1 -- 172.21.15.60:0/3461847099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 msgr2=0x5585d498a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f67fc700 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d498a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f67fc700 1 -- 172.21.15.60:0/3461847099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 msgr2=0x5585d49637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f67fc700 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d49637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f67fc700 1 -- 172.21.15.60:0/3461847099 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d4996120 con 0x5585d496c1f0 2023-10-05T15:17:46.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d49637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:46.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96f67fc700 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4963ce0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f96ec095f70 tx=0x7f96ec0ca3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706773dc6e330ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96de7fc700 1 -- 172.21.15.60:0/3461847099 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0a1e70 con 0x5585d496c1f0 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96de7fc700 1 -- 172.21.15.60:0/3461847099 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96ec099a70 con 0x5585d496c1f0 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.434+0000 7f96de7fc700 1 -- 172.21.15.60:0/3461847099 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0b90b0 con 0x5585d496c1f0 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 -- 172.21.15.60:0/3461847099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 msgr2=0x5585d4963ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4963ce0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f96ec095f70 tx=0x7f96ec0ca3f0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 -- 172.21.15.60:0/3461847099 shutdown_connections 2023-10-05T15:17:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d497fb10 0x5585d498a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496b8d0 0x5585d49637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 --2- 172.21.15.60:0/3461847099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d496c1f0 0x5585d4963ce0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 -- 172.21.15.60:0/3461847099 >> 172.21.15.60:0/3461847099 conn(0x5585d48d8260 msgr2=0x5585d497fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.435+0000 7f9709a5db80 1 -- 172.21.15.60:0/3461847099 shutdown_connections 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.436+0000 7f9709a5db80 1 -- 172.21.15.60:0/3461847099 wait complete. 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.436+0000 7f9709a5db80 1 -- start start 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.436+0000 7f9709a5db80 1 Processor -- start 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 0x5585d49840f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496c1f0 0x5585d4984630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d49e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d4984ed0 con 0x5585d497fb10 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d49e2440 con 0x5585d496c1f0 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d49e2580 con 0x5585d496b8d0 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f9709a5db80 10 client.0 _ll_register_callbacks cb 0x7f96ec0995d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 0x5585d49840f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d49e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 0x5585d49840f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53014/0 (socket says 172.21.15.60:53014) 2023-10-05T15:17:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 -- 172.21.15.60:0/614295704 learned_addr learned my addr 172.21.15.60:0/614295704 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f67fc700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496c1f0 0x5585d4984630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 -- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496c1f0 msgr2=0x5585d4984630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496c1f0 0x5585d4984630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 -- 172.21.15.60:0/614295704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 msgr2=0x5585d49e1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d49e1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f6ffd700 1 -- 172.21.15.60:0/614295704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585d46cac60 con 0x5585d496b8d0 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.437+0000 7f96f67fc700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496c1f0 0x5585d4984630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f96f6ffd700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 0x5585d49840f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96e8005bf0 tx=0x7f96e80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52582f64edf69e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f96d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f96d6ffd700 1 -- 172.21.15.60:0/614295704 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8022040 con 0x5585d496b8d0 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f96d6ffd700 1 -- 172.21.15.60:0/614295704 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f96e8003680 con 0x5585d496b8d0 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96ec09dbc0 con 0x5585d496b8d0 2023-10-05T15:17:46.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f96d6ffd700 1 -- 172.21.15.60:0/614295704 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96e8003840 con 0x5585d496b8d0 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f9709a5db80 10 client.25618 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5585d4708250 con 0x5585d496b8d0 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.438+0000 7f96d6ffd700 1 -- 172.21.15.60:0/614295704 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96ec09dbc0 con 0x5585d496b8d0 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f96d6ffd700 1 -- 172.21.15.60:0/614295704 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f96e8031a50 con 0x5585d496b8d0 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f9709a5db80 10 client.25618 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f9709a5db80 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f9709a5db80 20 client.25618 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f9709a5db80 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d49e3cd0 0x5585d49e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f9709a5db80 4 client.25618 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:17:46.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5585d48afb30 con 0x5585d49e3cd0 2023-10-05T15:17:46.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f96f67fc700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d49e3cd0 0x5585d49e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f96d6ffd700 10 client.25618 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.439+0000 7f96f67fc700 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d49e3cd0 0x5585d49e60f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e2ee9b95b4eda9 server_cookie=14ce0fb2f59979bc in_seq=0 out_seq=0 2023-10-05T15:17:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f96d6ffd700 1 -- 172.21.15.60:0/614295704 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5585d48afb30 con 0x5585d49e3cd0 2023-10-05T15:17:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f96d6ffd700 10 client.25618 handle_command_reply: tid=0 2023-10-05T15:17:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 client.25618 shutdown 2023-10-05T15:17:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 msgr2=0x5585d49840f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 0x5585d49840f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96e8005bf0 tx=0x7f96e80047c0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 shutdown_connections 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5585d49e3cd0 0x5585d49e60f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5585d497fb10 0x5585d49e1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585d496b8d0 0x5585d49840f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 --2- 172.21.15.60:0/614295704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5585d496c1f0 0x5585d4984630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 >> 172.21.15.60:0/614295704 conn(0x5585d48d8260 msgr2=0x5585d49637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f96d6ffd700 0 client.25618 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 shutdown_connections 2023-10-05T15:17:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 1 -- 172.21.15.60:0/614295704 wait complete. 2023-10-05T15:17:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.440+0000 7f9709a5db80 20 client.25618 trim_cache size 0 max 16384 2023-10-05T15:17:46.451 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:17:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f96e00a1710 msgr2=0x7f96e00a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f96e00a1710 0x7f96e00a3bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009ef0 tx=0x7f96e8009260 comp rx=0 tx=0).stop 2023-10-05T15:17:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 msgr2=0x7f96f8199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 0x7f96f8199750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00b3c0 tx=0x7f96ec009ab0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 shutdown_connections 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f819dbb0 0x7f96f819e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f80fff70 0x7f96f8199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f96e00a1710 0x7f96e00a3bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 --2- 172.21.15.60:0/3712382916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f8105090 0x7f96f8199750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 >> 172.21.15.60:0/3712382916 conn(0x7f96f80fb810 msgr2=0x7f96f80fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 shutdown_connections 2023-10-05T15:17:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:46.441+0000 7f96fd873700 1 -- 172.21.15.60:0/3712382916 wait complete. 2023-10-05T15:17:46.459 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:46 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3063021562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:17:46.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:46 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3063021562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:17:46.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:46 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3063021562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:17:47.461 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:17:47.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:17:47.496 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:47 smithi060 ceph-mon[99238]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2023-10-05T15:17:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:47 smithi135 ceph-mon[103360]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2023-10-05T15:17:47.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3517107635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 msgr2=0x7f0aac100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3517107635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac100370 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009990 tx=0x7f0a9c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3517107635 shutdown_connections 2023-10-05T15:17:47.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3517107635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac1050b0 0x7f0aac10cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3517107635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac100370 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3517107635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aac100940 0x7f0aac104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3517107635 >> 172.21.15.60:0/3517107635 conn(0x7f0aac0fb830 msgr2=0x7f0aac0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3517107635 shutdown_connections 2023-10-05T15:17:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.663+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3517107635 wait complete. 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 Processor -- start 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 -- start start 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aac1050b0 0x7f0aac196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac19a8d0 0x7f0aac19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac19b350 con 0x7f0aac0fff90 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac19b4c0 con 0x7f0aac19a8d0 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0ab1e4f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac19b680 con 0x7f0aac1050b0 2023-10-05T15:17:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.664+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39498/0 (socket says 172.21.15.60:39498) 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3112882929 learned_addr learned my addr 172.21.15.60:0/3112882929 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aabfff700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac19a8d0 0x7f0aac19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3112882929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aac1050b0 msgr2=0x7f0aac196470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aac1050b0 0x7f0aac196470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3112882929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac19a8d0 msgr2=0x7f0aac19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac19a8d0 0x7f0aac19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3112882929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0095f0 con 0x7f0aac0fff90 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aabfff700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac19a8d0 0x7f0aac19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac195f30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005720 tx=0x7f0a9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aa8ff9700 1 -- 172.21.15.60:0/3112882929 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c01d070 con 0x7f0aac0fff90 2023-10-05T15:17:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aac1a2b80 con 0x7f0aac0fff90 2023-10-05T15:17:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aa8ff9700 1 -- 172.21.15.60:0/3112882929 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a9c00f460 con 0x7f0aac0fff90 2023-10-05T15:17:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0aa8ff9700 1 -- 172.21.15.60:0/3112882929 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c021670 con 0x7f0aac0fff90 2023-10-05T15:17:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.665+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac1a3000 con 0x7f0aac0fff90 2023-10-05T15:17:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.669+0000 7f0aa8ff9700 1 -- 172.21.15.60:0/3112882929 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f0a9c00f5d0 con 0x7f0aac0fff90 2023-10-05T15:17:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.669+0000 7f0aa8ff9700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0a940a1710 0x7f0a940a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.670+0000 7f0aa8ff9700 1 -- 172.21.15.60:0/3112882929 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f0a9c0ceb30 con 0x7f0aac0fff90 2023-10-05T15:17:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 Processor -- start 2023-10-05T15:17:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 -- start start 2023-10-05T15:17:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97ab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 0x55eab97baf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab97144e0 con 0x55eab97b8b20 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.671+0000 7f0abe039b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab9705ca0 con 0x55eab97ab140 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0abe039b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab97035c0 con 0x55eab97aba60 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 0x55eab97baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 0x55eab97baf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39506/0 (socket says 172.21.15.60:39506) 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 -- 172.21.15.60:0/389013720 learned_addr learned my addr 172.21.15.60:0/389013720 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 -- 172.21.15.60:0/389013720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 msgr2=0x55eab97b85e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:17:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97b85e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 -- 172.21.15.60:0/389013720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 msgr2=0x55eab97ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 -- 172.21.15.60:0/389013720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eab9529e60 con 0x55eab97b8b20 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0aabfff700 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 0x55eab97baf10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400c450 tx=0x7f0aa400c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73605a8ba832541 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.672+0000 7f0a91ffb700 1 -- 172.21.15.60:0/389013720 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4011070 con 0x55eab97b8b20 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.673+0000 7f0a91ffb700 1 -- 172.21.15.60:0/389013720 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aa400a400 con 0x55eab97b8b20 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.673+0000 7f0a91ffb700 1 -- 172.21.15.60:0/389013720 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4015620 con 0x55eab97b8b20 2023-10-05T15:17:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.673+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0a940a1710 0x7f0a940a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:47 smithi092 ceph-mon[102944]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2023-10-05T15:17:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.673+0000 7f0abe039b80 1 -- 172.21.15.60:0/389013720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 msgr2=0x55eab97baf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.673+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0a940a1710 0x7f0a940a3bd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0aac197540 tx=0x7f0aa0009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.673+0000 7f0abe039b80 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 0x55eab97baf10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400c450 tx=0x7f0aa400c480 comp rx=0 tx=0).stop 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 -- 172.21.15.60:0/389013720 shutdown_connections 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97b8b20 0x55eab97baf10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 --2- 172.21.15.60:0/389013720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 -- 172.21.15.60:0/389013720 >> 172.21.15.60:0/389013720 conn(0x55eab97202e0 msgr2=0x55eab97a74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 -- 172.21.15.60:0/389013720 shutdown_connections 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 -- 172.21.15.60:0/389013720 wait complete. 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 -- start start 2023-10-05T15:17:47.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.674+0000 7f0abe039b80 1 Processor -- start 2023-10-05T15:17:47.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab96feeb0 con 0x55eab97aba60 2023-10-05T15:17:47.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab969b790 con 0x55eab97ab140 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab969b430 con 0x55eab97b8b20 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0abe039b80 10 client.0 _ll_register_callbacks cb 0x55eab94f8880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52932/0 (socket says 172.21.15.60:52932) 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3137176902 learned_addr learned my addr 172.21.15.60:0/3137176902 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.675+0000 7f0aabfff700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3137176902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 msgr2=0x55eab97b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3137176902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 msgr2=0x55eab97b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3137176902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac1a3000 con 0x55eab97ab140 2023-10-05T15:17:47.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:17:47.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aabfff700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:47.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b37f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c000c00 tx=0x7f0a9c00fb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d2fcf5c472806b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0a8affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0a8affd700 1 -- 172.21.15.60:0/3137176902 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a3970 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0a8affd700 1 -- 172.21.15.60:0/3137176902 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f0a9c09ad70 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eab979ef90 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0a8affd700 1 -- 172.21.15.60:0/3137176902 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9c0a34e0 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0abe039b80 10 client.25769 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.676+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f0aa4009ca0 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0a8affd700 1 -- 172.21.15.60:0/3137176902 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eab979ef90 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0a8affd700 1 -- 172.21.15.60:0/3137176902 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0a9c0b9ae0 con 0x55eab97ab140 2023-10-05T15:17:47.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0abe039b80 10 client.25769 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0abe039b80 10 client.25769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0abe039b80 20 client.25769 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab97cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0abe039b80 4 client.25769 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eab96f7e90 con 0x55eab97ca410 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.677+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab97cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0a8affd700 10 client.25769 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab97cc830 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df49a5113ac52116 server_cookie=ae40cf9b88fb5561 in_seq=0 out_seq=0 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0a8affd700 1 -- 172.21.15.60:0/3137176902 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eab96f7e90 con 0x55eab97ca410 2023-10-05T15:17:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0a8affd700 10 client.25769 handle_command_reply: tid=0 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0abe039b80 1 client.25769 shutdown 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 msgr2=0x55eab97b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b37f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c000c00 tx=0x7f0a9c00fb90 comp rx=0 tx=0).stop 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.678+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 shutdown_connections 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab97cc830 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0a8affd700 0 client.25769 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b37f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3137176902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 >> 172.21.15.60:0/3137176902 conn(0x55eab97202e0 msgr2=0x55eab97a7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 shutdown_connections 2023-10-05T15:17:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 1 -- 172.21.15.60:0/3137176902 wait complete. 2023-10-05T15:17:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.679+0000 7f0abe039b80 20 client.25769 trim_cache size 0 max 16384 2023-10-05T15:17:47.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 Processor -- start 2023-10-05T15:17:47.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 -- start start 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab957f9a0 con 0x55eab97aba60 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab97a3aa0 con 0x55eab97ab140 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.712+0000 7f0abe039b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab97adfd0 con 0x55eab97b8b20 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:52940/0 (socket says 172.21.15.60:52940) 2023-10-05T15:17:47.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3235973620 learned_addr learned my addr 172.21.15.60:0/3235973620 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aabfff700 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3235973620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 msgr2=0x55eab97b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3235973620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 msgr2=0x55eab97b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 -- 172.21.15.60:0/3235973620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eab97a31c0 con 0x55eab97ab140 2023-10-05T15:17:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b2ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00b2e0 tx=0x7f0a9c005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a52001411be7565b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0a927fc700 1 -- 172.21.15.60:0/3235973620 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a3970 con 0x55eab97ab140 2023-10-05T15:17:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0a927fc700 1 -- 172.21.15.60:0/3235973620 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a9c09ad70 con 0x55eab97ab140 2023-10-05T15:17:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.713+0000 7f0a927fc700 1 -- 172.21.15.60:0/3235973620 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0cc100 con 0x55eab97ab140 2023-10-05T15:17:47.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 -- 172.21.15.60:0/3235973620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 msgr2=0x55eab97b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b2ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00b2e0 tx=0x7f0a9c005b00 comp rx=0 tx=0).stop 2023-10-05T15:17:47.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 -- 172.21.15.60:0/3235973620 shutdown_connections 2023-10-05T15:17:47.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97b8b20 0x55eab97b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97ab140 0x55eab97b2ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 --2- 172.21.15.60:0/3235973620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97aba60 0x55eab97b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 -- 172.21.15.60:0/3235973620 >> 172.21.15.60:0/3235973620 conn(0x55eab97202e0 msgr2=0x55eab97ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 -- 172.21.15.60:0/3235973620 shutdown_connections 2023-10-05T15:17:47.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.714+0000 7f0abe039b80 1 -- 172.21.15.60:0/3235973620 wait complete. 2023-10-05T15:17:47.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.715+0000 7f0abe039b80 1 -- start start 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.715+0000 7f0abe039b80 1 Processor -- start 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.715+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 0x55eab97c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.715+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0abe039b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97b8b20 0x55eab97c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0abe039b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab981e270 con 0x55eab97ab140 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0abe039b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab981e3b0 con 0x55eab97b8b20 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0abe039b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab981e540 con 0x55eab97aba60 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0abe039b80 10 client.0 _ll_register_callbacks cb 0x7f0a9c09b250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:47.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 0x55eab97c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 0x55eab97c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39524/0 (socket says 172.21.15.60:39524) 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 -- 172.21.15.60:0/4025561405 learned_addr learned my addr 172.21.15.60:0/4025561405 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aabfff700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97b8b20 0x55eab97c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 -- 172.21.15.60:0/4025561405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 msgr2=0x55eab97c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 -- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97b8b20 msgr2=0x55eab97c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97b8b20 0x55eab97c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 -- 172.21.15.60:0/4025561405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa4009ca0 con 0x55eab97ab140 2023-10-05T15:17:47.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aabfff700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97b8b20 0x55eab97c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0aab7fe700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 0x55eab97c1ec0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0980e0 tx=0x7f0a9c097ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9db97e69837a7f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.716+0000 7f0a8affd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0a8affd700 1 -- 172.21.15.60:0/4025561405 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0cc300 con 0x55eab97ab140 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0a8affd700 1 -- 172.21.15.60:0/4025561405 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f0a9c0a3970 con 0x55eab97ab140 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0aa400a400 con 0x55eab97ab140 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0a8affd700 1 -- 172.21.15.60:0/4025561405 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9c0039d0 con 0x55eab97ab140 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 10 client.16074 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eab9512ce0 con 0x55eab97ab140 2023-10-05T15:17:47.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0a8affd700 1 -- 172.21.15.60:0/4025561405 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aa400a400 con 0x55eab97ab140 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0a8affd700 1 -- 172.21.15.60:0/4025561405 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0a9c09f130 con 0x55eab97ab140 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 20 client.16074 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab9821750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 4 client.16074 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.717+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55eab96f7bb0 con 0x55eab97ca410 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.718+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab9821750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.718+0000 7f0a8affd700 10 client.16074 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.718+0000 7f0aaaffd700 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab9821750 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2532ad2bb2e0f5 server_cookie=7f1e4fdfc1a48163 in_seq=0 out_seq=0 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.719+0000 7f0a8affd700 1 -- 172.21.15.60:0/4025561405 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eab96f7bb0 con 0x55eab97ca410 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.719+0000 7f0a8affd700 10 client.16074 handle_command_reply: tid=0 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 client.16074 shutdown 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 msgr2=0x55eab97c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 0x55eab97c1ec0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0980e0 tx=0x7f0a9c097ae0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 shutdown_connections 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55eab97ca410 0x55eab9821750 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eab97b8b20 0x55eab97c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eab97ab140 0x55eab97c1ec0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 --2- 172.21.15.60:0/4025561405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eab97aba60 0x55eab97c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 >> 172.21.15.60:0/4025561405 conn(0x55eab97202e0 msgr2=0x55eab97b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0a8affd700 0 client.16074 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 shutdown_connections 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 1 -- 172.21.15.60:0/4025561405 wait complete. 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.720+0000 7f0abe039b80 20 client.16074 trim_cache size 0 max 16384 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:17:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2023-10-05T15:17:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "b4640fd7-536c-4462-a147-f68fb47d52b8", 2023-10-05T15:17:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2023-10-05T15:17:47.730 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0a940a1710 msgr2=0x7f0a940a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0a940a1710 0x7f0a940a3bd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0aac197540 tx=0x7f0aa0009260 comp rx=0 tx=0).stop 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 msgr2=0x7f0aac195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac195f30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005720 tx=0x7f0a9c005800 comp rx=0 tx=0).stop 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 shutdown_connections 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0a940a1710 0x7f0a940a3bd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aac19a8d0 0x7f0aac19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac0fff90 0x7f0aac195f30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 --2- 172.21.15.60:0/3112882929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aac1050b0 0x7f0aac196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 >> 172.21.15.60:0/3112882929 conn(0x7f0aac0fb830 msgr2=0x7f0aac0fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 shutdown_connections 2023-10-05T15:17:47.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.721+0000 7f0ab1e4f700 1 -- 172.21.15.60:0/3112882929 wait complete. 2023-10-05T15:17:47.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:17:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 -- 172.21.15.60:0/2808491548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e04100940 msgr2=0x7f4e04104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 --2- 172.21.15.60:0/2808491548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e04100940 0x7f4e04104980 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009990 tx=0x7f4df4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 -- 172.21.15.60:0/2808491548 shutdown_connections 2023-10-05T15:17:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 --2- 172.21.15.60:0/2808491548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e041050b0 0x7f4e0410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 --2- 172.21.15.60:0/2808491548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e040fff90 0x7f4e04100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 --2- 172.21.15.60:0/2808491548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e04100940 0x7f4e04104980 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 -- 172.21.15.60:0/2808491548 >> 172.21.15.60:0/2808491548 conn(0x7f4e040fb830 msgr2=0x7f4e040fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 -- 172.21.15.60:0/2808491548 shutdown_connections 2023-10-05T15:17:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.976+0000 7f4e0c582700 1 -- 172.21.15.60:0/2808491548 wait complete. 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 Processor -- start 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 -- start start 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 0x7f4e04196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e041050b0 0x7f4e04197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e0419b960 0x7f4e0419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0419c3e0 con 0x7f4e040fff90 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0419c550 con 0x7f4e0419b960 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.977+0000 7f4e0c582700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0419c710 con 0x7f4e041050b0 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 0x7f4e04196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 0x7f4e04196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39538/0 (socket says 172.21.15.60:39538) 2023-10-05T15:17:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3167400284 learned_addr learned my addr 172.21.15.60:0/3167400284 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0ab1f700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e0419b960 0x7f4e0419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e041050b0 0x7f4e04197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3167400284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e041050b0 msgr2=0x7f4e04197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e041050b0 0x7f4e04197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3167400284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e0419b960 msgr2=0x7f4e0419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e0419b960 0x7f4e0419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3167400284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df40095f0 con 0x7f4e040fff90 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 0x7f4e04196fc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000d950 tx=0x7f4e0000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/3167400284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00009940 con 0x7f4e040fff90 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.978+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e041a3c70 con 0x7f4e040fff90 2023-10-05T15:17:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.979+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/3167400284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e00010460 con 0x7f4e040fff90 2023-10-05T15:17:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.979+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e041a41a0 con 0x7f4e040fff90 2023-10-05T15:17:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.979+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/3167400284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000f620 con 0x7f4e040fff90 2023-10-05T15:17:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.982+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/3167400284 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f4e00009aa0 con 0x7f4e040fff90 2023-10-05T15:17:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.983+0000 7f4dfb7fe700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4df00a1790 0x7f4df00a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.983+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/3167400284 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f4e000d0170 con 0x7f4e040fff90 2023-10-05T15:17:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.983+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4df00a1790 0x7f4df00a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.983+0000 7f4e1876cb80 1 Processor -- start 2023-10-05T15:17:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4df00a1790 0x7f4df00a3c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4df4006010 tx=0x7f4df400b260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e1876cb80 1 -- start start 2023-10-05T15:17:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a0c0 0x55609588a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095895350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 0x556095897c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560957f3460 con 0x556095895890 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.984+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560957e4c20 con 0x55609588a9e0 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560957e2540 con 0x55609588a0c0 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 0x556095897c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 0x556095897c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39548/0 (socket says 172.21.15.60:39548) 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 -- 172.21.15.60:0/2561757639 learned_addr learned my addr 172.21.15.60:0/2561757639 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a0c0 0x55609588a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095895350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 -- 172.21.15.60:0/2561757639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a0c0 msgr2=0x55609588a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a0c0 0x55609588a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 -- 172.21.15.60:0/2561757639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 msgr2=0x556095895350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095895350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 -- 172.21.15.60:0/2561757639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556095608de0 con 0x556095895890 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095895350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.985+0000 7f4e0ab1f700 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 0x556095897c80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc011680 tx=0x7f4dfc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd33a92b2083feef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.986+0000 7f4df8ff9700 1 -- 172.21.15.60:0/2561757639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00e040 con 0x556095895890 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.986+0000 7f4df8ff9700 1 -- 172.21.15.60:0/2561757639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dfc00f040 con 0x556095895890 2023-10-05T15:17:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.986+0000 7f4df8ff9700 1 -- 172.21.15.60:0/2561757639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0048c0 con 0x556095895890 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 -- 172.21.15.60:0/2561757639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 msgr2=0x556095897c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 0x556095897c80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc011680 tx=0x7f4dfc009920 comp rx=0 tx=0).stop 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 -- 172.21.15.60:0/2561757639 shutdown_connections 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556095895890 0x556095897c80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a0c0 0x55609588a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/2561757639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095895350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 -- 172.21.15.60:0/2561757639 >> 172.21.15.60:0/2561757639 conn(0x5560957ff260 msgr2=0x556095886450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 -- 172.21.15.60:0/2561757639 shutdown_connections 2023-10-05T15:17:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 -- 172.21.15.60:0/2561757639 wait complete. 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 -- start start 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.987+0000 7f4e1876cb80 1 Processor -- start 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a0c0 0x556095895290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 0x556095892510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095892b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560957dde30 con 0x55609588a9e0 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609577a710 con 0x55609588a0c0 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609577a3b0 con 0x556095895890 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e1876cb80 10 client.0 _ll_register_callbacks cb 0x5560955d7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 0x556095892510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 0x556095892510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39554/0 (socket says 172.21.15.60:39554) 2023-10-05T15:17:47.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 -- 172.21.15.60:0/1483851028 learned_addr learned my addr 172.21.15.60:0/1483851028 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:47.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 -- 172.21.15.60:0/1483851028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 msgr2=0x556095892b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:47.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095892b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 -- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a0c0 msgr2=0x556095895290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:17:47.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a0c0 0x556095895290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.988+0000 7f4e09b1d700 1 -- 172.21.15.60:0/1483851028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc011330 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 0x556095892510 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4df400bf20 tx=0x7f4df4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53595c2751fe3603 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4dedffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4dedffb700 1 -- 172.21.15.60:0/1483851028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4004da0 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4dedffb700 1 -- 172.21.15.60:0/1483851028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f4df400f460 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55609587df10 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4dedffb700 1 -- 172.21.15.60:0/1483851028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df400f620 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4e1876cb80 10 client.16086 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5560955f1c60 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.989+0000 7f4dedffb700 1 -- 172.21.15.60:0/1483851028 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55609587df10 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4dedffb700 1 -- 172.21.15.60:0/1483851028 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4df4024740 con 0x55609588a9e0 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e1876cb80 10 client.16086 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:47.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e1876cb80 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:47.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e1876cb80 20 client.16086 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:47.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958a97d0 0x5560958abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:47.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e1876cb80 4 client.16086 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:47.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560957d6e10 con 0x5560958a97d0 2023-10-05T15:17:47.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.990+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958a97d0 0x5560958abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:47.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4dedffb700 10 client.16086 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:47.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958a97d0 0x5560958abbf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ae8a76b354469 server_cookie=95489e6f5015cff in_seq=0 out_seq=0 2023-10-05T15:17:47.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4dedffb700 1 -- 172.21.15.60:0/1483851028 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5560957d6e10 con 0x5560958a97d0 2023-10-05T15:17:47.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4dedffb700 10 client.16086 handle_command_reply: tid=0 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4e1876cb80 1 client.16086 shutdown 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 msgr2=0x556095892510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.991+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 0x556095892510 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4df400bf20 tx=0x7f4df4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 shutdown_connections 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958a97d0 0x5560958abbf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095892b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a0c0 0x556095895290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/1483851028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a9e0 0x556095892510 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 >> 172.21.15.60:0/1483851028 conn(0x5560957ff260 msgr2=0x556095886040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4dedffb700 0 client.16086 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:47.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 shutdown_connections 2023-10-05T15:17:47.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 1 -- 172.21.15.60:0/1483851028 wait complete. 2023-10-05T15:17:47.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:47.992+0000 7f4e1876cb80 20 client.16086 trim_cache size 0 max 16384 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 Processor -- start 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 -- start start 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x55609589c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 0x5560958ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556095895890 0x55609588d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556095898140 con 0x55609588a0c0 2023-10-05T15:17:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609565e920 con 0x556095895890 2023-10-05T15:17:48.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.025+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556095890a70 con 0x55609588a9e0 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 0x5560958ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 0x5560958ab7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53092/0 (socket says 172.21.15.60:53092) 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 -- 172.21.15.60:0/3795229465 learned_addr learned my addr 172.21.15.60:0/3795229465 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e0ab1f700 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556095895890 0x55609588d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x55609589c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 -- 172.21.15.60:0/3795229465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556095895890 msgr2=0x55609588d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556095895890 0x55609588d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 -- 172.21.15.60:0/3795229465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 msgr2=0x55609589c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x55609589c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 -- 172.21.15.60:0/3795229465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55609562f250 con 0x55609588a9e0 2023-10-05T15:17:48.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 0x5560958ab7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4df4005ae0 tx=0x7f4df40094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b845a3a6e6ec4c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:48.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.026+0000 7f4df97fa700 1 -- 172.21.15.60:0/3795229465 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40047e0 con 0x55609588a9e0 2023-10-05T15:17:48.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.027+0000 7f4df97fa700 1 -- 172.21.15.60:0/3795229465 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4df402c040 con 0x55609588a9e0 2023-10-05T15:17:48.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.027+0000 7f4df97fa700 1 -- 172.21.15.60:0/3795229465 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400f860 con 0x55609588a9e0 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.027+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3795229465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 msgr2=0x5560958ab7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.027+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 0x5560958ab7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4df4005ae0 tx=0x7f4df40094b0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3795229465 shutdown_connections 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556095895890 0x55609588d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x55609589c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3795229465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609588a9e0 0x5560958ab7e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3795229465 >> 172.21.15.60:0/3795229465 conn(0x5560957ff260 msgr2=0x556095894ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3795229465 shutdown_connections 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3795229465 wait complete. 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 -- start start 2023-10-05T15:17:48.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 Processor -- start 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x556095898410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095898950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.028+0000 7f4e1876cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095898e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560958fc700 con 0x55609588a0c0 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560958fc870 con 0x55609588a9e0 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e1876cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560958fca30 con 0x556095895890 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e1876cb80 10 client.0 _ll_register_callbacks cb 0x7f4df400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x556095898410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x556095898410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39566/0 (socket says 172.21.15.60:39566) 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3089354117 learned_addr learned my addr 172.21.15.60:0/3089354117 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0ab1f700 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095898e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3089354117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 msgr2=0x556095898e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095898e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 msgr2=0x556095898950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095898950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 -- 172.21.15.60:0/3089354117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560955f1c60 con 0x55609588a0c0 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e0a31e700 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x556095898410 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4e000992b0 tx=0x7f4e00005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651bd45ef7b9b06b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4dedffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4dedffb700 1 -- 172.21.15.60:0/3089354117 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0009d470 con 0x55609588a0c0 2023-10-05T15:17:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4dedffb700 1 -- 172.21.15.60:0/3089354117 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9257+0+0 (secure 0 0 0) 0x7f4e000a16b0 con 0x55609588a0c0 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.029+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4dfc00f040 con 0x55609588a0c0 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4dedffb700 1 -- 172.21.15.60:0/3089354117 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e0009d120 con 0x55609588a0c0 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 10 client.16092 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5560956072b0 con 0x55609588a0c0 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4dedffb700 1 -- 172.21.15.60:0/3089354117 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dfc00f040 con 0x55609588a0c0 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4dedffb700 1 -- 172.21.15.60:0/3089354117 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e000a12b0 con 0x55609588a0c0 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 10 client.16092 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 20 client.16092 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958fe0e0 0x556095900500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 4 client.16092 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5560957d6b30 con 0x5560958fe0e0 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.030+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958fe0e0 0x556095900500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4dedffb700 10 client.16092 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e09b1d700 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958fe0e0 0x556095900500 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd51a1ad3f57f829 server_cookie=e0d9ba18e92e0d5b in_seq=0 out_seq=0 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4dedffb700 1 -- 172.21.15.60:0/3089354117 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5560957d6b30 con 0x5560958fe0e0 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4dedffb700 10 client.16092 handle_command_reply: tid=0 2023-10-05T15:17:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 client.16092 shutdown 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 msgr2=0x556095898410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x556095898410 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4e000992b0 tx=0x7f4e00005dc0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 shutdown_connections 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5560958fe0e0 0x556095900500 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556095895890 0x556095898e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55609588a0c0 0x556095898410 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 --2- 172.21.15.60:0/3089354117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55609588a9e0 0x556095898950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.031+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 >> 172.21.15.60:0/3089354117 conn(0x5560957ff260 msgr2=0x5560958ab7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4dedffb700 0 client.16092 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 shutdown_connections 2023-10-05T15:17:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e1876cb80 1 -- 172.21.15.60:0/3089354117 wait complete. 2023-10-05T15:17:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e1876cb80 20 client.16092 trim_cache size 0 max 16384 2023-10-05T15:17:48.040 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: "b4640fd7-536c-4462-a147-f68fb47d52b8": { 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "b4640fd7-536c-4462-a147-f68fb47d52b8", 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2023-10-05T15:17:48.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:17:48.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:17:48.042 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:17:48.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4df00a1790 msgr2=0x7f4df00a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e0c582700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4df00a1790 0x7f4df00a3c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4df4006010 tx=0x7f4df400b260 comp rx=0 tx=0).stop 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 msgr2=0x7f4e04196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.032+0000 7f4e0c582700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 0x7f4e04196fc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000d950 tx=0x7f4e0000dc60 comp rx=0 tx=0).stop 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 shutdown_connections 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4df00a1790 0x7f4df00a3c50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e0419b960 0x7f4e0419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040fff90 0x7f4e04196fc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 --2- 172.21.15.60:0/3167400284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e041050b0 0x7f4e04197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 >> 172.21.15.60:0/3167400284 conn(0x7f4e040fb830 msgr2=0x7f4e040fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:48.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 shutdown_connections 2023-10-05T15:17:48.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:17:48.033+0000 7f4e0c582700 1 -- 172.21.15.60:0/3167400284 wait complete. 2023-10-05T15:17:48.051 INFO:tasks.cephfs.filesystem:scrub status for tag:b4640fd7-536c-4462-a147-f68fb47d52b8 - {'path': '/', 'tag': 'b4640fd7-536c-4462-a147-f68fb47d52b8', 'options': 'recursive,force'} 2023-10-05T15:17:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:49 smithi135 ceph-mon[103360]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:17:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:49 smithi135 ceph-mon[103360]: scrub queued for path: / 2023-10-05T15:17:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:49 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:49 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:17:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:49 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:49.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:49 smithi060 ceph-mon[99238]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:17:49.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:49 smithi060 ceph-mon[99238]: scrub queued for path: / 2023-10-05T15:17:49.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:49 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:49.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:49 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:17:49.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:49 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:49 smithi092 ceph-mon[102944]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:17:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:49 smithi092 ceph-mon[102944]: scrub queued for path: / 2023-10-05T15:17:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:49 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:49 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:17:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:49 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:17:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:50 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-10-05T15:17:50.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:50 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-05T15:17:50.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:50 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-10-05T15:17:50.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:50 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-05T15:17:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:50 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-10-05T15:17:50.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:50 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-05T15:17:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:51 smithi135 ceph-mon[103360]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:17:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:51 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-10-05T15:17:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:51 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-05T15:17:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:51 smithi135 ceph-mon[103360]: osdmap e92: 12 total, 12 up, 12 in 2023-10-05T15:17:51.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:51 smithi060 ceph-mon[99238]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:17:51.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:51 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-10-05T15:17:51.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:51 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-05T15:17:51.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:51 smithi060 ceph-mon[99238]: osdmap e92: 12 total, 12 up, 12 in 2023-10-05T15:17:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:51 smithi092 ceph-mon[102944]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:17:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:51 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-10-05T15:17:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:51 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-05T15:17:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:51 smithi092 ceph-mon[102944]: osdmap e92: 12 total, 12 up, 12 in 2023-10-05T15:17:52.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:52 smithi135 ceph-mon[103360]: osdmap e93: 12 total, 12 up, 12 in 2023-10-05T15:17:52.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:52 smithi060 ceph-mon[99238]: osdmap e93: 12 total, 12 up, 12 in 2023-10-05T15:17:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:52 smithi092 ceph-mon[102944]: osdmap e93: 12 total, 12 up, 12 in 2023-10-05T15:17:53.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:53 smithi135 ceph-mon[103360]: pgmap v36: 129 pgs: 2 peering, 127 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 383 B/s wr, 14 op/s 2023-10-05T15:17:53.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:53 smithi135 ceph-mon[103360]: scrub summary: idle 2023-10-05T15:17:53.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:53 smithi060 ceph-mon[99238]: pgmap v36: 129 pgs: 2 peering, 127 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 383 B/s wr, 14 op/s 2023-10-05T15:17:53.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:53 smithi060 ceph-mon[99238]: scrub summary: idle 2023-10-05T15:17:53.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:53 smithi092 ceph-mon[102944]: pgmap v36: 129 pgs: 2 peering, 127 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 383 B/s wr, 14 op/s 2023-10-05T15:17:53.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:53 smithi092 ceph-mon[102944]: scrub summary: idle 2023-10-05T15:17:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:55 smithi135 ceph-mon[103360]: pgmap v37: 129 pgs: 2 peering, 127 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2023-10-05T15:17:55.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:55 smithi060 ceph-mon[99238]: pgmap v37: 129 pgs: 2 peering, 127 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2023-10-05T15:17:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:55 smithi092 ceph-mon[102944]: pgmap v37: 129 pgs: 2 peering, 127 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2023-10-05T15:17:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:56 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:17:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:56 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:17:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:56 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:17:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:56 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:17:56.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:56 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:17:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:56 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:17:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:56 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:17:56.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:56 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:17:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:56 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:17:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:56 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:17:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:56 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:17:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:56 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:17:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:57 smithi135 ceph-mon[103360]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 14 op/s; 40 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:17:57.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:57 smithi060 ceph-mon[99238]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 14 op/s; 40 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:17:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:57 smithi092 ceph-mon[102944]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 14 op/s; 40 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:17:57.718 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 98% (11820/12041) Updating files: 99% (11921/12041) Updating files: 100% (12041/12041) Updating files: 100% (12041/12041), done. 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.938+0000 7fd63dee3700 1 -- 172.21.15.60:0/942590250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 msgr2=0x7fd6381014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.938+0000 7fd63dee3700 1 --2- 172.21.15.60:0/942590250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381014f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd628009990 tx=0x7fd628009ca0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 -- 172.21.15.60:0/942590250 shutdown_connections 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 --2- 172.21.15.60:0/942590250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638106230 0x7fd63810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 --2- 172.21.15.60:0/942590250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381014f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 --2- 172.21.15.60:0/942590250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd638101ac0 0x7fd638105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 -- 172.21.15.60:0/942590250 >> 172.21.15.60:0/942590250 conn(0x7fd6380fc9b0 msgr2=0x7fd6380fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 -- 172.21.15.60:0/942590250 shutdown_connections 2023-10-05T15:17:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 -- 172.21.15.60:0/942590250 wait complete. 2023-10-05T15:17:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 Processor -- start 2023-10-05T15:17:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.939+0000 7fd63dee3700 1 -- start start 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd638106230 0x7fd6381997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd63819ddc0 0x7fd63819e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63819e840 con 0x7fd638101110 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63819e9b0 con 0x7fd638106230 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63819eb70 con 0x7fd63819ddc0 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39578/0 (socket says 172.21.15.60:39578) 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 -- 172.21.15.60:0/3803451904 learned_addr learned my addr 172.21.15.60:0/3803451904 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd636ffd700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd638106230 0x7fd6381997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd637fff700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd63819ddc0 0x7fd63819e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 -- 172.21.15.60:0/3803451904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd63819ddc0 msgr2=0x7fd63819e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd63819ddc0 0x7fd63819e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 -- 172.21.15.60:0/3803451904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd638106230 msgr2=0x7fd6381997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd638106230 0x7fd6381997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 -- 172.21.15.60:0/3803451904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280095f0 con 0x7fd638101110 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd637fff700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd63819ddc0 0x7fd63819e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd6377fe700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381992b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd628005910 tx=0x7fd628009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd634ff9700 1 -- 172.21.15.60:0/3803451904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62801d070 con 0x7fd638101110 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd634ff9700 1 -- 172.21.15.60:0/3803451904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd628003fe0 con 0x7fd638101110 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.940+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6381a6070 con 0x7fd638101110 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.941+0000 7fd634ff9700 1 -- 172.21.15.60:0/3803451904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628022df0 con 0x7fd638101110 2023-10-05T15:17:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.941+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6381a6490 con 0x7fd638101110 2023-10-05T15:17:57.951 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.943+0000 7fd634ff9700 1 -- 172.21.15.60:0/3803451904 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7fd628022470 con 0x7fd638101110 2023-10-05T15:17:57.951 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.943+0000 7fd634ff9700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd6200a1710 0x7fd6200a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.951 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.944+0000 7fd634ff9700 1 -- 172.21.15.60:0/3803451904 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fd6280cea90 con 0x7fd638101110 2023-10-05T15:17:57.951 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.944+0000 7fd636ffd700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd6200a1710 0x7fd6200a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.944+0000 7fd636ffd700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd6200a1710 0x7fd6200a3bd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd62c005950 tx=0x7fd62c0058e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.944+0000 7fd64a0cdb80 1 Processor -- start 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.944+0000 7fd64a0cdb80 1 -- start start 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e03fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e04520 0x560245e0ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e0f3d0 0x560245e117c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245d6d400 con 0x560245e03c00 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245d5ebc0 con 0x560245e04520 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245d5c4e0 con 0x560245e0f3d0 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e03fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e03fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39586/0 (socket says 172.21.15.60:39586) 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 -- 172.21.15.60:0/165868624 learned_addr learned my addr 172.21.15.60:0/165868624 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd636ffd700 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e04520 0x560245e0ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd637fff700 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e0f3d0 0x560245e117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 -- 172.21.15.60:0/165868624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e0f3d0 msgr2=0x560245e117c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e0f3d0 0x560245e117c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 -- 172.21.15.60:0/165868624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e04520 msgr2=0x560245e0ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e04520 0x560245e0ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 -- 172.21.15.60:0/165868624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560245b82d80 con 0x560245e03c00 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd637fff700 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e0f3d0 0x560245e117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd6377fe700 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e03fe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd62809b290 tx=0x7fd628009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c2ca5021d7c0e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.945+0000 7fd61dffb700 1 -- 172.21.15.60:0/165868624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62809bc90 con 0x560245e03c00 2023-10-05T15:17:57.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd61dffb700 1 -- 172.21.15.60:0/165868624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd62809b590 con 0x560245e03c00 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd61dffb700 1 -- 172.21.15.60:0/165868624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280a3400 con 0x560245e03c00 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/165868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 msgr2=0x560245e03fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e03fe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd62809b290 tx=0x7fd628009580 comp rx=0 tx=0).stop 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/165868624 shutdown_connections 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e0f3d0 0x560245e117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e03fe0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/165868624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e04520 0x560245e0ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/165868624 >> 172.21.15.60:0/165868624 conn(0x560245d79200 msgr2=0x560245e00080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/165868624 shutdown_connections 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.946+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/165868624 wait complete. 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 -- start start 2023-10-05T15:17:57.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 Processor -- start 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e0f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e04520 0x560245e0fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e10230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245d57dd0 con 0x560245e03c00 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245cf46b0 con 0x560245e0f3d0 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245cf4350 con 0x560245e04520 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd64a0cdb80 10 client.0 _ll_register_callbacks cb 0x560245b517a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e0f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e0f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39592/0 (socket says 172.21.15.60:39592) 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd6377fe700 1 -- 172.21.15.60:0/1076087548 learned_addr learned my addr 172.21.15.60:0/1076087548 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd637fff700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e10230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.947+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e04520 0x560245e0fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd6377fe700 1 -- 172.21.15.60:0/1076087548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e04520 msgr2=0x560245e0fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e04520 0x560245e0fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd6377fe700 1 -- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 msgr2=0x560245e10230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e10230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd6377fe700 1 -- 172.21.15.60:0/1076087548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6381a6490 con 0x560245e03c00 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e0f7b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd628098000 tx=0x7fd628099b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5effff1475b0610 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd616ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd616ffd700 1 -- 172.21.15.60:0/1076087548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62809f6e0 con 0x560245e03c00 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd616ffd700 1 -- 172.21.15.60:0/1076087548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fd6280a3890 con 0x560245e03c00 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560245df7d50 con 0x560245e03c00 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd616ffd700 1 -- 172.21.15.60:0/1076087548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6280a3610 con 0x560245e03c00 2023-10-05T15:17:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd64a0cdb80 10 client.16104 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560245b6bc00 con 0x560245e03c00 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.948+0000 7fd616ffd700 1 -- 172.21.15.60:0/1076087548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd62807e080 con 0x560245e03c00 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd616ffd700 1 -- 172.21.15.60:0/1076087548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd62809f170 con 0x560245e03c00 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd64a0cdb80 10 client.16104 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd64a0cdb80 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd64a0cdb80 20 client.16104 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e1e5f0 0x560245e209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd64a0cdb80 4 client.16104 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560245d50db0 con 0x560245e1e5f0 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e1e5f0 0x560245e209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e1e5f0 0x560245e209e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bcc0801b1141737 server_cookie=56f2ddece9c5cd4b in_seq=0 out_seq=0 2023-10-05T15:17:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.949+0000 7fd616ffd700 10 client.16104 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd616ffd700 1 -- 172.21.15.60:0/1076087548 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560245d50db0 con 0x560245e1e5f0 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd616ffd700 10 client.16104 handle_command_reply: tid=0 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 client.16104 shutdown 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 msgr2=0x560245e0f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e0f7b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd628098000 tx=0x7fd628099b40 comp rx=0 tx=0).stop 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 shutdown_connections 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e1e5f0 0x560245e209e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e10230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd616ffd700 0 client.16104 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:57.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e03c00 0x560245e0f7b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1076087548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e04520 0x560245e0fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 >> 172.21.15.60:0/1076087548 conn(0x560245d79200 msgr2=0x560245dffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:57.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 shutdown_connections 2023-10-05T15:17:57.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1076087548 wait complete. 2023-10-05T15:17:57.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.950+0000 7fd64a0cdb80 20 client.16104 trim_cache size 0 max 16384 2023-10-05T15:17:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 Processor -- start 2023-10-05T15:17:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 -- start start 2023-10-05T15:17:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e137e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245bd88c0 con 0x560245e04520 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245e00e50 con 0x560245e0f3d0 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.965+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245e1a6d0 con 0x560245e03c00 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e097e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39602/0 (socket says 172.21.15.60:39602) 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 -- 172.21.15.60:0/1896166542 learned_addr learned my addr 172.21.15.60:0/1896166542 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd637fff700 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 -- 172.21.15.60:0/1896166542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 msgr2=0x560245e137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 -- 172.21.15.60:0/1896166542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 msgr2=0x560245e09d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e09d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 -- 172.21.15.60:0/1896166542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560245ba91f0 con 0x560245e04520 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e097e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd63819aad0 tx=0x7fd62c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c762a5d79d6493cd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd61e7fc700 1 -- 172.21.15.60:0/1896166542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c024040 con 0x560245e04520 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd61e7fc700 1 -- 172.21.15.60:0/1896166542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd62c011900 con 0x560245e04520 2023-10-05T15:17:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.966+0000 7fd61e7fc700 1 -- 172.21.15.60:0/1896166542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c01f830 con 0x560245e04520 2023-10-05T15:17:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1896166542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 msgr2=0x560245e097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e097e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd63819aad0 tx=0x7fd62c012000 comp rx=0 tx=0).stop 2023-10-05T15:17:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1896166542 shutdown_connections 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e09d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1896166542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e097e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1896166542 >> 172.21.15.60:0/1896166542 conn(0x560245d79200 msgr2=0x560245e19f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1896166542 shutdown_connections 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1896166542 wait complete. 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.967+0000 7fd64a0cdb80 1 -- start start 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 Processor -- start 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e6ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e6f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e73080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245e73630 con 0x560245e04520 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245e737a0 con 0x560245e0f3d0 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560245e73960 con 0x560245e03c00 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd64a0cdb80 10 client.0 _ll_register_callbacks cb 0x560245b517a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e6f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e6f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39608/0 (socket says 172.21.15.60:39608) 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 -- 172.21.15.60:0/1318801387 learned_addr learned my addr 172.21.15.60:0/1318801387 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e6ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd637fff700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e73080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 -- 172.21.15.60:0/1318801387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 msgr2=0x560245e6ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e6ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 -- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 msgr2=0x560245e73080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e73080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.968+0000 7fd636ffd700 1 -- 172.21.15.60:0/1318801387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c00f970 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd636ffd700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e6f2c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ba40 tx=0x7fd62c0114e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33229af67d4da681 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd616ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd616ffd700 1 -- 172.21.15.60:0/1318801387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c024070 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd616ffd700 1 -- 172.21.15.60:0/1318801387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fd62c011c70 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd62809b590 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd616ffd700 1 -- 172.21.15.60:0/1318801387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd62c011790 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 10 client.16110 fetch_fsmap learned FSMap version 27 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560245b81250 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd616ffd700 1 -- 172.21.15.60:0/1318801387 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd62809b590 con 0x560245e04520 2023-10-05T15:17:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd616ffd700 1 -- 172.21.15.60:0/1318801387 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd62c004a20 con 0x560245e04520 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 10 client.16110 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 20 client.16110 populate_metadata read hostname 'smithi060' 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e7c360 0x560245e7e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 4 client.16110 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.969+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560245d50ad0 con 0x560245e7c360 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.970+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e7c360 0x560245e7e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.970+0000 7fd6377fe700 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e7c360 0x560245e7e780 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d38a3703e01e5ca2 server_cookie=a8869ea89a1cd043 in_seq=0 out_seq=0 2023-10-05T15:17:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.970+0000 7fd616ffd700 10 client.16110 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd616ffd700 1 -- 172.21.15.60:0/1318801387 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560245d50ad0 con 0x560245e7c360 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd616ffd700 10 client.16110 handle_command_reply: tid=0 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 client.16110 shutdown 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 msgr2=0x560245e6f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e6f2c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ba40 tx=0x7fd62c0114e0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 shutdown_connections 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560245e7c360 0x560245e7e780 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560245e0f3d0 0x560245e73080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd616ffd700 0 client.16110 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560245e03c00 0x560245e6ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 --2- 172.21.15.60:0/1318801387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560245e04520 0x560245e6f2c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 >> 172.21.15.60:0/1318801387 conn(0x560245d79200 msgr2=0x560245e097e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.974+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 shutdown_connections 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd64a0cdb80 1 -- 172.21.15.60:0/1318801387 wait complete. 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd64a0cdb80 20 client.16110 trim_cache size 0 max 16384 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:17:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:17:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd6200a1710 msgr2=0x7fd6200a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd6200a1710 0x7fd6200a3bd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd62c005950 tx=0x7fd62c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 msgr2=0x7fd6381992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:17:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381992b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd628005910 tx=0x7fd628009510 comp rx=0 tx=0).stop 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 shutdown_connections 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd63819ddc0 0x7fd63819e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638101110 0x7fd6381992b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd6200a1710 0x7fd6200a3bd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 --2- 172.21.15.60:0/3803451904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd638106230 0x7fd6381997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 >> 172.21.15.60:0/3803451904 conn(0x7fd6380fc9b0 msgr2=0x7fd6380fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 shutdown_connections 2023-10-05T15:17:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:17:57.975+0000 7fd63dee3700 1 -- 172.21.15.60:0/3803451904 wait complete. 2023-10-05T15:17:58.294 INFO:tasks.workunit.client.0.smithi060.stderr:Note: switching to '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f'. 2023-10-05T15:17:58.294 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.295 INFO:tasks.workunit.client.0.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-05T15:17:58.295 INFO:tasks.workunit.client.0.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-05T15:17:58.295 INFO:tasks.workunit.client.0.smithi060.stderr:state without impacting any branches by switching back to a branch. 2023-10-05T15:17:58.295 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.295 INFO:tasks.workunit.client.0.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-05T15:17:58.296 INFO:tasks.workunit.client.0.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-05T15:17:58.296 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.296 INFO:tasks.workunit.client.0.smithi060.stderr: git switch -c 2023-10-05T15:17:58.296 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.296 INFO:tasks.workunit.client.0.smithi060.stderr:Or undo this operation with: 2023-10-05T15:17:58.296 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.297 INFO:tasks.workunit.client.0.smithi060.stderr: git switch - 2023-10-05T15:17:58.297 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.297 INFO:tasks.workunit.client.0.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-05T15:17:58.297 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:58.297 INFO:tasks.workunit.client.0.smithi060.stderr:HEAD is now at 689b3d5ae1e PendingReleaseNotes: add a note about disallowing delegating inodes 2023-10-05T15:17:58.299 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-05T15:17:58.362 INFO:tasks.workunit.client.0.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-05T15:17:58.364 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T15:17:58.364 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-05T15:17:58.915 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-05T15:17:58.991 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-05T15:17:59.030 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T15:17:59.032 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T15:17:59.032 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-05T15:17:59.070 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T15:17:59.073 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:17:59.073 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-05T15:17:59.131 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2023-10-05T15:17:59.132 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2023-10-05T15:17:59.133 DEBUG:teuthology.orchestra.run.smithi060:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2023-10-05T15:17:59.195 INFO:tasks.workunit.client.0.smithi060.stdout:getting blogbench 2023-10-05T15:17:59.196 INFO:tasks.workunit.client.0.smithi060.stderr:+ echo 'getting blogbench' 2023-10-05T15:17:59.196 INFO:tasks.workunit.client.0.smithi060.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-10-05T15:17:59.216 INFO:tasks.workunit.client.0.smithi060.stderr:--2023-10-05 15:17:59-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-10-05T15:17:59.225 INFO:tasks.workunit.client.0.smithi060.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-05T15:17:59.262 INFO:tasks.workunit.client.0.smithi060.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-05T15:17:59.298 INFO:tasks.workunit.client.0.smithi060.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-05T15:17:59.299 INFO:tasks.workunit.client.0.smithi060.stderr:Length: 103355 (101K) [application/octet-stream] 2023-10-05T15:17:59.300 INFO:tasks.workunit.client.0.smithi060.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2023-10-05T15:17:59.304 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:59.370 INFO:tasks.workunit.client.0.smithi060.stderr: 0K .......... .......... .......... .......... .......... 49% 725K 0s 2023-10-05T15:17:59.405 INFO:tasks.workunit.client.0.smithi060.stderr: 50K .......... .......... .......... .......... .......... 99% 1.38M 0s 2023-10-05T15:17:59.405 INFO:tasks.workunit.client.0.smithi060.stderr: 100K 100% 1779G=0.1s 2023-10-05T15:17:59.406 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:59.406 INFO:tasks.workunit.client.0.smithi060.stderr:2023-10-05 15:17:59 (968 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2023-10-05T15:17:59.406 INFO:tasks.workunit.client.0.smithi060.stderr: 2023-10-05T15:17:59.406 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2023-10-05T15:17:59.442 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/ 2023-10-05T15:17:59.443 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/m4/ 2023-10-05T15:17:59.444 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/m4/acx_pthread.m4 2023-10-05T15:17:59.446 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/man/ 2023-10-05T15:17:59.447 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/man/blogbench.8 2023-10-05T15:17:59.448 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/man/Makefile.am 2023-10-05T15:17:59.448 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/man/Makefile.in 2023-10-05T15:17:59.449 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/ 2023-10-05T15:17:59.450 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/mysnprintf.c 2023-10-05T15:17:59.452 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/mysnprintf.h 2023-10-05T15:17:59.452 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/blogbench.c 2023-10-05T15:17:59.453 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/blogbench.h 2023-10-05T15:17:59.454 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/fakesnprintf.c 2023-10-05T15:17:59.455 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/fakesnprintf.h 2023-10-05T15:17:59.455 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/blogbench_p.h 2023-10-05T15:17:59.456 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/bsd-getopt_long.c 2023-10-05T15:17:59.457 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/bsd-getopt_long.h 2023-10-05T15:17:59.458 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/Makefile.am 2023-10-05T15:17:59.459 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/Makefile.in 2023-10-05T15:17:59.460 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/process.c 2023-10-05T15:17:59.460 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/globals.h 2023-10-05T15:17:59.461 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/commenter.c 2023-10-05T15:17:59.462 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/rewriter.c 2023-10-05T15:17:59.463 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/reader.c 2023-10-05T15:17:59.464 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/writer.c 2023-10-05T15:17:59.465 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/src/helpers.c 2023-10-05T15:17:59.466 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/NEWS 2023-10-05T15:17:59.467 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/compile 2023-10-05T15:17:59.468 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/depcomp 2023-10-05T15:17:59.469 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/aclocal.m4 2023-10-05T15:17:59.470 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/README 2023-10-05T15:17:59.471 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/configure 2023-10-05T15:17:59.474 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/configure.ac 2023-10-05T15:17:59.475 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/config.guess 2023-10-05T15:17:59.476 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/install-sh 2023-10-05T15:17:59.476 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/config.sub 2023-10-05T15:17:59.477 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/missing 2023-10-05T15:17:59.478 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/mkinstalldirs 2023-10-05T15:17:59.479 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/Makefile.am 2023-10-05T15:17:59.480 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/Makefile.in 2023-10-05T15:17:59.480 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/config.h.in 2023-10-05T15:17:59.481 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/AUTHORS 2023-10-05T15:17:59.482 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/INSTALL 2023-10-05T15:17:59.483 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/ChangeLog 2023-10-05T15:17:59.483 INFO:tasks.workunit.client.0.smithi060.stdout:blogbench-1.0/COPYING 2023-10-05T15:17:59.485 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd blogbench-1.0/ 2023-10-05T15:17:59.485 INFO:tasks.workunit.client.0.smithi060.stderr:+ echo 'making blogbench' 2023-10-05T15:17:59.485 INFO:tasks.workunit.client.0.smithi060.stdout:making blogbench 2023-10-05T15:17:59.486 INFO:tasks.workunit.client.0.smithi060.stderr:+ ./configure 2023-10-05T15:17:59.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:17:59 smithi135 ceph-mon[103360]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 14 op/s; 40 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:17:59.605 INFO:tasks.workunit.client.0.smithi060.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-10-05T15:17:59.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:17:59 smithi060 ceph-mon[99238]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 14 op/s; 40 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:17:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:17:59 smithi092 ceph-mon[102944]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 14 op/s; 40 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:00.617 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether build environment is sane... yes 2023-10-05T15:18:00.627 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gawk... gawk 2023-10-05T15:18:00.655 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether make sets $(MAKE)... yes 2023-10-05T15:18:00.669 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc... gcc 2023-10-05T15:18:00.723 INFO:tasks.workunit.client.0.smithi060.stdout:checking for C compiler default output file name... a.out 2023-10-05T15:18:00.724 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether the C compiler works... yes 2023-10-05T15:18:00.727 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are cross compiling... no 2023-10-05T15:18:00.765 INFO:tasks.workunit.client.0.smithi060.stdout:checking for suffix of executables... 2023-10-05T15:18:00.807 INFO:tasks.workunit.client.0.smithi060.stdout:checking for suffix of object files... o 2023-10-05T15:18:00.844 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are using the GNU C compiler... yes 2023-10-05T15:18:00.879 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether gcc accepts -g... yes 2023-10-05T15:18:00.922 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc option to accept ANSI C... none needed 2023-10-05T15:18:00.991 INFO:tasks.workunit.client.0.smithi060.stdout:checking for style of include used by make... GNU 2023-10-05T15:18:01.085 INFO:tasks.workunit.client.0.smithi060.stdout:checking dependency style of gcc... gcc3 2023-10-05T15:18:01.085 INFO:tasks.workunit.client.0.smithi060.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-10-05T15:18:01.125 INFO:tasks.workunit.client.0.smithi060.stdout:checking how to run the C preprocessor... gcc -E 2023-10-05T15:18:01.161 INFO:tasks.workunit.client.0.smithi060.stdout:checking for egrep... grep -E 2023-10-05T15:18:01.169 INFO:tasks.workunit.client.0.smithi060.stdout:checking for AIX... no 2023-10-05T15:18:01.237 INFO:tasks.workunit.client.0.smithi060.stdout:checking for library containing strerror... none required 2023-10-05T15:18:01.379 INFO:tasks.workunit.client.0.smithi060.stdout:checking for ANSI C header files... yes 2023-10-05T15:18:01.417 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-10-05T15:18:01.463 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/types.h... yes 2023-10-05T15:18:01.510 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/stat.h... yes 2023-10-05T15:18:01.578 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdlib.h... yes 2023-10-05T15:18:01.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:01 smithi135 ceph-mon[103360]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s; 34 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:01.656 INFO:tasks.workunit.client.0.smithi060.stdout:checking for string.h... yes 2023-10-05T15:18:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:01 smithi060 ceph-mon[99238]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s; 34 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:01 smithi092 ceph-mon[102944]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s; 34 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:01.706 INFO:tasks.workunit.client.0.smithi060.stdout:checking for memory.h... yes 2023-10-05T15:18:01.754 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strings.h... yes 2023-10-05T15:18:01.802 INFO:tasks.workunit.client.0.smithi060.stdout:checking for inttypes.h... yes 2023-10-05T15:18:01.850 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdint.h... yes 2023-10-05T15:18:01.900 INFO:tasks.workunit.client.0.smithi060.stdout:checking for unistd.h... yes 2023-10-05T15:18:01.913 INFO:tasks.workunit.client.0.smithi060.stdout:checking for memory.h... (cached) yes 2023-10-05T15:18:01.918 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strings.h... (cached) yes 2023-10-05T15:18:01.923 INFO:tasks.workunit.client.0.smithi060.stdout:checking for unistd.h... (cached) yes 2023-10-05T15:18:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:checking locale.h usability... yes 2023-10-05T15:18:01.984 INFO:tasks.workunit.client.0.smithi060.stdout:checking locale.h presence... yes 2023-10-05T15:18:01.985 INFO:tasks.workunit.client.0.smithi060.stdout:checking for locale.h... yes 2023-10-05T15:18:02.000 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdlib.h... (cached) yes 2023-10-05T15:18:02.005 INFO:tasks.workunit.client.0.smithi060.stdout:checking for string.h... (cached) yes 2023-10-05T15:18:02.051 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/socket.h usability... yes 2023-10-05T15:18:02.070 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/socket.h presence... yes 2023-10-05T15:18:02.070 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/socket.h... yes 2023-10-05T15:18:02.122 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/time.h usability... yes 2023-10-05T15:18:02.139 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/time.h presence... yes 2023-10-05T15:18:02.140 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/time.h... yes 2023-10-05T15:18:02.193 INFO:tasks.workunit.client.0.smithi060.stdout:checking fcntl.h usability... yes 2023-10-05T15:18:02.210 INFO:tasks.workunit.client.0.smithi060.stdout:checking fcntl.h presence... yes 2023-10-05T15:18:02.211 INFO:tasks.workunit.client.0.smithi060.stdout:checking for fcntl.h... yes 2023-10-05T15:18:02.266 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/fcntl.h usability... yes 2023-10-05T15:18:02.283 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/fcntl.h presence... yes 2023-10-05T15:18:02.284 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/fcntl.h... yes 2023-10-05T15:18:02.351 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/param.h usability... yes 2023-10-05T15:18:02.371 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/param.h presence... yes 2023-10-05T15:18:02.371 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/param.h... yes 2023-10-05T15:18:02.417 INFO:tasks.workunit.client.0.smithi060.stdout:checking ioctl.h usability... no 2023-10-05T15:18:02.433 INFO:tasks.workunit.client.0.smithi060.stdout:checking ioctl.h presence... no 2023-10-05T15:18:02.433 INFO:tasks.workunit.client.0.smithi060.stdout:checking for ioctl.h... no 2023-10-05T15:18:02.482 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/ioctl.h usability... yes 2023-10-05T15:18:02.499 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/ioctl.h presence... yes 2023-10-05T15:18:02.500 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/ioctl.h... yes 2023-10-05T15:18:02.550 INFO:tasks.workunit.client.0.smithi060.stdout:checking return type of signal handlers... void 2023-10-05T15:18:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:checking for size_t... yes 2023-10-05T15:18:02.632 INFO:tasks.workunit.client.0.smithi060.stdout:checking for dev_t... yes 2023-10-05T15:18:02.677 INFO:tasks.workunit.client.0.smithi060.stdout:checking for short... yes 2023-10-05T15:18:02.745 INFO:tasks.workunit.client.0.smithi060.stdout:checking size of short... 2 2023-10-05T15:18:02.789 INFO:tasks.workunit.client.0.smithi060.stdout:checking for int... yes 2023-10-05T15:18:02.853 INFO:tasks.workunit.client.0.smithi060.stdout:checking size of int... 4 2023-10-05T15:18:02.898 INFO:tasks.workunit.client.0.smithi060.stdout:checking for long... yes 2023-10-05T15:18:02.964 INFO:tasks.workunit.client.0.smithi060.stdout:checking size of long... 8 2023-10-05T15:18:03.007 INFO:tasks.workunit.client.0.smithi060.stdout:checking for long long... yes 2023-10-05T15:18:03.071 INFO:tasks.workunit.client.0.smithi060.stdout:checking size of long long... 8 2023-10-05T15:18:03.113 INFO:tasks.workunit.client.0.smithi060.stdout:checking for ssize_t... yes 2023-10-05T15:18:03.152 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sig_atomic_t... yes 2023-10-05T15:18:03.198 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether gcc needs -traditional... no 2023-10-05T15:18:03.234 INFO:tasks.workunit.client.0.smithi060.stdout:checking for an ANSI C-conforming const... yes 2023-10-05T15:18:03.258 INFO:tasks.workunit.client.0.smithi060.stdout:checking for inline... inline 2023-10-05T15:18:03.318 INFO:tasks.workunit.client.0.smithi060.stdout:checking for working alloca.h... yes 2023-10-05T15:18:03.365 INFO:tasks.workunit.client.0.smithi060.stdout:checking for alloca... yes 2023-10-05T15:18:03.433 INFO:tasks.workunit.client.0.smithi060.stdout:checking for working memcmp... yes 2023-10-05T15:18:03.486 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strftime... yes 2023-10-05T15:18:03.558 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2023-10-05T15:18:03.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:03 smithi135 ceph-mon[103360]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 24 op/s; 31 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:03.623 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether stat accepts an empty string... no 2023-10-05T15:18:03.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:03 smithi060 ceph-mon[99238]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 24 op/s; 31 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:03.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:03 smithi092 ceph-mon[102944]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 24 op/s; 31 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:checking for vprintf... yes 2023-10-05T15:18:03.733 INFO:tasks.workunit.client.0.smithi060.stdout:checking for _doprnt... no 2023-10-05T15:18:03.757 INFO:tasks.workunit.client.0.smithi060.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-10-05T15:18:03.770 INFO:tasks.workunit.client.0.smithi060.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-10-05T15:18:03.828 INFO:tasks.workunit.client.0.smithi060.stdout:checking for the pthreads library -lpthreads... no 2023-10-05T15:18:03.878 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether pthreads work without any flags... no 2023-10-05T15:18:03.893 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether pthreads work with -Kthread... no 2023-10-05T15:18:03.909 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether pthreads work with -kthread... no 2023-10-05T15:18:03.951 INFO:tasks.workunit.client.0.smithi060.stdout:checking for the pthreads library -llthread... no 2023-10-05T15:18:04.003 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether pthreads work with -pthread... yes 2023-10-05T15:18:04.048 INFO:tasks.workunit.client.0.smithi060.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2023-10-05T15:18:04.048 INFO:tasks.workunit.client.0.smithi060.stdout:checking if more special flags are required for pthreads... no 2023-10-05T15:18:04.048 INFO:tasks.workunit.client.0.smithi060.stdout:checking for cc_r... gcc 2023-10-05T15:18:04.131 INFO:tasks.workunit.client.0.smithi060.stdout:checking for setrlimit... yes 2023-10-05T15:18:04.190 INFO:tasks.workunit.client.0.smithi060.stdout:checking for setproctitle... no 2023-10-05T15:18:04.246 INFO:tasks.workunit.client.0.smithi060.stdout:checking for getopt_long... yes 2023-10-05T15:18:04.306 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strtoull... yes 2023-10-05T15:18:04.366 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strtoq... yes 2023-10-05T15:18:04.425 INFO:tasks.workunit.client.0.smithi060.stdout:checking for snprintf... yes 2023-10-05T15:18:04.484 INFO:tasks.workunit.client.0.smithi060.stdout:checking for vsnprintf... yes 2023-10-05T15:18:04.544 INFO:tasks.workunit.client.0.smithi060.stdout:checking for vfprintf... yes 2023-10-05T15:18:04.604 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gethostname... yes 2023-10-05T15:18:04.666 INFO:tasks.workunit.client.0.smithi060.stdout:checking for setlocale... yes 2023-10-05T15:18:04.728 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sync... yes 2023-10-05T15:18:04.981 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether snprintf is C99 conformant... done 2023-10-05T15:18:04.991 INFO:tasks.workunit.client.0.smithi060.stdout:configure: creating ./config.status 2023-10-05T15:18:05.159 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating Makefile 2023-10-05T15:18:05.177 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating src/Makefile 2023-10-05T15:18:05.196 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating man/Makefile 2023-10-05T15:18:05.209 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating config.h 2023-10-05T15:18:05.259 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: executing depfiles commands 2023-10-05T15:18:05.448 INFO:tasks.workunit.client.0.smithi060.stderr:+ make 2023-10-05T15:18:05.459 INFO:tasks.workunit.client.0.smithi060.stdout:make all-recursive 2023-10-05T15:18:05.460 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-05T15:18:05.462 INFO:tasks.workunit.client.0.smithi060.stdout:Making all in src 2023-10-05T15:18:05.469 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-10-05T15:18:05.469 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2023-10-05T15:18:05.469 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2023-10-05T15:18:05.548 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2023-10-05T15:18:05.548 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2023-10-05T15:18:05.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:05 smithi135 ceph-mon[103360]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 33 KiB/s wr, 21 op/s; 27 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:05.611 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2023-10-05T15:18:05.611 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2023-10-05T15:18:05.661 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2023-10-05T15:18:05.662 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2023-10-05T15:18:05.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:05 smithi060 ceph-mon[99238]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 33 KiB/s wr, 21 op/s; 27 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:05.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:05 smithi092 ceph-mon[102944]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 33 KiB/s wr, 21 op/s; 27 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:05.710 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2023-10-05T15:18:05.711 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2023-10-05T15:18:05.759 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2023-10-05T15:18:05.759 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2023-10-05T15:18:05.805 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2023-10-05T15:18:05.805 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2023-10-05T15:18:05.874 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2023-10-05T15:18:05.874 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2023-10-05T15:18:05.907 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2023-10-05T15:18:05.907 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2023-10-05T15:18:05.941 INFO:tasks.workunit.client.0.smithi060.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2023-10-05T15:18:05.941 INFO:tasks.workunit.client.0.smithi060.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2023-10-05T15:18:05.978 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2023-10-05T15:18:05.997 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-10-05T15:18:05.997 INFO:tasks.workunit.client.0.smithi060.stdout:Making all in man 2023-10-05T15:18:06.024 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-10-05T15:18:06.024 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Nothing to be done for 'all'. 2023-10-05T15:18:06.024 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-10-05T15:18:06.025 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-05T15:18:06.026 INFO:tasks.workunit.client.0.smithi060.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-05T15:18:06.026 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-10-05T15:18:06.027 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd src 2023-10-05T15:18:06.027 INFO:tasks.workunit.client.0.smithi060.stderr:+ mkdir blogtest_in 2023-10-05T15:18:06.029 INFO:tasks.workunit.client.0.smithi060.stdout:running blogbench 2023-10-05T15:18:06.030 INFO:tasks.workunit.client.0.smithi060.stderr:+ echo 'running blogbench' 2023-10-05T15:18:06.030 INFO:tasks.workunit.client.0.smithi060.stderr:+ ./blogbench -d blogtest_in 2023-10-05T15:18:06.030 INFO:tasks.workunit.client.0.smithi060.stdout: 2023-10-05T15:18:06.030 INFO:tasks.workunit.client.0.smithi060.stdout:Frequency = 10 secs 2023-10-05T15:18:06.030 INFO:tasks.workunit.client.0.smithi060.stdout:Scratch dir = [blogtest_in] 2023-10-05T15:18:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:07 smithi135 ceph-mon[103360]: pgmap v43: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 483 KiB/s wr, 61 op/s; 27 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:07.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:07 smithi060 ceph-mon[99238]: pgmap v43: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 483 KiB/s wr, 61 op/s; 27 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:07 smithi092 ceph-mon[102944]: pgmap v43: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 483 KiB/s wr, 61 op/s; 27 KiB/s, 0 keys/s, 0 objects/s recovering 2023-10-05T15:18:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:Spawning 3 writers... 2023-10-05T15:18:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:Spawning 1 rewriters... 2023-10-05T15:18:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:Spawning 5 commenters... 2023-10-05T15:18:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:Spawning 100 readers... 2023-10-05T15:18:08.242 INFO:tasks.workunit.client.0.smithi060.stdout:Benchmarking for 30 iterations. 2023-10-05T15:18:08.242 INFO:tasks.workunit.client.0.smithi060.stdout:The test will run during 5 minutes. 2023-10-05T15:18:08.242 INFO:tasks.workunit.client.0.smithi060.stdout: 2023-10-05T15:18:08.242 INFO:tasks.workunit.client.0.smithi060.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2023-10-05T15:18:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:09 smithi135 ceph-mon[103360]: pgmap v44: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 483 KiB/s wr, 57 op/s 2023-10-05T15:18:09.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:09 smithi060 ceph-mon[99238]: pgmap v44: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 483 KiB/s wr, 57 op/s 2023-10-05T15:18:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:09 smithi092 ceph-mon[102944]: pgmap v44: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 483 KiB/s wr, 57 op/s 2023-10-05T15:18:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 -- 172.21.15.60:0/2654994860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea28101a70 msgr2=0x7fea28105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 --2- 172.21.15.60:0/2654994860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea28101a70 0x7fea28105ab0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fea18009990 tx=0x7fea18009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 -- 172.21.15.60:0/2654994860 shutdown_connections 2023-10-05T15:18:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 --2- 172.21.15.60:0/2654994860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281061e0 0x7fea2810dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 --2- 172.21.15.60:0/2654994860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281010c0 0x7fea281014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 --2- 172.21.15.60:0/2654994860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea28101a70 0x7fea28105ab0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 -- 172.21.15.60:0/2654994860 >> 172.21.15.60:0/2654994860 conn(0x7fea280fc940 msgr2=0x7fea280fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 -- 172.21.15.60:0/2654994860 shutdown_connections 2023-10-05T15:18:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.092+0000 7fea303b7700 1 -- 172.21.15.60:0/2654994860 wait complete. 2023-10-05T15:18:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 Processor -- start 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 -- start start 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281010c0 0x7fea28196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281061e0 0x7fea28197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea2819bb40 0x7fea2819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819c5c0 con 0x7fea2819bb40 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819c730 con 0x7fea281061e0 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea303b7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819c8f0 con 0x7fea281010c0 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2d952700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281061e0 0x7fea28197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e954700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea2819bb40 0x7fea2819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2d952700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281061e0 0x7fea28197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53070/0 (socket says 172.21.15.60:53070) 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2d952700 1 -- 172.21.15.60:0/2461110953 learned_addr learned my addr 172.21.15.60:0/2461110953 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e153700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281010c0 0x7fea28196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e954700 1 -- 172.21.15.60:0/2461110953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281010c0 msgr2=0x7fea28196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e954700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281010c0 0x7fea28196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e954700 1 -- 172.21.15.60:0/2461110953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281061e0 msgr2=0x7fea28197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e954700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281061e0 0x7fea28197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.093+0000 7fea2e954700 1 -- 172.21.15.60:0/2461110953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24009520 con 0x7fea2819bb40 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.094+0000 7fea2e954700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea2819bb40 0x7fea2819bfc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea2000cc50 tx=0x7fea2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.094+0000 7fea1f7fe700 1 -- 172.21.15.60:0/2461110953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000aa90 con 0x7fea2819bb40 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.094+0000 7fea1f7fe700 1 -- 172.21.15.60:0/2461110953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea2000abf0 con 0x7fea2819bb40 2023-10-05T15:18:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.094+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180095f0 con 0x7fea2819bb40 2023-10-05T15:18:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.094+0000 7fea1f7fe700 1 -- 172.21.15.60:0/2461110953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200115e0 con 0x7fea2819bb40 2023-10-05T15:18:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.094+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281a4150 con 0x7fea2819bb40 2023-10-05T15:18:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.096+0000 7fea1f7fe700 1 -- 172.21.15.60:0/2461110953 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7fea20012420 con 0x7fea2819bb40 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.096+0000 7fea1f7fe700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fea140a1710 0x7fea140a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.097+0000 7fea2e153700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fea140a1710 0x7fea140a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.097+0000 7fea1f7fe700 1 -- 172.21.15.60:0/2461110953 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fea200cd650 con 0x7fea2819bb40 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.097+0000 7fea2e153700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fea140a1710 0x7fea140a3bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea24009df0 tx=0x7fea24009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.097+0000 7fea3c5a1b80 1 Processor -- start 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 -- start start 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592934efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x555929359e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x55592935c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559292b8400 con 0x55592934ec00 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559292a9bc0 con 0x55592935a3d0 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559292a74e0 con 0x55592934f520 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592934efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x55592935c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592934efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39654/0 (socket says 172.21.15.60:39654) 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e153700 1 -- 172.21.15.60:0/2260355004 learned_addr learned my addr 172.21.15.60:0/2260355004 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2d952700 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x555929359e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 -- 172.21.15.60:0/2260355004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 msgr2=0x555929359e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x555929359e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 -- 172.21.15.60:0/2260355004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 msgr2=0x55592934efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592934efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 -- 172.21.15.60:0/2260355004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559290cdd80 con 0x55592935a3d0 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2d952700 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x555929359e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.098+0000 7fea2e954700 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x55592935c7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea200caa10 tx=0x7fea2009a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f848d8530e3b68 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea1cd82700 1 -- 172.21.15.60:0/2260355004 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2009a8d0 con 0x55592935a3d0 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea1cd82700 1 -- 172.21.15.60:0/2260355004 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea2009a1d0 con 0x55592935a3d0 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea1cd82700 1 -- 172.21.15.60:0/2260355004 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200cd2d0 con 0x55592935a3d0 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2260355004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 msgr2=0x55592935c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x55592935c7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea200caa10 tx=0x7fea2009a0d0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2260355004 shutdown_connections 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x55592935c7c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592934efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2260355004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x555929359e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.099+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2260355004 >> 172.21.15.60:0/2260355004 conn(0x5559292c4200 msgr2=0x55592934b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2260355004 shutdown_connections 2023-10-05T15:18:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2260355004 wait complete. 2023-10-05T15:18:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 -- start start 2023-10-05T15:18:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 Processor -- start 2023-10-05T15:18:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x555929359e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x5559293570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x555929357830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559292a2dd0 con 0x55592934ec00 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592923f6b0 con 0x55592935a3d0 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.100+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592923f350 con 0x55592934f520 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x555929359e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea3c5a1b80 10 client.0 _ll_register_callbacks cb 0x55592909c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x555929359e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39660/0 (socket says 172.21.15.60:39660) 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 -- 172.21.15.60:0/2840008584 learned_addr learned my addr 172.21.15.60:0/2840008584 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e954700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x555929357830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2d952700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x5559293570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 -- 172.21.15.60:0/2840008584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 msgr2=0x5559293570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x5559293570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 -- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 msgr2=0x555929357830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x555929357830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 -- 172.21.15.60:0/2840008584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281a4150 con 0x55592934ec00 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2d952700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x5559293570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e954700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x555929357830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea2e153700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x555929359e00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fea2400ed50 tx=0x7fea240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1089dd33540b9e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea11ffb700 1 -- 172.21.15.60:0/2840008584 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24022070 con 0x55592934ec00 2023-10-05T15:18:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea11ffb700 1 -- 172.21.15.60:0/2840008584 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fea2400ee40 con 0x55592934ec00 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555929342d50 con 0x55592934ec00 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea11ffb700 1 -- 172.21.15.60:0/2840008584 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea2401ddc0 con 0x55592934ec00 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea3c5a1b80 10 client.16122 fetch_fsmap learned FSMap version 27 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.101+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5559290b6c00 con 0x55592934ec00 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea11ffb700 1 -- 172.21.15.60:0/2840008584 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555929342d50 con 0x55592934ec00 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea11ffb700 1 -- 172.21.15.60:0/2840008584 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fea24026410 con 0x55592934ec00 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea3c5a1b80 10 client.16122 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea3c5a1b80 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea3c5a1b80 20 client.16122 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555929369f40 0x55592936c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea3c5a1b80 4 client.16122 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55592929bdb0 con 0x555929369f40 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea2d952700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555929369f40 0x55592936c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea11ffb700 10 client.16122 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.102+0000 7fea2d952700 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555929369f40 0x55592936c360 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f37258f7e654af server_cookie=e95eb13cea153426 in_seq=0 out_seq=0 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.106+0000 7fea11ffb700 1 -- 172.21.15.60:0/2840008584 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55592929bdb0 con 0x555929369f40 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.106+0000 7fea11ffb700 10 client.16122 handle_command_reply: tid=0 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.106+0000 7fea3c5a1b80 1 client.16122 shutdown 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 msgr2=0x555929359e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x555929359e00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fea2400ed50 tx=0x7fea240047c0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 shutdown_connections 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555929369f40 0x55592936c360 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x555929357830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea11ffb700 0 client.16122 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x555929359e00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2840008584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934f520 0x5559293570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 >> 172.21.15.60:0/2840008584 conn(0x5559292c4200 msgr2=0x55592934ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 shutdown_connections 2023-10-05T15:18:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2840008584 wait complete. 2023-10-05T15:18:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.107+0000 7fea3c5a1b80 20 client.16122 trim_cache size 0 max 16384 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 Processor -- start 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 -- start start 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934ec00 0x5559293577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 0x5559293599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x5559293568b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559291238c0 con 0x55592934f520 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555929352f60 con 0x55592935a3d0 2023-10-05T15:18:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592934c480 con 0x55592934ec00 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea2d952700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 0x5559293599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea2e954700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x5559293568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea2d952700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 0x5559293599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39670/0 (socket says 172.21.15.60:39670) 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.122+0000 7fea2d952700 1 -- 172.21.15.60:0/2276966038 learned_addr learned my addr 172.21.15.60:0/2276966038 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2e153700 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934ec00 0x5559293577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2d952700 1 -- 172.21.15.60:0/2276966038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934ec00 msgr2=0x5559293577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2d952700 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934ec00 0x5559293577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2d952700 1 -- 172.21.15.60:0/2276966038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 msgr2=0x5559293568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2d952700 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x5559293568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2d952700 1 -- 172.21.15.60:0/2276966038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559290f41f0 con 0x55592934f520 2023-10-05T15:18:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2e954700 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x5559293568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea2d952700 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 0x5559293599a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fea1800b2e0 tx=0x7fea18009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d8c06c7d21d918 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea1d583700 1 -- 172.21.15.60:0/2276966038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1801d070 con 0x55592934f520 2023-10-05T15:18:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea1d583700 1 -- 172.21.15.60:0/2276966038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea1801e040 con 0x55592934f520 2023-10-05T15:18:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.123+0000 7fea1d583700 1 -- 172.21.15.60:0/2276966038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800f460 con 0x55592934f520 2023-10-05T15:18:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2276966038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 msgr2=0x5559293599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 0x5559293599a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fea1800b2e0 tx=0x7fea18009310 comp rx=0 tx=0).stop 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2276966038 shutdown_connections 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592935a3d0 0x5559293568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592934ec00 0x5559293577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2276966038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934f520 0x5559293599a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2276966038 >> 172.21.15.60:0/2276966038 conn(0x5559292c4200 msgr2=0x555929366150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2276966038 shutdown_connections 2023-10-05T15:18:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2276966038 wait complete. 2023-10-05T15:18:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- start start 2023-10-05T15:18:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 Processor -- start 2023-10-05T15:18:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592935f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 0x55592935f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592935a3d0 0x5559293bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592935fdc0 con 0x55592934ec00 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559293bd270 con 0x55592934f520 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559293bd3e0 con 0x55592935a3d0 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea3c5a1b80 10 client.0 _ll_register_callbacks cb 0x55592909c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.124+0000 7fea2e153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592935f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2d952700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 0x55592935f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2d952700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 0x55592935f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53098/0 (socket says 172.21.15.60:53098) 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592935f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39674/0 (socket says 172.21.15.60:39674) 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2d952700 1 -- 172.21.15.60:0/2607227795 learned_addr learned my addr 172.21.15.60:0/2607227795 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e954700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592935a3d0 0x5559293bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 -- 172.21.15.60:0/2607227795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592935a3d0 msgr2=0x5559293bcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592935a3d0 0x5559293bcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 -- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 msgr2=0x55592935f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 0x55592935f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 -- 172.21.15.60:0/2607227795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559290cdd80 con 0x55592934ec00 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2d952700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 0x55592935f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea2e153700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592935f0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fea24016040 tx=0x7fea240266a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b1b5778d3cfc08 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea11ffb700 1 -- 172.21.15.60:0/2607227795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24022030 con 0x55592934ec00 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea11ffb700 1 -- 172.21.15.60:0/2607227795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fea24023070 con 0x55592934ec00 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea2009a1d0 con 0x55592934ec00 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea11ffb700 1 -- 172.21.15.60:0/2607227795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea2400ee40 con 0x55592934ec00 2023-10-05T15:18:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea3c5a1b80 10 client.16128 fetch_fsmap learned FSMap version 27 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.125+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fea2810e5d0 con 0x55592934ec00 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea11ffb700 1 -- 172.21.15.60:0/2607227795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea2009a1d0 con 0x55592934ec00 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea11ffb700 1 -- 172.21.15.60:0/2607227795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fea240039f0 con 0x55592934ec00 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea3c5a1b80 10 client.16128 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea3c5a1b80 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea3c5a1b80 20 client.16128 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5559293beb90 0x5559293c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea3c5a1b80 4 client.16128 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55592929bad0 con 0x5559293beb90 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea2d952700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5559293beb90 0x5559293c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea11ffb700 10 client.16128 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:11.126+0000 7fea2d952700 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5559293beb90 0x5559293c0fb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c181477716f3e460 server_cookie=873c54d176da0f52 in_seq=0 out_seq=0 2023-10-05T15:18:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:11 smithi135 ceph-mon[103360]: pgmap v45: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 483 KiB/s wr, 57 op/s 2023-10-05T15:18:11.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:11 smithi060 ceph-mon[99238]: pgmap v45: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 483 KiB/s wr, 57 op/s 2023-10-05T15:18:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:11 smithi092 ceph-mon[102944]: pgmap v45: 129 pgs: 129 active+clean; 6.2 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 483 KiB/s wr, 57 op/s 2023-10-05T15:18:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.894+0000 7fea11ffb700 1 -- 172.21.15.60:0/2607227795 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55592929bad0 con 0x5559293beb90 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.894+0000 7fea11ffb700 10 client.16128 handle_command_reply: tid=0 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.894+0000 7fea3c5a1b80 1 client.16128 shutdown 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.894+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 msgr2=0x55592935f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.894+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592935f0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fea24016040 tx=0x7fea240266a0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 shutdown_connections 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5559293beb90 0x5559293c0fb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55592935a3d0 0x5559293bcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55592934ec00 0x55592935f0f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 --2- 172.21.15.60:0/2607227795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55592934f520 0x55592935f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 >> 172.21.15.60:0/2607227795 conn(0x5559292c4200 msgr2=0x555929350bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea11ffb700 0 client.16128 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 shutdown_connections 2023-10-05T15:18:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.895+0000 7fea3c5a1b80 1 -- 172.21.15.60:0/2607227795 wait complete. 2023-10-05T15:18:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.924+0000 7fea3c5a1b80 20 client.16128 trim_cache size 0 max 16384 2023-10-05T15:18:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:18:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:18:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:18:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fea140a1710 msgr2=0x7fea140a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fea140a1710 0x7fea140a3bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea24009df0 tx=0x7fea24009260 comp rx=0 tx=0).stop 2023-10-05T15:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea2819bb40 msgr2=0x7fea2819bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea2819bb40 0x7fea2819bfc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea2000cc50 tx=0x7fea2000cf60 comp rx=0 tx=0).stop 2023-10-05T15:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 shutdown_connections 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea2819bb40 0x7fea2819bfc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281010c0 0x7fea28196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fea140a1710 0x7fea140a3bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 --2- 172.21.15.60:0/2461110953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea281061e0 0x7fea28197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.956+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 >> 172.21.15.60:0/2461110953 conn(0x7fea280fc940 msgr2=0x7fea280fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.957+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 shutdown_connections 2023-10-05T15:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:12.957+0000 7fea303b7700 1 -- 172.21.15.60:0/2461110953 wait complete. 2023-10-05T15:18:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:13 smithi135 ceph-mon[103360]: pgmap v46: 129 pgs: 129 active+clean; 10 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 936 KiB/s wr, 86 op/s 2023-10-05T15:18:13.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:13 smithi060 ceph-mon[99238]: pgmap v46: 129 pgs: 129 active+clean; 10 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 936 KiB/s wr, 86 op/s 2023-10-05T15:18:13.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:13 smithi092 ceph-mon[102944]: pgmap v46: 129 pgs: 129 active+clean; 10 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 936 KiB/s wr, 86 op/s 2023-10-05T15:18:14.273 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[138967]: *** Caught signal (Segmentation fault) ** 2023-10-05T15:18:14.273 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[138967]: in thread 7f36afa61700 thread_name:MR_Finisher 2023-10-05T15:18:14.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:14 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:14.581 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:14 smithi135 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f.service: Main process exited, code=exited, status=139/n/a 2023-10-05T15:18:14.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:14 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:14.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:14 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:15.081 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:14 smithi135 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f.service: Failed with result 'exit-code'. 2023-10-05T15:18:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:15 smithi135 ceph-mon[103360]: pgmap v47: 129 pgs: 129 active+clean; 10 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 903 KiB/s wr, 69 op/s 2023-10-05T15:18:15.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:15 smithi060 ceph-mon[99238]: pgmap v47: 129 pgs: 129 active+clean; 10 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 903 KiB/s wr, 69 op/s 2023-10-05T15:18:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:15 smithi092 ceph-mon[102944]: pgmap v47: 129 pgs: 129 active+clean; 10 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 903 KiB/s wr, 69 op/s 2023-10-05T15:18:17.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:17 smithi135 ceph-mon[103360]: pgmap v48: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 601 op/s 2023-10-05T15:18:17.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:17 smithi060 ceph-mon[99238]: pgmap v48: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 601 op/s 2023-10-05T15:18:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:17 smithi092 ceph-mon[102944]: pgmap v48: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 601 op/s 2023-10-05T15:18:18.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 -- 172.21.15.60:0/1285563626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c100940 msgr2=0x7f4f7c104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 --2- 172.21.15.60:0/1285563626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c100940 0x7f4f7c104980 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 -- 172.21.15.60:0/1285563626 shutdown_connections 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 --2- 172.21.15.60:0/1285563626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f7c1050b0 0x7f4f7c10cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 --2- 172.21.15.60:0/1285563626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 --2- 172.21.15.60:0/1285563626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c100940 0x7f4f7c104980 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 -- 172.21.15.60:0/1285563626 >> 172.21.15.60:0/1285563626 conn(0x7f4f7c0fb830 msgr2=0x7f4f7c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 -- 172.21.15.60:0/1285563626 shutdown_connections 2023-10-05T15:18:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.183+0000 7f4f817a5700 1 -- 172.21.15.60:0/1285563626 wait complete. 2023-10-05T15:18:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 Processor -- start 2023-10-05T15:18:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 -- start start 2023-10-05T15:18:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c1050b0 0x7f4f7c196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f7c19a830 0x7f4f7c19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c19b2b0 con 0x7f4f7c0fff90 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c19b420 con 0x7f4f7c19a830 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f817a5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c19b5e0 con 0x7f4f7c1050b0 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39688/0 (socket says 172.21.15.60:39688) 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f7affd700 1 -- 172.21.15.60:0/531439256 learned_addr learned my addr 172.21.15.60:0/531439256 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c1050b0 0x7f4f7c196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.184+0000 7f4f7b7fe700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f7c19a830 0x7f4f7c19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f7affd700 1 -- 172.21.15.60:0/531439256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c1050b0 msgr2=0x7f4f7c196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f7affd700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c1050b0 0x7f4f7c196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f7affd700 1 -- 172.21.15.60:0/531439256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f7c19a830 msgr2=0x7f4f7c19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f7affd700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f7c19a830 0x7f4f7c19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f7affd700 1 -- 172.21.15.60:0/531439256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f700095f0 con 0x7f4f7c0fff90 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f7affd700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c195ee0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00eab0 tx=0x7f4f6c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f63fff700 1 -- 172.21.15.60:0/531439256 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c013070 con 0x7f4f7c0fff90 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c0680a0 con 0x7f4f7c0fff90 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f63fff700 1 -- 172.21.15.60:0/531439256 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f6c00be80 con 0x7f4f7c0fff90 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f63fff700 1 -- 172.21.15.60:0/531439256 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0163b0 con 0x7f4f7c0fff90 2023-10-05T15:18:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.185+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c068580 con 0x7f4f7c0fff90 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.188+0000 7f4f63fff700 1 -- 172.21.15.60:0/531439256 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f4f6c0175a0 con 0x7f4f7c0fff90 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.188+0000 7f4f63fff700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4f640a1710 0x7f4f640a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.188+0000 7f4f63fff700 1 -- 172.21.15.60:0/531439256 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4f6c0cec80 con 0x7f4f7c0fff90 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.188+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4f640a1710 0x7f4f640a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 Processor -- start 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 -- start start 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4f640a1710 0x7f4f640a3bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000b2e0 tx=0x7f4f70005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x56310002f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100032090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630fff89460 con 0x563100024df0 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630fff7ac20 con 0x56310002fca0 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630fff78540 con 0x5631000244d0 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x56310002f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x56310002f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39698/0 (socket says 172.21.15.60:39698) 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/964037291 learned_addr learned my addr 172.21.15.60:0/964037291 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7b7fe700 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100032090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/964037291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 msgr2=0x5631000248b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000248b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/964037291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 msgr2=0x563100032090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100032090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/964037291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630ffd9ede0 con 0x563100024df0 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.189+0000 7f4f7affd700 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000248b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x56310002f760 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700ba5a5d9238f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f617fa700 1 -- 172.21.15.60:0/964037291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70004500 con 0x563100024df0 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f617fa700 1 -- 172.21.15.60:0/964037291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f7001e040 con 0x563100024df0 2023-10-05T15:18:18.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f617fa700 1 -- 172.21.15.60:0/964037291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000f980 con 0x563100024df0 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/964037291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 msgr2=0x56310002f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x56310002f760 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70020000 comp rx=0 tx=0).stop 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/964037291 shutdown_connections 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100032090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000248b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/964037291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x56310002f760 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.190+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/964037291 >> 172.21.15.60:0/964037291 conn(0x5630fff95260 msgr2=0x56310001c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/964037291 shutdown_connections 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/964037291 wait complete. 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 -- start start 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 Processor -- start 2023-10-05T15:18:18.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x56310002ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563100024df0 0x56310002cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x56310002d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630fff73e30 con 0x5631000244d0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630fff10710 con 0x56310002fca0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630fff103b0 con 0x563100024df0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f8d98fb80 10 client.0 _ll_register_callbacks cb 0x5630ffd6d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x56310002ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x56310002ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39702/0 (socket says 172.21.15.60:39702) 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f7affd700 1 -- 172.21.15.60:0/1255944540 learned_addr learned my addr 172.21.15.60:0/1255944540 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563100024df0 0x56310002cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.191+0000 7f4f7b7fe700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x56310002d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f7affd700 1 -- 172.21.15.60:0/1255944540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563100024df0 msgr2=0x56310002cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f7affd700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563100024df0 0x56310002cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f7affd700 1 -- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 msgr2=0x56310002d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f7affd700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x56310002d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f7affd700 1 -- 172.21.15.60:0/1255944540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c068580 con 0x5631000244d0 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f7affd700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x56310002ca40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00b5a0 tx=0x7f4f6c09bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58305c003d3b0e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f5eff5700 1 -- 172.21.15.60:0/1255944540 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0a37f0 con 0x5631000244d0 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f5eff5700 1 -- 172.21.15.60:0/1255944540 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4f6c09bdf0 con 0x5631000244d0 2023-10-05T15:18:18.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563100013f10 con 0x5631000244d0 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f5eff5700 1 -- 172.21.15.60:0/1255944540 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6c09b230 con 0x5631000244d0 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f8d98fb80 10 client.16140 fetch_fsmap learned FSMap version 28 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f4f7c10d4a0 con 0x5631000244d0 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.192+0000 7f4f5eff5700 1 -- 172.21.15.60:0/1255944540 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563100013f10 con 0x5631000244d0 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f5eff5700 1 -- 172.21.15.60:0/1255944540 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4f6c0cc210 con 0x5631000244d0 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f8d98fb80 10 client.16140 fetch_fsmap finished waiting for FSMap version 28 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f8d98fb80 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f8d98fb80 20 client.16140 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56310003f790 0x563100041b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f8d98fb80 4 client.16140 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630fff6ce10 con 0x56310003f790 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56310003f790 0x563100041b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f5eff5700 10 client.16140 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.193+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56310003f790 0x563100041b80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca674e8f5f4792c server_cookie=1595530ca6a9bee7 in_seq=0 out_seq=0 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f5eff5700 1 -- 172.21.15.60:0/1255944540 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630fff6ce10 con 0x56310003f790 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f5eff5700 10 client.16140 handle_command_reply: tid=0 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 client.16140 shutdown 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 msgr2=0x56310002ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x56310002ca40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00b5a0 tx=0x7f4f6c09bc30 comp rx=0 tx=0).stop 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 shutdown_connections 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56310003f790 0x563100041b80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x56310002d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x56310002ca40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1255944540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563100024df0 0x56310002cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f5eff5700 0 client.16140 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:18.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 >> 172.21.15.60:0/1255944540 conn(0x5630fff95260 msgr2=0x56310001bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 shutdown_connections 2023-10-05T15:18:18.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1255944540 wait complete. 2023-10-05T15:18:18.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.194+0000 7f4f8d98fb80 20 client.16140 trim_cache size 0 max 16384 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 Processor -- start 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 -- start start 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x563100027470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563100024df0 0x56310002d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56310002fca0 0x56310002b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ffdf4920 con 0x5631000244d0 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100022150 con 0x563100024df0 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.212+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100028890 con 0x56310002fca0 2023-10-05T15:18:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x563100027470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x563100027470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39710/0 (socket says 172.21.15.60:39710) 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 -- 172.21.15.60:0/1832153995 learned_addr learned my addr 172.21.15.60:0/1832153995 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563100024df0 0x56310002d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7b7fe700 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56310002fca0 0x56310002b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 -- 172.21.15.60:0/1832153995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56310002fca0 msgr2=0x56310002b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56310002fca0 0x56310002b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 -- 172.21.15.60:0/1832153995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563100024df0 msgr2=0x56310002d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563100024df0 0x56310002d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 -- 172.21.15.60:0/1832153995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630ffd87c60 con 0x5631000244d0 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563100024df0 0x56310002d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f7affd700 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x563100027470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000c00 tx=0x7f4f6c0862c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb83145447739dd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f61ffb700 1 -- 172.21.15.60:0/1832153995 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c09b230 con 0x5631000244d0 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f61ffb700 1 -- 172.21.15.60:0/1832153995 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f6c09b050 con 0x5631000244d0 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.213+0000 7f4f61ffb700 1 -- 172.21.15.60:0/1832153995 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c09b6f0 con 0x5631000244d0 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1832153995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 msgr2=0x563100027470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x563100027470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000c00 tx=0x7f4f6c0862c0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1832153995 shutdown_connections 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56310002fca0 0x56310002b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631000244d0 0x563100027470 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/1832153995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563100024df0 0x56310002d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1832153995 >> 172.21.15.60:0/1832153995 conn(0x5630fff95260 msgr2=0x56310002b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1832153995 shutdown_connections 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/1832153995 wait complete. 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- start start 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 Processor -- start 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x563100034930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100092570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.214+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100035010 con 0x563100024df0 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100092ab0 con 0x56310002fca0 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f8d98fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100092bf0 con 0x5631000244d0 2023-10-05T15:18:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f8d98fb80 10 client.0 _ll_register_callbacks cb 0x7f4f6c097a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x563100034930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x563100034930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39718/0 (socket says 172.21.15.60:39718) 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/411633218 learned_addr learned my addr 172.21.15.60:0/411633218 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53246/0 (socket says 172.21.15.60:53246) 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7b7fe700 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100092570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/411633218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 msgr2=0x5631000343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 msgr2=0x563100092570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100092570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 -- 172.21.15.60:0/411633218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c10d4a0 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f7a7fc700 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x563100034930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5782407372a31c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f5eff5700 1 -- 172.21.15.60:0/411633218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7003be60 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f5eff5700 1 -- 172.21.15.60:0/411633218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4f7003b050 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f7001e040 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f5eff5700 1 -- 172.21.15.60:0/411633218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f7003b210 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f8d98fb80 10 client.16146 fetch_fsmap learned FSMap version 28 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.215+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5630ffdc5250 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f5eff5700 1 -- 172.21.15.60:0/411633218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f7001e040 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f5eff5700 1 -- 172.21.15.60:0/411633218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4f70004800 con 0x563100024df0 2023-10-05T15:18:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f8d98fb80 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2023-10-05T15:18:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f8d98fb80 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f8d98fb80 20 client.16146 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563100093ff0 0x563100096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f8d98fb80 4 client.16146 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:18:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630fff6cb30 con 0x563100093ff0 2023-10-05T15:18:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.216+0000 7f4f7affd700 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563100093ff0 0x563100096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f5eff5700 10 client.16146 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f7affd700 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563100093ff0 0x563100096410 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ad4c96e64bbf5d server_cookie=adfa18ebc50e7638 in_seq=0 out_seq=0 2023-10-05T15:18:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f5eff5700 1 -- 172.21.15.60:0/411633218 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5630fff6cb30 con 0x563100093ff0 2023-10-05T15:18:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f5eff5700 10 client.16146 handle_command_reply: tid=0 2023-10-05T15:18:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 client.16146 shutdown 2023-10-05T15:18:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 msgr2=0x563100034930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x563100034930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70005700 comp rx=0 tx=0).stop 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 shutdown_connections 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563100093ff0 0x563100096410 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56310002fca0 0x563100092570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f5eff5700 0 client.16146 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631000244d0 0x5631000343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 --2- 172.21.15.60:0/411633218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563100024df0 0x563100034930 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 >> 172.21.15.60:0/411633218 conn(0x5630fff95260 msgr2=0x56310002ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 shutdown_connections 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 1 -- 172.21.15.60:0/411633218 wait complete. 2023-10-05T15:18:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.217+0000 7f4f8d98fb80 20 client.16146 trim_cache size 0 max 16384 2023-10-05T15:18:18.227 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:18:18.227 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2023-10-05T15:18:18.227 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2023-10-05T15:18:18.227 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4f640a1710 msgr2=0x7f4f640a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4f640a1710 0x7f4f640a3bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000b2e0 tx=0x7f4f70005960 comp rx=0 tx=0).stop 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 msgr2=0x7f4f7c195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c195ee0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00eab0 tx=0x7f4f6c00edc0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 shutdown_connections 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4f640a1710 0x7f4f640a3bd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f7c19a830 0x7f4f7c19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f7c0fff90 0x7f4f7c195ee0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 --2- 172.21.15.60:0/531439256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f7c1050b0 0x7f4f7c196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 >> 172.21.15.60:0/531439256 conn(0x7f4f7c0fb830 msgr2=0x7f4f7c0fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 shutdown_connections 2023-10-05T15:18:18.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.218+0000 7f4f817a5700 1 -- 172.21.15.60:0/531439256 wait complete. 2023-10-05T15:18:18.231 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-05T15:18:18.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:18:18.242 INFO:tasks.workunit.client.0.smithi060.stdout: 8 83737 680 51477 572 21278 672 2023-10-05T15:18:18.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 -- 172.21.15.60:0/1581685028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c101050 msgr2=0x7f688c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 --2- 172.21.15.60:0/1581685028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c101050 0x7f688c101430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6888009990 tx=0x7f6888009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 -- 172.21.15.60:0/1581685028 shutdown_connections 2023-10-05T15:18:18.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 --2- 172.21.15.60:0/1581685028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c106170 0x7f688c10dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 --2- 172.21.15.60:0/1581685028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c101050 0x7f688c101430 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 --2- 172.21.15.60:0/1581685028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c101a00 0x7f688c105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 -- 172.21.15.60:0/1581685028 >> 172.21.15.60:0/1581685028 conn(0x7f688c0fc8f0 msgr2=0x7f688c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 -- 172.21.15.60:0/1581685028 shutdown_connections 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.360+0000 7f6893567700 1 -- 172.21.15.60:0/1581685028 wait complete. 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 Processor -- start 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 -- start start 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c101050 0x7f688c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 0x7f688c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c073c30 0x7f688c1a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1a5740 con 0x7f688c106170 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1a58b0 con 0x7f688c101050 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6893567700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1a5a70 con 0x7f688c073c30 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 0x7f688c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 0x7f688c0736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39732/0 (socket says 172.21.15.60:39732) 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 -- 172.21.15.60:0/1844517345 learned_addr learned my addr 172.21.15.60:0/1844517345 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6891b04700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c073c30 0x7f688c1a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6891303700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c101050 0x7f688c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 -- 172.21.15.60:0/1844517345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c073c30 msgr2=0x7f688c1a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c073c30 0x7f688c1a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 -- 172.21.15.60:0/1844517345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c101050 msgr2=0x7f688c0731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c101050 0x7f688c0731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.361+0000 7f6890b02700 1 -- 172.21.15.60:0/1844517345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880095f0 con 0x7f688c106170 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.362+0000 7f6890b02700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 0x7f688c0736f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f687c00e970 tx=0x7f687c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.362+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c009790 con 0x7f688c106170 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.362+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f687c00c7e0 con 0x7f688c106170 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.362+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c1a5d50 con 0x7f688c106170 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.362+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0054e0 con 0x7f688c106170 2023-10-05T15:18:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.362+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c1a6200 con 0x7f688c106170 2023-10-05T15:18:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.363+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c067c60 con 0x7f688c106170 2023-10-05T15:18:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.364+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f687c00c950 con 0x7f688c106170 2023-10-05T15:18:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.365+0000 7f68827fc700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f68780a1760 0x7f68780a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.365+0000 7f6891303700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f68780a1760 0x7f68780a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.365+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f687c014070 con 0x7f688c106170 2023-10-05T15:18:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.365+0000 7f6891303700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f68780a1760 0x7f68780a3c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f688800b2e0 tx=0x7f6888005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.369+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f687c0966b0 con 0x7f688c106170 2023-10-05T15:18:18.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.630+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f688c0746e0 con 0x7f688c106170 2023-10-05T15:18:18.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.631+0000 7f68827fc700 1 -- 172.21.15.60:0/1844517345 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+11366 (secure 0 0 0) 0x7f687c099cd0 con 0x7f688c106170 2023-10-05T15:18:18.633 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:18:18.634 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:18:17.667087+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24460":{"gid":24460,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/4284373269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4284373269},{"type":"v1","addr":"172.21.15.135:6835","nonce":4284373269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:18:18.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f68780a1760 msgr2=0x7f68780a3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f68780a1760 0x7f68780a3c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f688800b2e0 tx=0x7f6888005960 comp rx=0 tx=0).stop 2023-10-05T15:18:18.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 msgr2=0x7f688c0736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 0x7f688c0736f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f687c00e970 tx=0x7f687c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:18:18.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 shutdown_connections 2023-10-05T15:18:18.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c073c30 0x7f688c1a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f68780a1760 0x7f68780a3c20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c101050 0x7f688c0731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 --2- 172.21.15.60:0/1844517345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c106170 0x7f688c0736f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 >> 172.21.15.60:0/1844517345 conn(0x7f688c0fc8f0 msgr2=0x7f688c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 shutdown_connections 2023-10-05T15:18:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.633+0000 7f6893567700 1 -- 172.21.15.60:0/1844517345 wait complete. 2023-10-05T15:18:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2023-10-05T15:18:18.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-05T15:18:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 -- 172.21.15.60:0/546795264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e0102930 msgr2=0x7f25e010ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 --2- 172.21.15.60:0/546795264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e0102930 0x7f25e010ae10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009990 tx=0x7f25d0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 -- 172.21.15.60:0/546795264 shutdown_connections 2023-10-05T15:18:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 --2- 172.21.15.60:0/546795264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e010b430 0x7f25e010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 --2- 172.21.15.60:0/546795264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25e0102010 0x7f25e01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 --2- 172.21.15.60:0/546795264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e0102930 0x7f25e010ae10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 -- 172.21.15.60:0/546795264 >> 172.21.15.60:0/546795264 conn(0x7f25e00fb810 msgr2=0x7f25e00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 -- 172.21.15.60:0/546795264 shutdown_connections 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.818+0000 7f25e8048700 1 -- 172.21.15.60:0/546795264 wait complete. 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 Processor -- start 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 -- start start 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e0102010 0x7f25e0196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25e0102930 0x7f25e01974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 0x7f25e019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e019bf80 con 0x7f25e010b430 2023-10-05T15:18:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e019c0f0 con 0x7f25e0102010 2023-10-05T15:18:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e8048700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e019c2b0 con 0x7f25e0102930 2023-10-05T15:18:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e65e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 0x7f25e019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e65e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 0x7f25e019b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39748/0 (socket says 172.21.15.60:39748) 2023-10-05T15:18:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e65e5700 1 -- 172.21.15.60:0/2353226166 learned_addr learned my addr 172.21.15.60:0/2353226166 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e55e3700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25e0102930 0x7f25e01974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.819+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e0102010 0x7f25e0196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e65e5700 1 -- 172.21.15.60:0/2353226166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25e0102930 msgr2=0x7f25e01974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e65e5700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25e0102930 0x7f25e01974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e65e5700 1 -- 172.21.15.60:0/2353226166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e0102010 msgr2=0x7f25e0196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e65e5700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e0102010 0x7f25e0196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e65e5700 1 -- 172.21.15.60:0/2353226166 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00095f0 con 0x7f25e010b430 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e65e5700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 0x7f25e019b940 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007ee0 tx=0x7f25d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25d6ffd700 1 -- 172.21.15.60:0/2353226166 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8017070 con 0x7f25e010b430 2023-10-05T15:18:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25d6ffd700 1 -- 172.21.15.60:0/2353226166 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25d800f040 con 0x7f25e010b430 2023-10-05T15:18:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e019c590 con 0x7f25e010b430 2023-10-05T15:18:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25d6ffd700 1 -- 172.21.15.60:0/2353226166 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8005580 con 0x7f25e010b430 2023-10-05T15:18:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.820+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e01a3dd0 con 0x7f25e010b430 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.823+0000 7f25d6ffd700 1 -- 172.21.15.60:0/2353226166 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f25d800db20 con 0x7f25e010b430 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.824+0000 7f25d6ffd700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25cc0a1810 0x7f25cc0a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.824+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25cc0a1810 0x7f25cc0a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.824+0000 7f25d6ffd700 1 -- 172.21.15.60:0/2353226166 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f25d80ccd30 con 0x7f25e010b430 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.824+0000 7f25f4232b80 1 Processor -- start 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.824+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25cc0a1810 0x7f25cc0a3cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009c60 tx=0x7f25dc009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.824+0000 7f25f4232b80 1 -- start start 2023-10-05T15:18:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9000c0 0x55ceaa9004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa90b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa90dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25f4232b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa869460 con 0x55ceaa9009e0 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25f4232b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa85ac20 con 0x55ceaa9000c0 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25f4232b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa858540 con 0x55ceaa90b890 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa90b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa90b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39754/0 (socket says 172.21.15.60:39754) 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 -- 172.21.15.60:0/3170610908 learned_addr learned my addr 172.21.15.60:0/3170610908 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e65e5700 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa90dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e5de4700 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9000c0 0x55ceaa9004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 -- 172.21.15.60:0/3170610908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 msgr2=0x55ceaa90dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa90dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 -- 172.21.15.60:0/3170610908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9000c0 msgr2=0x55ceaa9004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9000c0 0x55ceaa9004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 -- 172.21.15.60:0/3170610908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceaa67ede0 con 0x55ceaa9009e0 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e5de4700 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9000c0 0x55ceaa9004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25e55e3700 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa90b350 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f25d0015000 tx=0x7f25d0005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57351c6562e385e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25cbfff700 1 -- 172.21.15.60:0/3170610908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d001d070 con 0x55ceaa9009e0 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25cbfff700 1 -- 172.21.15.60:0/3170610908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25d001e040 con 0x55ceaa9009e0 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.825+0000 7f25cbfff700 1 -- 172.21.15.60:0/3170610908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0004920 con 0x55ceaa9009e0 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 -- 172.21.15.60:0/3170610908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 msgr2=0x55ceaa90b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa90b350 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f25d0015000 tx=0x7f25d0005ea0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 -- 172.21.15.60:0/3170610908 shutdown_connections 2023-10-05T15:18:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa90dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9000c0 0x55ceaa9004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 --2- 172.21.15.60:0/3170610908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa90b350 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 -- 172.21.15.60:0/3170610908 >> 172.21.15.60:0/3170610908 conn(0x55ceaa875260 msgr2=0x55ceaa8fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 -- 172.21.15.60:0/3170610908 shutdown_connections 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.826+0000 7f25f4232b80 1 -- 172.21.15.60:0/3170610908 wait complete. 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 -- start start 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 Processor -- start 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa90b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9009e0 0x55ceaa908510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa908b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa853e30 con 0x55ceaa9000c0 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa7f0710 con 0x55ceaa9009e0 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa7f03b0 con 0x55ceaa90b890 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25f4232b80 10 client.0 _ll_register_callbacks cb 0x55ceaa64d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25e5de4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa90b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25e5de4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa90b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39758/0 (socket says 172.21.15.60:39758) 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25e5de4700 1 -- 172.21.15.60:0/297155116 learned_addr learned my addr 172.21.15.60:0/297155116 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25e65e5700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa908b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.827+0000 7f25e55e3700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9009e0 0x55ceaa908510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25e5de4700 1 -- 172.21.15.60:0/297155116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 msgr2=0x55ceaa908b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25e5de4700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa908b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25e5de4700 1 -- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9009e0 msgr2=0x55ceaa908510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25e5de4700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9009e0 0x55ceaa908510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25e5de4700 1 -- 172.21.15.60:0/297155116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e010e5b0 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25e5de4700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa90b220 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f25dc003980 tx=0x7f25dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58664b666628a067 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25c97fa700 1 -- 172.21.15.60:0/297155116 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc01e8b0 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25c97fa700 1 -- 172.21.15.60:0/297155116 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f25dc01ea10 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceaa8f3f10 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25c97fa700 1 -- 172.21.15.60:0/297155116 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25dc01ebd0 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25f4232b80 10 client.16164 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ceaa667c60 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.828+0000 7f25c97fa700 1 -- 172.21.15.60:0/297155116 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ceaa8f3f10 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25c97fa700 1 -- 172.21.15.60:0/297155116 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f25dc01c430 con 0x55ceaa9000c0 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25f4232b80 10 client.16164 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25f4232b80 10 client.16164 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:18:18.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25f4232b80 20 client.16164 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25f4232b80 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa91b360 0x55ceaa91d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25f4232b80 4 client.16164 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ceaa84ce10 con 0x55ceaa91b360 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25e55e3700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa91b360 0x55ceaa91d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25e55e3700 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa91b360 0x55ceaa91d780 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bafc16b60c807f99 server_cookie=f6f46d1af6802a41 in_seq=0 out_seq=0 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.829+0000 7f25c97fa700 10 client.16164 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25c97fa700 1 -- 172.21.15.60:0/297155116 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ceaa84ce10 con 0x55ceaa91b360 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25c97fa700 10 client.16164 handle_command_reply: tid=0 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 client.16164 shutdown 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 msgr2=0x55ceaa90b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa90b220 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f25dc003980 tx=0x7f25dc0047c0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 shutdown_connections 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa90b890 0x55ceaa908b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa91b360 0x55ceaa91d780 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa90b220 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 --2- 172.21.15.60:0/297155116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa9009e0 0x55ceaa908510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25c97fa700 0 client.16164 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 >> 172.21.15.60:0/297155116 conn(0x55ceaa875260 msgr2=0x55ceaa8fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 shutdown_connections 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 1 -- 172.21.15.60:0/297155116 wait complete. 2023-10-05T15:18:18.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.830+0000 7f25f4232b80 20 client.16164 trim_cache size 0 max 16384 2023-10-05T15:18:18.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 Processor -- start 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 -- start start 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa903030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9009e0 0x55ceaa912380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa907cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6d4920 con 0x55ceaa9000c0 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa8f6520 con 0x55ceaa90b890 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25f4232b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa904180 con 0x55ceaa9009e0 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25e5de4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa903030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25e5de4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa903030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39766/0 (socket says 172.21.15.60:39766) 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25e5de4700 1 -- 172.21.15.60:0/2982974756 learned_addr learned my addr 172.21.15.60:0/2982974756 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25e55e3700 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9009e0 0x55ceaa912380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.844+0000 7f25e65e5700 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa907cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e5de4700 1 -- 172.21.15.60:0/2982974756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9009e0 msgr2=0x55ceaa912380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9009e0 0x55ceaa912380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e5de4700 1 -- 172.21.15.60:0/2982974756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 msgr2=0x55ceaa907cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa907cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e5de4700 1 -- 172.21.15.60:0/2982974756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceaa6a5250 con 0x55ceaa9000c0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e55e3700 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9009e0 0x55ceaa912380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa903030 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f25dc005950 tx=0x7f25dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f0030140ed66a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25d4ff9700 1 -- 172.21.15.60:0/2982974756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc03a070 con 0x55ceaa9000c0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25d4ff9700 1 -- 172.21.15.60:0/2982974756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25dc01c430 con 0x55ceaa9000c0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.845+0000 7f25d4ff9700 1 -- 172.21.15.60:0/2982974756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc01ecf0 con 0x55ceaa9000c0 2023-10-05T15:18:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 -- 172.21.15.60:0/2982974756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 msgr2=0x55ceaa903030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa903030 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f25dc005950 tx=0x7f25dc009750 comp rx=0 tx=0).stop 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 -- 172.21.15.60:0/2982974756 shutdown_connections 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa907cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9000c0 0x55ceaa903030 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2982974756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9009e0 0x55ceaa912380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 -- 172.21.15.60:0/2982974756 >> 172.21.15.60:0/2982974756 conn(0x55ceaa875260 msgr2=0x55ceaa8fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 -- 172.21.15.60:0/2982974756 shutdown_connections 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 -- 172.21.15.60:0/2982974756 wait complete. 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 -- start start 2023-10-05T15:18:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 Processor -- start 2023-10-05T15:18:18.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9000c0 0x55ceaa911e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa912340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.846+0000 7f25f4232b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa910510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa910c10 con 0x55ceaa9009e0 2023-10-05T15:18:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa910d80 con 0x55ceaa90b890 2023-10-05T15:18:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa910f40 con 0x55ceaa9000c0 2023-10-05T15:18:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 10 client.0 _ll_register_callbacks cb 0x7f25dc0043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa912340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e5de4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9000c0 0x55ceaa911e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa912340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39774/0 (socket says 172.21.15.60:39774) 2023-10-05T15:18:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 -- 172.21.15.60:0/2780967480 learned_addr learned my addr 172.21.15.60:0/2780967480 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e65e5700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa910510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 -- 172.21.15.60:0/2780967480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9000c0 msgr2=0x55ceaa911e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9000c0 0x55ceaa911e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 -- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 msgr2=0x55ceaa910510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa910510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 -- 172.21.15.60:0/2780967480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ceaa667c60 con 0x55ceaa9009e0 2023-10-05T15:18:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e65e5700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa910510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:18:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25e55e3700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa912340 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009990 tx=0x7f25d00058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49994db139135a41 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25c97fa700 1 -- 172.21.15.60:0/2780967480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d001d040 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25c97fa700 1 -- 172.21.15.60:0/2780967480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f25d0031070 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25d001e040 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25c97fa700 1 -- 172.21.15.60:0/2780967480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d000bce0 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 10 client.16170 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.847+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ceaa67d2b0 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25c97fa700 1 -- 172.21.15.60:0/2780967480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25d001e040 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25c97fa700 1 -- 172.21.15.60:0/2780967480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f25d003b070 con 0x55ceaa9009e0 2023-10-05T15:18:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25f4232b80 10 client.16170 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25f4232b80 10 client.16170 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25f4232b80 20 client.16170 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa9745a0 0x55ceaa9769c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25f4232b80 4 client.16170 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ceaa84cb30 con 0x55ceaa9745a0 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.848+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa9745a0 0x55ceaa9769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25e5de4700 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa9745a0 0x55ceaa9769c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=792c135514a3da1b server_cookie=eaebeb9221c1914f in_seq=0 out_seq=0 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25c97fa700 10 client.16170 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25c97fa700 1 -- 172.21.15.60:0/2780967480 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ceaa84cb30 con 0x55ceaa9745a0 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25c97fa700 10 client.16170 handle_command_reply: tid=0 2023-10-05T15:18:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 client.16170 shutdown 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 msgr2=0x55ceaa912340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa912340 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009990 tx=0x7f25d00058e0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 shutdown_connections 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ceaa90b890 0x55ceaa910510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ceaa9000c0 0x55ceaa911e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x55ceaa9745a0 0x55ceaa9769c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 --2- 172.21.15.60:0/2780967480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ceaa9009e0 0x55ceaa912340 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 >> 172.21.15.60:0/2780967480 conn(0x55ceaa875260 msgr2=0x55ceaa8fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25c97fa700 0 client.16170 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 shutdown_connections 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 1 -- 172.21.15.60:0/2780967480 wait complete. 2023-10-05T15:18:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25f4232b80 20 client.16170 trim_cache size 0 max 16384 2023-10-05T15:18:18.863 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.849+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25cc0a1810 msgr2=0x7f25cc0a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25cc0a1810 0x7f25cc0a3cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009c60 tx=0x7f25dc009260 comp rx=0 tx=0).stop 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 msgr2=0x7f25e019b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 0x7f25e019b940 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007ee0 tx=0x7f25d800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 shutdown_connections 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e010b430 0x7f25e019b940 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25cc0a1810 0x7f25cc0a3cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e0102010 0x7f25e0196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 --2- 172.21.15.60:0/2353226166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25e0102930 0x7f25e01974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 >> 172.21.15.60:0/2353226166 conn(0x7f25e00fb810 msgr2=0x7f25e010d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 shutdown_connections 2023-10-05T15:18:18.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.850+0000 7f25e8048700 1 -- 172.21.15.60:0/2353226166 wait complete. 2023-10-05T15:18:18.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-05T15:18:18.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 -- 172.21.15.60:0/3338618028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 msgr2=0x7f2e680ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:18.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/3338618028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e680ff990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009990 tx=0x7f2e58009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 -- 172.21.15.60:0/3338618028 shutdown_connections 2023-10-05T15:18:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/3338618028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e681061d0 0x7f2e6810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/3338618028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e680ff990 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/3338618028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e680fff60 0x7f2e68105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 -- 172.21.15.60:0/3338618028 >> 172.21.15.60:0/3338618028 conn(0x7f2e68077330 msgr2=0x7f2e680fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 -- 172.21.15.60:0/3338618028 shutdown_connections 2023-10-05T15:18:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.996+0000 7f2e6e50e700 1 -- 172.21.15.60:0/3338618028 wait complete. 2023-10-05T15:18:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.997+0000 7f2e6e50e700 1 Processor -- start 2023-10-05T15:18:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.997+0000 7f2e6e50e700 1 -- start start 2023-10-05T15:18:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e68196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e681061d0 0x7f2e68197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e6819b970 0x7f2e6819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6819c3f0 con 0x7f2e680ff5b0 2023-10-05T15:18:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6819c560 con 0x7f2e6819b970 2023-10-05T15:18:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6819c720 con 0x7f2e681061d0 2023-10-05T15:18:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e68196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e68196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39786/0 (socket says 172.21.15.60:39786) 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 -- 172.21.15.60:0/1477992498 learned_addr learned my addr 172.21.15.60:0/1477992498 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e677fe700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e681061d0 0x7f2e68197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6caab700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e6819b970 0x7f2e6819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 -- 172.21.15.60:0/1477992498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e681061d0 msgr2=0x7f2e68197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e681061d0 0x7f2e68197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 -- 172.21.15.60:0/1477992498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e6819b970 msgr2=0x7f2e6819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e6819b970 0x7f2e6819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 -- 172.21.15.60:0/1477992498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009520 con 0x7f2e680ff5b0 2023-10-05T15:18:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e67fff700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e68196fd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e58004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e657fa700 1 -- 172.21.15.60:0/1477992498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5801d070 con 0x7f2e680ff5b0 2023-10-05T15:18:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e657fa700 1 -- 172.21.15.60:0/1477992498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e58021410 con 0x7f2e680ff5b0 2023-10-05T15:18:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e580095f0 con 0x7f2e680ff5b0 2023-10-05T15:18:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.998+0000 7f2e657fa700 1 -- 172.21.15.60:0/1477992498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58017650 con 0x7f2e680ff5b0 2023-10-05T15:18:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:18.999+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e681a3f60 con 0x7f2e680ff5b0 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.001+0000 7f2e657fa700 1 -- 172.21.15.60:0/1477992498 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f2e58021580 con 0x7f2e680ff5b0 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.001+0000 7f2e657fa700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e500a1810 0x7f2e500a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e677fe700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e500a1810 0x7f2e500a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e657fa700 1 -- 172.21.15.60:0/1477992498 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e580ce9f0 con 0x7f2e680ff5b0 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 Processor -- start 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 -- start start 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e677fe700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e500a1810 0x7f2e500a3cd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e681985e0 tx=0x7f2e5c009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3989e0 0x55927a3a3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a301460 con 0x55927a3a3890 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a2f2c20 con 0x55927a3989e0 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a2f0540 con 0x55927a3980c0 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e6caab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e6caab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3a5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39798/0 (socket says 172.21.15.60:39798) 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53324/0 (socket says 172.21.15.60:53324) 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.002+0000 7f2e6caab700 1 -- 172.21.15.60:0/3752470892 learned_addr learned my addr 172.21.15.60:0/3752470892 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e677fe700 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3989e0 0x55927a3a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e67fff700 1 -- 172.21.15.60:0/3752470892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3989e0 msgr2=0x55927a3a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e67fff700 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3989e0 0x55927a3a3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e67fff700 1 -- 172.21.15.60:0/3752470892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 msgr2=0x55927a3a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e67fff700 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e67fff700 1 -- 172.21.15.60:0/3752470892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927a116de0 con 0x55927a3980c0 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e6caab700 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e677fe700 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3989e0 0x55927a3a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e67fff700 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3984a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e580cbc40 tx=0x7f2e5809b2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb1bacb13f618ced server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e4e7fc700 1 -- 172.21.15.60:0/3752470892 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5809bb90 con 0x55927a3980c0 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e4e7fc700 1 -- 172.21.15.60:0/3752470892 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e5809b490 con 0x55927a3980c0 2023-10-05T15:18:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.003+0000 7f2e4e7fc700 1 -- 172.21.15.60:0/3752470892 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5809aba0 con 0x55927a3980c0 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/3752470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 msgr2=0x55927a3984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3984a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e580cbc40 tx=0x7f2e5809b2e0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/3752470892 shutdown_connections 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3984a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/3752470892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3989e0 0x55927a3a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/3752470892 >> 172.21.15.60:0/3752470892 conn(0x55927a30d260 msgr2=0x55927a394450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/3752470892 shutdown_connections 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/3752470892 wait complete. 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.004+0000 7f2e7a6f8b80 1 -- start start 2023-10-05T15:18:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 Processor -- start 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 0x55927a3a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a3a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a3a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a2ebe30 con 0x55927a3980c0 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a288710 con 0x55927a3a3890 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a2883b0 con 0x55927a3989e0 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e7a6f8b80 10 client.0 _ll_register_callbacks cb 0x55927a0e5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 0x55927a3a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 0x55927a3a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39800/0 (socket says 172.21.15.60:39800) 2023-10-05T15:18:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 -- 172.21.15.60:0/2909244307 learned_addr learned my addr 172.21.15.60:0/2909244307 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e677fe700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a3a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e6caab700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a3a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 -- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 msgr2=0x55927a3a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a3a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 -- 172.21.15.60:0/2909244307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 msgr2=0x55927a3a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a3a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 -- 172.21.15.60:0/2909244307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e600090f0 con 0x55927a3980c0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e67fff700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 0x55927a3a3c70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e5809b420 tx=0x7f2e5809bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e8a3b99709a468 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.005+0000 7f2e477fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e477fe700 1 -- 172.21.15.60:0/2909244307 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580a3790 con 0x55927a3980c0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e477fe700 1 -- 172.21.15.60:0/2909244307 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e5809b900 con 0x55927a3980c0 2023-10-05T15:18:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55927a38bf10 con 0x55927a3980c0 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e477fe700 1 -- 172.21.15.60:0/2909244307 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e580a3300 con 0x55927a3980c0 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 10 client.16182 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f2e681a3f60 con 0x55927a3980c0 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e477fe700 1 -- 172.21.15.60:0/2909244307 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55927a38bf10 con 0x55927a3980c0 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e477fe700 1 -- 172.21.15.60:0/2909244307 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2e580cbf20 con 0x55927a3980c0 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 10 client.16182 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 10 client.16182 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 20 client.16182 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a3b2b10 0x55927a3b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 4 client.16182 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55927a2e4e10 con 0x55927a3b2b10 2023-10-05T15:18:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.006+0000 7f2e677fe700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a3b2b10 0x55927a3b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.007+0000 7f2e477fe700 10 client.16182 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.007+0000 7f2e677fe700 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a3b2b10 0x55927a3b4f30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=946e22aec397f762 server_cookie=c9a49e2c06899c0b in_seq=0 out_seq=0 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e477fe700 1 -- 172.21.15.60:0/2909244307 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55927a2e4e10 con 0x55927a3b2b10 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e477fe700 10 client.16182 handle_command_reply: tid=0 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 client.16182 shutdown 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 msgr2=0x55927a3a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 0x55927a3a3c70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e5809b420 tx=0x7f2e5809bb90 comp rx=0 tx=0).stop 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 shutdown_connections 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a3b2b10 0x55927a3b4f30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a3a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3980c0 0x55927a3a3c70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e477fe700 0 client.16182 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2909244307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a3a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 >> 172.21.15.60:0/2909244307 conn(0x55927a30d260 msgr2=0x55927a393fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 shutdown_connections 2023-10-05T15:18:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2909244307 wait complete. 2023-10-05T15:18:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.008+0000 7f2e7a6f8b80 20 client.16182 trim_cache size 0 max 16384 2023-10-05T15:18:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.021+0000 7f2e7a6f8b80 1 Processor -- start 2023-10-05T15:18:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.021+0000 7f2e7a6f8b80 1 -- start start 2023-10-05T15:18:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 0x55927a393660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a39dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a16c920 con 0x55927a3989e0 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a3a2f00 con 0x55927a3a3890 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a3a2cd0 con 0x55927a3980c0 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 0x55927a393660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 0x55927a393660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39810/0 (socket says 172.21.15.60:39810) 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 -- 172.21.15.60:0/4163389676 learned_addr learned my addr 172.21.15.60:0/4163389676 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e6caab700 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a39dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e67fff700 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 -- 172.21.15.60:0/4163389676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 msgr2=0x55927a3a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 -- 172.21.15.60:0/4163389676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 msgr2=0x55927a39dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a39dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 -- 172.21.15.60:0/4163389676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927a0ffc60 con 0x55927a3989e0 2023-10-05T15:18:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e677fe700 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 0x55927a393660 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009bd0 tx=0x7f2e5c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c41d007d87ca623 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e4effd700 1 -- 172.21.15.60:0/4163389676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c023040 con 0x55927a3989e0 2023-10-05T15:18:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e4effd700 1 -- 172.21.15.60:0/4163389676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e5c0285b0 con 0x55927a3989e0 2023-10-05T15:18:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.022+0000 7f2e4effd700 1 -- 172.21.15.60:0/4163389676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c01d830 con 0x55927a3989e0 2023-10-05T15:18:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/4163389676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 msgr2=0x55927a393660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 0x55927a393660 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009bd0 tx=0x7f2e5c014000 comp rx=0 tx=0).stop 2023-10-05T15:18:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/4163389676 shutdown_connections 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3a3890 0x55927a39dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3980c0 0x55927a3a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/4163389676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3989e0 0x55927a393660 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/4163389676 >> 172.21.15.60:0/4163389676 conn(0x55927a30d260 msgr2=0x55927a3af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/4163389676 shutdown_connections 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/4163389676 wait complete. 2023-10-05T15:18:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.023+0000 7f2e7a6f8b80 1 -- start start 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 Processor -- start 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3980c0 0x55927a403330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a403870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3fece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a3ff3f0 con 0x55927a3a3890 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a3ff560 con 0x55927a3980c0 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927a3ff720 con 0x55927a3989e0 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e7a6f8b80 10 client.0 _ll_register_callbacks cb 0x55927a0e5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3fece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39818/0 (socket says 172.21.15.60:39818) 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 -- 172.21.15.60:0/2723476870 learned_addr learned my addr 172.21.15.60:0/2723476870 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e677fe700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a403870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e67fff700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3980c0 0x55927a403330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 -- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 msgr2=0x55927a403870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a403870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 -- 172.21.15.60:0/2723476870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3980c0 msgr2=0x55927a403330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3980c0 0x55927a403330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.024+0000 7f2e6caab700 1 -- 172.21.15.60:0/2723476870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c017070 con 0x55927a3a3890 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e6caab700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3fece0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2e60007e70 tx=0x7f2e60007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa6b572e30b9f6a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e477fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e477fe700 1 -- 172.21.15.60:0/2723476870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000e040 con 0x55927a3a3890 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e477fe700 1 -- 172.21.15.60:0/2723476870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e60018d60 con 0x55927a3a3890 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55927a2e4b30 con 0x55927a3a3890 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e477fe700 1 -- 172.21.15.60:0/2723476870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e60003a00 con 0x55927a3a3890 2023-10-05T15:18:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 10 client.16188 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55927a13d250 con 0x55927a3a3890 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e477fe700 1 -- 172.21.15.60:0/2723476870 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55927a2e4b30 con 0x55927a3a3890 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e477fe700 1 -- 172.21.15.60:0/2723476870 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2e60020430 con 0x55927a3a3890 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 10 client.16188 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 10 client.16188 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 20 client.16188 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a40c350 0x55927a40e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 4 client.16188 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.025+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55927a137f70 con 0x55927a40c350 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e67fff700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a40c350 0x55927a40e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e477fe700 10 client.16188 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e67fff700 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a40c350 0x55927a40e770 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3e80c41b759385dc server_cookie=1436d3d3663ecc06 in_seq=0 out_seq=0 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e477fe700 1 -- 172.21.15.60:0/2723476870 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55927a137f70 con 0x55927a40c350 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e477fe700 10 client.16188 handle_command_reply: tid=0 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 client.16188 shutdown 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 msgr2=0x55927a3fece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3fece0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2e60007e70 tx=0x7f2e60007ea0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 shutdown_connections 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55927a40c350 0x55927a40e770 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55927a3a3890 0x55927a3fece0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927a3980c0 0x55927a403330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 --2- 172.21.15.60:0/2723476870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55927a3989e0 0x55927a403870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 >> 172.21.15.60:0/2723476870 conn(0x55927a30d260 msgr2=0x55927a3a2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.026+0000 7f2e477fe700 0 client.16188 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 shutdown_connections 2023-10-05T15:18:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e7a6f8b80 1 -- 172.21.15.60:0/2723476870 wait complete. 2023-10-05T15:18:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e7a6f8b80 20 client.16188 trim_cache size 0 max 16384 2023-10-05T15:18:19.036 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e500a1810 msgr2=0x7f2e500a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e500a1810 0x7f2e500a3cd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e681985e0 tx=0x7f2e5c009260 comp rx=0 tx=0).stop 2023-10-05T15:18:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 msgr2=0x7f2e68196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e68196fd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e58004790 comp rx=0 tx=0).stop 2023-10-05T15:18:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 shutdown_connections 2023-10-05T15:18:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e500a1810 0x7f2e500a3cd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e6819b970 0x7f2e6819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e680ff5b0 0x7f2e68196fd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 --2- 172.21.15.60:0/1477992498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e681061d0 0x7f2e68197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 >> 172.21.15.60:0/1477992498 conn(0x7f2e68077330 msgr2=0x7f2e681058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 shutdown_connections 2023-10-05T15:18:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.027+0000 7f2e6e50e700 1 -- 172.21.15.60:0/1477992498 wait complete. 2023-10-05T15:18:19.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-05T15:18:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 -- 172.21.15.60:0/1138853786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 msgr2=0x7f515410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 --2- 172.21.15.60:0/1138853786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f515410d8d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b0a0 tx=0x7f514c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 -- 172.21.15.60:0/1138853786 shutdown_connections 2023-10-05T15:18:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 --2- 172.21.15.60:0/1138853786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f515410d8d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 --2- 172.21.15.60:0/1138853786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154101ff0 0x7f51541023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 --2- 172.21.15.60:0/1138853786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154102910 0x7f515410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 -- 172.21.15.60:0/1138853786 >> 172.21.15.60:0/1138853786 conn(0x7f51540fb830 msgr2=0x7f51540fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 -- 172.21.15.60:0/1138853786 shutdown_connections 2023-10-05T15:18:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 -- 172.21.15.60:0/1138853786 wait complete. 2023-10-05T15:18:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.170+0000 7f51598d0700 1 Processor -- start 2023-10-05T15:18:19.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 -- start start 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154101ff0 0x7f51540ffc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154102910 0x7f5154100180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f51541a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541009b0 con 0x7f515410b410 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541a5710 con 0x7f5154102910 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51598d0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541a5850 con 0x7f5154101ff0 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f51541a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f5152ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154101ff0 0x7f51540ffc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f51541a51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39832/0 (socket says 172.21.15.60:39832) 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 -- 172.21.15.60:0/2893756121 learned_addr learned my addr 172.21.15.60:0/2893756121 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51527fc700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154102910 0x7f5154100180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 -- 172.21.15.60:0/2893756121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154101ff0 msgr2=0x7f51540ffc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154101ff0 0x7f51540ffc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 -- 172.21.15.60:0/2893756121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154102910 msgr2=0x7f5154100180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154102910 0x7f5154100180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51537fe700 1 -- 172.21.15.60:0/2893756121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c009d00 con 0x7f515410b410 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.171+0000 7f51527fc700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154102910 0x7f5154100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.172+0000 7f51537fe700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f51541a51d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b780 tx=0x7f514c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.172+0000 7f51588ce700 1 -- 172.21.15.60:0/2893756121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00e040 con 0x7f515410b410 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.172+0000 7f51588ce700 1 -- 172.21.15.60:0/2893756121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f514c004e60 con 0x7f515410b410 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.172+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51541a5a50 con 0x7f515410b410 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.172+0000 7f51588ce700 1 -- 172.21.15.60:0/2893756121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0052a0 con 0x7f515410b410 2023-10-05T15:18:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.172+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51541a5f30 con 0x7f515410b410 2023-10-05T15:18:19.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.174+0000 7f51588ce700 1 -- 172.21.15.60:0/2893756121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f514c005400 con 0x7f515410b410 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.175+0000 7f51588ce700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51400a1710 0x7f51400a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.175+0000 7f51588ce700 1 -- 172.21.15.60:0/2893756121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f514c0cec70 con 0x7f515410b410 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.175+0000 7f5152ffd700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51400a1710 0x7f51400a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.175+0000 7f5152ffd700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51400a1710 0x7f51400a3bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f513c00ac50 tx=0x7f513c00a380 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 Processor -- start 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 -- start start 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563120222460 con 0x5631202b99e0 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563120213c20 con 0x5631202b90c0 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5165abab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563120211540 con 0x5631202c4890 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39838/0 (socket says 172.21.15.60:39838) 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 -- 172.21.15.60:0/2882414046 learned_addr learned my addr 172.21.15.60:0/2882414046 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51537fe700 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f5152ffd700 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 -- 172.21.15.60:0/2882414046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 msgr2=0x5631202c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 -- 172.21.15.60:0/2882414046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 msgr2=0x5631202b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 -- 172.21.15.60:0/2882414046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563120037de0 con 0x5631202b99e0 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.176+0000 7f51527fc700 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c4350 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5144009c50 tx=0x7f5144009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a169e9dadb4b1b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5149ffb700 1 -- 172.21.15.60:0/2882414046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144004230 con 0x5631202b99e0 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5149ffb700 1 -- 172.21.15.60:0/2882414046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f514400fe00 con 0x5631202b99e0 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5149ffb700 1 -- 172.21.15.60:0/2882414046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144003dd0 con 0x5631202b99e0 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 -- 172.21.15.60:0/2882414046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 msgr2=0x5631202c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c4350 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5144009c50 tx=0x7f5144009f60 comp rx=0 tx=0).stop 2023-10-05T15:18:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 -- 172.21.15.60:0/2882414046 shutdown_connections 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 --2- 172.21.15.60:0/2882414046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c4350 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 -- 172.21.15.60:0/2882414046 >> 172.21.15.60:0/2882414046 conn(0x56312022e260 msgr2=0x5631202b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 -- 172.21.15.60:0/2882414046 shutdown_connections 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.177+0000 7f5165abab80 1 -- 172.21.15.60:0/2882414046 wait complete. 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 -- start start 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 Processor -- start 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56312020ce30 con 0x5631202b99e0 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631201a9710 con 0x5631202b90c0 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631201a93b0 con 0x5631202c4890 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5165abab80 10 client.0 _ll_register_callbacks cb 0x563120006800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f51527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f51527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39844/0 (socket says 172.21.15.60:39844) 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f51527fc700 1 -- 172.21.15.60:0/1084455368 learned_addr learned my addr 172.21.15.60:0/1084455368 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.178+0000 7f5152ffd700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51537fe700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51527fc700 1 -- 172.21.15.60:0/1084455368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 msgr2=0x5631202c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51527fc700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51527fc700 1 -- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 msgr2=0x5631202c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51527fc700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51527fc700 1 -- 172.21.15.60:0/1084455368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51440098b0 con 0x5631202b99e0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f51527fc700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c1560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5144003970 tx=0x7f514400fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8074fed4003a7497 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5132ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5132ffd700 1 -- 172.21.15.60:0/1084455368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144021070 con 0x5631202b99e0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5132ffd700 1 -- 172.21.15.60:0/1084455368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f5144005ce0 con 0x5631202b99e0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631202acf10 con 0x5631202b99e0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5132ffd700 1 -- 172.21.15.60:0/1084455368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5144003790 con 0x5631202b99e0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5165abab80 10 client.16200 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563120020c60 con 0x5631202b99e0 2023-10-05T15:18:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.179+0000 7f5132ffd700 1 -- 172.21.15.60:0/1084455368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5631202acf10 con 0x5631202b99e0 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5132ffd700 1 -- 172.21.15.60:0/1084455368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5144019030 con 0x5631202b99e0 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5165abab80 10 client.16200 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5165abab80 10 client.16200 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5165abab80 20 client.16200 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5165abab80 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5631202d4150 0x5631202d6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5165abab80 4 client.16200 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563120205e10 con 0x5631202d4150 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5152ffd700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5631202d4150 0x5631202d6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5132ffd700 10 client.16200 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.180+0000 7f5152ffd700 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5631202d4150 0x5631202d6570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c176cf11b86775f server_cookie=187c4a16add78a6b in_seq=0 out_seq=0 2023-10-05T15:18:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5132ffd700 1 -- 172.21.15.60:0/1084455368 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563120205e10 con 0x5631202d4150 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5132ffd700 10 client.16200 handle_command_reply: tid=0 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 client.16200 shutdown 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 msgr2=0x5631202c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c1560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5144003970 tx=0x7f514400fb70 comp rx=0 tx=0).stop 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 shutdown_connections 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x5631202d4150 0x5631202d6570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5132ffd700 0 client.16200 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 --2- 172.21.15.60:0/1084455368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202c1560 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 >> 172.21.15.60:0/1084455368 conn(0x56312022e260 msgr2=0x5631202b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 shutdown_connections 2023-10-05T15:18:19.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.181+0000 7f5165abab80 1 -- 172.21.15.60:0/1084455368 wait complete. 2023-10-05T15:18:19.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.182+0000 7f5165abab80 20 client.16200 trim_cache size 0 max 16384 2023-10-05T15:18:19.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.194+0000 7f5165abab80 1 Processor -- start 2023-10-05T15:18:19.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.194+0000 7f5165abab80 1 -- start start 2023-10-05T15:18:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5165abab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5165abab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5165abab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5165abab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56312008d920 con 0x5631202b99e0 2023-10-05T15:18:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5165abab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631202ba020 con 0x5631202b90c0 2023-10-05T15:18:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5165abab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631202bd0e0 con 0x5631202c4890 2023-10-05T15:18:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39852/0 (socket says 172.21.15.60:39852) 2023-10-05T15:18:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 -- 172.21.15.60:0/976108794 learned_addr learned my addr 172.21.15.60:0/976108794 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51537fe700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 -- 172.21.15.60:0/976108794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 msgr2=0x5631202c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5152ffd700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 -- 172.21.15.60:0/976108794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 msgr2=0x5631202c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 -- 172.21.15.60:0/976108794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56312005e250 con 0x5631202b99e0 2023-10-05T15:18:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51537fe700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f5152ffd700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:18:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f51527fc700 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202bbf60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5144009810 tx=0x7f5144001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39814201c45ecd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f514a7fc700 1 -- 172.21.15.60:0/976108794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144021070 con 0x5631202b99e0 2023-10-05T15:18:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f514a7fc700 1 -- 172.21.15.60:0/976108794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f514400fbe0 con 0x5631202b99e0 2023-10-05T15:18:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.195+0000 7f514a7fc700 1 -- 172.21.15.60:0/976108794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144005d60 con 0x5631202b99e0 2023-10-05T15:18:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 -- 172.21.15.60:0/976108794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 msgr2=0x5631202bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202bbf60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5144009810 tx=0x7f5144001e50 comp rx=0 tx=0).stop 2023-10-05T15:18:19.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 -- 172.21.15.60:0/976108794 shutdown_connections 2023-10-05T15:18:19.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202c4890 0x5631202c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 --2- 172.21.15.60:0/976108794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202b99e0 0x5631202bbf60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 -- 172.21.15.60:0/976108794 >> 172.21.15.60:0/976108794 conn(0x56312022e260 msgr2=0x5631202c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 -- 172.21.15.60:0/976108794 shutdown_connections 2023-10-05T15:18:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 -- 172.21.15.60:0/976108794 wait complete. 2023-10-05T15:18:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.196+0000 7f5165abab80 1 -- start start 2023-10-05T15:18:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 Processor -- start 2023-10-05T15:18:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202b99e0 0x5631202c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 0x5631202c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631202ca0d0 con 0x5631202c4890 2023-10-05T15:18:19.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631202ca210 con 0x5631202b90c0 2023-10-05T15:18:19.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631202ca3d0 con 0x5631202b99e0 2023-10-05T15:18:19.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5165abab80 10 client.0 _ll_register_callbacks cb 0x7f514c009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 0x5631202c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 0x5631202c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39860/0 (socket says 172.21.15.60:39860) 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 -- 172.21.15.60:0/3121787282 learned_addr learned my addr 172.21.15.60:0/3121787282 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51527fc700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202b99e0 0x5631202c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f5152ffd700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 -- 172.21.15.60:0/3121787282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202b99e0 msgr2=0x5631202c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202b99e0 0x5631202c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 -- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 msgr2=0x5631202cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.197+0000 7f51537fe700 1 -- 172.21.15.60:0/3121787282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563120020c60 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f51537fe700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 0x5631202c9af0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f514c0062a0 tx=0x7f514c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb8f66f5194ba1c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5132ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5132ffd700 1 -- 172.21.15.60:0/3121787282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c09bb70 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5132ffd700 1 -- 172.21.15.60:0/3121787282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f514c09b710 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f514400fe00 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5132ffd700 1 -- 172.21.15.60:0/3121787282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f514c09f860 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 10 client.16206 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5631200362b0 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5132ffd700 1 -- 172.21.15.60:0/3121787282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f514c0b5080 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5132ffd700 1 -- 172.21.15.60:0/3121787282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f514c0a3680 con 0x5631202c4890 2023-10-05T15:18:19.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 10 client.16206 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 10 client.16206 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 20 client.16206 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x563120329280 0x56312032b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 4 client.16206 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.198+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563120205b30 con 0x563120329280 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.199+0000 7f5152ffd700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x563120329280 0x56312032b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5132ffd700 10 client.16206 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5152ffd700 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x563120329280 0x56312032b6a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44b52bf591dea28a server_cookie=9c6f723abfada210 in_seq=0 out_seq=0 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5132ffd700 1 -- 172.21.15.60:0/3121787282 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563120205b30 con 0x563120329280 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5132ffd700 10 client.16206 handle_command_reply: tid=0 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 client.16206 shutdown 2023-10-05T15:18:19.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 msgr2=0x5631202c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 0x5631202c9af0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f514c0062a0 tx=0x7f514c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 shutdown_connections 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x563120329280 0x56312032b6a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631202c4890 0x5631202c9af0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631202b90c0 0x5631202cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5132ffd700 0 client.16206 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 --2- 172.21.15.60:0/3121787282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631202b99e0 0x5631202c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 >> 172.21.15.60:0/3121787282 conn(0x56312022e260 msgr2=0x5631202b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 shutdown_connections 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.200+0000 7f5165abab80 1 -- 172.21.15.60:0/3121787282 wait complete. 2023-10-05T15:18:19.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f5165abab80 20 client.16206 trim_cache size 0 max 16384 2023-10-05T15:18:19.218 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51400a1710 msgr2=0x7f51400a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51400a1710 0x7f51400a3bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f513c00ac50 tx=0x7f513c00a380 comp rx=0 tx=0).stop 2023-10-05T15:18:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 msgr2=0x7f51541a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f51541a51d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b780 tx=0x7f514c00bd60 comp rx=0 tx=0).stop 2023-10-05T15:18:19.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 shutdown_connections 2023-10-05T15:18:19.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f515410b410 0x7f51541a51d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154101ff0 0x7f51540ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51400a1710 0x7f51400a3bd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 --2- 172.21.15.60:0/2893756121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154102910 0x7f5154100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 >> 172.21.15.60:0/2893756121 conn(0x7f51540fb830 msgr2=0x7f515410d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 shutdown_connections 2023-10-05T15:18:19.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.201+0000 7f51598d0700 1 -- 172.21.15.60:0/2893756121 wait complete. 2023-10-05T15:18:19.223 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 -- 172.21.15.60:0/2987209663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 msgr2=0x7f4ea4100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/2987209663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4100370 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009990 tx=0x7f4ea0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 -- 172.21.15.60:0/2987209663 shutdown_connections 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/2987209663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41050b0 0x7f4ea410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/2987209663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4100370 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/2987209663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea4100940 0x7f4ea4104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 -- 172.21.15.60:0/2987209663 >> 172.21.15.60:0/2987209663 conn(0x7f4ea40fb830 msgr2=0x7f4ea40fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 -- 172.21.15.60:0/2987209663 shutdown_connections 2023-10-05T15:18:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.354+0000 7f4eabaaf700 1 -- 172.21.15.60:0/2987209663 wait complete. 2023-10-05T15:18:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 Processor -- start 2023-10-05T15:18:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 -- start start 2023-10-05T15:18:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea41050b0 0x7f4ea41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41989a0 0x7f4ea41a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41a36b0 con 0x7f4ea40fff90 2023-10-05T15:18:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41a3820 con 0x7f4ea41989a0 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eabaaf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41a39e0 con 0x7f4ea41050b0 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39870/0 (socket says 172.21.15.60:39870) 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4ea984b700 1 -- 172.21.15.60:0/3834431856 learned_addr learned my addr 172.21.15.60:0/3834431856 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.355+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41989a0 0x7f4ea41a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea904a700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea41050b0 0x7f4ea41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea984b700 1 -- 172.21.15.60:0/3834431856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea41050b0 msgr2=0x7f4ea41983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea984b700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea41050b0 0x7f4ea41983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea984b700 1 -- 172.21.15.60:0/3834431856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41989a0 msgr2=0x7f4ea41a2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea984b700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41989a0 0x7f4ea41a2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea984b700 1 -- 172.21.15.60:0/3834431856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00095f0 con 0x7f4ea40fff90 2023-10-05T15:18:19.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41989a0 0x7f4ea41a2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4ea984b700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4197e80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005770 tx=0x7f4ea00057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4e9affd700 1 -- 172.21.15.60:0/3834431856 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea001d070 con 0x7f4ea40fff90 2023-10-05T15:18:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4e9affd700 1 -- 172.21.15.60:0/3834431856 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ea0022470 con 0x7f4ea40fff90 2023-10-05T15:18:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea41a3c60 con 0x7f4ea40fff90 2023-10-05T15:18:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4e9affd700 1 -- 172.21.15.60:0/3834431856 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0017650 con 0x7f4ea40fff90 2023-10-05T15:18:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.356+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea41a4080 con 0x7f4ea40fff90 2023-10-05T15:18:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.359+0000 7f4e9affd700 1 -- 172.21.15.60:0/3834431856 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f4ea000fb40 con 0x7f4ea40fff90 2023-10-05T15:18:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.359+0000 7f4e9affd700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4e900a1710 0x7f4e900a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.359+0000 7f4e9affd700 1 -- 172.21.15.60:0/3834431856 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4ea00cea10 con 0x7f4ea40fff90 2023-10-05T15:18:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.359+0000 7f4ea904a700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4e900a1710 0x7f4e900a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4ea904a700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4e900a1710 0x7f4e900a3bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4068910 tx=0x7f4e94009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 Processor -- start 2023-10-05T15:18:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 -- start start 2023-10-05T15:18:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 0x555dbaf2a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf35350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf35890 0x555dbaf37c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbae93460 con 0x555dbaf35890 2023-10-05T15:18:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbae84c20 con 0x555dbaf2a9e0 2023-10-05T15:18:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.360+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbae82540 con 0x555dbaf2a0c0 2023-10-05T15:18:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf35890 0x555dbaf37c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 0x555dbaf2a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 0x555dbaf2a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53408/0 (socket says 172.21.15.60:53408) 2023-10-05T15:18:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4ea984b700 1 -- 172.21.15.60:0/1388893205 learned_addr learned my addr 172.21.15.60:0/1388893205 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4ea904a700 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf35350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 -- 172.21.15.60:0/1388893205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 msgr2=0x555dbaf2a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 0x555dbaf2a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 -- 172.21.15.60:0/1388893205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 msgr2=0x555dbaf35350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf35350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 -- 172.21.15.60:0/1388893205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dbaca8de0 con 0x555dbaf35890 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4ea984b700 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 0x555dbaf2a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf35890 0x555dbaf37c80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c003db0 tx=0x7f4e9c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbc74a9485913 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4e8ffff700 1 -- 172.21.15.60:0/1388893205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c004bb0 con 0x555dbaf35890 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4e8ffff700 1 -- 172.21.15.60:0/1388893205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e9c00f040 con 0x555dbaf35890 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.361+0000 7f4e8ffff700 1 -- 172.21.15.60:0/1388893205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c007c20 con 0x555dbaf35890 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/1388893205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf35890 msgr2=0x555dbaf37c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf35890 0x555dbaf37c80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c003db0 tx=0x7f4e9c009920 comp rx=0 tx=0).stop 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/1388893205 shutdown_connections 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf35890 0x555dbaf37c80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a0c0 0x555dbaf2a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/1388893205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf35350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/1388893205 >> 172.21.15.60:0/1388893205 conn(0x555dbae9f260 msgr2=0x555dbaf26450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/1388893205 shutdown_connections 2023-10-05T15:18:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/1388893205 wait complete. 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.362+0000 7f4eb7c99b80 1 -- start start 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 Processor -- start 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf32590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf33010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbae7de30 con 0x555dbaf2a0c0 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbae1a710 con 0x555dbaf2a9e0 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbae1a3b0 con 0x555dbaf35890 2023-10-05T15:18:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eb7c99b80 10 client.0 _ll_register_callbacks cb 0x555dbac77800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf32590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf32590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39884/0 (socket says 172.21.15.60:39884) 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 -- 172.21.15.60:0/2348227156 learned_addr learned my addr 172.21.15.60:0/2348227156 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4eaa04c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf33010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea904a700 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 -- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 msgr2=0x555dbaf33010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf33010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 -- 172.21.15.60:0/2348227156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 msgr2=0x555dbaf32ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.363+0000 7f4ea984b700 1 -- 172.21.15.60:0/2348227156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea41a4080 con 0x555dbaf2a0c0 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4ea984b700 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf32590 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4ea009b4a0 tx=0x7f4ea009ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1847799f9a84fa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4e8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/2348227156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea009ae70 con 0x555dbaf2a0c0 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dbaf1df10 con 0x555dbaf2a0c0 2023-10-05T15:18:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/2348227156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4ea009bc10 con 0x555dbaf2a0c0 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/2348227156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ea009b510 con 0x555dbaf2a0c0 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 10 client.16218 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f4e9c003a60 con 0x555dbaf2a0c0 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/2348227156 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ea0066020 con 0x555dbaf2a0c0 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/2348227156 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4ea00cbfa0 con 0x555dbaf2a0c0 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 10 client.16218 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 10 client.16218 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:18:19.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 20 client.16218 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf44fd0 0x555dbaf473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 4 client.16218 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:19.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.364+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dbae76e10 con 0x555dbaf44fd0 2023-10-05T15:18:19.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.365+0000 7f4ea904a700 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf44fd0 0x555dbaf473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.365+0000 7f4e8d7fa700 10 client.16218 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.365+0000 7f4ea904a700 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf44fd0 0x555dbaf473c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34b0c3a1af352c2d server_cookie=9594ee25f2ecadf6 in_seq=0 out_seq=0 2023-10-05T15:18:19.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/2348227156 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555dbae76e10 con 0x555dbaf44fd0 2023-10-05T15:18:19.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4e8d7fa700 10 client.16218 handle_command_reply: tid=0 2023-10-05T15:18:19.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 client.16218 shutdown 2023-10-05T15:18:19.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 msgr2=0x555dbaf32590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf32590 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4ea009b4a0 tx=0x7f4ea009ba50 comp rx=0 tx=0).stop 2023-10-05T15:18:19.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 shutdown_connections 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf44fd0 0x555dbaf473c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf33010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf32590 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/2348227156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4e8d7fa700 0 client.16218 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 >> 172.21.15.60:0/2348227156 conn(0x555dbae9f260 msgr2=0x555dbaf26040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 shutdown_connections 2023-10-05T15:18:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/2348227156 wait complete. 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.368+0000 7f4eb7c99b80 20 client.16218 trim_cache size 0 max 16384 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 Processor -- start 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 -- start start 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf2f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbacfe920 con 0x555dbaf2a9e0 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbaf3c910 con 0x555dbaf2a0c0 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbaf35620 con 0x555dbaf35890 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39894/0 (socket says 172.21.15.60:39894) 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 -- 172.21.15.60:0/120659698 learned_addr learned my addr 172.21.15.60:0/120659698 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf2f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea984b700 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 -- 172.21.15.60:0/120659698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 msgr2=0x555dbaf2f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf2f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 -- 172.21.15.60:0/120659698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a0c0 msgr2=0x555dbaf3c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea904a700 1 -- 172.21.15.60:0/120659698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dbac91c60 con 0x555dbaf2a9e0 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.382+0000 7f4ea984b700 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4ea904a700 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32e40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x555dbaf33c40 tx=0x7f4e94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d6e27f9c087439 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4e98d82700 1 -- 172.21.15.60:0/120659698 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94024040 con 0x555dbaf2a9e0 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4e98d82700 1 -- 172.21.15.60:0/120659698 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e94029dc0 con 0x555dbaf2a9e0 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4e98d82700 1 -- 172.21.15.60:0/120659698 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94003d00 con 0x555dbaf2a9e0 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/120659698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 msgr2=0x555dbaf32e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32e40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x555dbaf33c40 tx=0x7f4e94014000 comp rx=0 tx=0).stop 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/120659698 shutdown_connections 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf35890 0x555dbaf2f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/120659698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a9e0 0x555dbaf32e40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/120659698 >> 172.21.15.60:0/120659698 conn(0x555dbae9f260 msgr2=0x555dbaf41630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/120659698 shutdown_connections 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.383+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/120659698 wait complete. 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 -- start start 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 Processor -- start 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a9e0 0x555dbaf3aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf35890 0x555dbaf91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbaf922e0 con 0x555dbaf2a0c0 2023-10-05T15:18:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbaf92450 con 0x555dbaf35890 2023-10-05T15:18:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbaf92610 con 0x555dbaf2a9e0 2023-10-05T15:18:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4eb7c99b80 10 client.0 _ll_register_callbacks cb 0x555dbac77800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4ea984b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39898/0 (socket says 172.21.15.60:39898) 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4ea984b700 1 -- 172.21.15.60:0/344405306 learned_addr learned my addr 172.21.15.60:0/344405306 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.384+0000 7f4ea904a700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a9e0 0x555dbaf3aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4eaa04c700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf35890 0x555dbaf91da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4ea984b700 1 -- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a9e0 msgr2=0x555dbaf3aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4ea984b700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a9e0 0x555dbaf3aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4ea984b700 1 -- 172.21.15.60:0/344405306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf35890 msgr2=0x555dbaf91da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4ea984b700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf35890 0x555dbaf91da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4ea984b700 1 -- 172.21.15.60:0/344405306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e94017070 con 0x555dbaf2a0c0 2023-10-05T15:18:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4ea984b700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3a5b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00cc440 tx=0x7f4ea0022c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25169da1cb33de86 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4e8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/344405306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a3580 con 0x555dbaf2a0c0 2023-10-05T15:18:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/344405306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4ea009bc10 con 0x555dbaf2a0c0 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e9c00f040 con 0x555dbaf2a0c0 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/344405306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ea009ae70 con 0x555dbaf2a0c0 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4eb7c99b80 10 client.16224 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555dbaccf250 con 0x555dbaf2a0c0 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/344405306 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e9c00f040 con 0x555dbaf2a0c0 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.385+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/344405306 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4ea009f200 con 0x555dbaf2a0c0 2023-10-05T15:18:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4eb7c99b80 10 client.16224 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4eb7c99b80 10 client.16224 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:18:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4eb7c99b80 20 client.16224 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf99940 0x555dbaf9bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4eb7c99b80 4 client.16224 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555dbae76b30 con 0x555dbaf99940 2023-10-05T15:18:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4ea904a700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf99940 0x555dbaf9bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4e8d7fa700 10 client.16224 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.386+0000 7f4ea904a700 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf99940 0x555dbaf9bd30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=857e4772b5129312 server_cookie=5bf29ab4b94cbc3c in_seq=0 out_seq=0 2023-10-05T15:18:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4e8d7fa700 1 -- 172.21.15.60:0/344405306 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555dbae76b30 con 0x555dbaf99940 2023-10-05T15:18:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4e8d7fa700 10 client.16224 handle_command_reply: tid=0 2023-10-05T15:18:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 client.16224 shutdown 2023-10-05T15:18:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 msgr2=0x555dbaf3a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3a5b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00cc440 tx=0x7f4ea0022c40 comp rx=0 tx=0).stop 2023-10-05T15:18:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 shutdown_connections 2023-10-05T15:18:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x555dbaf99940 0x555dbaf9bd30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555dbaf35890 0x555dbaf91da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dbaf2a0c0 0x555dbaf3a5b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 --2- 172.21.15.60:0/344405306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dbaf2a9e0 0x555dbaf3aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4e8d7fa700 0 client.16224 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:19.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 >> 172.21.15.60:0/344405306 conn(0x555dbae9f260 msgr2=0x555dbaf2bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 shutdown_connections 2023-10-05T15:18:19.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 1 -- 172.21.15.60:0/344405306 wait complete. 2023-10-05T15:18:19.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.392+0000 7f4eb7c99b80 20 client.16224 trim_cache size 0 max 16384 2023-10-05T15:18:19.408 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:19.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4e900a1710 msgr2=0x7f4e900a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4e900a1710 0x7f4e900a3bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4068910 tx=0x7f4e94009260 comp rx=0 tx=0).stop 2023-10-05T15:18:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 msgr2=0x7f4ea4197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4197e80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005770 tx=0x7f4ea00057a0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 shutdown_connections 2023-10-05T15:18:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4e900a1710 0x7f4e900a3bd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ea41989a0 0x7f4ea41a2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea40fff90 0x7f4ea4197e80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 --2- 172.21.15.60:0/3834431856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea41050b0 0x7f4ea41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 >> 172.21.15.60:0/3834431856 conn(0x7f4ea40fb830 msgr2=0x7f4ea40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 shutdown_connections 2023-10-05T15:18:19.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.393+0000 7f4eabaaf700 1 -- 172.21.15.60:0/3834431856 wait complete. 2023-10-05T15:18:19.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:19 smithi060 ceph-mon[99238]: pgmap v49: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 561 op/s 2023-10-05T15:18:19.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:19 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:19.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:19 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1844517345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:18:19.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-05T15:18:19.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 -- 172.21.15.60:0/1764990185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a141001b0 msgr2=0x7f8a14100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1764990185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a141001b0 0x7f8a14100590 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009990 tx=0x7f8a10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 -- 172.21.15.60:0/1764990185 shutdown_connections 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1764990185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a14105140 0x7f8a1410ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1764990185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a141001b0 0x7f8a14100590 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1764990185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a14100b60 0x7f8a14104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 -- 172.21.15.60:0/1764990185 >> 172.21.15.60:0/1764990185 conn(0x7f8a14077cb0 msgr2=0x7f8a140780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 -- 172.21.15.60:0/1764990185 shutdown_connections 2023-10-05T15:18:19.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.544+0000 7f8a1c393700 1 -- 172.21.15.60:0/1764990185 wait complete. 2023-10-05T15:18:19.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 Processor -- start 2023-10-05T15:18:19.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 -- start start 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a141001b0 0x7f8a14195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 0x7f8a141964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a1419a950 0x7f8a1419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419b3d0 con 0x7f8a14105140 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419b540 con 0x7f8a1419a950 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1c393700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419b700 con 0x7f8a141001b0 2023-10-05T15:18:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1992e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 0x7f8a141964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a141001b0 0x7f8a14195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1992e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 0x7f8a141964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39914/0 (socket says 172.21.15.60:39914) 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.545+0000 7f8a1992e700 1 -- 172.21.15.60:0/1276402228 learned_addr learned my addr 172.21.15.60:0/1276402228 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1a930700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a1419a950 0x7f8a1419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1992e700 1 -- 172.21.15.60:0/1276402228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a141001b0 msgr2=0x7f8a14195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1992e700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a141001b0 0x7f8a14195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1992e700 1 -- 172.21.15.60:0/1276402228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a1419a950 msgr2=0x7f8a1419add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1992e700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a1419a950 0x7f8a1419add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1992e700 1 -- 172.21.15.60:0/1276402228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100095f0 con 0x7f8a14105140 2023-10-05T15:18:19.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1992e700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 0x7f8a141964f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400ea80 tx=0x7f8a0400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a0b7fe700 1 -- 172.21.15.60:0/1276402228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04013070 con 0x7f8a14105140 2023-10-05T15:18:19.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a0b7fe700 1 -- 172.21.15.60:0/1276402228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a0400be80 con 0x7f8a14105140 2023-10-05T15:18:19.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140692f0 con 0x7f8a14105140 2023-10-05T15:18:19.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a0b7fe700 1 -- 172.21.15.60:0/1276402228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04005350 con 0x7f8a14105140 2023-10-05T15:18:19.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.546+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a14069850 con 0x7f8a14105140 2023-10-05T15:18:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.549+0000 7f8a0b7fe700 1 -- 172.21.15.60:0/1276402228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 136236+0+0 (secure 0 0 0) 0x7f8a040054f0 con 0x7f8a14105140 2023-10-05T15:18:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.549+0000 7f8a0b7fe700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8a000a1790 0x7f8a000a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.550+0000 7f8a0b7fe700 1 -- 172.21.15.60:0/1276402228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f8a040cecd0 con 0x7f8a14105140 2023-10-05T15:18:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.550+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8a000a1790 0x7f8a000a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.550+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8a000a1790 0x7f8a000a3c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000b2e0 tx=0x7f8a10005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.550+0000 7f8a2857db80 1 Processor -- start 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.550+0000 7f8a2857db80 1 -- start start 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a2857db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47111460 con 0x561a471a80c0 2023-10-05T15:18:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a2857db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47102c20 con 0x561a471b7ca0 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a2857db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47100540 con 0x561a471a89e0 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39920/0 (socket says 172.21.15.60:39920) 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 -- 172.21.15.60:0/1223402699 learned_addr learned my addr 172.21.15.60:0/1223402699 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1992e700 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a930700 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 -- 172.21.15.60:0/1223402699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 msgr2=0x561a471b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 -- 172.21.15.60:0/1223402699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 msgr2=0x561a471ba090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471ba090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 -- 172.21.15.60:0/1223402699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a46f26de0 con 0x561a471a80c0 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471a84a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009990 tx=0x7f8a10020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ba9a53b0eab31e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.551+0000 7f8a08d82700 1 -- 172.21.15.60:0/1223402699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10004500 con 0x561a471a80c0 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a08d82700 1 -- 172.21.15.60:0/1223402699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a1001e040 con 0x561a471a80c0 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a08d82700 1 -- 172.21.15.60:0/1223402699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000f9c0 con 0x561a471a80c0 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 -- 172.21.15.60:0/1223402699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 msgr2=0x561a471a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471a84a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009990 tx=0x7f8a10020000 comp rx=0 tx=0).stop 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 -- 172.21.15.60:0/1223402699 shutdown_connections 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471ba090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471a84a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 --2- 172.21.15.60:0/1223402699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 -- 172.21.15.60:0/1223402699 >> 172.21.15.60:0/1223402699 conn(0x561a4711d260 msgr2=0x561a471a4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 -- 172.21.15.60:0/1223402699 shutdown_connections 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.552+0000 7f8a2857db80 1 -- 172.21.15.60:0/1223402699 wait complete. 2023-10-05T15:18:19.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 -- start start 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 Processor -- start 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a470fbe30 con 0x561a471a80c0 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47098710 con 0x561a471b7ca0 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a470983b0 con 0x561a471a89e0 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a2857db80 10 client.0 _ll_register_callbacks cb 0x561a46ef5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39926/0 (socket says 172.21.15.60:39926) 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 -- 172.21.15.60:0/468341320 learned_addr learned my addr 172.21.15.60:0/468341320 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1992e700 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 -- 172.21.15.60:0/468341320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 msgr2=0x561a471b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 -- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 msgr2=0x561a471b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.553+0000 7f8a1a12f700 1 -- 172.21.15.60:0/468341320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1410d530 con 0x561a471a80c0 2023-10-05T15:18:19.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b4a30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000f540 tx=0x7f8a10005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8baf67f1245090 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f89fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f89fdffb700 1 -- 172.21.15.60:0/468341320 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10004500 con 0x561a471a80c0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f89fdffb700 1 -- 172.21.15.60:0/468341320 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f8a10004660 con 0x561a471a80c0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a4719bf10 con 0x561a471a80c0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f89fdffb700 1 -- 172.21.15.60:0/468341320 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a10004820 con 0x561a471a80c0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 10 client.16236 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561a46f0fc60 con 0x561a471a80c0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f89fdffb700 1 -- 172.21.15.60:0/468341320 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561a4719bf10 con 0x561a471a80c0 2023-10-05T15:18:19.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f89fdffb700 1 -- 172.21.15.60:0/468341320 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8a10024af0 con 0x561a471a80c0 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 10 client.16236 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 20 client.16236 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a471c72f0 0x561a471c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 4 client.16236 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.554+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a470f4e10 con 0x561a471c72f0 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.555+0000 7f8a1992e700 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a471c72f0 0x561a471c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.555+0000 7f8a1992e700 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a471c72f0 0x561a471c9710 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ff9fc5eca8f3f9 server_cookie=6869c633cf0158bb in_seq=0 out_seq=0 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.555+0000 7f89fdffb700 10 client.16236 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:19.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f89fdffb700 1 -- 172.21.15.60:0/468341320 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a470f4e10 con 0x561a471c72f0 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f89fdffb700 10 client.16236 handle_command_reply: tid=0 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 client.16236 shutdown 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 msgr2=0x561a471b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b4a30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000f540 tx=0x7f8a10005a60 comp rx=0 tx=0).stop 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 shutdown_connections 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a471c72f0 0x561a471c9710 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f89fdffb700 0 client.16236 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b4a30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 --2- 172.21.15.60:0/468341320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 >> 172.21.15.60:0/468341320 conn(0x561a4711d260 msgr2=0x561a471a4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 shutdown_connections 2023-10-05T15:18:19.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 1 -- 172.21.15.60:0/468341320 wait complete. 2023-10-05T15:18:19.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.556+0000 7f8a2857db80 20 client.16236 trim_cache size 0 max 16384 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.569+0000 7f8a2857db80 1 Processor -- start 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.569+0000 7f8a2857db80 1 -- start start 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471aac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a2857db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a46f7c920 con 0x561a471a80c0 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a2857db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a471a98f0 con 0x561a471b7ca0 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a2857db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a471a0a70 con 0x561a471a89e0 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39934/0 (socket says 172.21.15.60:39934) 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 -- 172.21.15.60:0/515915422 learned_addr learned my addr 172.21.15.60:0/515915422 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1992e700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a930700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 -- 172.21.15.60:0/515915422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 msgr2=0x561a471aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 -- 172.21.15.60:0/515915422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 msgr2=0x561a471aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 -- 172.21.15.60:0/515915422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a471a0140 con 0x561a471a80c0 2023-10-05T15:18:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a930700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1992e700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b52e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8a10005f50 tx=0x7f8a10009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108c43448ef95be server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a09583700 1 -- 172.21.15.60:0/515915422 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000be60 con 0x561a471a80c0 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a09583700 1 -- 172.21.15.60:0/515915422 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a10018cf0 con 0x561a471a80c0 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.570+0000 7f8a09583700 1 -- 172.21.15.60:0/515915422 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10024a70 con 0x561a471a80c0 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 -- 172.21.15.60:0/515915422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 msgr2=0x561a471b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b52e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8a10005f50 tx=0x7f8a10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 -- 172.21.15.60:0/515915422 shutdown_connections 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471b7ca0 0x561a471aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471a80c0 0x561a471b52e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 --2- 172.21.15.60:0/515915422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 -- 172.21.15.60:0/515915422 >> 172.21.15.60:0/515915422 conn(0x561a4711d260 msgr2=0x561a471aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 -- 172.21.15.60:0/515915422 shutdown_connections 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 -- 172.21.15.60:0/515915422 wait complete. 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 -- start start 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.571+0000 7f8a2857db80 1 Processor -- start 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471a80c0 0x561a471bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 0x561a47214110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47214650 con 0x561a471b7ca0 2023-10-05T15:18:19.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a472147c0 con 0x561a471a80c0 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a47214980 con 0x561a471a89e0 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 10 client.0 _ll_register_callbacks cb 0x7f8a10005580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 0x561a47214110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 0x561a47214110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39944/0 (socket says 172.21.15.60:39944) 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 -- 172.21.15.60:0/2431090228 learned_addr learned my addr 172.21.15.60:0/2431090228 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1992e700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471a80c0 0x561a471bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 -- 172.21.15.60:0/2431090228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 msgr2=0x561a471bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 -- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471a80c0 msgr2=0x561a471bc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471a80c0 0x561a471bc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 -- 172.21.15.60:0/2431090228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a46f0fc60 con 0x561a471b7ca0 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471a80c0 0x561a471bc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a1a930700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 0x561a47214110 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c007a00 tx=0x7f8a0c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2d05cf64fe409a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f89fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f89fdffb700 1 -- 172.21.15.60:0/2431090228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00e040 con 0x561a471b7ca0 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a1001e040 con 0x561a471b7ca0 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.572+0000 7f89fdffb700 1 -- 172.21.15.60:0/2431090228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f8a0c012a40 con 0x561a471b7ca0 2023-10-05T15:18:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f89fdffb700 1 -- 172.21.15.60:0/2431090228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a0c012c00 con 0x561a471b7ca0 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 10 client.16242 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561a46f4d250 con 0x561a471b7ca0 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f89fdffb700 1 -- 172.21.15.60:0/2431090228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a1001e040 con 0x561a471b7ca0 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f89fdffb700 1 -- 172.21.15.60:0/2431090228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8a0c014040 con 0x561a471b7ca0 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 10 client.16242 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 20 client.16242 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a4721c250 0x561a4721e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:19.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 4 client.16242 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561a470f4b30 con 0x561a4721c250 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.573+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a4721c250 0x561a4721e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f89fdffb700 10 client.16242 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a1a12f700 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a4721c250 0x561a4721e670 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369125948c3095b2 server_cookie=925474a3041b81c2 in_seq=0 out_seq=0 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f89fdffb700 1 -- 172.21.15.60:0/2431090228 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561a470f4b30 con 0x561a4721c250 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f89fdffb700 10 client.16242 handle_command_reply: tid=0 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 client.16242 shutdown 2023-10-05T15:18:19.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 msgr2=0x561a47214110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 0x561a47214110 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c007a00 tx=0x7f8a0c007d10 comp rx=0 tx=0).stop 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 shutdown_connections 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561a4721c250 0x561a4721e670 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561a471b7ca0 0x561a47214110 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a471a80c0 0x561a471bc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f89fdffb700 0 client.16242 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 --2- 172.21.15.60:0/2431090228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a471a89e0 0x561a471bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 >> 172.21.15.60:0/2431090228 conn(0x561a4711d260 msgr2=0x561a471aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 shutdown_connections 2023-10-05T15:18:19.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 1 -- 172.21.15.60:0/2431090228 wait complete. 2023-10-05T15:18:19.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.574+0000 7f8a2857db80 20 client.16242 trim_cache size 0 max 16384 2023-10-05T15:18:19.587 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:19.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8a000a1790 msgr2=0x7f8a000a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8a000a1790 0x7f8a000a3c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000b2e0 tx=0x7f8a10005960 comp rx=0 tx=0).stop 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 msgr2=0x7f8a141964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 0x7f8a141964f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400ea80 tx=0x7f8a0400ed90 comp rx=0 tx=0).stop 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 shutdown_connections 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8a000a1790 0x7f8a000a3c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a1419a950 0x7f8a1419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a141001b0 0x7f8a14195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 --2- 172.21.15.60:0/1276402228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a14105140 0x7f8a141964f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 >> 172.21.15.60:0/1276402228 conn(0x7f8a14077cb0 msgr2=0x7f8a140fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 shutdown_connections 2023-10-05T15:18:19.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:19.575+0000 7f8a1c393700 1 -- 172.21.15.60:0/1276402228 wait complete. 2023-10-05T15:18:19.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:19 smithi135 ceph-mon[103360]: pgmap v49: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 561 op/s 2023-10-05T15:18:19.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:19 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:19.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:19 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1844517345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:18:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:19 smithi092 ceph-mon[102944]: pgmap v49: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 561 op/s 2023-10-05T15:18:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:19 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:19 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1844517345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:18:20.591 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:18:20.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 -- 172.21.15.60:0/3941450714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c0100960 msgr2=0x7f19c0104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 --2- 172.21.15.60:0/3941450714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c0100960 0x7f19c0104ab0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009990 tx=0x7f19b0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 -- 172.21.15.60:0/3941450714 shutdown_connections 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 --2- 172.21.15.60:0/3941450714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c01051e0 0x7f19c010cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 --2- 172.21.15.60:0/3941450714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c00fffb0 0x7f19c0100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 --2- 172.21.15.60:0/3941450714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c0100960 0x7f19c0104ab0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 -- 172.21.15.60:0/3941450714 >> 172.21.15.60:0/3941450714 conn(0x7f19c00fb850 msgr2=0x7f19c00fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 -- 172.21.15.60:0/3941450714 shutdown_connections 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.724+0000 7f19c81e3700 1 -- 172.21.15.60:0/3941450714 wait complete. 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 Processor -- start 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 -- start start 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c00fffb0 0x7f19c0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 0x7f19c0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c0198a70 0x7f19c01a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a3700 con 0x7f19c01051e0 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a3870 con 0x7f19c0198a70 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c81e3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a3a30 con 0x7f19c00fffb0 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 0x7f19c0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 0x7f19c0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39956/0 (socket says 172.21.15.60:39956) 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 -- 172.21.15.60:0/1289671087 learned_addr learned my addr 172.21.15.60:0/1289671087 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c00fffb0 0x7f19c0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c6780700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c0198a70 0x7f19c01a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 -- 172.21.15.60:0/1289671087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c00fffb0 msgr2=0x7f19c0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c00fffb0 0x7f19c0197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 -- 172.21.15.60:0/1289671087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c0198a70 msgr2=0x7f19c01a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c0198a70 0x7f19c01a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 -- 172.21.15.60:0/1289671087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b00095f0 con 0x7f19c01051e0 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.725+0000 7f19c577e700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 0x7f19c0198490 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f19b0000c00 tx=0x7f19b00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.726+0000 7f19b6ffd700 1 -- 172.21.15.60:0/1289671087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b001d070 con 0x7f19c01051e0 2023-10-05T15:18:20.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.726+0000 7f19b6ffd700 1 -- 172.21.15.60:0/1289671087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19b0021410 con 0x7f19c01051e0 2023-10-05T15:18:20.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.726+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c01a3cb0 con 0x7f19c01051e0 2023-10-05T15:18:20.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.726+0000 7f19b6ffd700 1 -- 172.21.15.60:0/1289671087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0017650 con 0x7f19c01051e0 2023-10-05T15:18:20.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.726+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c01a4160 con 0x7f19c01051e0 2023-10-05T15:18:20.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.728+0000 7f19b6ffd700 1 -- 172.21.15.60:0/1289671087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f19b0021580 con 0x7f19c01051e0 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.729+0000 7f19b6ffd700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19ac0a15f0 0x7f19ac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.729+0000 7f19b6ffd700 1 -- 172.21.15.60:0/1289671087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f19b00ce7f0 con 0x7f19c01051e0 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.729+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19ac0a15f0 0x7f19ac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.730+0000 7f19d43cdb80 1 Processor -- start 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 -- start start 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19ac0a15f0 0x7f19ac0a3ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19bc005950 tx=0x7f19bc00b410 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539140 0x560692539520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 0x56069254cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x56069254f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606924a24e0 con 0x56069254d120 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560692493ca0 con 0x560692539a60 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606924915c0 con 0x560692539140 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c5f7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539140 0x560692539520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 0x56069254cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 0x56069254cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53386/0 (socket says 172.21.15.60:53386) 2023-10-05T15:18:20.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c5f7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539140 0x560692539520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53492/0 (socket says 172.21.15.60:53492) 2023-10-05T15:18:20.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 -- 172.21.15.60:0/616400561 learned_addr learned my addr 172.21.15.60:0/616400561 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c6780700 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x56069254f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 -- 172.21.15.60:0/616400561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539140 msgr2=0x560692539520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539140 0x560692539520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 -- 172.21.15.60:0/616400561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 msgr2=0x56069254f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.731+0000 7f19c577e700 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x56069254f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.732+0000 7f19c577e700 1 -- 172.21.15.60:0/616400561 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606922b7e60 con 0x560692539a60 2023-10-05T15:18:20.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.732+0000 7f19c577e700 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 0x56069254cbe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19b00a3310 tx=0x7f19b009b080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ddb40f1d3a0d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.732+0000 7f19abfff700 1 -- 172.21.15.60:0/616400561 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b009b540 con 0x560692539a60 2023-10-05T15:18:20.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.732+0000 7f19abfff700 1 -- 172.21.15.60:0/616400561 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19b009f690 con 0x560692539a60 2023-10-05T15:18:20.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.732+0000 7f19abfff700 1 -- 172.21.15.60:0/616400561 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b009b7a0 con 0x560692539a60 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 -- 172.21.15.60:0/616400561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 msgr2=0x56069254cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 0x56069254cbe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19b00a3310 tx=0x7f19b009b080 comp rx=0 tx=0).stop 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 -- 172.21.15.60:0/616400561 shutdown_connections 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x56069254f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539140 0x560692539520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/616400561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539a60 0x56069254cbe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 -- 172.21.15.60:0/616400561 >> 172.21.15.60:0/616400561 conn(0x5606924ae2e0 msgr2=0x5606925354d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 -- 172.21.15.60:0/616400561 shutdown_connections 2023-10-05T15:18:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 -- 172.21.15.60:0/616400561 wait complete. 2023-10-05T15:18:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 -- start start 2023-10-05T15:18:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.733+0000 7f19d43cdb80 1 Processor -- start 2023-10-05T15:18:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539140 0x56069254d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x56069254da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x560692558580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56069248ceb0 con 0x56069254d120 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560692429790 con 0x560692539140 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560692429430 con 0x560692539a60 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 10 client.0 _ll_register_callbacks cb 0x560692286880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x560692558580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x560692558580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39972/0 (socket says 172.21.15.60:39972) 2023-10-05T15:18:20.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c577e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x56069254da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 -- 172.21.15.60:0/491319066 learned_addr learned my addr 172.21.15.60:0/491319066 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539140 0x56069254d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 -- 172.21.15.60:0/491319066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 msgr2=0x56069254da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x56069254da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 -- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539140 msgr2=0x56069254d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539140 0x56069254d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 -- 172.21.15.60:0/491319066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c01a4160 con 0x56069254d120 2023-10-05T15:18:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19c6780700 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x560692558580 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f19b8012e80 tx=0x7f19b8014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c172445166ddf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19a97fa700 1 -- 172.21.15.60:0/491319066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800e040 con 0x56069254d120 2023-10-05T15:18:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19a97fa700 1 -- 172.21.15.60:0/491319066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f19b8014ae0 con 0x56069254d120 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.734+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56069252cf90 con 0x56069254d120 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19a97fa700 1 -- 172.21.15.60:0/491319066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19b8014ca0 con 0x56069254d120 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 10 client.16254 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5606922a0ce0 con 0x56069254d120 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19a97fa700 1 -- 172.21.15.60:0/491319066 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56069252cf90 con 0x56069254d120 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19a97fa700 1 -- 172.21.15.60:0/491319066 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f19b801c020 con 0x56069254d120 2023-10-05T15:18:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 10 client.16254 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 20 client.16254 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x56069255ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 4 client.16254 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560692485e90 con 0x56069255ca30 2023-10-05T15:18:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.735+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x56069255ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.736+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x56069255ee50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bace69a59fbd48cb server_cookie=898d90f4341b1b2b in_seq=0 out_seq=0 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.736+0000 7f19a97fa700 10 client.16254 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.736+0000 7f19a97fa700 1 -- 172.21.15.60:0/491319066 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560692485e90 con 0x56069255ca30 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.736+0000 7f19a97fa700 10 client.16254 handle_command_reply: tid=0 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.736+0000 7f19d43cdb80 1 client.16254 shutdown 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.736+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 msgr2=0x560692558580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x560692558580 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f19b8012e80 tx=0x7f19b8014600 comp rx=0 tx=0).stop 2023-10-05T15:18:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 shutdown_connections 2023-10-05T15:18:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x56069255ee50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56069254d120 0x560692558580 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19a97fa700 0 client.16254 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560692539140 0x56069254d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/491319066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x56069254da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 >> 172.21.15.60:0/491319066 conn(0x5606924ae2e0 msgr2=0x560692535060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 shutdown_connections 2023-10-05T15:18:20.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 1 -- 172.21.15.60:0/491319066 wait complete. 2023-10-05T15:18:20.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.737+0000 7f19d43cdb80 20 client.16254 trim_cache size 0 max 16384 2023-10-05T15:18:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 Processor -- start 2023-10-05T15:18:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 -- start start 2023-10-05T15:18:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x5606925440f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692557c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56069230d9a0 con 0x560692539140 2023-10-05T15:18:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56069254de20 con 0x56069254d120 2023-10-05T15:18:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56069254e2a0 con 0x560692539a60 2023-10-05T15:18:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19c5f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19c5f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39976/0 (socket says 172.21.15.60:39976) 2023-10-05T15:18:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.754+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1356910870 learned_addr learned my addr 172.21.15.60:0/1356910870 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c577e700 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x5606925440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c6780700 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692557c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1356910870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 msgr2=0x5606925440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x5606925440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1356910870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 msgr2=0x560692557c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692557c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1356910870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560692563a40 con 0x560692539140 2023-10-05T15:18:20.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c6780700 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692557c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:20.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f19bc011750 tx=0x7f19bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22078de9b409650 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19b4ff9700 1 -- 172.21.15.60:0/1356910870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc024040 con 0x560692539140 2023-10-05T15:18:20.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19b4ff9700 1 -- 172.21.15.60:0/1356910870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19bc015070 con 0x560692539140 2023-10-05T15:18:20.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.755+0000 7f19b4ff9700 1 -- 172.21.15.60:0/1356910870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc004a90 con 0x560692539140 2023-10-05T15:18:20.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1356910870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 msgr2=0x560692552510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f19bc011750 tx=0x7f19bc013000 comp rx=0 tx=0).stop 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1356910870 shutdown_connections 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692557c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552510 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1356910870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x5606925440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1356910870 >> 172.21.15.60:0/1356910870 conn(0x5606924ae2e0 msgr2=0x5606925439e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1356910870 shutdown_connections 2023-10-05T15:18:20.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1356910870 wait complete. 2023-10-05T15:18:20.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 -- start start 2023-10-05T15:18:20.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.756+0000 7f19d43cdb80 1 Processor -- start 2023-10-05T15:18:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x560692550840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692550e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606925515b0 con 0x560692539140 2023-10-05T15:18:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606925b0830 con 0x56069254d120 2023-10-05T15:18:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606925b0970 con 0x560692539a60 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19d43cdb80 10 client.0 _ll_register_callbacks cb 0x7f19b80127b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39982/0 (socket says 172.21.15.60:39982) 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1299404135 learned_addr learned my addr 172.21.15.60:0/1299404135 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c577e700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x560692550840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c6780700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692550e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1299404135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 msgr2=0x560692550840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x560692550840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 msgr2=0x560692550e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692550e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 -- 172.21.15.60:0/1299404135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc0114c0 con 0x560692539140 2023-10-05T15:18:20.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c6780700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692550e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:20.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19c5f7f700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552450 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f19bc02b040 tx=0x7f19bc011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cb086f20028625 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:20.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.757+0000 7f19a97fa700 1 -- 172.21.15.60:0/1299404135 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc024040 con 0x560692539140 2023-10-05T15:18:20.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19a97fa700 1 -- 172.21.15.60:0/1299404135 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f19bc017070 con 0x560692539140 2023-10-05T15:18:20.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19b009f690 con 0x560692539140 2023-10-05T15:18:20.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19a97fa700 1 -- 172.21.15.60:0/1299404135 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19bc029b00 con 0x560692539140 2023-10-05T15:18:20.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 10 client.16260 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:20.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5606922de2d0 con 0x560692539140 2023-10-05T15:18:20.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19a97fa700 1 -- 172.21.15.60:0/1299404135 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19b009f690 con 0x560692539140 2023-10-05T15:18:20.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19a97fa700 1 -- 172.21.15.60:0/1299404135 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f19bc031400 con 0x560692539140 2023-10-05T15:18:20.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 10 client.16260 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:20.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:20.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 20 client.16260 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:20.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x5606925b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 4 client.16260 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560692485bb0 con 0x56069255ca30 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.758+0000 7f19c577e700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x5606925b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19a97fa700 10 client.16260 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19c577e700 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x5606925b4120 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de8c75cf34e6b140 server_cookie=f423aa9cd2a4472 in_seq=0 out_seq=0 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19a97fa700 1 -- 172.21.15.60:0/1299404135 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560692485bb0 con 0x56069255ca30 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19a97fa700 10 client.16260 handle_command_reply: tid=0 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 client.16260 shutdown 2023-10-05T15:18:20.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 msgr2=0x560692552450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552450 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f19bc02b040 tx=0x7f19bc011b90 comp rx=0 tx=0).stop 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 shutdown_connections 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56069255ca30 0x5606925b4120 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56069254d120 0x560692550e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560692539140 0x560692552450 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19a97fa700 0 client.16260 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.759+0000 7f19d43cdb80 1 --2- 172.21.15.60:0/1299404135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560692539a60 0x560692550840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 >> 172.21.15.60:0/1299404135 conn(0x5606924ae2e0 msgr2=0x560692544270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 shutdown_connections 2023-10-05T15:18:20.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19d43cdb80 1 -- 172.21.15.60:0/1299404135 wait complete. 2023-10-05T15:18:20.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19d43cdb80 20 client.16260 trim_cache size 0 max 16384 2023-10-05T15:18:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:18:20.776 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2023-10-05T15:18:20.776 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "c86f7e1f-0f49-4006-8efc-d7f562e32198", 2023-10-05T15:18:20.776 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2023-10-05T15:18:20.776 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19ac0a15f0 msgr2=0x7f19ac0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19ac0a15f0 0x7f19ac0a3ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19bc005950 tx=0x7f19bc00b410 comp rx=0 tx=0).stop 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 msgr2=0x7f19c0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 0x7f19c0198490 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f19b0000c00 tx=0x7f19b00047b0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 shutdown_connections 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19ac0a15f0 0x7f19ac0a3ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c0198a70 0x7f19c01a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c00fffb0 0x7f19c0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 --2- 172.21.15.60:0/1289671087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c01051e0 0x7f19c0198490 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 >> 172.21.15.60:0/1289671087 conn(0x7f19c00fb850 msgr2=0x7f19c00fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 shutdown_connections 2023-10-05T15:18:20.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.760+0000 7f19c81e3700 1 -- 172.21.15.60:0/1289671087 wait complete. 2023-10-05T15:18:20.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:18:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 -- 172.21.15.60:0/1019370158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c100b60 msgr2=0x7f737c104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 --2- 172.21.15.60:0/1019370158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c100b60 0x7f737c104a10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7370009990 tx=0x7f7370009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 -- 172.21.15.60:0/1019370158 shutdown_connections 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 --2- 172.21.15.60:0/1019370158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f737c105140 0x7f737c10ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 --2- 172.21.15.60:0/1019370158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737c1001b0 0x7f737c100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 --2- 172.21.15.60:0/1019370158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c100b60 0x7f737c104a10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 -- 172.21.15.60:0/1019370158 >> 172.21.15.60:0/1019370158 conn(0x7f737c077cb0 msgr2=0x7f737c0780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 -- 172.21.15.60:0/1019370158 shutdown_connections 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.909+0000 7f73816ae700 1 -- 172.21.15.60:0/1019370158 wait complete. 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 Processor -- start 2023-10-05T15:18:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 -- start start 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 0x7f737c197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737c105140 0x7f737c197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f737c19b9e0 0x7f737c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c19c460 con 0x7f737c1001b0 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.910+0000 7f73816ae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c19c5d0 con 0x7f737c19b9e0 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f73816ae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c19c790 con 0x7f737c105140 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 0x7f737c197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 0x7f737c197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39996/0 (socket says 172.21.15.60:39996) 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 -- 172.21.15.60:0/1396710655 learned_addr learned my addr 172.21.15.60:0/1396710655 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737a7fc700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737c105140 0x7f737c197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737b7fe700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f737c19b9e0 0x7f737c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 -- 172.21.15.60:0/1396710655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737c105140 msgr2=0x7f737c197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737c105140 0x7f737c197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 -- 172.21.15.60:0/1396710655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f737c19b9e0 msgr2=0x7f737c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f737c19b9e0 0x7f737c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 -- 172.21.15.60:0/1396710655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700095f0 con 0x7f737c1001b0 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f737affd700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 0x7f737c197040 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e9a0 tx=0x7f736c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f7363fff700 1 -- 172.21.15.60:0/1396710655 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c009790 con 0x7f737c1001b0 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c1a3cf0 con 0x7f737c1001b0 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f7363fff700 1 -- 172.21.15.60:0/1396710655 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736c010430 con 0x7f737c1001b0 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f7363fff700 1 -- 172.21.15.60:0/1396710655 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c018680 con 0x7f737c1001b0 2023-10-05T15:18:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.911+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c1a41d0 con 0x7f737c1001b0 2023-10-05T15:18:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.914+0000 7f7363fff700 1 -- 172.21.15.60:0/1396710655 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f736c0105a0 con 0x7f737c1001b0 2023-10-05T15:18:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.915+0000 7f7363fff700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f73640a15f0 0x7f73640a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.915+0000 7f7363fff700 1 -- 172.21.15.60:0/1396710655 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f736c014070 con 0x7f737c1001b0 2023-10-05T15:18:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.915+0000 7f737a7fc700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f73640a15f0 0x7f73640a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.915+0000 7f737a7fc700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f73640a15f0 0x7f73640a3ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f737000b2e0 tx=0x7f7370005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 Processor -- start 2023-10-05T15:18:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 -- start start 2023-10-05T15:18:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a1b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a26350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a28c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00984460 con 0x55ae00a26890 2023-10-05T15:18:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00975c20 con 0x55ae00a1b0c0 2023-10-05T15:18:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f738d898b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00973540 con 0x55ae00a1b9e0 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f737affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a1b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a28c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f737affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a1b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53426/0 (socket says 172.21.15.60:53426) 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f737affd700 1 -- 172.21.15.60:0/1996799054 learned_addr learned my addr 172.21.15.60:0/1996799054 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.916+0000 7f737a7fc700 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a26350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737affd700 1 -- 172.21.15.60:0/1996799054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 msgr2=0x55ae00a26350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737affd700 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a26350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737affd700 1 -- 172.21.15.60:0/1996799054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 msgr2=0x55ae00a28c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737affd700 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a28c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737affd700 1 -- 172.21.15.60:0/1996799054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae00799de0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737b7fe700 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a28c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f737affd700 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a1b4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f736c09a220 tx=0x7f736c099cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944b1c2bcd230c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f73617fa700 1 -- 172.21.15.60:0/1996799054 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c09e3e0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f73617fa700 1 -- 172.21.15.60:0/1996799054 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736c0a2620 con 0x55ae00a1b0c0 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.917+0000 7f73617fa700 1 -- 172.21.15.60:0/1996799054 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0cd470 con 0x55ae00a1b0c0 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 -- 172.21.15.60:0/1996799054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 msgr2=0x55ae00a1b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a1b4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f736c09a220 tx=0x7f736c099cf0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 -- 172.21.15.60:0/1996799054 shutdown_connections 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a28c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a1b4a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 --2- 172.21.15.60:0/1996799054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a26350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 -- 172.21.15.60:0/1996799054 >> 172.21.15.60:0/1996799054 conn(0x55ae00990260 msgr2=0x55ae00a17450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 -- 172.21.15.60:0/1996799054 shutdown_connections 2023-10-05T15:18:20.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 -- 172.21.15.60:0/1996799054 wait complete. 2023-10-05T15:18:20.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 -- start start 2023-10-05T15:18:20.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.918+0000 7f738d898b80 1 Processor -- start 2023-10-05T15:18:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 0x55ae00a235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a23b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a26890 0x55ae00a24040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae0096ee30 con 0x55ae00a1b0c0 2023-10-05T15:18:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae0090b710 con 0x55ae00a1b9e0 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae0090b3b0 con 0x55ae00a26890 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f738d898b80 10 client.0 _ll_register_callbacks cb 0x55ae00768800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 0x55ae00a235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 0x55ae00a235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40010/0 (socket says 172.21.15.60:40010) 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 -- 172.21.15.60:0/4247578876 learned_addr learned my addr 172.21.15.60:0/4247578876 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737a7fc700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a23b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737b7fe700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a26890 0x55ae00a24040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 -- 172.21.15.60:0/4247578876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a26890 msgr2=0x55ae00a24040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a26890 0x55ae00a24040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 -- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 msgr2=0x55ae00a23b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a23b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 -- 172.21.15.60:0/4247578876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7374003ae0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f737affd700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 0x55ae00a235c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f736c01e000 tx=0x7f736c095f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9426f2dec3f4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.919+0000 7f735eff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f735eff5700 1 -- 172.21.15.60:0/4247578876 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c098630 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f735eff5700 1 -- 172.21.15.60:0/4247578876 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f736c099780 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae00a0ef10 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f735eff5700 1 -- 172.21.15.60:0/4247578876 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f736c099940 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 10 client.16272 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f737c1a41d0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f735eff5700 1 -- 172.21.15.60:0/4247578876 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ae00a0ef10 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f735eff5700 1 -- 172.21.15.60:0/4247578876 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f736c0b82c0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 10 client.16272 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:20.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 20 client.16272 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a35ea0 0x55ae00a382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 4 client.16272 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae00967e10 con 0x55ae00a35ea0 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.920+0000 7f737a7fc700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a35ea0 0x55ae00a382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f735eff5700 10 client.16272 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f737a7fc700 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a35ea0 0x55ae00a382c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d9a1c638b13d156 server_cookie=59f759ce94760412 in_seq=0 out_seq=0 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f735eff5700 1 -- 172.21.15.60:0/4247578876 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ae00967e10 con 0x55ae00a35ea0 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f735eff5700 10 client.16272 handle_command_reply: tid=0 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 client.16272 shutdown 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 msgr2=0x55ae00a235c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 0x55ae00a235c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f736c01e000 tx=0x7f736c095f20 comp rx=0 tx=0).stop 2023-10-05T15:18:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 shutdown_connections 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a35ea0 0x55ae00a382c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a26890 0x55ae00a24040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f735eff5700 0 client.16272 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a1b0c0 0x55ae00a235c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 --2- 172.21.15.60:0/4247578876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a23b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 >> 172.21.15.60:0/4247578876 conn(0x55ae00990260 msgr2=0x55ae00a16fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 shutdown_connections 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.921+0000 7f738d898b80 1 -- 172.21.15.60:0/4247578876 wait complete. 2023-10-05T15:18:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.922+0000 7f738d898b80 20 client.16272 trim_cache size 0 max 16384 2023-10-05T15:18:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 Processor -- start 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 -- start start 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a23e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a20850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae007ef920 con 0x55ae00a26890 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00a1cb80 con 0x55ae00a1b0c0 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f738d898b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00a21b20 con 0x55ae00a1b9e0 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a23e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a20850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a23e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53440/0 (socket says 172.21.15.60:53440) 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 -- 172.21.15.60:0/126941915 learned_addr learned my addr 172.21.15.60:0/126941915 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 -- 172.21.15.60:0/126941915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 msgr2=0x55ae00a22480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a22480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 -- 172.21.15.60:0/126941915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 msgr2=0x55ae00a20850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a20850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 -- 172.21.15.60:0/126941915 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae00a13140 con 0x55ae00a1b0c0 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737b7fe700 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.939+0000 7f737affd700 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a23e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e970 tx=0x7f736c099ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b0b2de7a9b96ade server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f7361ffb700 1 -- 172.21.15.60:0/126941915 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c094ea0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f7361ffb700 1 -- 172.21.15.60:0/126941915 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736c0a2190 con 0x55ae00a1b0c0 2023-10-05T15:18:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f7361ffb700 1 -- 172.21.15.60:0/126941915 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0995a0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 -- 172.21.15.60:0/126941915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 msgr2=0x55ae00a23e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a23e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e970 tx=0x7f736c099ee0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 -- 172.21.15.60:0/126941915 shutdown_connections 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b0c0 0x55ae00a23e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 --2- 172.21.15.60:0/126941915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b9e0 0x55ae00a22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 -- 172.21.15.60:0/126941915 >> 172.21.15.60:0/126941915 conn(0x55ae00990260 msgr2=0x55ae00a21d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 -- 172.21.15.60:0/126941915 shutdown_connections 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.940+0000 7f738d898b80 1 -- 172.21.15.60:0/126941915 wait complete. 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 -- start start 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 Processor -- start 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b0c0 0x55ae00a2b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a2bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a2ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00a2d010 con 0x55ae00a26890 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00a2d180 con 0x55ae00a1b9e0 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae00a2d340 con 0x55ae00a1b0c0 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f738d898b80 10 client.0 _ll_register_callbacks cb 0x7f7374009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a2ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a2ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40028/0 (socket says 172.21.15.60:40028) 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a2bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b0c0 0x55ae00a2b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737b7fe700 1 -- 172.21.15.60:0/107369004 learned_addr learned my addr 172.21.15.60:0/107369004 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 -- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 msgr2=0x55ae00a2bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a2bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 -- 172.21.15.60:0/107369004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 msgr2=0x55ae00a2ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a2ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 -- 172.21.15.60:0/107369004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7374009930 con 0x55ae00a1b0c0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f737affd700 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b0c0 0x55ae00a2b690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f736c099f90 tx=0x7f736c09aa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e7c15eaef3f51b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.941+0000 7f735eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f735eff5700 1 -- 172.21.15.60:0/107369004 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c094ea0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f736c0a2620 con 0x55ae00a1b0c0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f735eff5700 1 -- 172.21.15.60:0/107369004 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f736c09a700 con 0x55ae00a1b0c0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f735eff5700 1 -- 172.21.15.60:0/107369004 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f736c099780 con 0x55ae00a1b0c0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 10 client.25816 fetch_fsmap learned FSMap version 29 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f737c1a41d0 con 0x55ae00a1b0c0 2023-10-05T15:18:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f735eff5700 1 -- 172.21.15.60:0/107369004 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736c0a2620 con 0x55ae00a1b0c0 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f735eff5700 1 -- 172.21.15.60:0/107369004 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f736c099400 con 0x55ae00a1b0c0 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 10 client.25816 fetch_fsmap finished waiting for FSMap version 29 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 10 client.25816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 20 client.25816 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a8ee20 0x55ae00a91240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 4 client.25816 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ae00967b30 con 0x55ae00a8ee20 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.942+0000 7f737a7fc700 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a8ee20 0x55ae00a91240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f735eff5700 10 client.25816 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f737a7fc700 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a8ee20 0x55ae00a91240 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfeb904324ed6221 server_cookie=9b09543396cb5d9b in_seq=0 out_seq=0 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f735eff5700 1 -- 172.21.15.60:0/107369004 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ae00967b30 con 0x55ae00a8ee20 2023-10-05T15:18:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f735eff5700 10 client.25816 handle_command_reply: tid=0 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 client.25816 shutdown 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b0c0 msgr2=0x55ae00a2b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b0c0 0x55ae00a2b690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f736c099f90 tx=0x7f736c09aa10 comp rx=0 tx=0).stop 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 shutdown_connections 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ae00a8ee20 0x55ae00a91240 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae00a26890 0x55ae00a2ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae00a1b0c0 0x55ae00a2b690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 --2- 172.21.15.60:0/107369004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae00a1b9e0 0x55ae00a2bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f735eff5700 0 client.25816 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 >> 172.21.15.60:0/107369004 conn(0x55ae00990260 msgr2=0x55ae00a22600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 shutdown_connections 2023-10-05T15:18:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 1 -- 172.21.15.60:0/107369004 wait complete. 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.943+0000 7f738d898b80 20 client.25816 trim_cache size 0 max 16384 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "c86f7e1f-0f49-4006-8efc-d7f562e32198": { 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "c86f7e1f-0f49-4006-8efc-d7f562e32198", 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2023-10-05T15:18:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:18:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:18:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:18:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f73640a15f0 msgr2=0x7f73640a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f73640a15f0 0x7f73640a3ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f737000b2e0 tx=0x7f7370005960 comp rx=0 tx=0).stop 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 msgr2=0x7f737c197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 0x7f737c197040 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e9a0 tx=0x7f736c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 shutdown_connections 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f73640a15f0 0x7f73640a3ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f737c19b9e0 0x7f737c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737c1001b0 0x7f737c197040 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 --2- 172.21.15.60:0/1396710655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737c105140 0x7f737c197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 >> 172.21.15.60:0/1396710655 conn(0x7f737c077cb0 msgr2=0x7f737c103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 shutdown_connections 2023-10-05T15:18:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:20.944+0000 7f73816ae700 1 -- 172.21.15.60:0/1396710655 wait complete. 2023-10-05T15:18:20.957 INFO:tasks.cephfs.filesystem:scrub status for tag:c86f7e1f-0f49-4006-8efc-d7f562e32198 - {'path': '/', 'tag': 'c86f7e1f-0f49-4006-8efc-d7f562e32198', 'options': 'recursive,force'} 2023-10-05T15:18:21.031 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.772+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/blogbench.8 auth v14 ap=1 s=964 n(v0 rc2023-10-05T15:17:59.446228+0000 b964 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143014b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000205:[<0x10000000204/blogbench.8 v14>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000205:[<0x10000000204/blogbench.8 v14>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.772+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000380 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile auth v33 ap=1 s=10072 n(v0 rc2023-10-05T15:18:05.204174+0000 b10072 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143014ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000380:[<0x10000000204/Makefile v33>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000380:[<0x10000000204/Makefile v33>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.773+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.in auth v10 ap=1 s=9817 n(v0 rc2023-10-05T15:17:59.448228+0000 b9817 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/pFscr@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143014c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000207:[<0x10000000204/Makefile.in v10>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000207:[<0x10000000204/Makefile.in v10>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.773+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.am auth v18 ap=1 s=55 n(v0 rc2023-10-05T15:17:59.447228+0000 b55 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143014cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000206:[<0x10000000204/Makefile.am v18>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000206:[<0x10000000204/Makefile.am v18>,<0x10000000201/man v1710>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.776+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000203 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4 auth v6 ap=1 s=9243 n(v0 rc2023-10-05T15:17:59.444228+0000 b9243 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430d4d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000203:[<0x10000000202/acx_pthread.m4 v6>,<0x10000000201/m4 v1672>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000203:[<0x10000000202/acx_pthread.m4 v6>,<0x10000000201/m4 v1672>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.778+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.o auth v280 ap=1 s=13216 n(v0 rc2023-10-05T15:18:05.753169+0000 b13216 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614300f8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039b:[<0x10000000208/reader.o v280>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000039b:[<0x10000000208/reader.o v280>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.779+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000387 [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/ auth{0=1,2=1,3=1,4=1} v276 ap=1 f(v0 m2023-10-05T15:18:05.973167+0000 10=10+0) n(v0 rc2023-10-05T15:18:05.973167+0000 b72805 11=10+1) (inest mix) (ifile excl) (iversion lock) caps={15483=pAsLsXsFsx/pAsLsXsFsx@2},l=15483 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x56143014a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000387:[<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000387:[<0x10000000208/.deps v276>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:05.973167+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:05.973167+0000 b72805 11=10+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:05.973167+0000 10=10+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:05.973167+0000 b72805 11=10+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.779+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.c auth v100 ap=1 s=2117 n(v0 rc2023-10-05T15:17:59.452227+0000 b2117 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614300f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020b:[<0x10000000208/blogbench.c v100>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000020b:[<0x10000000208/blogbench.c v100>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.780+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000399 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.o auth v266 ap=1 s=13104 n(v0 rc2023-10-05T15:18:05.705170+0000 b13104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614300f9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000399:[<0x10000000208/rewriter.o v266>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000399:[<0x10000000208/rewriter.o v266>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.032 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.781+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000395 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.o auth v240 ap=1 s=22296 n(v0 rc2023-10-05T15:18:05.605171+0000 b22296 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614300f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000395:[<0x10000000208/process.o v240>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000395:[<0x10000000208/process.o v240>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.781+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.o auth v268 ap=1 s=7912 n(v0 rc2023-10-05T15:18:05.971167+0000 b7912 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614300f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a5:[<0x10000000208/mysnprintf.o v268>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a5:[<0x10000000208/mysnprintf.o v268>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.782+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.o auth v278 ap=1 s=11656 n(v0 rc2023-10-05T15:18:05.799169+0000 b11656 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614300fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039d:[<0x10000000208/commenter.o v278>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000039d:[<0x10000000208/commenter.o v278>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.783+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/globals.h auth v56 ap=1 s=1419 n(v0 rc2023-10-05T15:17:59.460227+0000 b1419 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000215:[<0x10000000208/globals.h v56>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000215:[<0x10000000208/globals.h v56>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.783+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000219 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.c auth v76 ap=1 s=1910 n(v0 rc2023-10-05T15:17:59.464227+0000 b1910 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000219:[<0x10000000208/writer.c v76>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000219:[<0x10000000208/writer.c v76>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.784+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.c auth v40 ap=1 s=729 n(v0 rc2023-10-05T15:17:59.450228+0000 b729 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000209:[<0x10000000208/mysnprintf.c v40>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000209:[<0x10000000208/mysnprintf.c v40>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.784+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000211 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h auth v48 ap=1 s=4944 n(v0 rc2005-02-11T11:45:33.000000+0000 b4944 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000211:[<0x10000000208/bsd-getopt_long.h v48>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000211:[<0x10000000208/bsd-getopt_long.h v48>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.785+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000216 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.c auth v96 ap=1 s=939 n(v0 rc2023-10-05T15:17:59.461227+0000 b939 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000216:[<0x10000000208/commenter.c v96>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000216:[<0x10000000208/commenter.c v96>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.786+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.c auth v92 ap=1 s=4200 n(v0 rc2005-02-11T14:46:26.000000+0000 b4200 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021a:[<0x10000000208/helpers.c v92>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000021a:[<0x10000000208/helpers.c v92>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.787+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.h auth v64 ap=1 s=696 n(v0 rc2023-10-05T15:17:59.451227+0000 b696 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020a:[<0x10000000208/mysnprintf.h v64>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000020a:[<0x10000000208/mysnprintf.h v64>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.033 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.787+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.o auth v262 ap=1 s=29104 n(v0 rc2023-10-05T15:18:05.869168+0000 b29104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039f:[<0x10000000208/helpers.o v262>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000039f:[<0x10000000208/helpers.o v262>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.788+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench_p.h auth v80 ap=1 s=460 n(v0 rc2023-10-05T15:17:59.455227+0000 b460 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020f:[<0x10000000208/blogbench_p.h v80>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000020f:[<0x10000000208/blogbench_p.h v80>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.789+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.o auth v246 ap=1 s=7904 n(v0 rc2023-10-05T15:18:05.935168+0000 b7904 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a3:[<0x10000000208/fakesnprintf.o v246>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a3:[<0x10000000208/fakesnprintf.o v246>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.789+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.h auth v108 ap=1 s=3764 n(v0 rc2005-02-11T19:50:06.000000+0000 b3764 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56143134d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020c:[<0x10000000208/blogbench.h v108>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000020c:[<0x10000000208/blogbench.h v108>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.790+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000217 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.c auth v84 ap=1 s=1581 n(v0 rc2023-10-05T15:17:59.462227+0000 b1581 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431336000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000217:[<0x10000000208/rewriter.c v84>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000217:[<0x10000000208/rewriter.c v84>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.790+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000393 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.o auth v238 ap=1 s=19280 n(v0 rc2023-10-05T15:18:05.541171+0000 b19280 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431336580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000393:[<0x10000000208/blogbench.o v238>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000393:[<0x10000000208/blogbench.o v238>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.790+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile auth v264 ap=1 s=13322 n(v0 rc2023-10-05T15:18:05.185175+0000 b13322 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431336b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037f:[<0x10000000208/Makefile v264>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000037f:[<0x10000000208/Makefile v264>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.791+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000213 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.in auth v68 ap=1 s=13775 n(v0 rc2023-10-05T15:17:59.458227+0000 b13775 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/pFscr@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431337080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000213:[<0x10000000208/Makefile.in v68>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000213:[<0x10000000208/Makefile.in v68>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.792+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.c auth v104 ap=1 s=10682 n(v0 rc2023-10-05T15:17:59.453227+0000 b10682 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431337600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020d:[<0x10000000208/fakesnprintf.c v104>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000020d:[<0x10000000208/fakesnprintf.c v104>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.034 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.793+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000212 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.am auth v72 ap=1 s=299 n(v0 rc2023-10-05T15:17:59.457227+0000 b299 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431337b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000212:[<0x10000000208/Makefile.am v72>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000212:[<0x10000000208/Makefile.am v72>,<0x10000000201/src v1752>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.793+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000210 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c auth v88 ap=1 s=18847 n(v0 rc2023-10-05T15:17:59.456227+0000 b18847 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431338100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000210:[<0x10000000208/bsd-getopt_long.c v88>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000210:[<0x10000000208/bsd-getopt_long.c v88>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.794+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a7 [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/ auth{0=1,2=1,3=1,4=1} v334 ap=1 f(v0 m2023-10-05T15:18:16.434071+0000 11=0+11) n(v0 rc2023-10-05T15:18:19.906039+0000 b23005410 1666=1654+12) (isnap sync r=35) (inest mix w=50 dirty) (ipolicy sync r=9) (ifile excl) (iversion lock) caps={15483=pAsLsXsFsx/pAsLsXsFsx@2},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=3 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x56143014a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000003a7:[<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000003a7:[<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:16.434071+0000 11=0+11)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:19.906039+0000 b23005410 1666=1654+12)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:16.434071+0000 11=0+11)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:19.906039+0000 b23005410 1666=1654+12)","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.794+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o auth v258 ap=1 s=7912 n(v0 rc2023-10-05T15:18:05.901168+0000 b7912 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431338680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a1:[<0x10000000208/bsd-getopt_long.o v258>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a1:[<0x10000000208/bsd-getopt_long.o v258>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.795+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000218 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.c auth v60 ap=1 s=1605 n(v0 rc2023-10-05T15:17:59.463227+0000 b1605 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431338c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000218:[<0x10000000208/reader.c v60>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000218:[<0x10000000208/reader.c v60>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.795+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000214 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.c auth v52 ap=1 s=4649 n(v0 rc2023-10-05T15:17:59.459227+0000 b4649 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431339180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000214:[<0x10000000208/process.c v52>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000214:[<0x10000000208/process.c v52>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.796+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000397 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.o auth v272 ap=1 s=14040 n(v0 rc2023-10-05T15:18:05.656170+0000 b14040 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431339700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000397:[<0x10000000208/writer.o v272>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000397:[<0x10000000208/writer.o v272>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.796+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.h auth v44 ap=1 s=606 n(v0 rc2023-10-05T15:17:59.454227+0000 b606 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431314000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020e:[<0x10000000208/fakesnprintf.h v44>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000020e:[<0x10000000208/fakesnprintf.h v44>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.796+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench auth v244 ap=1 s=74456 n(v0 rc2023-10-05T15:18:05.995167+0000 b74456 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561431314580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a6:[<0x10000000208/blogbench v244>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a6:[<0x10000000208/blogbench v244>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.035 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.796+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000398 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po auth v108 ap=1 s=7615 n(v0 rc2023-10-05T15:18:05.706170+0000 b7615 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430364b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000398:[<0x10000000387/rewriter.Po v108>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000398:[<0x10000000387/rewriter.Po v108>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.797+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000396 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/writer.Po auth v102 ap=1 s=7611 n(v0 rc2023-10-05T15:18:05.657170+0000 b7611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430365080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000396:[<0x10000000387/writer.Po v102>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000396:[<0x10000000387/writer.Po v102>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.797+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po auth v98 ap=1 s=7617 n(v0 rc2023-10-05T15:18:05.801169+0000 b7617 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430365600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039c:[<0x10000000387/commenter.Po v98>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000039c:[<0x10000000387/commenter.Po v98>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.798+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/reader.Po auth v92 ap=1 s=7611 n(v0 rc2023-10-05T15:18:05.755169+0000 b7611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430365b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039a:[<0x10000000387/reader.Po v92>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000039a:[<0x10000000387/reader.Po v92>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.798+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000392 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po auth v94 ap=1 s=7760 n(v0 rc2023-10-05T15:18:05.543171+0000 b7760 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430366100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000392:[<0x10000000387/blogbench.Po v94>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000392:[<0x10000000387/blogbench.Po v94>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.799+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000394 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/process.Po auth v96 ap=1 s=7613 n(v0 rc2023-10-05T15:18:05.607171+0000 b7613 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430366680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000394:[<0x10000000387/process.Po v96>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000394:[<0x10000000387/process.Po v96>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.799+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po auth v100 ap=1 s=4110 n(v0 rc2023-10-05T15:18:05.973167+0000 b4110 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430366c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a4:[<0x10000000387/mysnprintf.Po v100>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a4:[<0x10000000387/mysnprintf.Po v100>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.803+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po auth v110 ap=1 s=7623 n(v0 rc2023-10-05T15:18:05.936168+0000 b7623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430367180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a2:[<0x10000000387/fakesnprintf.Po v110>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a2:[<0x10000000387/fakesnprintf.Po v110>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.806+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po auth v104 ap=1 s=7613 n(v0 rc2023-10-05T15:18:05.870168+0000 b7613 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561430367700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039e:[<0x10000000387/helpers.Po v104>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000039e:[<0x10000000387/helpers.Po v104>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.810+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po auth v106 ap=1 s=7632 n(v0 rc2023-10-05T15:18:05.903168+0000 b7632 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5614303f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a0:[<0x10000000387/bsd-getopt_long.Po v106>,<0x10000000208/.deps v276>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a0:[<0x10000000387/bsd-getopt_long.Po v106>,<0x10000000208/.deps v276>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.814+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a8 [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v13476 pv13642 ap=7 f(v0 m2023-10-05T15:18:20.218036+0000 191=191+0)->f(v0 m2023-10-05T15:18:20.695032+0000 190=190+0) n(v0 rc2023-10-05T15:18:20.218036+0000 b3424043 192=191+1)->n(v0 rc2023-10-05T15:18:20.695032+0000 b3403606 191=190+1) (iauth sync r=1) (isnap sync r=4) (inest mix w=4 dirty) (ipolicy sync r=1) (ifile excl w=4) (iversion lock w=5 last_client=15483) caps={15483=pAsLsXsFsx/pAsLsXsFsx@111},l=15483 | dirtyscattered=1 lock=6 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430147080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000003a8:[<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000003a8:[<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:20.218036+0000 191=191+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:20.218036+0000 b3424043 192=191+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:20.218036+0000 191=191+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:20.218036+0000 b3424043 192=191+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.036 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.817+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077f [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/ auth{0=1} fragtree_t(*^3) v13456 pv13526 ap=5 f(v0 m2023-10-05T15:18:20.167037+0000 159=159+0)->f(v0 m2023-10-05T15:18:20.372035+0000 158=158+0) n(v0 rc2023-10-05T15:18:20.167037+0000 b4222940 160=159+1)->n(v0 rc2023-10-05T15:18:20.372035+0000 b4193170 159=158+1) (iauth sync r=1) (isnap sync r=3) (inest lock w=3 dirty) (ipolicy sync r=1) (ifile excl w=3) (iversion lock w=3 last_client=15483) caps={15483=pAsLsXsFsx/pAsLsXsFsx@11},l=15483 | dirtyscattered=1 lock=6 importingcaps=0 dirfrag=8 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431314b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000077f:[<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000077f:[<0x100000003a7/blog-7 v13456>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:20.167037+0000 159=159+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:20.167037+0000 b4222940 160=159+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:20.167037+0000 159=159+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:20.167037+0000 b4222940 160=159+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.819+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000559 [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v13440 ap=2 f(v0 m2023-10-05T15:18:20.113037+0000 114=114+0) n(v0 rc2023-10-05T15:18:20.113037+0000 b2254766 115=114+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1 dirty) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={15483=pAsLsXsFsx/pAsLsXsFsx@520},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=5 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x561430147600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000559:[<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000559:[<0x100000003a7/blog-4 v13440>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:20.113037+0000 114=114+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:20.113037+0000 b2254766 115=114+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:20.113037+0000 114=114+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:20.113037+0000 b2254766 115=114+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.821+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003aa [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v13466 pv13654 ap=12 f(v1 m2023-10-05T15:18:20.196036+0000 208=208+0)->f(v1 m2023-10-05T15:18:20.727031+0000 207=207+0) n(v0 rc2023-10-05T15:18:20.196036+0000 b3816347 209=208+1)->n(v0 rc2023-10-05T15:18:20.727031+0000 b3782897 208=207+1) (iauth sync r=1) (isnap sync r=6) (inest mix w=7 dirty) (ipolicy sync r=1) (ifile excl w=6) (iversion lock w=10) caps={15483=pAsLsXsFsx/pAsLsXsFsx@1653},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=6 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430147b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000003aa:[<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000003aa:[<0x100000003a7/blog-1 v13466>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:20.196036+0000 208=208+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:20.196036+0000 b3816347 209=208+1)","memory_value.dirstat":"f(v1 m2023-10-05T15:18:20.196036+0000 208=208+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:20.196036+0000 b3816347 209=208+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.830+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000775 [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/ auth{0=1,2=1,3=1,4=1} v13196 pv13606 ap=6 f(v0 m2023-10-05T15:18:16.864067+0000 78=78+0)->f(v0 m2023-10-05T15:18:20.612032+0000 80=80+0) n(v0 rc2023-10-05T15:18:16.864067+0000 b1493696 79=78+1)->n(v0 rc2023-10-05T15:18:20.612032+0000 b1493696 81=80+1) (iauth sync r=1) (isnap sync r=3) (inest mix w=3 dirty) (ipolicy sync r=1) (ifile excl w=3) (iversion lock w=3 last_client=15483) caps={15483=pAsLsXsFsx/pAsLsXsFsx@2720},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=6 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430148680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000775:[<0x100000003a7/blog-6 v7506>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000775:[<0x100000003a7/blog-6 v13196>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:16.864067+0000 78=78+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:16.864067+0000 b1493696 79=78+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:16.864067+0000 78=78+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:16.864067+0000 b1493696 79=78+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.838+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f9 [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v12214 ap=1 f(v0 m2023-10-05T15:18:13.067102+0000 186=186+0) n(v0 rc2023-10-05T15:18:13.067102+0000 b838571 187=186+1) (inest mix dirty) (ifile excl) (iversion lock) caps={15483=pAsLsXsFsx/pAsLsXsFsx@1817},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=0 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430148c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000005f9:[<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000005f9:[<0x100000003a7/blog-5 v12214>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:13.067102+0000 186=186+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:13.067102+0000 b838571 187=186+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:13.067102+0000 186=186+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:13.067102+0000 b838571 187=186+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.839+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ab [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v12354 ap=1 f(v0 m2023-10-05T15:18:13.101102+0000 240=240+0) n(v0 rc2023-10-05T15:18:13.101102+0000 b2226336 241=240+1) (inest mix dirty) (ifile excl) (iversion lock) caps={15483=pAsLsXsFsx/pAsLsXsFsx@1960},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=0 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430149180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000003ab:[<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000003ab:[<0x100000003a7/blog-2 v12354>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:13.101102+0000 240=240+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:13.101102+0000 b2226336 241=240+1)","memory_value.dirstat":"f(v0 m2023-10-05T15:18:13.101102+0000 240=240+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:13.101102+0000 b2226336 241=240+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.840+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051d [...4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v13464 pv13644 ap=11 f(v1 m2023-10-05T15:18:20.182036+0000 213=213+0)->f(v1 m2023-10-05T15:18:20.709032+0000 213=213+0) n(v0 rc2023-10-05T15:18:20.182036+0000 b3444891 214=213+1)->n(v0 rc2023-10-05T15:18:20.709032+0000 b3448924 214=213+1) (iauth sync r=1) (isnap sync r=5) (inest mix w=6 dirty) (ipolicy sync r=1) (ifile excl w=5) (iversion lock w=9 last_client=15483) caps={15483=pAsLsXsFsx/pAsLsXsFsx@1372},l=15483 | ptrwaiter=0 dirtyscattered=1 lock=6 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430149700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000051d:[<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000051d:[<0x100000003a7/blog-3 v13464>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-05T15:18:20.182036+0000 213=213+0)","ondisk_value.rstat":"n(v0 rc2023-10-05T15:18:20.182036+0000 b3444891 214=213+1)","memory_value.dirstat":"f(v1 m2023-10-05T15:18:20.182036+0000 213=213+0)","memory_value.rstat":"n(v0 rc2023-10-05T15:18:20.182036+0000 b3444891 214=213+1)","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.841+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg auth v1189 ap=1 s=21634 n(v0 rc2023-10-05T15:18:08.759142+0000 b21634 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c6:[<0x100000003a8/picture-13.jpg v594>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c6:[<0x100000003a8/picture-13.jpg v1189>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.842+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ab [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg auth v1191 ap=1 s=16371 n(v0 rc2023-10-05T15:18:08.690142+0000 b16371 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ab:[<0x100000003a8/picture-18.jpg v538>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ab:[<0x100000003a8/picture-18.jpg v1191>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.843+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg auth v1193 ap=1 s=25220 n(v0 rc2023-10-05T15:18:08.671143+0000 b25220 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c65180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a2:[<0x100000003a8/picture-19.jpg v522>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a2:[<0x100000003a8/picture-19.jpg v1193>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.037 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.845+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-82.jpg auth v1195 ap=1 s=36901 n(v0 rc2023-10-05T15:18:08.284146+0000 b36901 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c72000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c4:[<0x100000003a8/picture-82.jpg v58>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c4:[<0x100000003a8/picture-82.jpg v1195>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.845+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000505 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg auth v1197 ap=1 s=45263 n(v0 rc2023-10-05T15:18:08.922140+0000 b45263 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c72580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000505:[<0x100000003a8/picture-4.jpg v720>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000505:[<0x100000003a8/picture-4.jpg v1197>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.846+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000451 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg auth v1199 ap=1 s=9916 n(v0 rc2023-10-05T15:18:08.498144+0000 b9916 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c72b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000451:[<0x100000003a8/picture-35.jpg v340>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000451:[<0x100000003a8/picture-35.jpg v1199>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.847+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000511 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg auth v1201 ap=1 s=10752 n(v0 rc2023-10-05T15:18:08.953140+0000 b10752 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c73080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000511:[<0x100000003a8/picture-2.jpg v744>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000511:[<0x100000003a8/picture-2.jpg v1201>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.847+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-78.jpg auth v1203 ap=1 s=36682 n(v0 rc2023-10-05T15:18:08.302146+0000 b36682 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c73600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d0:[<0x100000003a8/picture-78.jpg v82>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d0:[<0x100000003a8/picture-78.jpg v1203>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.848+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg auth v1205 ap=1 s=30568 n(v0 rc2023-10-05T15:18:08.749142+0000 b30568 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c73b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c3:[<0x100000003a8/picture-14.jpg v586>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c3:[<0x100000003a8/picture-14.jpg v1205>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.849+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-89.jpg auth v1207 ap=1 s=48771 n(v0 rc2023-10-05T15:18:08.252146+0000 b48771 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c74100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b0:[<0x100000003a8/picture-89.jpg v16>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b0:[<0x100000003a8/picture-89.jpg v1207>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.851+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000403 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-61.jpg auth v1209 ap=1 s=30154 n(v0 rc2023-10-05T15:18:08.379145+0000 b30154 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c75180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000403:[<0x100000003a8/picture-61.jpg v184>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000403:[<0x100000003a8/picture-61.jpg v1209>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.851+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg auth v1211 ap=1 s=25910 n(v0 rc2023-10-05T15:18:08.874141+0000 b25910 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c75700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f3:[<0x100000003a8/picture-7.jpg v684>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f3:[<0x100000003a8/picture-7.jpg v1211>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.852+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg auth v1213 ap=1 s=27186 n(v0 rc2023-10-05T15:18:08.835141+0000 b27186 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c84000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e4:[<0x100000003a8/picture-9.jpg v654>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e4:[<0x100000003a8/picture-9.jpg v1213>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.038 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.854+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-64.jpg auth v1211 ap=1 s=61147 n(v0 rc2023-10-05T15:18:08.365145+0000 b61147 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c14100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003fa:[<0x100000003a8/picture-64.jpg v166>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003fa:[<0x100000003a8/picture-64.jpg v1211>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.855+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004de [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg auth v1213 ap=1 s=44429 n(v0 rc2023-10-05T15:18:08.820141+0000 b44429 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c15180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004de:[<0x100000003a8/picture-10.jpg v642>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004de:[<0x100000003a8/picture-10.jpg v1213>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.857+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000517 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg auth v1215 ap=1 s=37246 n(v0 rc2023-10-05T15:18:08.969140+0000 b37246 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c22000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000517:[<0x100000003a8/picture-1.jpg v756>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000517:[<0x100000003a8/picture-1.jpg v1215>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.858+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-83.jpg auth v1217 ap=1 s=25128 n(v0 rc2023-10-05T15:18:08.279146+0000 b25128 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c22b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c1:[<0x100000003a8/picture-83.jpg v52>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c1:[<0x100000003a8/picture-83.jpg v1217>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.859+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg auth v1219 ap=1 s=37212 n(v0 rc2023-10-05T15:18:08.891140+0000 b37212 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c23080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f9:[<0x100000003a8/picture-6.jpg v696>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f9:[<0x100000003a8/picture-6.jpg v1219>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.861+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000470 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg auth v1221 ap=1 s=24714 n(v0 rc2023-10-05T15:18:08.543144+0000 b24714 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c24c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000470:[<0x100000003a8/picture-28.jpg v406>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000470:[<0x100000003a8/picture-28.jpg v1221>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.863+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg auth v1223 ap=1 s=15242 n(v0 rc2023-10-05T15:18:08.488144+0000 b15242 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c32000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000044b:[<0x100000003a8/picture-37.jpg v328>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000044b:[<0x100000003a8/picture-37.jpg v1223>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.864+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg auth v1225 ap=1 s=32742 n(v0 rc2023-10-05T15:18:08.708142+0000 b32742 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c32580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b1:[<0x100000003a8/picture-17.jpg v552>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b1:[<0x100000003a8/picture-17.jpg v1225>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.865+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-85.jpg auth v1227 ap=1 s=58997 n(v0 rc2023-10-05T15:18:08.270146+0000 b58997 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bb:[<0x100000003a8/picture-85.jpg v40>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003bb:[<0x100000003a8/picture-85.jpg v1227>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.865+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg auth v1229 ap=1 s=14137 n(v0 rc2023-10-05T15:18:08.581143+0000 b14137 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c33080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047e:[<0x100000003a8/picture-24.jpg v450>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000047e:[<0x100000003a8/picture-24.jpg v1229>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.866+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000457 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg auth v1231 ap=1 s=23554 n(v0 rc2023-10-05T15:18:08.506144+0000 b23554 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c33600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000457:[<0x100000003a8/picture-33.jpg v352>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000457:[<0x100000003a8/picture-33.jpg v1231>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.039 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.866+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-57.jpg auth v1233 ap=1 s=59989 n(v0 rc2023-10-05T15:18:08.397145+0000 b59989 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c33b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000040f:[<0x100000003a8/picture-57.jpg v208>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000040f:[<0x100000003a8/picture-57.jpg v1233>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.867+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg auth v1235 ap=1 s=15893 n(v0 rc2023-10-05T15:18:08.466144+0000 b15893 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c34100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000043c:[<0x100000003a8/picture-42.jpg v298>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000043c:[<0x100000003a8/picture-42.jpg v1235>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.868+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ee [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-68.jpg auth v1237 ap=1 s=40660 n(v0 rc2023-10-05T15:18:08.347146+0000 b40660 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c34680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ee:[<0x100000003a8/picture-68.jpg v142>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ee:[<0x100000003a8/picture-68.jpg v1237>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.869+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000445 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg auth v1239 ap=1 s=34855 n(v0 rc2023-10-05T15:18:08.480144+0000 b34855 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c34c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000445:[<0x100000003a8/picture-39.jpg v316>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000445:[<0x100000003a8/picture-39.jpg v1239>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.873+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-25.jpg auth v1213 ap=1 s=21277 n(v0 rc2023-10-05T15:18:08.567143+0000 b21277 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c85080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047a:[<0x100000003a8/picture-25.jpg v436>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000047a:[<0x100000003a8/picture-25.jpg v1213>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.875+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000460 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-31.jpg auth v1215 ap=1 s=58396 n(v0 rc2023-10-05T15:18:08.520144+0000 b58396 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000460:[<0x100000003a8/picture-31.jpg v372>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000460:[<0x100000003a8/picture-31.jpg v1215>,<0x100000003a7/blog-0 v13476>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.970+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000427 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-49.jpg auth v1217 ap=1 s=59713 n(v0 rc2023-10-05T15:18:08.433145+0000 b59713 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c87180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000427:[<0x100000003a8/picture-49.jpg v256>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000427:[<0x100000003a8/picture-49.jpg v1217>,<0x100000003a7/blog-0 v13658>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.971+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ed [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-8.jpg auth v1219 ap=1 s=53102 n(v0 rc2023-10-05T15:18:08.858141+0000 b53102 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ed:[<0x100000003a8/picture-8.jpg v672>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ed:[<0x100000003a8/picture-8.jpg v1219>,<0x100000003a7/blog-0 v13658>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.040 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.971+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-88.jpg auth v1221 ap=1 s=18412 n(v0 rc2023-10-05T15:18:08.256146+0000 b18412 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c9e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b3:[<0x100000003a8/picture-88.jpg v22>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b3:[<0x100000003a8/picture-88.jpg v1221>,<0x100000003a7/blog-0 v13658>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.972+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000476 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-26.jpg auth v1223 ap=1 s=8234 n(v0 rc2023-10-05T15:18:08.559144+0000 b8234 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c9e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000476:[<0x100000003a8/picture-26.jpg v426>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000476:[<0x100000003a8/picture-26.jpg v1223>,<0x100000003a7/blog-0 v13658>,<0x10000000208/blogtest_in v334>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.999+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000418 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-54.jpg auth v1225 ap=1 s=35074 n(v0 rc2023-10-05T15:18:08.411145+0000 b35074 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000418:[<0x100000003a8/picture-54.jpg v226>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000418:[<0x100000003a8/picture-54.jpg v1225>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:20.999+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-29.jpg auth v1227 ap=1 s=22221 n(v0 rc2023-10-05T15:18:08.537144+0000 b22221 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046c:[<0x100000003a8/picture-29.jpg v396>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000046c:[<0x100000003a8/picture-29.jpg v1227>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.002+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-86.jpg auth v1199 ap=1 s=15222 n(v0 rc2023-10-05T15:18:08.266146+0000 b15222 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b8:[<0x100000003a8/picture-86.jpg v34>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b8:[<0x100000003a8/picture-86.jpg v1199>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.003+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-81.jpg auth v1201 ap=1 s=59641 n(v0 rc2023-10-05T15:18:08.288146+0000 b59641 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c7:[<0x100000003a8/picture-81.jpg v64>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c7:[<0x100000003a8/picture-81.jpg v1201>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.004+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ff [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg auth v1203 ap=1 s=10239 n(v0 rc2023-10-05T15:18:08.906140+0000 b10239 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ff:[<0x100000003a8/picture-5.jpg v708>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ff:[<0x100000003a8/picture-5.jpg v1203>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.006+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000424 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-50.jpg auth v1205 ap=1 s=23478 n(v0 rc2023-10-05T15:18:08.429145+0000 b23478 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000424:[<0x100000003a8/picture-50.jpg v250>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000424:[<0x100000003a8/picture-50.jpg v1205>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.007+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-58.jpg auth v1207 ap=1 s=54067 n(v0 rc2023-10-05T15:18:08.392145+0000 b54067 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000040c:[<0x100000003a8/picture-58.jpg v202>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000040c:[<0x100000003a8/picture-58.jpg v1207>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.041 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.009+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-65.jpg auth v1209 ap=1 s=34432 n(v0 rc2023-10-05T15:18:08.361145+0000 b34432 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f7:[<0x100000003a8/picture-65.jpg v160>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f7:[<0x100000003a8/picture-65.jpg v1209>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.013+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-77.jpg auth v1211 ap=1 s=57553 n(v0 rc2023-10-05T15:18:08.307146+0000 b57553 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d3:[<0x100000003a8/picture-77.jpg v88>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d3:[<0x100000003a8/picture-77.jpg v1211>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.014+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003eb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-69.jpg auth v1213 ap=1 s=35415 n(v0 rc2023-10-05T15:18:08.343146+0000 b35415 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003eb:[<0x100000003a8/picture-69.jpg v136>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003eb:[<0x100000003a8/picture-69.jpg v1213>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.016+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000421 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-51.jpg auth v1215 ap=1 s=32739 n(v0 rc2023-10-05T15:18:08.424145+0000 b32739 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c62000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000421:[<0x100000003a8/picture-51.jpg v244>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000421:[<0x100000003a8/picture-51.jpg v1215>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.017+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000400 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-62.jpg auth v1217 ap=1 s=25155 n(v0 rc2023-10-05T15:18:08.375145+0000 b25155 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c62b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000400:[<0x100000003a8/picture-62.jpg v178>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000400:[<0x100000003a8/picture-62.jpg v1217>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.019+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000430 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg auth v1219 ap=1 s=22020 n(v0 rc2023-10-05T15:18:08.447145+0000 b22020 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c63600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000430:[<0x100000003a8/picture-46.jpg v274>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000430:[<0x100000003a8/picture-46.jpg v1219>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.020+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg auth v1206 ap=1 s=47215 n(v0 rc2023-10-05T15:18:08.937140+0000 b47215 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430caec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000050b:[<0x100000003a8/picture-3.jpg v732>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000050b:[<0x100000003a8/picture-3.jpg v1206>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.023+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000415 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-55.jpg auth v1208 ap=1 s=39022 n(v0 rc2023-10-05T15:18:08.406145+0000 b39022 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cbe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000415:[<0x100000003a8/picture-55.jpg v220>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000415:[<0x100000003a8/picture-55.jpg v1208>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.024+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg auth v1210 ap=1 s=43263 n(v0 rc2023-10-05T15:18:08.804141+0000 b43263 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d8:[<0x100000003a8/picture-11.jpg v630>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d8:[<0x100000003a8/picture-11.jpg v1210>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.025+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-70.jpg auth v1212 ap=1 s=29662 n(v0 rc2023-10-05T15:18:08.338146+0000 b29662 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cbf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e8:[<0x100000003a8/picture-70.jpg v130>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e8:[<0x100000003a8/picture-70.jpg v1212>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.042 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.028+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-71.jpg auth v1214 ap=1 s=36098 n(v0 rc2023-10-05T15:18:08.334146+0000 b36098 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cc0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e5:[<0x100000003a8/picture-71.jpg v124>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e5:[<0x100000003a8/picture-71.jpg v1214>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.043 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.029+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-63.jpg auth v1216 ap=1 s=28157 n(v0 rc2023-10-05T15:18:08.370145+0000 b28157 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cc0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003fd:[<0x100000003a8/picture-63.jpg v172>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003fd:[<0x100000003a8/picture-63.jpg v1216>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.277 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.030+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000442 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg auth v1218 ap=1 s=21573 n(v0 rc2023-10-05T15:18:08.475144+0000 b21573 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cc1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000442:[<0x100000003a8/picture-40.jpg v310>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000442:[<0x100000003a8/picture-40.jpg v1218>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.277 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.034+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-87.jpg auth v1220 ap=1 s=49922 n(v0 rc2023-10-05T15:18:08.261146+0000 b49922 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cd2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b5:[<0x100000003a8/picture-87.jpg v28>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b5:[<0x100000003a8/picture-87.jpg v1220>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.277 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.034+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003be [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-84.jpg auth v1222 ap=1 s=16417 n(v0 rc2023-10-05T15:18:08.275146+0000 b16417 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cd3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003be:[<0x100000003a8/picture-84.jpg v46>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003be:[<0x100000003a8/picture-84.jpg v1222>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.277 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.036+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000487 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-23.jpg auth v1195 ap=1 s=35705 n(v0 rc2023-10-05T15:18:08.604143+0000 b35705 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cd4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000487:[<0x100000003a8/picture-23.jpg v468>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000487:[<0x100000003a8/picture-23.jpg v1195>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.277 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.037+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-79.jpg auth v1197 ap=1 s=57113 n(v0 rc2023-10-05T15:18:08.298146+0000 b57113 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cd4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cd:[<0x100000003a8/picture-79.jpg v76>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003cd:[<0x100000003a8/picture-79.jpg v1197>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.277 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.038+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000433 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-45.jpg auth v1199 ap=1 s=53321 n(v0 rc2023-10-05T15:18:08.452145+0000 b53321 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cd4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000433:[<0x100000003a8/picture-45.jpg v280>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000433:[<0x100000003a8/picture-45.jpg v1199>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.039+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-41.jpg auth v1201 ap=1 s=39516 n(v0 rc2023-10-05T15:18:08.471144+0000 b39516 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cd5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000043f:[<0x100000003a8/picture-41.jpg v304>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000043f:[<0x100000003a8/picture-41.jpg v1201>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.040+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000406 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-60.jpg auth v1203 ap=1 s=42165 n(v0 rc2023-10-05T15:18:08.383145+0000 b42165 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000406:[<0x100000003a8/picture-60.jpg v190>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000406:[<0x100000003a8/picture-60.jpg v1203>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.040+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-66.jpg auth v1205 ap=1 s=34485 n(v0 rc2023-10-05T15:18:08.356145+0000 b34485 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f4:[<0x100000003a8/picture-66.jpg v154>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f4:[<0x100000003a8/picture-66.jpg v1205>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.041+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ca [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-80.jpg auth v1207 ap=1 s=24418 n(v0 rc2023-10-05T15:18:08.293146+0000 b24418 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ca:[<0x100000003a8/picture-80.jpg v70>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ca:[<0x100000003a8/picture-80.jpg v1207>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.042+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000490 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-22.jpg auth v1209 ap=1 s=55007 n(v0 rc2023-10-05T15:18:08.623143+0000 b55007 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000490:[<0x100000003a8/picture-22.jpg v484>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000490:[<0x100000003a8/picture-22.jpg v1209>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.044+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-15.jpg auth v1211 ap=1 s=32736 n(v0 rc2023-10-05T15:18:08.737142+0000 b32736 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004bd:[<0x100000003a8/picture-15.jpg v576>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004bd:[<0x100000003a8/picture-15.jpg v1211>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.045+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000412 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-56.jpg auth v1213 ap=1 s=27421 n(v0 rc2023-10-05T15:18:08.401145+0000 b27421 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000412:[<0x100000003a8/picture-56.jpg v214>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000412:[<0x100000003a8/picture-56.jpg v1213>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.278 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.045+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-47.jpg auth v1215 ap=1 s=12232 n(v0 rc2023-10-05T15:18:08.443145+0000 b12232 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000042d:[<0x100000003a8/picture-47.jpg v268>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000042d:[<0x100000003a8/picture-47.jpg v1215>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.279 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.046+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-12.jpg auth v1217 ap=1 s=40449 n(v0 rc2023-10-05T15:18:08.781142+0000 b40449 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004cf:[<0x100000003a8/picture-12.jpg v612>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004cf:[<0x100000003a8/picture-12.jpg v1217>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.279 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.047+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000436 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-44.jpg auth v1219 ap=1 s=42261 n(v0 rc2023-10-05T15:18:08.457144+0000 b42261 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ce7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000436:[<0x100000003a8/picture-44.jpg v286>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000436:[<0x100000003a8/picture-44.jpg v1219>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.279 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.049+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-72.jpg auth v1221 ap=1 s=22107 n(v0 rc2023-10-05T15:18:08.329146+0000 b22107 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cf2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e2:[<0x100000003a8/picture-72.jpg v118>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e2:[<0x100000003a8/picture-72.jpg v1221>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.279 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.050+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000409 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-59.jpg auth v1223 ap=1 s=14599 n(v0 rc2023-10-05T15:18:08.388145+0000 b14599 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cf3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000409:[<0x100000003a8/picture-59.jpg v196>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000409:[<0x100000003a8/picture-59.jpg v1223>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.051+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003df [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-73.jpg auth v1210 ap=1 s=19100 n(v0 rc2023-10-05T15:18:08.325146+0000 b19100 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bf1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003df:[<0x100000003a8/picture-73.jpg v112>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003df:[<0x100000003a8/picture-73.jpg v1210>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.052+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000493 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-21.jpg auth v1212 ap=1 s=49967 n(v0 rc2023-10-05T15:18:08.633143+0000 b49967 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bf1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000493:[<0x100000003a8/picture-21.jpg v492>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000493:[<0x100000003a8/picture-21.jpg v1212>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.054+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-75.jpg auth v1214 ap=1 s=20091 n(v0 rc2023-10-05T15:18:08.316146+0000 b20091 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bf2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d9:[<0x100000003a8/picture-75.jpg v100>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d9:[<0x100000003a8/picture-75.jpg v1214>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.056+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000466 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-30.jpg auth v1216 ap=1 s=55269 n(v0 rc2023-10-05T15:18:08.529144+0000 b55269 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c08000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000466:[<0x100000003a8/picture-30.jpg v384>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000466:[<0x100000003a8/picture-30.jpg v1216>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.061+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-36.jpg auth v1218 ap=1 s=17525 n(v0 rc2023-10-05T15:18:08.493144+0000 b17525 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c0a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000044e:[<0x100000003a8/picture-36.jpg v334>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000044e:[<0x100000003a8/picture-36.jpg v1218>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.061+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000439 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-43.jpg auth v1220 ap=1 s=23597 n(v0 rc2023-10-05T15:18:08.461144+0000 b23597 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c0ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000439:[<0x100000003a8/picture-43.jpg v292>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000439:[<0x100000003a8/picture-43.jpg v1220>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.062+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-20.jpg auth v1222 ap=1 s=50583 n(v0 rc2023-10-05T15:18:08.656143+0000 b50583 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c0b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049c:[<0x100000003a8/picture-20.jpg v510>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000049c:[<0x100000003a8/picture-20.jpg v1222>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.066+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000448 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-38.jpg auth v1224 ap=1 s=65193 n(v0 rc2023-10-05T15:18:08.484144+0000 b65193 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430c13b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000448:[<0x100000003a8/picture-38.jpg v322>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000448:[<0x100000003a8/picture-38.jpg v1224>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.284 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.068+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000472 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg auth v1201 ap=1 s=18804 n(v0 rc2023-10-05T15:18:08.549144+0000 b18804 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bcb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000472:[<0x100000003a8/picture-27.jpg v414>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000472:[<0x100000003a8/picture-27.jpg v1201>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.069+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-52.jpg auth v1203 ap=1 s=41720 n(v0 rc2023-10-05T15:18:08.420145+0000 b41720 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bcbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000041e:[<0x100000003a8/picture-52.jpg v238>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000041e:[<0x100000003a8/picture-52.jpg v1203>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.070+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml auth v1205 ap=1 s=14262 n(v0 rc2023-10-05T15:18:08.242146+0000 b14262 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bcc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a9:[<0x100000003a8/article-1.xml v4>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003a9:[<0x100000003a8/article-1.xml v1205>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.071+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000454 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg auth v1207 ap=1 s=19583 n(v0 rc2023-10-05T15:18:08.502144+0000 b19583 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000454:[<0x100000003a8/picture-34.jpg v346>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000454:[<0x100000003a8/picture-34.jpg v1207>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.072+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-53.jpg auth v1209 ap=1 s=17122 n(v0 rc2023-10-05T15:18:08.415145+0000 b17122 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bcd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000041b:[<0x100000003a8/picture-53.jpg v232>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000041b:[<0x100000003a8/picture-53.jpg v1209>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.073+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-67.jpg auth v1211 ap=1 s=42532 n(v0 rc2023-10-05T15:18:08.352145+0000 b42532 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bcd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f1:[<0x100000003a8/picture-67.jpg v148>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f1:[<0x100000003a8/picture-67.jpg v1211>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.073+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ad [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-90.jpg auth v1213 ap=1 s=61639 n(v0 rc2023-10-05T15:18:08.247146+0000 b61639 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ad:[<0x100000003a8/picture-90.jpg v10>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ad:[<0x100000003a8/picture-90.jpg v1213>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.075+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ba [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg auth v1215 ap=1 s=18275 n(v0 rc2023-10-05T15:18:08.727142+0000 b18275 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bdb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ba:[<0x100000003a8/picture-16.jpg v568>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ba:[<0x100000003a8/picture-16.jpg v1215>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.077+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-74.jpg auth v1217 ap=1 s=41997 n(v0 rc2023-10-05T15:18:08.320146+0000 b41997 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bdbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003dc:[<0x100000003a8/picture-74.jpg v106>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003dc:[<0x100000003a8/picture-74.jpg v1217>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.080+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-76.jpg auth v1219 ap=1 s=34634 n(v0 rc2023-10-05T15:18:08.311146+0000 b34634 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bdd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d6:[<0x100000003a8/picture-76.jpg v94>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d6:[<0x100000003a8/picture-76.jpg v1219>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.285 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.080+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg auth v1221 ap=1 s=9316 n(v0 rc2023-10-05T15:18:08.512144+0000 b9316 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bf0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000045a:[<0x100000003a8/picture-32.jpg v360>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000045a:[<0x100000003a8/picture-32.jpg v1221>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.082+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg auth v1223 ap=1 s=26536 n(v0 rc2023-10-05T15:18:08.438145+0000 b26536 1=1+0) (iversion lock) caps={15483=pAsLsXsFsc/-@2},l=15483(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430bf0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000042a:[<0x100000003a8/picture-48.jpg v262>,<0x100000003a7/blog-0 v7498>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000042a:[<0x100000003a8/picture-48.jpg v1223>,<0x100000003a7/blog-0 v13701>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.084+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-59.xml auth v928 ap=1 s=18883 n(v0 rc2023-10-05T15:18:10.822123+0000 b18883 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431315600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a8:[<0x1000000077f/article-59.xml v70>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a8:[<0x1000000077f/article-59.xml v928>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.088+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-51.xml auth{0=1} v962 ap=1 s=24481 n(v0 rc2023-10-05T15:18:10.900122+0000 b24481 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431317180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c4:[<0x1000000077f/article-51.xml v118>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007c4:[<0x1000000077f/article-51.xml v962>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.093+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000782 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-70.xml auth{0=1} v966 ap=1 s=12523 n(v0 rc2023-10-05T15:18:10.726124+0000 b12523 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431381b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000782:[<0x1000000077f/article-70.xml v4>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000782:[<0x1000000077f/article-70.xml v966>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.095+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-61.xml auth{0=1} v950 ap=1 s=9067 n(v0 rc2023-10-05T15:18:10.806123+0000 b9067 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431382c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a2:[<0x1000000077f/article-61.xml v58>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a2:[<0x1000000077f/article-61.xml v950>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.096+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007eb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-41.xml auth v930 ap=1 s=31110 n(v0 rc2023-10-05T15:18:11.010121+0000 b31110 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431383180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007eb:[<0x1000000077f/article-41.xml v178>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007eb:[<0x1000000077f/article-41.xml v930>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.097+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007da [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-45.xml auth v940 ap=1 s=4218 n(v0 rc2023-10-05T15:18:10.966121+0000 b4218 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431383700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007da:[<0x1000000077f/article-45.xml v154>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007da:[<0x1000000077f/article-45.xml v940>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.098+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000787 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-69.xml auth v938 ap=1 s=6781 n(v0 rc2023-10-05T15:18:10.736123+0000 b6781 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143135c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000787:[<0x1000000077f/article-69.xml v10>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000787:[<0x1000000077f/article-69.xml v938>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.104+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007de [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-44.xml auth{0=1} v961 ap=1 s=20978 n(v0 rc2023-10-05T15:18:10.977121+0000 b20978 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56143135f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007de:[<0x1000000077f/article-44.xml v160>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007de:[<0x1000000077f/article-44.xml v961>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.286 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.107+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000794 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-65.xml auth v929 ap=1 s=6044 n(v0 rc2023-10-05T15:18:10.769123+0000 b6044 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431362580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000794:[<0x1000000077f/article-65.xml v34>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000794:[<0x1000000077f/article-65.xml v929>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.108+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-62.xml auth{0=1} v963 ap=1 s=2000 n(v0 rc2023-10-05T15:18:10.796123+0000 b2000 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431362b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000079f:[<0x1000000077f/article-62.xml v52>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000079f:[<0x1000000077f/article-62.xml v963>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.116+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-55.xml auth v920 ap=1 s=6460 n(v0 rc2023-10-05T15:18:10.865122+0000 b6460 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143136a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b7:[<0x1000000077f/article-55.xml v94>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007b7:[<0x1000000077f/article-55.xml v920>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.118+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-68.xml auth v926 ap=1 s=7131 n(v0 rc2023-10-05T15:18:10.747123+0000 b7131 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143136b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000078b:[<0x1000000077f/article-68.xml v16>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000078b:[<0x1000000077f/article-68.xml v926>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.121+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000815 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-32.xml auth{0=1} v952 ap=1 s=13082 n(v0 rc2023-10-05T15:18:11.122120+0000 b13082 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614313a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000815:[<0x1000000077f/article-32.xml v232>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000815:[<0x1000000077f/article-32.xml v952>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.123+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-50.xml auth{0=1} v940 ap=1 s=11107 n(v0 rc2023-10-05T15:18:10.912122+0000 b11107 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614313a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c8:[<0x1000000077f/article-50.xml v124>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007c8:[<0x1000000077f/article-50.xml v940>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.125+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-56.xml auth v918 ap=1 s=10054 n(v0 rc2023-10-05T15:18:10.853122+0000 b10054 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143137a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b3:[<0x1000000077f/article-56.xml v88>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007b3:[<0x1000000077f/article-56.xml v918>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.126+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-43.xml auth v925 ap=1 s=15532 n(v0 rc2023-10-05T15:18:10.987121+0000 b15532 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143137b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007e2:[<0x1000000077f/article-43.xml v166>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007e2:[<0x1000000077f/article-43.xml v925>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.126+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000810 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-33.xml auth{0=1} v931 ap=1 s=15103 n(v0 rc2023-10-05T15:18:11.107120+0000 b15103 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56143137b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000810:[<0x1000000077f/article-33.xml v226>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000810:[<0x1000000077f/article-33.xml v931>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.129+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-57.xml auth v921 ap=1 s=13426 n(v0 rc2023-10-05T15:18:10.840123+0000 b13426 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143137d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b0:[<0x1000000077f/article-57.xml v82>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007b0:[<0x1000000077f/article-57.xml v921>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.287 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.130+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ab [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-58.xml auth v927 ap=1 s=12372 n(v0 rc2023-10-05T15:18:10.830123+0000 b12372 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614313ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ab:[<0x1000000077f/article-58.xml v76>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ab:[<0x1000000077f/article-58.xml v927>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.131+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-53.xml auth{0=1} v949 ap=1 s=7626 n(v0 rc2023-10-05T15:18:10.881122+0000 b7626 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614313ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007bd:[<0x1000000077f/article-53.xml v106>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007bd:[<0x1000000077f/article-53.xml v949>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.132+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-52.xml auth v923 ap=1 s=20101 n(v0 rc2023-10-05T15:18:10.889122+0000 b20101 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614313ed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c0:[<0x1000000077f/article-52.xml v112>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007c0:[<0x1000000077f/article-52.xml v923>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.139+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-34.xml auth{0=1} v942 ap=1 s=20615 n(v0 rc2023-10-05T15:18:11.098120+0000 b20615 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614313bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000080c:[<0x1000000077f/article-34.xml v220>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000080c:[<0x1000000077f/article-34.xml v942>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.141+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-60.xml auth v926 ap=1 s=14824 n(v0 rc2023-10-05T15:18:10.814123+0000 b14824 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614313bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a5:[<0x1000000077f/article-60.xml v64>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a5:[<0x1000000077f/article-60.xml v926>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.145+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-49.xml auth v932 ap=1 s=10342 n(v0 rc2023-10-05T15:18:10.925122+0000 b10342 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614313fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007cc:[<0x1000000077f/article-49.xml v130>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007cc:[<0x1000000077f/article-49.xml v932>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.150+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-46.xml auth{0=1} v944 ap=1 s=26915 n(v0 rc2023-10-05T15:18:10.955121+0000 b26915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431400680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007d6:[<0x1000000077f/article-46.xml v148>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007d6:[<0x1000000077f/article-46.xml v944>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.152+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-47.xml auth{0=1} v964 ap=1 s=21335 n(v0 rc2023-10-05T15:18:10.944122+0000 b21335 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431401700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007d2:[<0x1000000077f/article-47.xml v142>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007d2:[<0x1000000077f/article-47.xml v964>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.155+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ba [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-54.xml auth{0=1} v966 ap=1 s=8697 n(v0 rc2023-10-05T15:18:10.873122+0000 b8697 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561430805080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ba:[<0x1000000077f/article-54.xml v100>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ba:[<0x1000000077f/article-54.xml v966>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.161+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-48.xml auth v928 ap=1 s=14352 n(v0 rc2023-10-05T15:18:10.935122+0000 b14352 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431240000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007cf:[<0x1000000077f/article-48.xml v136>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007cf:[<0x1000000077f/article-48.xml v928>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.288 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.165+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-38.xml auth{0=1} v960 ap=1 s=23649 n(v0 rc2023-10-05T15:18:11.048121+0000 b23649 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431241b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f9:[<0x1000000077f/article-38.xml v196>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007f9:[<0x1000000077f/article-38.xml v960>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.167+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000807 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-35.xml auth{0=1} v940 ap=1 s=6948 n(v0 rc2023-10-05T15:18:11.089120+0000 b6948 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431242c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000807:[<0x1000000077f/article-35.xml v214>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000807:[<0x1000000077f/article-35.xml v940>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.170+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ef [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-40.xml auth{0=1} v930 ap=1 s=28999 n(v0 rc2023-10-05T15:18:11.023121+0000 b28999 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431243700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ef:[<0x1000000077f/article-40.xml v184>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ef:[<0x1000000077f/article-40.xml v930>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.175+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-42.xml auth v924 ap=1 s=31535 n(v0 rc2023-10-05T15:18:10.998121+0000 b31535 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431228100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007e6:[<0x1000000077f/article-42.xml v172>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007e6:[<0x1000000077f/article-42.xml v924>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.176+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000797 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-64.xml auth{0=1} v958 ap=1 s=31365 n(v0 rc2023-10-05T15:18:10.777123+0000 b31365 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561431228c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000797:[<0x1000000077f/article-64.xml v40>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000797:[<0x1000000077f/article-64.xml v958>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.177+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-37.xml auth v926 ap=1 s=14211 n(v0 rc2023-10-05T15:18:11.066120+0000 b14211 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561431229180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007fd:[<0x1000000077f/article-37.xml v202>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007fd:[<0x1000000077f/article-37.xml v926>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.178+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-39.xml auth{0=1} v940 ap=1 s=14639 n(v0 rc2023-10-05T15:18:11.035121+0000 b14639 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614311e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f5:[<0x1000000077f/article-39.xml v190>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007f5:[<0x1000000077f/article-39.xml v940>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.179+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000803 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-36.xml auth{0=1} v946 ap=1 s=29842 n(v0 rc2023-10-05T15:18:11.072120+0000 b29842 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614311e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000803:[<0x1000000077f/article-36.xml v208>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000803:[<0x1000000077f/article-36.xml v946>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.183+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000791 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-66.xml auth v922 ap=1 s=25708 n(v0 rc2023-10-05T15:18:10.762123+0000 b25708 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614311eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000791:[<0x1000000077f/article-66.xml v28>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000791:[<0x1000000077f/article-66.xml v922>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.188+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-63.xml auth v930 ap=1 s=3776 n(v0 rc2023-10-05T15:18:10.787123+0000 b3776 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143113d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000079b:[<0x1000000077f/article-63.xml v46>,<0x100000003a7/blog-7 v7492>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000079b:[<0x1000000077f/article-63.xml v930>,<0x100000003a7/blog-7 v13703>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.189+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg auth v701 ap=1 s=15010 n(v0 rc2023-10-05T15:18:09.412136+0000 b15010 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143014d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e2:[<0x10000000559/picture-13.jpg v292>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e2:[<0x10000000559/picture-13.jpg v701>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.289 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.190+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg auth v703 ap=1 s=38532 n(v0 rc2023-10-05T15:18:09.380136+0000 b38532 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143014d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d7:[<0x10000000559/picture-18.jpg v262>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d7:[<0x10000000559/picture-18.jpg v703>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.191+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg auth v707 ap=1 s=64044 n(v0 rc2023-10-05T15:18:09.374136+0000 b64044 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d4:[<0x10000000559/picture-19.jpg v256>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d4:[<0x10000000559/picture-19.jpg v707>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.192+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg auth v711 ap=1 s=37952 n(v0 rc2023-10-05T15:18:09.453135+0000 b37952 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f4:[<0x10000000559/picture-4.jpg v346>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005f4:[<0x10000000559/picture-4.jpg v711>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.193+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ad [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-35.jpg auth v713 ap=1 s=9676 n(v0 rc2023-10-05T15:18:09.270137+0000 b9676 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ad:[<0x10000000559/picture-35.jpg v160>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ad:[<0x10000000559/picture-35.jpg v713>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.194+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg auth v715 ap=1 s=10710 n(v0 rc2023-10-05T15:18:09.462135+0000 b10710 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f7:[<0x10000000559/picture-2.jpg v358>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005f7:[<0x10000000559/picture-2.jpg v715>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.194+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg auth v717 ap=1 s=33670 n(v0 rc2023-10-05T15:18:09.407136+0000 b33670 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e0:[<0x10000000559/picture-14.jpg v286>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e0:[<0x10000000559/picture-14.jpg v717>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.195+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ee [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg auth v719 ap=1 s=34847 n(v0 rc2023-10-05T15:18:09.440135+0000 b34847 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ee:[<0x10000000559/picture-7.jpg v328>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ee:[<0x10000000559/picture-7.jpg v719>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.196+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-9.jpg auth v721 ap=1 s=22704 n(v0 rc2023-10-05T15:18:09.430136+0000 b22704 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e9:[<0x10000000559/picture-9.jpg v316>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e9:[<0x10000000559/picture-9.jpg v721>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.197+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000811 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml auth v727 ap=1 s=2685 n(v0 rc2023-10-05T15:18:11.111120+0000 b2685 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@6},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000811:[<0x10000000559/comment-37.xml v436>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000811:[<0x10000000559/comment-37.xml v727>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.290 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.198+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg auth v729 ap=1 s=23206 n(v0 rc2023-10-05T15:18:09.426136+0000 b23206 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301ac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e8:[<0x10000000559/picture-10.jpg v310>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e8:[<0x10000000559/picture-10.jpg v729>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.199+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg auth{0=1} v927 ap=1 s=60166 n(v0 rc2023-10-05T15:18:09.465135+0000 b60166 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/pFscr@9} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5614301acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f8:[<0x10000000559/picture-1.jpg v364>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005f8:[<0x10000000559/picture-1.jpg v927>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.200+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml auth v735 ap=1 s=27594 n(v0 rc2023-10-05T15:18:09.146138+0000 b27594 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301ad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000057a:[<0x10000000559/article-9.xml v52>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000057a:[<0x10000000559/article-9.xml v735>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.201+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ef [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg auth v737 ap=1 s=39444 n(v0 rc2023-10-05T15:18:09.445135+0000 b39444 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301adb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ef:[<0x10000000559/picture-6.jpg v334>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ef:[<0x10000000559/picture-6.jpg v737>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.203+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005be [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-28.jpg auth v743 ap=1 s=39415 n(v0 rc2023-10-05T15:18:09.316137+0000 b39415 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301aec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005be:[<0x10000000559/picture-28.jpg v202>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005be:[<0x10000000559/picture-28.jpg v743>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.204+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fe [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml auth v745 ap=1 s=4156 n(v0 rc2023-10-05T15:18:11.066120+0000 b4156 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301af180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007fe:[<0x10000000559/comment-41.xml v412>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007fe:[<0x10000000559/comment-41.xml v745>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.205+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-37.jpg auth v747 ap=1 s=24774 n(v0 rc2023-10-05T15:18:09.256137+0000 b24774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301af700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a9:[<0x10000000559/picture-37.jpg v148>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a9:[<0x10000000559/picture-37.jpg v747>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.205+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg auth v749 ap=1 s=43518 n(v0 rc2023-10-05T15:18:09.387136+0000 b43518 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d9:[<0x10000000559/picture-17.jpg v268>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d9:[<0x10000000559/picture-17.jpg v749>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.208+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg auth v755 ap=1 s=62329 n(v0 rc2023-10-05T15:18:09.341136+0000 b62329 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c8:[<0x10000000559/picture-24.jpg v226>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005c8:[<0x10000000559/picture-24.jpg v755>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.208+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-33.jpg auth v757 ap=1 s=57989 n(v0 rc2023-10-05T15:18:09.283137+0000 b57989 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b2:[<0x10000000559/picture-33.jpg v172>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005b2:[<0x10000000559/picture-33.jpg v757>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.291 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.209+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000581 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml auth v759 ap=1 s=28168 n(v0 rc2023-10-05T15:18:09.159138+0000 b28168 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000581:[<0x10000000559/article-7.xml v64>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000581:[<0x10000000559/article-7.xml v759>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.210+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-42.jpg auth v761 ap=1 s=47812 n(v0 rc2023-10-05T15:18:09.223137+0000 b47812 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000059c:[<0x10000000559/picture-42.jpg v118>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000059c:[<0x10000000559/picture-42.jpg v761>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.210+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-39.jpg auth v763 ap=1 s=46395 n(v0 rc2023-10-05T15:18:09.241137+0000 b46395 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a4:[<0x10000000559/picture-39.jpg v136>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a4:[<0x10000000559/picture-39.jpg v763>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.213+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg auth v771 ap=1 s=35978 n(v0 rc2023-10-05T15:18:09.335136+0000 b35978 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301f8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c6:[<0x10000000559/picture-25.jpg v220>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005c6:[<0x10000000559/picture-25.jpg v771>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.215+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml auth v775 ap=1 s=9404 n(v0 rc2023-10-05T15:18:11.002121+0000 b9404 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007e7:[<0x10000000559/comment-46.xml v382>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007e7:[<0x10000000559/comment-46.xml v775>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.215+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-31.jpg auth v777 ap=1 s=40024 n(v0 rc2023-10-05T15:18:09.296137+0000 b40024 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b7:[<0x10000000559/picture-31.jpg v184>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005b7:[<0x10000000559/picture-31.jpg v777>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.216+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ec [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg auth v779 ap=1 s=31575 n(v0 rc2023-10-05T15:18:09.435135+0000 b31575 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ec:[<0x10000000559/picture-8.jpg v322>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ec:[<0x10000000559/picture-8.jpg v779>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.217+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg auth v781 ap=1 s=63133 n(v0 rc2023-10-05T15:18:09.329136+0000 b63133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c3:[<0x10000000559/picture-26.jpg v214>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005c3:[<0x10000000559/picture-26.jpg v781>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.218+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000056a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml auth v785 ap=1 s=9501 n(v0 rc2023-10-05T15:18:09.123138+0000 b9501 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301fac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000056a:[<0x10000000559/article-13.xml v28>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000056a:[<0x10000000559/article-13.xml v785>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.220+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000584 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml auth v789 ap=1 s=22421 n(v0 rc2023-10-05T15:18:09.164138+0000 b22421 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5614301fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000584:[<0x10000000559/article-6.xml v70>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000584:[<0x10000000559/article-6.xml v789>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.221+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000590 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml auth v791 ap=1 s=26593 n(v0 rc2023-10-05T15:18:09.193138+0000 b26593 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143020c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000590:[<0x10000000559/article-2.xml v94>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000590:[<0x10000000559/article-2.xml v791>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.292 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.222+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005bc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-29.jpg auth v795 ap=1 s=35261 n(v0 rc2023-10-05T15:18:09.310137+0000 b35261 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143020cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005bc:[<0x10000000559/picture-29.jpg v196>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005bc:[<0x10000000559/picture-29.jpg v795>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.226+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml auth v803 ap=1 s=3253 n(v0 rc2023-10-05T15:18:11.027121+0000 b3253 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143020e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f1:[<0x10000000559/comment-44.xml v394>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007f1:[<0x10000000559/comment-44.xml v803>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.227+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg auth v805 ap=1 s=52103 n(v0 rc2023-10-05T15:18:09.449135+0000 b52103 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143020e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f2:[<0x10000000559/picture-5.jpg v340>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005f2:[<0x10000000559/picture-5.jpg v805>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.230+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml auth v815 ap=1 s=3228 n(v0 rc2023-10-05T15:18:11.040121+0000 b3228 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430224580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f6:[<0x10000000559/comment-43.xml v400>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007f6:[<0x10000000559/comment-43.xml v815>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.233+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ec [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml auth v821 ap=1 s=8432 n(v0 rc2023-10-05T15:18:11.015121+0000 b8432 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430225600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ec:[<0x10000000559/comment-45.xml v388>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ec:[<0x10000000559/comment-45.xml v821>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.234+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg auth v825 ap=1 s=60100 n(v0 rc2023-10-05T15:18:09.458135+0000 b60100 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430226100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f5:[<0x10000000559/picture-3.jpg v352>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005f5:[<0x10000000559/picture-3.jpg v825>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.236+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg auth v829 ap=1 s=14517 n(v0 rc2023-10-05T15:18:09.421136+0000 b14517 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430226c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e6:[<0x10000000559/picture-11.jpg v304>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e6:[<0x10000000559/picture-11.jpg v829>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.237+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000587 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml auth v831 ap=1 s=5432 n(v0 rc2023-10-05T15:18:09.171138+0000 b5432 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430227180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000587:[<0x10000000559/article-5.xml v76>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000587:[<0x10000000559/article-5.xml v831>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.239+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-40.jpg auth v837 ap=1 s=38165 n(v0 rc2023-10-05T15:18:09.236137+0000 b38165 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430238580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a1:[<0x10000000559/picture-40.jpg v130>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a1:[<0x10000000559/picture-40.jpg v837>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.239+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml auth v839 ap=1 s=8778 n(v0 rc2023-10-05T15:18:11.100120+0000 b8778 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430238b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000080d:[<0x10000000559/comment-38.xml v430>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000080d:[<0x10000000559/comment-38.xml v839>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.293 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.241+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ca [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-23.jpg auth v843 ap=1 s=65033 n(v0 rc2023-10-05T15:18:09.348136+0000 b65033 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430239600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ca:[<0x10000000559/picture-23.jpg v232>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ca:[<0x10000000559/picture-23.jpg v843>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.241+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000566 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-14.xml auth v845 ap=1 s=30818 n(v0 rc2023-10-05T15:18:09.117138+0000 b30818 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430239b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000566:[<0x10000000559/article-14.xml v22>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000566:[<0x10000000559/article-14.xml v845>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.243+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-41.jpg auth v847 ap=1 s=12492 n(v0 rc2023-10-05T15:18:09.231137+0000 b12492 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143023a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000059f:[<0x10000000559/picture-41.jpg v124>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000059f:[<0x10000000559/picture-41.jpg v847>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.244+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000572 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-11.xml auth v851 ap=1 s=29043 n(v0 rc2023-10-05T15:18:09.134138+0000 b29043 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143023ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000572:[<0x10000000559/article-11.xml v40>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000572:[<0x10000000559/article-11.xml v851>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.245+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-16.xml auth v853 ap=1 s=4011 n(v0 rc2023-10-05T15:18:09.106139+0000 b4011 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143023b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000055e:[<0x10000000559/article-16.xml v10>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000055e:[<0x10000000559/article-16.xml v853>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.246+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005de [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-15.jpg auth v855 ap=1 s=8260 n(v0 rc2023-10-05T15:18:09.402136+0000 b8260 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143023b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005de:[<0x10000000559/picture-15.jpg v280>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005de:[<0x10000000559/picture-15.jpg v855>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.246+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000576 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-10.xml auth v857 ap=1 s=11025 n(v0 rc2023-10-05T15:18:09.140138+0000 b11025 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430258000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000576:[<0x10000000559/article-10.xml v46>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000576:[<0x10000000559/article-10.xml v857>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.247+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-12.jpg auth v859 ap=1 s=34605 n(v0 rc2023-10-05T15:18:09.416136+0000 b34605 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430258580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e4:[<0x10000000559/picture-12.jpg v298>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e4:[<0x10000000559/picture-12.jpg v859>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.294 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.248+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000596 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-44.jpg auth v861 ap=1 s=9388 n(v0 rc2023-10-05T15:18:09.208138+0000 b9388 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430258b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000596:[<0x10000000559/picture-44.jpg v106>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000596:[<0x10000000559/picture-44.jpg v861>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.248+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-4.xml auth v863 ap=1 s=26595 n(v0 rc2023-10-05T15:18:09.178138+0000 b26595 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430259080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000058a:[<0x10000000559/article-4.xml v82>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000058a:[<0x10000000559/article-4.xml v863>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.249+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000704 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-59.jpg auth v867 ap=1 s=63534 n(v0 rc2023-10-05T15:18:10.445126+0000 b63534 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430259b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000704:[<0x10000000559/picture-59.jpg v370>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000704:[<0x10000000559/picture-59.jpg v867>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.251+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005cf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg auth v871 ap=1 s=25075 n(v0 rc2023-10-05T15:18:09.361136+0000 b25075 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143025a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005cf:[<0x10000000559/picture-21.jpg v244>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005cf:[<0x10000000559/picture-21.jpg v871>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.252+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000706 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml auth v875 ap=1 s=10448 n(v0 rc2023-10-05T15:18:10.450126+0000 b10448 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143025b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000706:[<0x10000000559/article-40.xml v376>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000706:[<0x10000000559/article-40.xml v875>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.252+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ba [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-30.jpg auth v877 ap=1 s=24078 n(v0 rc2023-10-05T15:18:09.302137+0000 b24078 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143025b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ba:[<0x10000000559/picture-30.jpg v190>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ba:[<0x10000000559/picture-30.jpg v877>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.253+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000562 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml auth v879 ap=1 s=5602 n(v0 rc2023-10-05T15:18:09.111138+0000 b5602 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430262000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000562:[<0x10000000559/article-15.xml v16>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000562:[<0x10000000559/article-15.xml v879>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.253+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000804 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml auth v881 ap=1 s=6671 n(v0 rc2023-10-05T15:18:11.075120+0000 b6671 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430262580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000804:[<0x10000000559/comment-40.xml v418>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000804:[<0x10000000559/comment-40.xml v881>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.255+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000808 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml auth v885 ap=1 s=2588 n(v0 rc2023-10-05T15:18:11.089120+0000 b2588 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430263080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000808:[<0x10000000559/comment-39.xml v424>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000808:[<0x10000000559/comment-39.xml v885>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.255+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ab [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-36.jpg auth v887 ap=1 s=12381 n(v0 rc2023-10-05T15:18:09.264137+0000 b12381 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430263600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ab:[<0x10000000559/picture-36.jpg v154>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ab:[<0x10000000559/picture-36.jpg v887>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.295 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.256+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000599 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-43.jpg auth v889 ap=1 s=15007 n(v0 rc2023-10-05T15:18:09.216138+0000 b15007 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430263b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000599:[<0x10000000559/picture-43.jpg v112>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000599:[<0x10000000559/picture-43.jpg v889>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.257+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg auth v891 ap=1 s=12788 n(v0 rc2023-10-05T15:18:09.367136+0000 b12788 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d2:[<0x10000000559/picture-20.jpg v250>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d2:[<0x10000000559/picture-20.jpg v891>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.258+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-38.jpg auth v895 ap=1 s=41179 n(v0 rc2023-10-05T15:18:09.249137+0000 b41179 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430264c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a7:[<0x10000000559/picture-38.jpg v142>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a7:[<0x10000000559/picture-38.jpg v895>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.260+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg auth v903 ap=1 s=14440 n(v0 rc2023-10-05T15:18:09.322137+0000 b14440 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430270580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c1:[<0x10000000559/picture-27.jpg v208>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005c1:[<0x10000000559/picture-27.jpg v903>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.261+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000593 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml auth v907 ap=1 s=30763 n(v0 rc2023-10-05T15:18:09.201138+0000 b30763 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430271080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000593:[<0x10000000559/article-1.xml v100>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000593:[<0x10000000559/article-1.xml v907>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.262+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-34.jpg auth v911 ap=1 s=15320 n(v0 rc2023-10-05T15:18:09.276137+0000 b15320 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430271b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b0:[<0x10000000559/picture-34.jpg v166>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005b0:[<0x10000000559/picture-34.jpg v911>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.264+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005da [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg auth v917 ap=1 s=41572 n(v0 rc2023-10-05T15:18:09.395136+0000 b41572 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430272c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005da:[<0x10000000559/picture-16.jpg v274>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005da:[<0x10000000559/picture-16.jpg v917>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.264+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml auth v921 ap=1 s=8249 n(v0 rc2023-10-05T15:18:11.051121+0000 b8249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561430273700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007fa:[<0x10000000559/comment-42.xml v406>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007fa:[<0x10000000559/comment-42.xml v921>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.265+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-17.xml auth v923 ap=1 s=1380 n(v0 rc2023-10-05T15:18:09.100139+0000 b1380 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143028a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000055a:[<0x10000000559/article-17.xml v4>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000055a:[<0x10000000559/article-17.xml v923>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.265+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-32.jpg auth v925 ap=1 s=59447 n(v0 rc2023-10-05T15:18:09.290137+0000 b59447 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x56143028a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b4:[<0x10000000559/picture-32.jpg v178>,<0x100000003a7/blog-4 v7502>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005b4:[<0x10000000559/picture-32.jpg v925>,<0x100000003a7/blog-4 v13694>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.296 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.266+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000402 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-59.xml auth v1089 ap=1 s=18033 n(v0 rc2023-10-05T15:18:08.380145+0000 b18033 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a9f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000402:[<0x100000003aa/article-59.xml v174>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000402:[<0x100000003aa/article-59.xml v1089>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.266+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000592 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-13.jpg auth v1091 ap=1 s=11420 n(v0 rc2023-10-05T15:18:09.195138+0000 b11420 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a9fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000592:[<0x100000003aa/picture-13.jpg v887>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000592:[<0x100000003aa/picture-13.jpg v1091>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.267+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000583 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg auth v1095 ap=1 s=46217 n(v0 rc2023-10-05T15:18:09.160138+0000 b46217 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aa0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000583:[<0x100000003aa/picture-18.jpg v857>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000583:[<0x100000003aa/picture-18.jpg v1095>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.268+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml auth v1097 ap=1 s=25978 n(v0 rc2023-10-05T15:18:08.713142+0000 b25978 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aa0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b5:[<0x100000003aa/article-18.xml v497>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b5:[<0x100000003aa/article-18.xml v1097>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.269+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000580 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg auth v1101 ap=1 s=21165 n(v0 rc2023-10-05T15:18:09.155138+0000 b21165 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aa1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000580:[<0x100000003aa/picture-19.jpg v851>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000580:[<0x100000003aa/picture-19.jpg v1101>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.270+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-51.xml auth v1103 ap=1 s=28834 n(v0 rc2023-10-05T15:18:08.447145+0000 b28834 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000042f:[<0x100000003aa/article-51.xml v262>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000042f:[<0x100000003aa/article-51.xml v1103>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.271+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml auth v1107 ap=1 s=23353 n(v0 rc2023-10-05T15:18:08.646143+0000 b23353 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049a:[<0x100000003aa/article-27.xml v443>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000049a:[<0x100000003aa/article-27.xml v1107>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.271+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000742 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-4.jpg auth v1109 ap=1 s=32810 n(v0 rc2023-10-05T15:18:10.573125+0000 b32810 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000742:[<0x100000003aa/picture-4.jpg v930>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000742:[<0x100000003aa/picture-4.jpg v1109>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.272+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000540 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-35.jpg auth v1111 ap=1 s=33777 n(v0 rc2023-10-05T15:18:09.060139+0000 b33777 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000540:[<0x100000003aa/picture-35.jpg v755>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000540:[<0x100000003aa/picture-35.jpg v1111>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.272+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-2.jpg auth v1113 ap=1 s=36914 n(v0 rc2023-10-05T15:18:10.673124+0000 b36914 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000076a:[<0x100000003aa/picture-2.jpg v938>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000076a:[<0x100000003aa/picture-2.jpg v1113>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.273+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-70.xml auth v1115 ap=1 s=12214 n(v0 rc2023-10-05T15:18:08.280146+0000 b12214 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c0:[<0x100000003aa/article-70.xml v42>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c0:[<0x100000003aa/article-70.xml v1115>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.273+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004af [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml auth v1117 ap=1 s=9203 n(v0 rc2023-10-05T15:18:08.698142+0000 b9203 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004af:[<0x100000003aa/article-20.xml v485>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004af:[<0x100000003aa/article-20.xml v1117>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.274+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg auth v1119 ap=1 s=52271 n(v0 rc2023-10-05T15:18:09.188138+0000 b52271 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000058f:[<0x100000003aa/picture-14.jpg v881>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000058f:[<0x100000003aa/picture-14.jpg v1119>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.274+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-61.xml auth v1121 ap=1 s=7319 n(v0 rc2023-10-05T15:18:08.362145+0000 b7319 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f6:[<0x100000003aa/article-61.xml v150>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f6:[<0x100000003aa/article-61.xml v1121>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.275+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml auth v1123 ap=1 s=15847 n(v0 rc2023-10-05T15:18:08.518144+0000 b15847 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ab5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000045f:[<0x100000003aa/article-41.xml v358>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000045f:[<0x100000003aa/article-41.xml v1123>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.276+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-45.xml auth v1125 ap=1 s=24970 n(v0 rc2023-10-05T15:18:08.494144+0000 b24970 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000044d:[<0x100000003aa/article-45.xml v324>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000044d:[<0x100000003aa/article-45.xml v1125>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.276+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-69.xml auth v1127 ap=1 s=8759 n(v0 rc2023-10-05T15:18:08.294146+0000 b8759 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c9:[<0x100000003aa/article-69.xml v60>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c9:[<0x100000003aa/article-69.xml v1127>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.277+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-7.jpg auth v1129 ap=1 s=13922 n(v0 rc2023-10-05T15:18:10.448126+0000 b13922 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006fc:[<0x100000003aa/picture-7.jpg v918>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006fc:[<0x100000003aa/picture-7.jpg v1129>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.278+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml auth v1131 ap=1 s=6285 n(v0 rc2023-10-05T15:18:08.616143+0000 b6285 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048e:[<0x100000003aa/article-31.xml v419>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000048e:[<0x100000003aa/article-31.xml v1131>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.298 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.279+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-9.jpg auth v1133 ap=1 s=57484 n(v0 rc2023-10-05T15:18:09.225137+0000 b57484 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000059e:[<0x100000003aa/picture-9.jpg v911>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000059e:[<0x100000003aa/picture-9.jpg v1133>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: pgmap v50: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 561 op/s 2023-10-05T15:18:21.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: mgrmap e26: x(active, since 90s), standbys: z, y 2023-10-05T15:18:21.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:21.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000205 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000380 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000207 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000206 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000203 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000039b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000387 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000020b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000399 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000395 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000039d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000215 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/globals.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000219 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000209 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000211 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000216 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000039f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000020f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000020c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.301 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000217 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.581 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.283+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-10.jpg auth v1105 ap=1 s=44510 n(v0 rc2023-10-05T15:18:09.218137+0000 b44510 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a6f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000059b:[<0x100000003aa/picture-10.jpg v905>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000059b:[<0x100000003aa/picture-10.jpg v1105>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.581 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.284+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000776 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-1.jpg auth{0=1} v1210 ap=1 s=47058 n(v0 rc2023-10-05T15:18:10.711124+0000 b47058 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/pFscr@13} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x561430a82000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000776:[<0x100000003aa/picture-1.jpg v941>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000776:[<0x100000003aa/picture-1.jpg v1210>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.285+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml auth v1111 ap=1 s=26026 n(v0 rc2023-10-05T15:18:08.779142+0000 b26026 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a82b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d0:[<0x100000003aa/article-9.xml v551>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d0:[<0x100000003aa/article-9.xml v1111>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.286+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000453 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml auth v1113 ap=1 s=5870 n(v0 rc2023-10-05T15:18:08.503144+0000 b5870 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a83080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000453:[<0x100000003aa/article-44.xml v336>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000453:[<0x100000003aa/article-44.xml v1113>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.287+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000714 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-6.jpg auth v1115 ap=1 s=39646 n(v0 rc2023-10-05T15:18:10.500126+0000 b39646 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a83600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000714:[<0x100000003aa/picture-6.jpg v921>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000714:[<0x100000003aa/picture-6.jpg v1115>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.288+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-65.xml auth v1117 ap=1 s=18157 n(v0 rc2023-10-05T15:18:08.330146+0000 b18157 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a83b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e1:[<0x100000003aa/article-65.xml v108>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e1:[<0x100000003aa/article-65.xml v1117>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.290+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-62.xml auth v1121 ap=1 s=26700 n(v0 rc2023-10-05T15:18:08.351145+0000 b26700 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a84680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f0:[<0x100000003aa/article-62.xml v136>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f0:[<0x100000003aa/article-62.xml v1121>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.291+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml auth v1125 ap=1 s=22208 n(v0 rc2023-10-05T15:18:08.668143+0000 b22208 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a85180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a3:[<0x100000003aa/article-24.xml v461>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a3:[<0x100000003aa/article-24.xml v1125>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.294+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-28.jpg auth v1131 ap=1 s=56629 n(v0 rc2023-10-05T15:18:09.102139+0000 b56629 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000055d:[<0x100000003aa/picture-28.jpg v797>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000055d:[<0x100000003aa/picture-28.jpg v1131>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.296+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-67.xml auth v1135 ap=1 s=25203 n(v0 rc2023-10-05T15:18:08.312146+0000 b25203 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a91080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d5:[<0x100000003aa/article-67.xml v84>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d5:[<0x100000003aa/article-67.xml v1135>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.582 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.296+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000538 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-37.jpg auth v1137 ap=1 s=63764 n(v0 rc2023-10-05T15:18:09.048139+0000 b63764 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a91600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000538:[<0x100000003aa/picture-37.jpg v743>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000538:[<0x100000003aa/picture-37.jpg v1137>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.297+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000586 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg auth v1139 ap=1 s=65204 n(v0 rc2023-10-05T15:18:09.166138+0000 b65204 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a91b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000586:[<0x100000003aa/picture-17.jpg v863>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000586:[<0x100000003aa/picture-17.jpg v1139>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.298+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml auth v1141 ap=1 s=17049 n(v0 rc2023-10-05T15:18:08.825141+0000 b17049 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e2:[<0x100000003aa/article-3.xml v587>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e2:[<0x100000003aa/article-3.xml v1141>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: pgmap v50: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 561 op/s 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: mgrmap e26: x(active, since 90s), standbys: z, y 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000205 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000380 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000207 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000206 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000203 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000039b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000387 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000020b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000399 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000395 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000039d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000215 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/globals.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000219 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000209 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000211 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.585 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.298+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000056d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg auth v1143 ap=1 s=21890 n(v0 rc2023-10-05T15:18:09.124138+0000 b21890 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000056d:[<0x100000003aa/picture-24.jpg v821>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000056d:[<0x100000003aa/picture-24.jpg v1143>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.585 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.299+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000548 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-33.jpg auth v1145 ap=1 s=10319 n(v0 rc2023-10-05T15:18:09.072139+0000 b10319 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000548:[<0x100000003aa/picture-33.jpg v767>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000548:[<0x100000003aa/picture-33.jpg v1145>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.585 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.300+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-57.jpg auth v1147 ap=1 s=53704 n(v0 rc2023-10-05T15:18:08.872141+0000 b53704 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f4:[<0x100000003aa/picture-57.jpg v623>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f4:[<0x100000003aa/picture-57.jpg v1147>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.301+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml auth v1149 ap=1 s=2127 n(v0 rc2023-10-05T15:18:08.795141+0000 b2127 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d6:[<0x100000003aa/article-7.xml v563>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d6:[<0x100000003aa/article-7.xml v1149>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.301+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000524 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-42.jpg auth v1151 ap=1 s=51134 n(v0 rc2023-10-05T15:18:08.996140+0000 b51134 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a9e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000524:[<0x100000003aa/picture-42.jpg v713>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000524:[<0x100000003aa/picture-42.jpg v1151>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.302+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000530 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-39.jpg auth v1153 ap=1 s=57074 n(v0 rc2023-10-05T15:18:09.027139+0000 b57074 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a9e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000530:[<0x100000003aa/picture-39.jpg v731>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000530:[<0x100000003aa/picture-39.jpg v1153>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.303+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000414 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml auth v1078 ap=1 s=13103 n(v0 rc2023-10-05T15:18:08.407145+0000 b13103 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000414:[<0x100000003aa/article-55.xml v210>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000414:[<0x100000003aa/article-55.xml v1078>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.304+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000569 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg auth v1080 ap=1 s=61855 n(v0 rc2023-10-05T15:18:09.119138+0000 b61855 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000569:[<0x100000003aa/picture-25.jpg v815>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000569:[<0x100000003aa/picture-25.jpg v1080>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.305+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml auth v1082 ap=1 s=18294 n(v0 rc2023-10-05T15:18:08.787141+0000 b18294 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d3:[<0x100000003aa/article-8.xml v557>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d3:[<0x100000003aa/article-8.xml v1082>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000216 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000039f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000020f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000020c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000217 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000393 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000037f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000213 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000020d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000218 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.306+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000550 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg auth v1088 ap=1 s=14281 n(v0 rc2023-10-05T15:18:09.084139+0000 b14281 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430af0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000550:[<0x100000003aa/picture-31.jpg v779>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000550:[<0x100000003aa/picture-31.jpg v1088>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.307+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml auth v1090 ap=1 s=26654 n(v0 rc2023-10-05T15:18:08.303146+0000 b26654 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430af1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cf:[<0x100000003aa/article-68.xml v72>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003cf:[<0x100000003aa/article-68.xml v1090>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.308+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg auth v1094 ap=1 s=38135 n(v0 rc2023-10-05T15:18:08.935140+0000 b38135 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b00000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000050c:[<0x100000003aa/picture-49.jpg v671>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000050c:[<0x100000003aa/picture-49.jpg v1094>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.308+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ea [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg auth v1096 ap=1 s=45695 n(v0 rc2023-10-05T15:18:10.384127+0000 b45695 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b00580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ea:[<0x100000003aa/picture-8.jpg v914>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ea:[<0x100000003aa/picture-8.jpg v1096>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.309+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000565 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg auth v1098 ap=1 s=43405 n(v0 rc2023-10-05T15:18:09.113138+0000 b43405 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b00b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000565:[<0x100000003aa/picture-26.jpg v809>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000565:[<0x100000003aa/picture-26.jpg v1098>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.310+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml auth v1100 ap=1 s=22967 n(v0 rc2023-10-05T15:18:08.609143+0000 b22967 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b01080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048b:[<0x100000003aa/article-32.xml v413>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000048b:[<0x100000003aa/article-32.xml v1100>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.311+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ac [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml auth v1104 ap=1 s=27773 n(v0 rc2023-10-05T15:18:08.691142+0000 b27773 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b01b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ac:[<0x100000003aa/article-21.xml v479>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ac:[<0x100000003aa/article-21.xml v1104>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.589 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.312+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000491 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml auth v1106 ap=1 s=31630 n(v0 rc2023-10-05T15:18:08.624143+0000 b31630 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b02100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000491:[<0x100000003aa/article-30.xml v425>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000491:[<0x100000003aa/article-30.xml v1106>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.313+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml auth v1112 ap=1 s=18148 n(v0 rc2023-10-05T15:18:08.750142+0000 b18148 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b03180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c4:[<0x100000003aa/article-13.xml v527>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c4:[<0x100000003aa/article-13.xml v1112>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.316+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000435 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml auth v1120 ap=1 s=30452 n(v0 rc2023-10-05T15:18:08.456145+0000 b30452 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b12b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000435:[<0x100000003aa/article-50.xml v274>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000435:[<0x100000003aa/article-50.xml v1120>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.317+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml auth v1122 ap=1 s=24333 n(v0 rc2023-10-05T15:18:08.802141+0000 b24333 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d9:[<0x100000003aa/article-6.xml v569>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d9:[<0x100000003aa/article-6.xml v1122>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.318+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml auth v1124 ap=1 s=13812 n(v0 rc2023-10-05T15:18:08.833141+0000 b13812 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b13600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e5:[<0x100000003aa/article-2.xml v593>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e5:[<0x100000003aa/article-2.xml v1124>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000214 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000397 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000020e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000398 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000396 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/writer.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000039c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000039a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/reader.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000392 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000394 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/process.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000039e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000077f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000559 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.592 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.321+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg auth v1130 ap=1 s=19661 n(v0 rc2023-10-05T15:18:08.896140+0000 b19661 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b14680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004fd:[<0x100000003aa/picture-54.jpg v641>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004fd:[<0x100000003aa/picture-54.jpg v1130>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.322+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000558 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg auth v1132 ap=1 s=26155 n(v0 rc2023-10-05T15:18:09.096139+0000 b26155 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b14c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000558:[<0x100000003aa/picture-29.jpg v791>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000558:[<0x100000003aa/picture-29.jpg v1132>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.323+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000411 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml auth v1136 ap=1 s=32315 n(v0 rc2023-10-05T15:18:08.401145+0000 b32315 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b15700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000411:[<0x100000003aa/article-56.xml v202>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000411:[<0x100000003aa/article-56.xml v1136>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.324+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-2.xml auth v1093 ap=1 s=5133 n(v0 rc2023-10-05T15:18:10.947122+0000 b5133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b28580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c5:[<0x100000003aa/comment-2.xml v950>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007c5:[<0x100000003aa/comment-2.xml v1093>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.325+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000459 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml auth v1097 ap=1 s=11367 n(v0 rc2023-10-05T15:18:08.510144+0000 b11367 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b29080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000459:[<0x100000003aa/article-43.xml v346>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000459:[<0x100000003aa/article-43.xml v1097>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.326+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000488 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml auth v1099 ap=1 s=14814 n(v0 rc2023-10-05T15:18:08.602143+0000 b14814 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b29600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000488:[<0x100000003aa/article-33.xml v407>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000488:[<0x100000003aa/article-33.xml v1099>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.326+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-5.jpg auth v1101 ap=1 s=57975 n(v0 rc2023-10-05T15:18:10.536125+0000 b57975 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b29b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000072d:[<0x100000003aa/picture-5.jpg v925>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000072d:[<0x100000003aa/picture-5.jpg v1101>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.328+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-58.jpg auth v1107 ap=1 s=54744 n(v0 rc2023-10-05T15:18:08.864141+0000 b54744 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b2ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f1:[<0x100000003aa/picture-58.jpg v617>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f1:[<0x100000003aa/picture-58.jpg v1107>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.593 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.329+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-57.xml auth v1109 ap=1 s=17929 n(v0 rc2023-10-05T15:18:08.394145+0000 b17929 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b2b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000040b:[<0x100000003aa/article-57.xml v192>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000040b:[<0x100000003aa/article-57.xml v1109>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000775 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000051d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-82.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000505 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000451 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000511 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-78.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-89.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000403 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-61.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.596 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.332+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000408 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-58.xml auth v1119 ap=1 s=21898 n(v0 rc2023-10-05T15:18:08.387145+0000 b21898 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b35080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000408:[<0x100000003aa/article-58.xml v184>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000408:[<0x100000003aa/article-58.xml v1119>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.596 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.333+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000423 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-53.xml auth v1121 ap=1 s=18503 n(v0 rc2023-10-05T15:18:08.430145+0000 b18503 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b35600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000423:[<0x100000003aa/article-53.xml v240>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000423:[<0x100000003aa/article-53.xml v1121>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.596 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.335+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000497 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml auth v1127 ap=1 s=20055 n(v0 rc2023-10-05T15:18:08.638143+0000 b20055 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b36680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000497:[<0x100000003aa/article-28.xml v437>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000497:[<0x100000003aa/article-28.xml v1127>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.596 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.336+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000429 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-52.xml auth v1131 ap=1 s=3096 n(v0 rc2023-10-05T15:18:08.439145+0000 b3096 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b37180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000429:[<0x100000003aa/article-52.xml v252>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000429:[<0x100000003aa/article-52.xml v1131>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.337+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000506 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-51.jpg auth v1133 ap=1 s=50654 n(v0 rc2023-10-05T15:18:08.919140+0000 b50654 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000506:[<0x100000003aa/picture-51.jpg v659>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000506:[<0x100000003aa/picture-51.jpg v1133>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.338+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000515 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-46.jpg auth v1137 ap=1 s=27768 n(v0 rc2023-10-05T15:18:08.959140+0000 b27768 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b40580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000515:[<0x100000003aa/picture-46.jpg v689>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000515:[<0x100000003aa/picture-46.jpg v1137>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.340+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000758 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-3.jpg auth v1086 ap=1 s=29275 n(v0 rc2023-10-05T15:18:10.609125+0000 b29275 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000758:[<0x100000003aa/picture-3.jpg v931>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000758:[<0x100000003aa/picture-3.jpg v1086>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-64.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000517 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-83.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000470 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000044b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-85.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000047e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000457 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000040f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000043c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-68.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000445 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000047a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000460 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.602 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.342+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-55.jpg auth v1092 ap=1 s=31107 n(v0 rc2023-10-05T15:18:08.888141+0000 b31107 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004fa:[<0x100000003aa/picture-55.jpg v635>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004fa:[<0x100000003aa/picture-55.jpg v1092>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.602 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.342+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000598 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg auth v1094 ap=1 s=31337 n(v0 rc2023-10-05T15:18:09.210138+0000 b31337 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000598:[<0x100000003aa/picture-11.jpg v899>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000598:[<0x100000003aa/picture-11.jpg v1094>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.602 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.343+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml auth v1096 ap=1 s=7645 n(v0 rc2023-10-05T15:18:08.810141+0000 b7645 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b42c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004dc:[<0x100000003aa/article-5.xml v575>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004dc:[<0x100000003aa/article-5.xml v1096>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.344+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000485 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml auth v1098 ap=1 s=21393 n(v0 rc2023-10-05T15:18:08.594143+0000 b21393 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000485:[<0x100000003aa/article-34.xml v401>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000485:[<0x100000003aa/article-34.xml v1098>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.346+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000494 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml auth v1106 ap=1 s=13265 n(v0 rc2023-10-05T15:18:08.631143+0000 b13265 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b58b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000494:[<0x100000003aa/article-29.xml v431>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000494:[<0x100000003aa/article-29.xml v1106>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.347+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-60.xml auth v1108 ap=1 s=13792 n(v0 rc2023-10-05T15:18:08.371145+0000 b13792 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b59080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003fc:[<0x100000003aa/article-60.xml v162>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003fc:[<0x100000003aa/article-60.xml v1108>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.348+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-40.jpg auth v1110 ap=1 s=64163 n(v0 rc2023-10-05T15:18:09.017139+0000 b64163 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b59600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000052c:[<0x100000003aa/picture-40.jpg v725>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000052c:[<0x100000003aa/picture-40.jpg v1110>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.349+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml auth v1114 ap=1 s=11085 n(v0 rc2023-10-05T15:18:08.684142+0000 b11085 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a9:[<0x100000003aa/article-22.xml v473>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a9:[<0x100000003aa/article-22.xml v1114>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.351+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000438 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-49.xml auth v1120 ap=1 s=25238 n(v0 rc2023-10-05T15:18:08.462144+0000 b25238 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430b5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000438:[<0x100000003aa/article-49.xml v282>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000438:[<0x100000003aa/article-49.xml v1120>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.352+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000571 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-23.jpg auth v1074 ap=1 s=37210 n(v0 rc2023-10-05T15:18:09.130138+0000 b37210 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000571:[<0x100000003aa/picture-23.jpg v827>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000571:[<0x100000003aa/picture-23.jpg v1074>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.353+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-14.xml auth v1076 ap=1 s=12189 n(v0 rc2023-10-05T15:18:08.742142+0000 b12189 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c1:[<0x100000003aa/article-14.xml v521>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c1:[<0x100000003aa/article-14.xml v1076>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.603 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.354+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-45.jpg auth v1078 ap=1 s=22750 n(v0 rc2023-10-05T15:18:08.966140+0000 b22750 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000518:[<0x100000003aa/picture-45.jpg v695>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000518:[<0x100000003aa/picture-45.jpg v1078>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.355+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000528 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-41.jpg auth v1080 ap=1 s=52277 n(v0 rc2023-10-05T15:18:09.006139+0000 b52277 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ac3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000528:[<0x100000003aa/picture-41.jpg v719>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000528:[<0x100000003aa/picture-41.jpg v1080>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.356+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004eb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-60.jpg auth v1084 ap=1 s=30770 n(v0 rc2023-10-05T15:18:08.848141+0000 b30770 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004eb:[<0x100000003aa/picture-60.jpg v605>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004eb:[<0x100000003aa/picture-60.jpg v1084>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.357+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000447 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-46.xml auth v1086 ap=1 s=5093 n(v0 rc2023-10-05T15:18:08.485144+0000 b5093 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000447:[<0x100000003aa/article-46.xml v312>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000447:[<0x100000003aa/article-46.xml v1086>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.358+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000441 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-47.xml auth v1088 ap=1 s=20589 n(v0 rc2023-10-05T15:18:08.476144+0000 b20589 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000441:[<0x100000003aa/article-47.xml v300>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000441:[<0x100000003aa/article-47.xml v1088>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.359+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-71.xml auth v1090 ap=1 s=27193 n(v0 rc2023-10-05T15:18:08.267146+0000 b27193 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b7:[<0x100000003aa/article-71.xml v24>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b7:[<0x100000003aa/article-71.xml v1090>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.360+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000575 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-22.jpg auth v1092 ap=1 s=54896 n(v0 rc2023-10-05T15:18:09.136138+0000 b54896 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000575:[<0x100000003aa/picture-22.jpg v833>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000575:[<0x100000003aa/picture-22.jpg v1092>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.360+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ca [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-11.xml auth v1094 ap=1 s=5376 n(v0 rc2023-10-05T15:18:08.764142+0000 b5376 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ca:[<0x100000003aa/article-11.xml v539>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ca:[<0x100000003aa/article-11.xml v1094>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.362+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-16.xml auth v1098 ap=1 s=14237 n(v0 rc2023-10-05T15:18:08.727142+0000 b14237 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004bb:[<0x100000003aa/article-16.xml v509>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004bb:[<0x100000003aa/article-16.xml v1098>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.363+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-54.xml auth v1100 ap=1 s=23937 n(v0 rc2023-10-05T15:18:08.416145+0000 b23937 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000041a:[<0x100000003aa/article-54.xml v222>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000041a:[<0x100000003aa/article-54.xml v1100>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.604 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.364+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-26.xml auth v1102 ap=1 s=12462 n(v0 rc2023-10-05T15:18:08.653143+0000 b12462 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ad7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049d:[<0x100000003aa/article-26.xml v449>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000049d:[<0x100000003aa/article-26.xml v1102>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.364+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-15.jpg auth v1104 ap=1 s=33107 n(v0 rc2023-10-05T15:18:09.181138+0000 b33107 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000058c:[<0x100000003aa/picture-15.jpg v875>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000058c:[<0x100000003aa/picture-15.jpg v1104>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.365+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-56.jpg auth v1106 ap=1 s=43967 n(v0 rc2023-10-05T15:18:08.880141+0000 b43967 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f7:[<0x100000003aa/picture-56.jpg v629>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f7:[<0x100000003aa/picture-56.jpg v1106>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.366+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000512 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-47.jpg auth v1108 ap=1 s=10114 n(v0 rc2023-10-05T15:18:08.951140+0000 b10114 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000512:[<0x100000003aa/picture-47.jpg v683>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000512:[<0x100000003aa/picture-47.jpg v1108>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.367+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-10.xml auth v1110 ap=1 s=1220 n(v0 rc2023-10-05T15:18:08.772142+0000 b1220 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004cd:[<0x100000003aa/article-10.xml v545>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004cd:[<0x100000003aa/article-10.xml v1110>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.367+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000595 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-12.jpg auth v1112 ap=1 s=15277 n(v0 rc2023-10-05T15:18:09.202138+0000 b15277 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000595:[<0x100000003aa/picture-12.jpg v893>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000595:[<0x100000003aa/picture-12.jpg v1112>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.368+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-44.jpg auth v1114 ap=1 s=56511 n(v0 rc2023-10-05T15:18:08.974140+0000 b56511 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000051b:[<0x100000003aa/picture-44.jpg v701>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000051b:[<0x100000003aa/picture-44.jpg v1114>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.371+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-48.xml auth v1118 ap=1 s=6603 n(v0 rc2023-10-05T15:18:08.470144+0000 b6603 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000043e:[<0x100000003aa/article-48.xml v292>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000043e:[<0x100000003aa/article-48.xml v1118>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.372+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004df [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-4.xml auth v1122 ap=1 s=7018 n(v0 rc2023-10-05T15:18:08.817141+0000 b7018 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004df:[<0x100000003aa/article-4.xml v581>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004df:[<0x100000003aa/article-4.xml v1122>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.373+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-25.xml auth v1124 ap=1 s=4163 n(v0 rc2023-10-05T15:18:08.661143+0000 b4163 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430ae5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a0:[<0x100000003aa/article-25.xml v455>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a0:[<0x100000003aa/article-25.xml v1124>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.605 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.373+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ee [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-59.jpg auth v1126 ap=1 s=39960 n(v0 rc2023-10-05T15:18:08.856141+0000 b39960 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ee:[<0x100000003aa/picture-59.jpg v611>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ee:[<0x100000003aa/picture-59.jpg v1126>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.374+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000469 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-38.xml auth v1128 ap=1 s=31607 n(v0 rc2023-10-05T15:18:08.530144+0000 b31607 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430aee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000469:[<0x100000003aa/article-38.xml v376>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000469:[<0x100000003aa/article-38.xml v1128>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.376+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ac [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-72.xml auth v1053 ap=1 s=5429 n(v0 rc2023-10-05T15:18:08.256146+0000 b5429 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ac:[<0x100000003aa/article-72.xml v8>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ac:[<0x100000003aa/article-72.xml v1053>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.377+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000579 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-21.jpg auth v1055 ap=1 s=23670 n(v0 rc2023-10-05T15:18:09.142138+0000 b23670 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a5a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000579:[<0x100000003aa/picture-21.jpg v839>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000579:[<0x100000003aa/picture-21.jpg v1055>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.378+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000482 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-35.xml auth v1057 ap=1 s=30812 n(v0 rc2023-10-05T15:18:08.587143+0000 b30812 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a5a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000482:[<0x100000003aa/article-35.xml v395>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000482:[<0x100000003aa/article-35.xml v1057>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.379+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-1.xml auth{0=1} v1119 ap=1 s=5868 n(v0 rc2023-10-05T15:18:10.990121+0000 b5868 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/pFscr@11} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x561430a5b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007dc:[<0x100000003aa/comment-1.xml v960>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007dc:[<0x100000003aa/comment-1.xml v1119>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.380+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000463 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-40.xml auth v1063 ap=1 s=31888 n(v0 rc2023-10-05T15:18:08.522144+0000 b31888 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a5b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000463:[<0x100000003aa/article-40.xml v364>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000463:[<0x100000003aa/article-40.xml v1063>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.381+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000554 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-30.jpg auth v1065 ap=1 s=62864 n(v0 rc2023-10-05T15:18:09.090139+0000 b62864 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a5bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000554:[<0x100000003aa/picture-30.jpg v785>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000554:[<0x100000003aa/picture-30.jpg v1065>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.606 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.381+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004be [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-15.xml auth v1067 ap=1 s=29895 n(v0 rc2023-10-05T15:18:08.735142+0000 b29895 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a5c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004be:[<0x100000003aa/article-15.xml v515>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004be:[<0x100000003aa/article-15.xml v1067>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.384+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-36.jpg auth v1075 ap=1 s=33578 n(v0 rc2023-10-05T15:18:09.054139+0000 b33578 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a5d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000053c:[<0x100000003aa/picture-36.jpg v749>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000053c:[<0x100000003aa/picture-36.jpg v1075>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.385+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000520 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-43.jpg auth v1077 ap=1 s=30507 n(v0 rc2023-10-05T15:18:08.985140+0000 b30507 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a6c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000520:[<0x100000003aa/picture-43.jpg v707>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000520:[<0x100000003aa/picture-43.jpg v1077>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.386+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-19.xml auth v1079 ap=1 s=8994 n(v0 rc2023-10-05T15:18:08.705142+0000 b8994 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a6c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b2:[<0x100000003aa/article-19.xml v491>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b2:[<0x100000003aa/article-19.xml v1079>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.387+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-20.jpg auth v1081 ap=1 s=29557 n(v0 rc2023-10-05T15:18:09.148138+0000 b29557 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000057d:[<0x100000003aa/picture-20.jpg v845>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000057d:[<0x100000003aa/picture-20.jpg v1081>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.389+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-42.xml auth v1089 ap=1 s=28769 n(v0 rc2023-10-05T15:18:08.514144+0000 b28769 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000045d:[<0x100000003aa/article-42.xml v352>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000045d:[<0x100000003aa/article-42.xml v1089>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.390+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000534 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-38.jpg auth v1091 ap=1 s=11695 n(v0 rc2023-10-05T15:18:09.037139+0000 b11695 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000534:[<0x100000003aa/picture-38.jpg v737>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000534:[<0x100000003aa/picture-38.jpg v1091>,<0x100000003a7/blog-1 v13699>,<0x10000000208/blogtest_in v337>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.418+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-64.xml auth v1095 ap=1 s=19893 n(v0 rc2023-10-05T15:18:08.338146+0000 b19893 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a26b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e7:[<0x100000003aa/article-64.xml v118>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e7:[<0x100000003aa/article-64.xml v1095>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.421+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml auth v1105 ap=1 s=24289 n(v0 rc2023-10-05T15:18:08.535144+0000 b24289 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a28680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046b:[<0x100000003aa/article-37.xml v382>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000046b:[<0x100000003aa/article-37.xml v1105>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.607 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.422+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000561 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg auth v1107 ap=1 s=65336 n(v0 rc2023-10-05T15:18:09.108138+0000 b65336 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a28c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000561:[<0x100000003aa/picture-27.jpg v803>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000561:[<0x100000003aa/picture-27.jpg v1107>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.422+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000465 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml auth v1109 ap=1 s=4866 n(v0 rc2023-10-05T15:18:08.526144+0000 b4866 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a29180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000465:[<0x100000003aa/article-39.xml v370>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000465:[<0x100000003aa/article-39.xml v1109>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.423+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml auth v1111 ap=1 s=14176 n(v0 rc2023-10-05T15:18:08.579143+0000 b14176 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a29700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047f:[<0x100000003aa/article-36.xml v388>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000047f:[<0x100000003aa/article-36.xml v1111>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.423+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml auth v1113 ap=1 s=15467 n(v0 rc2023-10-05T15:18:08.757142+0000 b15467 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a36000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c7:[<0x100000003aa/article-12.xml v533>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c7:[<0x100000003aa/article-12.xml v1113>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.424+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000503 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-52.jpg auth v1115 ap=1 s=24922 n(v0 rc2023-10-05T15:18:08.912140+0000 b24922 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a36580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000503:[<0x100000003aa/picture-52.jpg v653>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000503:[<0x100000003aa/picture-52.jpg v1115>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.424+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml auth v1117 ap=1 s=11356 n(v0 rc2023-10-05T15:18:08.841141+0000 b11356 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a36b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e8:[<0x100000003aa/article-1.xml v599>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e8:[<0x100000003aa/article-1.xml v1117>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.425+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000544 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-34.jpg auth v1121 ap=1 s=32350 n(v0 rc2023-10-05T15:18:09.066139+0000 b32350 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a37600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000544:[<0x100000003aa/picture-34.jpg v761>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000544:[<0x100000003aa/picture-34.jpg v1121>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.426+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000500 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-53.jpg auth v1123 ap=1 s=52028 n(v0 rc2023-10-05T15:18:08.904140+0000 b52028 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a37b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000500:[<0x100000003aa/picture-53.jpg v647>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000500:[<0x100000003aa/picture-53.jpg v1123>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.427+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003db [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-66.xml auth v1129 ap=1 s=22618 n(v0 rc2023-10-05T15:18:08.321146+0000 b22618 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a38c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003db:[<0x100000003aa/article-66.xml v96>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003db:[<0x100000003aa/article-66.xml v1129>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.428+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000589 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg auth v1131 ap=1 s=19409 n(v0 rc2023-10-05T15:18:09.173138+0000 b19409 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a39180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000589:[<0x100000003aa/picture-16.jpg v869>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000589:[<0x100000003aa/picture-16.jpg v1131>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.436+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml auth v1143 ap=1 s=6983 n(v0 rc2023-10-05T15:18:08.676142+0000 b6983 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a4b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a6:[<0x100000003aa/article-23.xml v467>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a6:[<0x100000003aa/article-23.xml v1143>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.608 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.436+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml auth v1145 ap=1 s=19041 n(v0 rc2023-10-05T15:18:08.720142+0000 b19041 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a4bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b8:[<0x100000003aa/article-17.xml v503>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b8:[<0x100000003aa/article-17.xml v1145>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.609 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.437+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-32.jpg auth v1147 ap=1 s=35079 n(v0 rc2023-10-05T15:18:09.078139+0000 b35079 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a4c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000054c:[<0x100000003aa/picture-32.jpg v773>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000054c:[<0x100000003aa/picture-32.jpg v1147>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.609 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.437+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ea [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-63.xml auth v1149 ap=1 s=2742 n(v0 rc2023-10-05T15:18:08.344146+0000 b2742 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a4c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ea:[<0x100000003aa/article-63.xml v126>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ea:[<0x100000003aa/article-63.xml v1149>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.609 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.438+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-48.jpg auth v1151 ap=1 s=61099 n(v0 rc2023-10-05T15:18:08.943140+0000 b61099 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a4cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000050f:[<0x100000003aa/picture-48.jpg v677>,<0x100000003a7/blog-1 v7496>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000050f:[<0x100000003aa/picture-48.jpg v1151>,<0x100000003a7/blog-1 v13797>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.609 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.508+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000793 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml auth v479 ap=1 s=29125 n(v0 rc2023-10-05T15:18:10.768123+0000 b29125 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@21},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143028ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000793:[<0x10000000775/article-59.xml v52>,<0x100000003a7/blog-6 v7506>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000793:[<0x10000000775/article-59.xml v479>,<0x100000003a7/blog-6 v13695>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.609 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.514+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ae [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml auth v483 ap=1 s=19227 n(v0 rc2023-10-05T15:18:10.838123+0000 b19227 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143028b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ae:[<0x10000000775/article-51.xml v100>,<0x100000003a7/blog-6 v7506>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ae:[<0x10000000775/article-51.xml v483>,<0x100000003a7/blog-6 v13695>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.609 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.515+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml auth v485 ap=1 s=19417 n(v0 rc2023-10-05T15:18:11.107120+0000 b19417 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@26},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143028bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000080f:[<0x10000000775/article-27.xml v244>,<0x100000003a7/blog-6 v7506>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000080f:[<0x10000000775/article-27.xml v485>,<0x100000003a7/blog-6 v13695>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000393 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000037f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000213 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000020d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000218 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000214 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000397 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000020e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000398 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000396 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/writer.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000039c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000039a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/reader.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000392 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000394 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/process.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000039e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000077f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000559 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000775 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000051d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-82.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000505 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000451 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000511 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-78.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-89.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000403 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-61.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-64.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000517 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-83.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000470 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000044b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-85.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000047e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000457 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000040f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000043c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-68.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000445 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000047a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:21 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000460 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: pgmap v50: 129 pgs: 129 active+clean; 42 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 561 op/s 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: mgrmap e26: x(active, since 90s), standbys: z, y 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000205 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000380 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000207 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000206 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000203 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000039b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000387 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000020b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000399 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000395 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000039d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000215 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/globals.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000219 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000209 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000211 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000216 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000039f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000020f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000020c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000217 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000393 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000037f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000213 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000020d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000218 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000214 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.c) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000397 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.o) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000020e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000398 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000396 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/writer.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000039c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000039a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/reader.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000392 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000394 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/process.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000039e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000077f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000559 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000775 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000051d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-82.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000505 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000451 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000511 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-78.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-89.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000403 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-61.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-64.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.682 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000517 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-83.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000470 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000044b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-85.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000047e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000457 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000040f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000043c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-68.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000445 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000047a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:21 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000460 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:21.938 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.668+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000614 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml auth v1002 ap=1 s=23866 n(v0 rc2023-10-05T15:18:09.545134+0000 b23866 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000614:[<0x100000005f9/article-59.xml v160>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000614:[<0x100000005f9/article-59.xml v1002>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.938 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.669+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000744 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg auth v1004 ap=1 s=15247 n(v0 rc2023-10-05T15:18:10.563125+0000 b15247 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000744:[<0x100000005f9/picture-13.jpg v941>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000744:[<0x100000005f9/picture-13.jpg v1004>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.938 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.669+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg auth v1008 ap=1 s=41192 n(v0 rc2023-10-05T15:18:10.523125+0000 b41192 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000072c:[<0x100000005f9/picture-18.jpg v935>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000072c:[<0x100000005f9/picture-18.jpg v1008>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.938 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.670+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000605 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml auth v1010 ap=1 s=30546 n(v0 rc2023-10-05T15:18:09.503135+0000 b30546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000605:[<0x100000005f9/article-74.xml v70>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000605:[<0x100000005f9/article-74.xml v1010>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.671+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml auth v1012 ap=1 s=8766 n(v0 rc2023-10-05T15:18:09.643134+0000 b8766 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063d:[<0x100000005f9/article-18.xml v406>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000063d:[<0x100000005f9/article-18.xml v1012>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.671+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000729 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg auth v1014 ap=1 s=44279 n(v0 rc2023-10-05T15:18:10.514126+0000 b44279 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000729:[<0x100000005f9/picture-19.jpg v927>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000729:[<0x100000005f9/picture-19.jpg v1014>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.671+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml auth v1016 ap=1 s=25090 n(v0 rc2023-10-05T15:18:09.564134+0000 b25090 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061c:[<0x100000005f9/article-51.xml v208>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000061c:[<0x100000005f9/article-51.xml v1016>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.672+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000661 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-82.jpg auth v1018 ap=1 s=8361 n(v0 rc2023-10-05T15:18:09.731133+0000 b8361 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000661:[<0x100000005f9/picture-82.jpg v622>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000661:[<0x100000005f9/picture-82.jpg v1018>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.672+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000634 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml auth v1020 ap=1 s=29546 n(v0 rc2023-10-05T15:18:09.622134+0000 b29546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000634:[<0x100000005f9/article-27.xml v352>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000634:[<0x100000005f9/article-27.xml v1020>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.673+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000769 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg auth v966 ap=1 s=53339 n(v0 rc2023-10-05T15:18:10.662124+0000 b53339 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@15},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000769:[<0x100000005f9/picture-4.jpg v955>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000769:[<0x100000005f9/picture-4.jpg v966>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.674+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000690 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg auth v968 ap=1 s=34776 n(v0 rc2023-10-05T15:18:09.851132+0000 b34776 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000690:[<0x100000005f9/picture-35.jpg v904>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000690:[<0x100000005f9/picture-35.jpg v968>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.939 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.674+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg auth v970 ap=1 s=25374 n(v0 rc2023-10-05T15:18:10.676124+0000 b25374 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@14},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000076f:[<0x100000005f9/picture-2.jpg v959>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000076f:[<0x100000005f9/picture-2.jpg v970>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.675+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000665 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-78.jpg auth v972 ap=1 s=45204 n(v0 rc2023-10-05T15:18:09.741133+0000 b45204 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000665:[<0x100000005f9/picture-78.jpg v646>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000665:[<0x100000005f9/picture-78.jpg v972>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.675+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000609 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml auth v974 ap=1 s=27429 n(v0 rc2023-10-05T15:18:09.515135+0000 b27429 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000609:[<0x100000005f9/article-70.xml v94>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000609:[<0x100000005f9/article-70.xml v974>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.676+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000656 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-93.jpg auth v976 ap=1 s=64617 n(v0 rc2023-10-05T15:18:09.704133+0000 b64617 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000656:[<0x100000005f9/picture-93.jpg v556>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000656:[<0x100000005f9/picture-93.jpg v976>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.676+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml auth v978 ap=1 s=10457 n(v0 rc2023-10-05T15:18:09.639134+0000 b10457 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063b:[<0x100000005f9/article-20.xml v394>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000063b:[<0x100000005f9/article-20.xml v978>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.677+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000740 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg auth v980 ap=1 s=38084 n(v0 rc2023-10-05T15:18:10.555125+0000 b38084 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000740:[<0x100000005f9/picture-14.jpg v937>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000740:[<0x100000005f9/picture-14.jpg v980>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.677+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-89.jpg auth v982 ap=1 s=58936 n(v0 rc2023-10-05T15:18:09.714133+0000 b58936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065a:[<0x100000005f9/picture-89.jpg v580>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000065a:[<0x100000005f9/picture-89.jpg v982>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.678+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005fc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-83.xml auth v984 ap=1 s=8924 n(v0 rc2023-10-05T15:18:09.476135+0000 b8924 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005fc:[<0x100000005f9/article-83.xml v16>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005fc:[<0x100000005f9/article-83.xml v984>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.678+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000612 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml auth v986 ap=1 s=30629 n(v0 rc2023-10-05T15:18:09.540135+0000 b30629 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56142fc7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000612:[<0x100000005f9/article-61.xml v148>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000612:[<0x100000005f9/article-61.xml v986>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.940 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.679+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000622 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml auth v990 ap=1 s=10008 n(v0 rc2023-10-05T15:18:09.579134+0000 b10008 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000622:[<0x100000005f9/article-45.xml v244>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000622:[<0x100000005f9/article-45.xml v990>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.680+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml auth v992 ap=1 s=29782 n(v0 rc2023-10-05T15:18:09.519135+0000 b29782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000060a:[<0x100000005f9/article-69.xml v100>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000060a:[<0x100000005f9/article-69.xml v992>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.680+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000676 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg auth v994 ap=1 s=65040 n(v0 rc2023-10-05T15:18:09.783132+0000 b65040 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000676:[<0x100000005f9/picture-61.jpg v748>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000676:[<0x100000005f9/picture-61.jpg v994>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.680+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000761 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg auth v996 ap=1 s=40942 n(v0 rc2023-10-05T15:18:10.612125+0000 b40942 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000761:[<0x100000005f9/picture-7.jpg v951>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000761:[<0x100000005f9/picture-7.jpg v996>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.681+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000630 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml auth v998 ap=1 s=24500 n(v0 rc2023-10-05T15:18:09.612134+0000 b24500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000630:[<0x100000005f9/article-31.xml v328>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000630:[<0x100000005f9/article-31.xml v998>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.682+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000757 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg auth v1000 ap=1 s=59059 n(v0 rc2023-10-05T15:18:10.595125+0000 b59059 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000757:[<0x100000005f9/picture-9.jpg v945>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000757:[<0x100000005f9/picture-9.jpg v1000>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.683+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ff [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml auth v1002 ap=1 s=27007 n(v0 rc2023-10-05T15:18:09.484135+0000 b27007 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ff:[<0x100000005f9/article-80.xml v34>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ff:[<0x100000005f9/article-80.xml v1002>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.684+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000753 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg auth v1004 ap=1 s=60168 n(v0 rc2023-10-05T15:18:10.586125+0000 b60168 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303a3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000753:[<0x100000005f9/picture-10.jpg v941>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000753:[<0x100000005f9/picture-10.jpg v1004>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.685+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000772 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg auth{0=1} v1006 ap=3 s=53834 n(v0 rc2023-10-05T15:18:10.684124+0000 b53834 1=1+0) (ifile mix->sync g=0) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFr/pAsLsXsFrw/pAsxXsxFsxcrwb@12} mcw={0=AsXsFscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5614303a3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000772:[<0x100000005f9/picture-1.jpg v951>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000772:[<0x100000005f9/picture-1.jpg v1006>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.941 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.685+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000646 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml auth v956 ap=1 s=14233 n(v0 rc2023-10-05T15:18:09.665133+0000 b14233 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143003e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000646:[<0x100000005f9/article-9.xml v460>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000646:[<0x100000005f9/article-9.xml v956>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.686+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000660 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-83.jpg auth v958 ap=1 s=36140 n(v0 rc2023-10-05T15:18:09.729133+0000 b36140 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143003e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000660:[<0x100000005f9/picture-83.jpg v616>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000660:[<0x100000005f9/picture-83.jpg v958>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.686+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000623 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml auth v960 ap=1 s=24249 n(v0 rc2023-10-05T15:18:09.581134+0000 b24249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143003eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000623:[<0x100000005f9/article-44.xml v250>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000623:[<0x100000005f9/article-44.xml v960>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.687+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000763 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg auth v962 ap=1 s=56679 n(v0 rc2023-10-05T15:18:10.622125+0000 b56679 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143003f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000763:[<0x100000005f9/picture-6.jpg v945>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000763:[<0x100000005f9/picture-6.jpg v962>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.687+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml auth v964 ap=1 s=3638 n(v0 rc2023-10-05T15:18:09.531135+0000 b3638 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143003f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000060e:[<0x100000005f9/article-65.xml v124>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000060e:[<0x100000005f9/article-65.xml v964>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.688+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000611 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml auth v966 ap=1 s=6774 n(v0 rc2023-10-05T15:18:09.538135+0000 b6774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143003fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000611:[<0x100000005f9/article-62.xml v142>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000611:[<0x100000005f9/article-62.xml v966>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.689+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000637 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml auth v968 ap=1 s=31219 n(v0 rc2023-10-05T15:18:09.629134+0000 b31219 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430040100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000637:[<0x100000005f9/article-24.xml v370>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000637:[<0x100000005f9/article-24.xml v968>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.942 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.689+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ff [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg auth v970 ap=1 s=13714 n(v0 rc2023-10-05T15:18:10.424126+0000 b13714 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430040680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ff:[<0x100000005f9/picture-28.jpg v920>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ff:[<0x100000005f9/picture-28.jpg v970>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.945 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.690+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005fa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-85.xml auth v972 ap=1 s=25658 n(v0 rc2023-10-05T15:18:09.470135+0000 b25658 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430040c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005fa:[<0x100000005f9/article-85.xml v4>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005fa:[<0x100000005f9/article-85.xml v972>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.945 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.690+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000657 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-92.jpg auth v974 ap=1 s=15752 n(v0 rc2023-10-05T15:18:09.706133+0000 b15752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430041180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000657:[<0x100000005f9/picture-92.jpg v562>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000657:[<0x100000005f9/picture-92.jpg v974>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.945 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.691+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml auth v976 ap=1 s=19194 n(v0 rc2023-10-05T15:18:09.525135+0000 b19194 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430041700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000060c:[<0x100000005f9/article-67.xml v112>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000060c:[<0x100000005f9/article-67.xml v976>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.691+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg auth v978 ap=1 s=50937 n(v0 rc2023-10-05T15:18:09.847132+0000 b50937 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430052000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068e:[<0x100000005f9/picture-37.jpg v892>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000068e:[<0x100000005f9/picture-37.jpg v978>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.692+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000731 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg auth v980 ap=1 s=19558 n(v0 rc2023-10-05T15:18:10.531125+0000 b19558 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430052580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000731:[<0x100000005f9/picture-17.jpg v934>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000731:[<0x100000005f9/picture-17.jpg v980>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.693+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-85.jpg auth v982 ap=1 s=51190 n(v0 rc2023-10-05T15:18:09.723133+0000 b51190 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430052b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065e:[<0x100000005f9/picture-85.jpg v604>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000065e:[<0x100000005f9/picture-85.jpg v982>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.693+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml auth v984 ap=1 s=15327 n(v0 rc2023-10-05T15:18:09.679133+0000 b15327 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@14},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430053080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000064c:[<0x100000005f9/article-3.xml v496>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000064c:[<0x100000005f9/article-3.xml v984>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.694+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000711 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg auth v986 ap=1 s=34135 n(v0 rc2023-10-05T15:18:10.475126+0000 b34135 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430053600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000711:[<0x100000005f9/picture-24.jpg v923>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000711:[<0x100000005f9/picture-24.jpg v986>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.695+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006eb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg auth v988 ap=1 s=42518 n(v0 rc2023-10-05T15:18:10.360127+0000 b42518 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430053b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006eb:[<0x100000005f9/picture-33.jpg v909>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006eb:[<0x100000005f9/picture-33.jpg v988>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.946 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.695+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg auth v990 ap=1 s=43162 n(v0 rc2023-10-05T15:18:09.798132+0000 b43162 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430054100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000067a:[<0x100000005f9/picture-57.jpg v772>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000067a:[<0x100000005f9/picture-57.jpg v990>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.696+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000648 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml auth v992 ap=1 s=23710 n(v0 rc2023-10-05T15:18:09.670133+0000 b23710 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430054680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000648:[<0x100000005f9/article-7.xml v472>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000648:[<0x100000005f9/article-7.xml v992>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.696+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000689 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg auth v994 ap=1 s=55072 n(v0 rc2023-10-05T15:18:09.835132+0000 b55072 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430054c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000689:[<0x100000005f9/picture-42.jpg v862>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000689:[<0x100000005f9/picture-42.jpg v994>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.696+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg auth v996 ap=1 s=27094 n(v0 rc2023-10-05T15:18:09.766132+0000 b27094 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430055180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066f:[<0x100000005f9/picture-68.jpg v706>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000066f:[<0x100000005f9/picture-68.jpg v996>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.698+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg auth v998 ap=1 s=54645 n(v0 rc2023-10-05T15:18:09.842132+0000 b54645 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430055700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068c:[<0x100000005f9/picture-39.jpg v880>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000068c:[<0x100000005f9/picture-39.jpg v998>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.699+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000618 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml auth v950 ap=1 s=2697 n(v0 rc2023-10-05T15:18:09.555134+0000 b2697 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000618:[<0x100000005f9/article-55.xml v184>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000618:[<0x100000005f9/article-55.xml v950>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.700+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg auth v952 ap=1 s=19942 n(v0 rc2023-10-05T15:18:10.468126+0000 b19942 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000070e:[<0x100000005f9/picture-25.jpg v920>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000070e:[<0x100000005f9/picture-25.jpg v952>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.700+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000647 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml auth v954 ap=1 s=21865 n(v0 rc2023-10-05T15:18:09.668133+0000 b21865 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000647:[<0x100000005f9/article-8.xml v466>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000647:[<0x100000005f9/article-8.xml v954>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.701+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg auth v956 ap=1 s=20506 n(v0 rc2023-10-05T15:18:10.385127+0000 b20506 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006f2:[<0x100000005f9/picture-31.jpg v905>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006f2:[<0x100000005f9/picture-31.jpg v956>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.701+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml auth v958 ap=1 s=25634 n(v0 rc2023-10-05T15:18:09.522135+0000 b25634 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000060b:[<0x100000005f9/article-68.xml v106>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000060b:[<0x100000005f9/article-68.xml v958>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.947 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.702+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000682 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg auth v960 ap=1 s=42886 n(v0 rc2023-10-05T15:18:09.817132+0000 b42886 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000682:[<0x100000005f9/picture-49.jpg v820>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000682:[<0x100000005f9/picture-49.jpg v960>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.702+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000603 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml auth v962 ap=1 s=19836 n(v0 rc2023-10-05T15:18:09.496135+0000 b19836 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000603:[<0x100000005f9/article-76.xml v58>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000603:[<0x100000005f9/article-76.xml v962>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.703+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg auth v964 ap=1 s=46887 n(v0 rc2023-10-05T15:18:10.603125+0000 b46887 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000075b:[<0x100000005f9/picture-8.jpg v948>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000075b:[<0x100000005f9/picture-8.jpg v964>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.704+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-88.jpg auth v966 ap=1 s=64038 n(v0 rc2023-10-05T15:18:09.716133+0000 b64038 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065b:[<0x100000005f9/picture-88.jpg v586>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000065b:[<0x100000005f9/picture-88.jpg v966>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.705+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000709 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg auth v968 ap=1 s=31979 n(v0 rc2023-10-05T15:18:10.456126+0000 b31979 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000709:[<0x100000005f9/picture-26.jpg v918>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000709:[<0x100000005f9/picture-26.jpg v968>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.705+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml auth v970 ap=1 s=6750 n(v0 rc2023-10-05T15:18:09.610134+0000 b6750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000062f:[<0x100000005f9/article-32.xml v322>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000062f:[<0x100000005f9/article-32.xml v970>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.705+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000654 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-95.jpg auth v972 ap=1 s=15793 n(v0 rc2023-10-05T15:18:09.698133+0000 b15793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000654:[<0x100000005f9/picture-95.jpg v544>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000654:[<0x100000005f9/picture-95.jpg v972>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.706+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml auth v974 ap=1 s=9049 n(v0 rc2023-10-05T15:18:09.636134+0000 b9049 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063a:[<0x100000005f9/article-21.xml v388>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000063a:[<0x100000005f9/article-21.xml v974>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.948 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.706+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000631 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml auth v976 ap=1 s=4985 n(v0 rc2023-10-05T15:18:09.615134+0000 b4985 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000631:[<0x100000005f9/article-30.xml v334>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000631:[<0x100000005f9/article-30.xml v976>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.707+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000642 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml auth v978 ap=1 s=13527 n(v0 rc2023-10-05T15:18:09.655133+0000 b13527 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000642:[<0x100000005f9/article-13.xml v436>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000642:[<0x100000005f9/article-13.xml v978>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.707+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml auth v980 ap=1 s=12504 n(v0 rc2023-10-05T15:18:09.566134+0000 b12504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061d:[<0x100000005f9/article-50.xml v214>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000061d:[<0x100000005f9/article-50.xml v980>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.708+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000649 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml auth v982 ap=1 s=29345 n(v0 rc2023-10-05T15:18:09.672133+0000 b29345 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000649:[<0x100000005f9/article-6.xml v478>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000649:[<0x100000005f9/article-6.xml v982>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.709+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml auth v984 ap=1 s=1976 n(v0 rc2023-10-05T15:18:09.681133+0000 b1976 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@14},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000064d:[<0x100000005f9/article-2.xml v502>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000064d:[<0x100000005f9/article-2.xml v984>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.709+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg auth v986 ap=1 s=20624 n(v0 rc2023-10-05T15:18:09.805132+0000 b20624 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000067d:[<0x100000005f9/picture-54.jpg v790>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000067d:[<0x100000005f9/picture-54.jpg v986>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.710+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg auth v988 ap=1 s=60323 n(v0 rc2023-10-05T15:18:10.410126+0000 b60323 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006fb:[<0x100000005f9/picture-29.jpg v916>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006fb:[<0x100000005f9/picture-29.jpg v988>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.711+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000617 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml auth v990 ap=1 s=26689 n(v0 rc2023-10-05T15:18:09.552134+0000 b26689 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000617:[<0x100000005f9/article-56.xml v178>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000617:[<0x100000005f9/article-56.xml v990>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.712+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-86.jpg auth v952 ap=1 s=38997 n(v0 rc2023-10-05T15:18:09.721133+0000 b38997 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065d:[<0x100000005f9/picture-86.jpg v598>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000065d:[<0x100000005f9/picture-86.jpg v952>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.712+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000653 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-96.jpg auth v972 ap=1 s=44434 n(v0 rc2023-10-05T15:18:09.696133+0000 b44434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000653:[<0x100000005f9/picture-96.jpg v538>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000653:[<0x100000005f9/picture-96.jpg v972>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.949 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.713+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000655 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-94.jpg auth v974 ap=1 s=56462 n(v0 rc2023-10-05T15:18:09.701133+0000 b56462 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000655:[<0x100000005f9/picture-94.jpg v550>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000655:[<0x100000005f9/picture-94.jpg v974>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.713+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000624 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml auth v976 ap=1 s=23267 n(v0 rc2023-10-05T15:18:09.583134+0000 b23267 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000624:[<0x100000005f9/article-43.xml v256>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000624:[<0x100000005f9/article-43.xml v976>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.714+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml auth v978 ap=1 s=9171 n(v0 rc2023-10-05T15:18:09.607134+0000 b9171 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000062e:[<0x100000005f9/article-33.xml v316>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000062e:[<0x100000005f9/article-33.xml v978>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.714+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000662 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-81.jpg auth v980 ap=1 s=33579 n(v0 rc2023-10-05T15:18:09.733133+0000 b33579 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000662:[<0x100000005f9/picture-81.jpg v628>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000662:[<0x100000005f9/picture-81.jpg v980>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.715+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000766 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg auth v982 ap=1 s=51868 n(v0 rc2023-10-05T15:18:10.628124+0000 b51868 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@15},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000766:[<0x100000005f9/picture-5.jpg v942>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000766:[<0x100000005f9/picture-5.jpg v982>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.716+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000681 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg auth v984 ap=1 s=48442 n(v0 rc2023-10-05T15:18:09.815132+0000 b48442 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000681:[<0x100000005f9/picture-50.jpg v814>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000681:[<0x100000005f9/picture-50.jpg v984>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.716+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000679 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg auth v986 ap=1 s=50248 n(v0 rc2023-10-05T15:18:09.795132+0000 b50248 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000679:[<0x100000005f9/picture-58.jpg v766>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000679:[<0x100000005f9/picture-58.jpg v986>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.717+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000616 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml auth v988 ap=1 s=32263 n(v0 rc2023-10-05T15:18:09.550134+0000 b32263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000616:[<0x100000005f9/article-57.xml v172>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000616:[<0x100000005f9/article-57.xml v988>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.718+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000672 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg auth v990 ap=1 s=63336 n(v0 rc2023-10-05T15:18:09.774132+0000 b63336 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000672:[<0x100000005f9/picture-65.jpg v724>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000672:[<0x100000005f9/picture-65.jpg v990>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.950 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.718+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000600 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-79.xml auth v992 ap=1 s=2969 n(v0 rc2023-10-05T15:18:09.487135+0000 b2969 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000600:[<0x100000005f9/article-79.xml v40>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000600:[<0x100000005f9/article-79.xml v992>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.719+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000615 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml auth v954 ap=1 s=27633 n(v0 rc2023-10-05T15:18:09.548134+0000 b27633 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000615:[<0x100000005f9/article-58.xml v166>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000615:[<0x100000005f9/article-58.xml v954>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.720+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml auth v956 ap=1 s=1704 n(v0 rc2023-10-05T15:18:09.560134+0000 b1704 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061a:[<0x100000005f9/article-53.xml v196>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000061a:[<0x100000005f9/article-53.xml v956>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.720+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000633 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml auth v958 ap=1 s=15598 n(v0 rc2023-10-05T15:18:09.619134+0000 b15598 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000633:[<0x100000005f9/article-28.xml v346>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000633:[<0x100000005f9/article-28.xml v958>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.720+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml auth v960 ap=1 s=10598 n(v0 rc2023-10-05T15:18:09.563134+0000 b10598 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061b:[<0x100000005f9/article-52.xml v202>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000061b:[<0x100000005f9/article-52.xml v960>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.721+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000666 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-77.jpg auth v962 ap=1 s=24154 n(v0 rc2023-10-05T15:18:09.743133+0000 b24154 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000666:[<0x100000005f9/picture-77.jpg v652>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000666:[<0x100000005f9/picture-77.jpg v962>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.722+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg auth v964 ap=1 s=42850 n(v0 rc2023-10-05T15:18:09.764132+0000 b42850 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066e:[<0x100000005f9/picture-69.jpg v700>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000066e:[<0x100000005f9/picture-69.jpg v964>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.722+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000680 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg auth v966 ap=1 s=20793 n(v0 rc2023-10-05T15:18:09.812132+0000 b20793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000680:[<0x100000005f9/picture-51.jpg v808>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000680:[<0x100000005f9/picture-51.jpg v966>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.951 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.723+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000675 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg auth v968 ap=1 s=62418 n(v0 rc2023-10-05T15:18:09.781132+0000 b62418 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000675:[<0x100000005f9/picture-62.jpg v742>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000675:[<0x100000005f9/picture-62.jpg v968>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.723+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000685 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg auth v970 ap=1 s=58848 n(v0 rc2023-10-05T15:18:09.824132+0000 b58848 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000685:[<0x100000005f9/picture-46.jpg v838>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000685:[<0x100000005f9/picture-46.jpg v970>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.724+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg auth v954 ap=1 s=62917 n(v0 rc2023-10-05T15:18:10.667124+0000 b62917 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@14},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000076c:[<0x100000005f9/picture-3.jpg v948>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000076c:[<0x100000005f9/picture-3.jpg v954>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.724+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg auth v956 ap=1 s=23709 n(v0 rc2023-10-05T15:18:09.803132+0000 b23709 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000067c:[<0x100000005f9/picture-55.jpg v784>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000067c:[<0x100000005f9/picture-55.jpg v956>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.725+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg auth v958 ap=1 s=19812 n(v0 rc2023-10-05T15:18:10.579125+0000 b19812 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000074d:[<0x100000005f9/picture-11.jpg v938>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000074d:[<0x100000005f9/picture-11.jpg v958>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.725+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-70.jpg auth v960 ap=1 s=65109 n(v0 rc2023-10-05T15:18:09.761132+0000 b65109 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066d:[<0x100000005f9/picture-70.jpg v694>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000066d:[<0x100000005f9/picture-70.jpg v960>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.726+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml auth v962 ap=1 s=25572 n(v0 rc2023-10-05T15:18:09.674133+0000 b25572 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000064a:[<0x100000005f9/article-5.xml v484>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000064a:[<0x100000005f9/article-5.xml v962>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.726+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml auth v964 ap=1 s=18750 n(v0 rc2023-10-05T15:18:09.605134+0000 b18750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000062d:[<0x100000005f9/article-34.xml v310>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000062d:[<0x100000005f9/article-34.xml v964>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.727+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005fe [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml auth v966 ap=1 s=13872 n(v0 rc2023-10-05T15:18:09.481135+0000 b13872 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005fe:[<0x100000005f9/article-81.xml v28>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005fe:[<0x100000005f9/article-81.xml v966>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.952 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.727+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000650 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-99.jpg auth v968 ap=1 s=28925 n(v0 rc2023-10-05T15:18:09.689133+0000 b28925 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000650:[<0x100000005f9/picture-99.jpg v520>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000650:[<0x100000005f9/picture-99.jpg v968>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.728+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000601 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml auth v970 ap=1 s=27798 n(v0 rc2023-10-05T15:18:09.490135+0000 b27798 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000601:[<0x100000005f9/article-78.xml v46>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000601:[<0x100000005f9/article-78.xml v970>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.728+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-71.jpg auth v972 ap=1 s=14553 n(v0 rc2023-10-05T15:18:09.758133+0000 b14553 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066c:[<0x100000005f9/picture-71.jpg v688>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000066c:[<0x100000005f9/picture-71.jpg v972>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.729+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000632 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml auth v974 ap=1 s=30350 n(v0 rc2023-10-05T15:18:09.616134+0000 b30350 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000632:[<0x100000005f9/article-29.xml v340>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000632:[<0x100000005f9/article-29.xml v974>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.730+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000613 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml auth v976 ap=1 s=24624 n(v0 rc2023-10-05T15:18:09.543134+0000 b24624 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000613:[<0x100000005f9/article-60.xml v154>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000613:[<0x100000005f9/article-60.xml v976>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.731+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000674 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg auth v978 ap=1 s=40587 n(v0 rc2023-10-05T15:18:09.778132+0000 b40587 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000674:[<0x100000005f9/picture-63.jpg v736>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000674:[<0x100000005f9/picture-63.jpg v978>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.731+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg auth v980 ap=1 s=32035 n(v0 rc2023-10-05T15:18:09.839132+0000 b32035 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068b:[<0x100000005f9/picture-40.jpg v874>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000068b:[<0x100000005f9/picture-40.jpg v980>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.732+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000639 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml auth v982 ap=1 s=8151 n(v0 rc2023-10-05T15:18:09.634134+0000 b8151 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000639:[<0x100000005f9/article-22.xml v382>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000639:[<0x100000005f9/article-22.xml v982>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.953 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.733+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-87.jpg auth v984 ap=1 s=26551 n(v0 rc2023-10-05T15:18:09.718133+0000 b26551 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065c:[<0x100000005f9/picture-87.jpg v592>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000065c:[<0x100000005f9/picture-87.jpg v984>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.734+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-84.jpg auth v986 ap=1 s=53571 n(v0 rc2023-10-05T15:18:09.726133+0000 b53571 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065f:[<0x100000005f9/picture-84.jpg v610>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000065f:[<0x100000005f9/picture-84.jpg v986>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.734+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml auth v988 ap=1 s=2789 n(v0 rc2023-10-05T15:18:09.569134+0000 b2789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061e:[<0x100000005f9/article-49.xml v220>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000061e:[<0x100000005f9/article-49.xml v988>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.735+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000717 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg auth v961 ap=1 s=22328 n(v0 rc2023-10-05T15:18:10.481126+0000 b22328 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000717:[<0x100000005f9/picture-23.jpg v926>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000717:[<0x100000005f9/picture-23.jpg v961>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.735+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000664 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-79.jpg auth v963 ap=1 s=58434 n(v0 rc2023-10-05T15:18:09.739133+0000 b58434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000664:[<0x100000005f9/picture-79.jpg v640>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000664:[<0x100000005f9/picture-79.jpg v963>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.736+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000641 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml auth v965 ap=1 s=9612 n(v0 rc2023-10-05T15:18:09.653133+0000 b9612 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000641:[<0x100000005f9/article-14.xml v430>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000641:[<0x100000005f9/article-14.xml v965>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.737+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000686 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg auth v967 ap=1 s=12382 n(v0 rc2023-10-05T15:18:09.827132+0000 b12382 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000686:[<0x100000005f9/picture-45.jpg v844>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000686:[<0x100000005f9/picture-45.jpg v967>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.738+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg auth v969 ap=1 s=65145 n(v0 rc2023-10-05T15:18:09.837132+0000 b65145 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068a:[<0x100000005f9/picture-41.jpg v868>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000068a:[<0x100000005f9/picture-41.jpg v969>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.738+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005fb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-84.xml auth v971 ap=1 s=7783 n(v0 rc2023-10-05T15:18:09.473135+0000 b7783 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614303e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005fb:[<0x100000005f9/article-84.xml v10>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005fb:[<0x100000005f9/article-84.xml v971>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.954 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.739+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000677 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg auth v973 ap=1 s=52851 n(v0 rc2023-10-05T15:18:09.789132+0000 b52851 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430654000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000677:[<0x100000005f9/picture-60.jpg v754>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000677:[<0x100000005f9/picture-60.jpg v973>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.740+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000621 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml auth v975 ap=1 s=27537 n(v0 rc2023-10-05T15:18:09.576134+0000 b27537 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430654580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000621:[<0x100000005f9/article-46.xml v238>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000621:[<0x100000005f9/article-46.xml v975>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.740+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000671 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg auth v977 ap=1 s=57853 n(v0 rc2023-10-05T15:18:09.771132+0000 b57853 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430654b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000671:[<0x100000005f9/picture-66.jpg v718>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000671:[<0x100000005f9/picture-66.jpg v977>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.741+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000663 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-80.jpg auth v979 ap=1 s=15804 n(v0 rc2023-10-05T15:18:09.736133+0000 b15804 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430655080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000663:[<0x100000005f9/picture-80.jpg v634>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000663:[<0x100000005f9/picture-80.jpg v979>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.742+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000620 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml auth v981 ap=1 s=7534 n(v0 rc2023-10-05T15:18:09.574134+0000 b7534 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430655600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000620:[<0x100000005f9/article-47.xml v232>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000620:[<0x100000005f9/article-47.xml v981>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.743+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000658 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-91.jpg auth v985 ap=1 s=20456 n(v0 rc2023-10-05T15:18:09.708133+0000 b20456 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430656100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000658:[<0x100000005f9/picture-91.jpg v568>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000658:[<0x100000005f9/picture-91.jpg v985>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.744+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg auth v987 ap=1 s=42584 n(v0 rc2023-10-05T15:18:10.490126+0000 b42584 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430656680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000071a:[<0x100000005f9/picture-22.jpg v928>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000071a:[<0x100000005f9/picture-22.jpg v987>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.745+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000644 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml auth v989 ap=1 s=2536 n(v0 rc2023-10-05T15:18:09.660133+0000 b2536 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430656c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000644:[<0x100000005f9/article-11.xml v448>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000644:[<0x100000005f9/article-11.xml v989>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.955 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.746+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000652 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-97.jpg auth v991 ap=1 s=23195 n(v0 rc2023-10-05T15:18:09.693133+0000 b23195 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430657180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000652:[<0x100000005f9/picture-97.jpg v532>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000652:[<0x100000005f9/picture-97.jpg v991>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.746+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml auth v993 ap=1 s=24093 n(v0 rc2023-10-05T15:18:09.648134+0000 b24093 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430657700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063f:[<0x100000005f9/article-16.xml v418>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000063f:[<0x100000005f9/article-16.xml v993>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.747+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000619 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml auth v995 ap=1 s=23105 n(v0 rc2023-10-05T15:18:09.557134+0000 b23105 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430662000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000619:[<0x100000005f9/article-54.xml v190>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000619:[<0x100000005f9/article-54.xml v995>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.748+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000635 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml auth v997 ap=1 s=29845 n(v0 rc2023-10-05T15:18:09.624134+0000 b29845 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430662580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000635:[<0x100000005f9/article-26.xml v358>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000635:[<0x100000005f9/article-26.xml v997>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.748+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg auth v999 ap=1 s=40295 n(v0 rc2023-10-05T15:18:10.547125+0000 b40295 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430662b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000073a:[<0x100000005f9/picture-15.jpg v942>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000073a:[<0x100000005f9/picture-15.jpg v999>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.748+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg auth v1001 ap=1 s=43211 n(v0 rc2023-10-05T15:18:09.801132+0000 b43211 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430663080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000067b:[<0x100000005f9/picture-56.jpg v778>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000067b:[<0x100000005f9/picture-56.jpg v1001>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.749+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000684 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg auth v1003 ap=1 s=19919 n(v0 rc2023-10-05T15:18:09.822132+0000 b19919 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430663600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000684:[<0x100000005f9/picture-47.jpg v832>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000684:[<0x100000005f9/picture-47.jpg v1003>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.956 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.750+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000645 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml auth v1005 ap=1 s=5263 n(v0 rc2023-10-05T15:18:09.663133+0000 b5263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430663b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000645:[<0x100000005f9/article-10.xml v454>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000645:[<0x100000005f9/article-10.xml v1005>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.957 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.750+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000749 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg auth v1007 ap=1 s=13089 n(v0 rc2023-10-05T15:18:10.570125+0000 b13089 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430664100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000749:[<0x100000005f9/picture-12.jpg v946>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000749:[<0x100000005f9/picture-12.jpg v1007>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.957 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.750+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000687 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg auth v1009 ap=1 s=30280 n(v0 rc2023-10-05T15:18:09.830132+0000 b30280 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000687:[<0x100000005f9/picture-44.jpg v850>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000687:[<0x100000005f9/picture-44.jpg v1009>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.957 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.751+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml auth v1011 ap=1 s=24987 n(v0 rc2023-10-05T15:18:09.571134+0000 b24987 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430664c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061f:[<0x100000005f9/article-48.xml v226>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000061f:[<0x100000005f9/article-48.xml v1011>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.957 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.751+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml auth v1013 ap=1 s=21520 n(v0 rc2023-10-05T15:18:09.677133+0000 b21520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@15},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430665180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000064b:[<0x100000005f9/article-4.xml v490>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000064b:[<0x100000005f9/article-4.xml v1013>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.957 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.753+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000636 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml auth v1015 ap=1 s=9519 n(v0 rc2023-10-05T15:18:09.626134+0000 b9519 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430665700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000636:[<0x100000005f9/article-25.xml v364>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000636:[<0x100000005f9/article-25.xml v1015>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.957 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.753+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-72.jpg auth v1017 ap=1 s=51249 n(v0 rc2023-10-05T15:18:09.756133+0000 b51249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430678000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066b:[<0x100000005f9/picture-72.jpg v682>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000066b:[<0x100000005f9/picture-72.jpg v1017>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.958 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.754+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000678 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg auth v1019 ap=1 s=24852 n(v0 rc2023-10-05T15:18:09.792132+0000 b24852 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430678580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000678:[<0x100000005f9/picture-59.jpg v760>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000678:[<0x100000005f9/picture-59.jpg v1019>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.958 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.756+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000629 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml auth v1021 ap=1 s=21518 n(v0 rc2023-10-05T15:18:09.596134+0000 b21518 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430678b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000629:[<0x100000005f9/article-38.xml v286>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000629:[<0x100000005f9/article-38.xml v1021>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.958 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.756+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000607 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml auth v953 ap=1 s=3327 n(v0 rc2023-10-05T15:18:09.509135+0000 b3327 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430679080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000607:[<0x100000005f9/article-72.xml v82>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000607:[<0x100000005f9/article-72.xml v953>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.958 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.757+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-73.jpg auth v955 ap=1 s=59074 n(v0 rc2023-10-05T15:18:09.754133+0000 b59074 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430679600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066a:[<0x100000005f9/picture-73.jpg v676>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000066a:[<0x100000005f9/picture-73.jpg v955>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.958 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.758+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg auth v957 ap=1 s=55971 n(v0 rc2023-10-05T15:18:10.498126+0000 b55971 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430679b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000071f:[<0x100000005f9/picture-21.jpg v925>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000071f:[<0x100000005f9/picture-21.jpg v957>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.959 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.760+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml auth v959 ap=1 s=32626 n(v0 rc2023-10-05T15:18:09.602134+0000 b32626 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143067a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000062c:[<0x100000005f9/article-35.xml v304>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000062c:[<0x100000005f9/article-35.xml v959>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.959 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.761+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000668 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-75.jpg auth v961 ap=1 s=26745 n(v0 rc2023-10-05T15:18:09.748133+0000 b26745 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143067a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000668:[<0x100000005f9/picture-75.jpg v664>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000668:[<0x100000005f9/picture-75.jpg v961>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.959 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.762+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-100.jpg auth v963 ap=1 s=65329 n(v0 rc2023-10-05T15:18:09.686133+0000 b65329 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143067ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000064f:[<0x100000005f9/picture-100.jpg v514>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000064f:[<0x100000005f9/picture-100.jpg v963>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.959 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.763+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000627 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml auth v965 ap=1 s=25318 n(v0 rc2023-10-05T15:18:09.590134+0000 b25318 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143067b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000627:[<0x100000005f9/article-40.xml v274>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000627:[<0x100000005f9/article-40.xml v965>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.959 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.763+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg auth v967 ap=1 s=55122 n(v0 rc2023-10-05T15:18:10.398127+0000 b55122 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143067b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006f5:[<0x100000005f9/picture-30.jpg v913>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006f5:[<0x100000005f9/picture-30.jpg v967>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.959 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.764+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005fd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml auth v969 ap=1 s=3008 n(v0 rc2023-10-05T15:18:09.478135+0000 b3008 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005fd:[<0x100000005f9/article-82.xml v22>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005fd:[<0x100000005f9/article-82.xml v969>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.960 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.765+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000640 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml auth v971 ap=1 s=1487 n(v0 rc2023-10-05T15:18:09.651133+0000 b1487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000640:[<0x100000005f9/article-15.xml v424>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000640:[<0x100000005f9/article-15.xml v971>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.960 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.766+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000651 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-98.jpg auth v973 ap=1 s=58497 n(v0 rc2023-10-05T15:18:09.691133+0000 b58497 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000651:[<0x100000005f9/picture-98.jpg v526>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000651:[<0x100000005f9/picture-98.jpg v973>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.960 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.766+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg auth v975 ap=1 s=38987 n(v0 rc2023-10-05T15:18:09.849132+0000 b38987 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068f:[<0x100000005f9/picture-36.jpg v898>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000068f:[<0x100000005f9/picture-36.jpg v975>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.960 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.767+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000688 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg auth v977 ap=1 s=25674 n(v0 rc2023-10-05T15:18:09.832132+0000 b25674 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000688:[<0x100000005f9/picture-43.jpg v856>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000688:[<0x100000005f9/picture-43.jpg v977>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.961 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.768+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml auth v979 ap=1 s=19631 n(v0 rc2023-10-05T15:18:09.641134+0000 b19631 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063c:[<0x100000005f9/article-19.xml v400>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000063c:[<0x100000005f9/article-19.xml v979>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.961 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.769+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000723 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg auth v981 ap=1 s=43104 n(v0 rc2023-10-05T15:18:10.507126+0000 b43104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000723:[<0x100000005f9/picture-20.jpg v931>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000723:[<0x100000005f9/picture-20.jpg v981>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.961 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.770+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000625 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml auth v983 ap=1 s=27739 n(v0 rc2023-10-05T15:18:09.586134+0000 b27739 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000625:[<0x100000005f9/article-42.xml v262>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000625:[<0x100000005f9/article-42.xml v983>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.961 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.770+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg auth v985 ap=1 s=42459 n(v0 rc2023-10-05T15:18:09.844132+0000 b42459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068d:[<0x100000005f9/picture-38.jpg v886>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000068d:[<0x100000005f9/picture-38.jpg v985>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.962 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.771+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml auth v948 ap=1 s=3416 n(v0 rc2023-10-05T15:18:09.534135+0000 b3416 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000060f:[<0x100000005f9/article-64.xml v130>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000060f:[<0x100000005f9/article-64.xml v948>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.962 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.772+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000604 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml auth v950 ap=1 s=17739 n(v0 rc2023-10-05T15:18:09.500135+0000 b17739 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000604:[<0x100000005f9/article-75.xml v64>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000604:[<0x100000005f9/article-75.xml v950>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.962 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.773+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000703 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg auth v954 ap=1 s=58804 n(v0 rc2023-10-05T15:18:10.448126+0000 b58804 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000703:[<0x100000005f9/picture-27.jpg v911>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000703:[<0x100000005f9/picture-27.jpg v954>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.962 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.773+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000606 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml auth v956 ap=1 s=18755 n(v0 rc2023-10-05T15:18:09.505135+0000 b18755 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000606:[<0x100000005f9/article-73.xml v76>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000606:[<0x100000005f9/article-73.xml v956>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.962 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.774+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000628 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml auth v958 ap=1 s=20353 n(v0 rc2023-10-05T15:18:09.593134+0000 b20353 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000628:[<0x100000005f9/article-39.xml v280>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000628:[<0x100000005f9/article-39.xml v958>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.963 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.775+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml auth v960 ap=1 s=6779 n(v0 rc2023-10-05T15:18:09.600134+0000 b6779 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000062b:[<0x100000005f9/article-36.xml v298>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000062b:[<0x100000005f9/article-36.xml v960>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.963 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.775+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg auth v964 ap=1 s=43466 n(v0 rc2023-10-05T15:18:09.810132+0000 b43466 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000067f:[<0x100000005f9/picture-52.jpg v802>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000067f:[<0x100000005f9/picture-52.jpg v964>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.963 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.776+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000643 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml auth v962 ap=1 s=23731 n(v0 rc2023-10-05T15:18:09.657133+0000 b23731 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000643:[<0x100000005f9/article-12.xml v442>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000643:[<0x100000005f9/article-12.xml v962>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.963 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.777+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml auth v966 ap=1 s=27246 n(v0 rc2023-10-05T15:18:09.683133+0000 b27246 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000064e:[<0x100000005f9/article-1.xml v508>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000064e:[<0x100000005f9/article-1.xml v966>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.963 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.777+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg auth v968 ap=1 s=51808 n(v0 rc2023-10-05T15:18:10.349127+0000 b51808 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006e4:[<0x100000005f9/picture-34.jpg v906>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006e4:[<0x100000005f9/picture-34.jpg v968>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.778+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg auth v970 ap=1 s=23055 n(v0 rc2023-10-05T15:18:09.808132+0000 b23055 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000067e:[<0x100000005f9/picture-53.jpg v796>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000067e:[<0x100000005f9/picture-53.jpg v970>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.779+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000670 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg auth v972 ap=1 s=58070 n(v0 rc2023-10-05T15:18:09.768132+0000 b58070 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000670:[<0x100000005f9/picture-67.jpg v712>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000670:[<0x100000005f9/picture-67.jpg v972>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.779+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000659 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-90.jpg auth v974 ap=1 s=36162 n(v0 rc2023-10-05T15:18:09.711133+0000 b36162 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000659:[<0x100000005f9/picture-90.jpg v574>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000659:[<0x100000005f9/picture-90.jpg v974>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.780+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml auth v976 ap=1 s=14180 n(v0 rc2023-10-05T15:18:09.528135+0000 b14180 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000060d:[<0x100000005f9/article-66.xml v118>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000060d:[<0x100000005f9/article-66.xml v976>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.781+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000737 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg auth v978 ap=1 s=39313 n(v0 rc2023-10-05T15:18:10.538125+0000 b39313 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000737:[<0x100000005f9/picture-16.jpg v939>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000737:[<0x100000005f9/picture-16.jpg v978>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.782+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000602 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml auth v980 ap=1 s=25772 n(v0 rc2023-10-05T15:18:09.493135+0000 b25772 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000602:[<0x100000005f9/article-77.xml v52>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000602:[<0x100000005f9/article-77.xml v980>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.782+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000669 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-74.jpg auth v982 ap=1 s=40554 n(v0 rc2023-10-05T15:18:09.750133+0000 b40554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000669:[<0x100000005f9/picture-74.jpg v670>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000669:[<0x100000005f9/picture-74.jpg v982>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.783+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000638 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml auth v984 ap=1 s=20183 n(v0 rc2023-10-05T15:18:09.632134+0000 b20183 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000638:[<0x100000005f9/article-23.xml v376>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000638:[<0x100000005f9/article-23.xml v984>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.964 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.784+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml auth v986 ap=1 s=32372 n(v0 rc2023-10-05T15:18:09.645134+0000 b32372 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063e:[<0x100000005f9/article-17.xml v412>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000063e:[<0x100000005f9/article-17.xml v986>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.785+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000667 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-76.jpg auth v988 ap=1 s=15075 n(v0 rc2023-10-05T15:18:09.745133+0000 b15075 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000667:[<0x100000005f9/picture-76.jpg v658>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000667:[<0x100000005f9/picture-76.jpg v988>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.785+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ef [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg auth v990 ap=1 s=31043 n(v0 rc2023-10-05T15:18:10.372127+0000 b31043 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ef:[<0x100000005f9/picture-32.jpg v908>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ef:[<0x100000005f9/picture-32.jpg v990>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.786+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000610 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml auth v992 ap=1 s=8939 n(v0 rc2023-10-05T15:18:09.536135+0000 b8939 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000610:[<0x100000005f9/article-63.xml v136>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000610:[<0x100000005f9/article-63.xml v992>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.786+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000683 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg auth v994 ap=1 s=62843 n(v0 rc2023-10-05T15:18:09.820132+0000 b62843 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614306c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000683:[<0x100000005f9/picture-48.jpg v826>,<0x100000003a7/blog-5 v5920>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000683:[<0x100000005f9/picture-48.jpg v994>,<0x100000003a7/blog-5 v13696>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.787+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000407 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml auth v1030 ap=1 s=13736 n(v0 rc2023-10-05T15:18:08.384145+0000 b13736 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430402000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000407:[<0x100000003ab/article-59.xml v184>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000407:[<0x100000003ab/article-59.xml v1030>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.788+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000525 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg auth v1032 ap=1 s=23586 n(v0 rc2023-10-05T15:18:08.997140+0000 b23586 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430402580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000525:[<0x100000003ab/picture-13.jpg v766>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000525:[<0x100000003ab/picture-13.jpg v1032>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.788+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000789 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml auth v1034 ap=1 s=9142 n(v0 rc2023-10-05T15:18:10.743123+0000 b9142 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430402b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000789:[<0x100000003ab/comment-56.xml v943>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000789:[<0x100000003ab/comment-56.xml v1034>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.789+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000513 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg auth v1036 ap=1 s=56265 n(v0 rc2023-10-05T15:18:08.952140+0000 b56265 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430403080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000513:[<0x100000003ab/picture-18.jpg v736>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000513:[<0x100000003ab/picture-18.jpg v1036>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.965 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.790+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003da [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml auth v1038 ap=1 s=28096 n(v0 rc2023-10-05T15:18:08.316146+0000 b28096 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430403600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003da:[<0x100000003ab/article-74.xml v94>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003da:[<0x100000003ab/article-74.xml v1038>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.790+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml auth v1040 ap=1 s=20964 n(v0 rc2023-10-05T15:18:08.568143+0000 b20964 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430403b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047b:[<0x100000003ab/article-18.xml v430>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000047b:[<0x100000003ab/article-18.xml v1040>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.791+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000510 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg auth v1044 ap=1 s=27344 n(v0 rc2023-10-05T15:18:08.944140+0000 b27344 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430404680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000510:[<0x100000003ab/picture-19.jpg v730>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000510:[<0x100000003ab/picture-19.jpg v1044>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.793+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml auth v1048 ap=1 s=3212 n(v0 rc2023-10-05T15:18:11.006121+0000 b3212 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430405180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007e8:[<0x100000003ab/comment-29.xml v984>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007e8:[<0x100000003ab/comment-29.xml v1048>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.793+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000467 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml auth v1050 ap=1 s=16401 n(v0 rc2023-10-05T15:18:08.528144+0000 b16401 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430405700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000467:[<0x100000003ab/article-27.xml v376>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000467:[<0x100000003ab/article-27.xml v1050>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.794+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000549 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg auth v1052 ap=1 s=46101 n(v0 rc2023-10-05T15:18:09.073139+0000 b46101 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@6},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430430000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000549:[<0x100000003ab/picture-4.jpg v820>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000549:[<0x100000003ab/picture-4.jpg v1052>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.794+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg auth v1054 ap=1 s=10517 n(v0 rc2023-10-05T15:18:08.818141+0000 b10517 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430430580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e0:[<0x100000003ab/picture-35.jpg v634>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e0:[<0x100000003ab/picture-35.jpg v1054>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.966 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.795+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000551 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg auth v1056 ap=1 s=21850 n(v0 rc2023-10-05T15:18:09.084139+0000 b21850 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430430b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000551:[<0x100000003ab/picture-2.jpg v832>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000551:[<0x100000003ab/picture-2.jpg v1056>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.796+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml auth v1058 ap=1 s=13275 n(v0 rc2023-10-05T15:18:08.334146+0000 b13275 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430431080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e6:[<0x100000003ab/article-70.xml v118>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e6:[<0x100000003ab/article-70.xml v1058>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.796+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000477 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml auth v1060 ap=1 s=24963 n(v0 rc2023-10-05T15:18:08.557144+0000 b24963 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430431600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000477:[<0x100000003ab/article-20.xml v418>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000477:[<0x100000003ab/article-20.xml v1060>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.797+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000521 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg auth v1062 ap=1 s=14063 n(v0 rc2023-10-05T15:18:08.986140+0000 b14063 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430431b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000521:[<0x100000003ab/picture-14.jpg v760>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000521:[<0x100000003ab/picture-14.jpg v1062>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.797+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005cb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml auth v1064 ap=1 s=3838 n(v0 rc2023-10-05T15:18:09.356136+0000 b3838 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430432100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005cb:[<0x100000003ab/comment-92.xml v886>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005cb:[<0x100000003ab/comment-92.xml v1064>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.798+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml auth v1066 ap=1 s=31851 n(v0 rc2023-10-05T15:18:08.276146+0000 b31851 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430432680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bf:[<0x100000003ab/article-83.xml v40>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003bf:[<0x100000003ab/article-83.xml v1066>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.798+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000401 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml auth v1068 ap=1 s=15560 n(v0 rc2023-10-05T15:18:08.375145+0000 b15560 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430432c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000401:[<0x100000003ab/article-61.xml v172>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000401:[<0x100000003ab/article-61.xml v1068>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.799+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml auth v1070 ap=1 s=26405 n(v0 rc2023-10-05T15:18:08.466144+0000 b26405 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430433180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000043d:[<0x100000003ab/article-41.xml v292>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000043d:[<0x100000003ab/article-41.xml v1070>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.967 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.799+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000431 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml auth v1072 ap=1 s=2330 n(v0 rc2023-10-05T15:18:08.448145+0000 b2330 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430433700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000431:[<0x100000003ab/article-45.xml v268>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000431:[<0x100000003ab/article-45.xml v1072>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.800+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml auth v1074 ap=1 s=24381 n(v0 rc2023-10-05T15:18:08.339146+0000 b24381 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e9:[<0x100000003ab/article-69.xml v124>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e9:[<0x100000003ab/article-69.xml v1074>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.800+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005bf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml auth v1076 ap=1 s=8658 n(v0 rc2023-10-05T15:18:09.321137+0000 b8658 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005bf:[<0x100000003ab/comment-94.xml v874>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005bf:[<0x100000003ab/comment-94.xml v1076>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.801+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg auth v1078 ap=1 s=27905 n(v0 rc2023-10-05T15:18:09.055139+0000 b27905 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000053d:[<0x100000003ab/picture-7.jpg v802>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000053d:[<0x100000003ab/picture-7.jpg v1078>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.801+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml auth v1080 ap=1 s=5109 n(v0 rc2023-10-05T15:18:08.511144+0000 b5109 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000045b:[<0x100000003ab/article-31.xml v352>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000045b:[<0x100000003ab/article-31.xml v1080>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.802+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000535 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg auth v1082 ap=1 s=57398 n(v0 rc2023-10-05T15:18:09.039139+0000 b57398 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000535:[<0x100000003ab/picture-9.jpg v790>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000535:[<0x100000003ab/picture-9.jpg v1082>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.803+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000813 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml auth v1086 ap=1 s=8573 n(v0 rc2023-10-05T15:18:11.117120+0000 b8573 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000813:[<0x100000003ab/comment-20.xml v1000>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000813:[<0x100000003ab/comment-20.xml v1086>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.968 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.804+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-80.xml auth v1028 ap=1 s=11996 n(v0 rc2023-10-05T15:18:08.289146+0000 b11996 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c8:[<0x100000003ab/article-80.xml v58>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c8:[<0x100000003ab/article-80.xml v1028>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.804+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ca [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml auth v1030 ap=1 s=6611 n(v0 rc2023-10-05T15:18:10.922122+0000 b6611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ca:[<0x100000003ab/comment-37.xml v966>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ca:[<0x100000003ab/comment-37.xml v1030>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.805+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000755 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml auth v1032 ap=1 s=3225 n(v0 rc2023-10-05T15:18:10.593125+0000 b3225 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000755:[<0x100000003ab/comment-71.xml v934>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000755:[<0x100000003ab/comment-71.xml v1032>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.805+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000531 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg auth v1034 ap=1 s=49463 n(v0 rc2023-10-05T15:18:09.028139+0000 b49463 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143043d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000531:[<0x100000003ab/picture-10.jpg v784>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000531:[<0x100000003ab/picture-10.jpg v1034>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.806+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml auth v1036 ap=1 s=3396 n(v0 rc2023-10-05T15:18:09.305137+0000 b3396 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143044e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b9:[<0x100000003ab/comment-95.xml v868>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005b9:[<0x100000003ab/comment-95.xml v1036>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.807+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000555 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg auth{0=1} v1094 ap=1 s=44783 n(v0 rc2023-10-05T15:18:09.090139+0000 b44783 1=1+0) (iversion lock) caps={15483=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56143044e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000555:[<0x100000003ab/picture-1.jpg v838>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000555:[<0x100000003ab/picture-1.jpg v1094>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.808+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000495 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml auth v1042 ap=1 s=20744 n(v0 rc2023-10-05T15:18:08.632143+0000 b20744 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143044f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000495:[<0x100000003ab/article-9.xml v484>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000495:[<0x100000003ab/article-9.xml v1042>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.808+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000434 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml auth v1044 ap=1 s=6910 n(v0 rc2023-10-05T15:18:08.452145+0000 b6910 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143044f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000434:[<0x100000003ab/article-44.xml v274>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000434:[<0x100000003ab/article-44.xml v1044>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.969 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.809+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000541 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg auth v1046 ap=1 s=16956 n(v0 rc2023-10-05T15:18:09.061139+0000 b16956 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@6},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143044fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000541:[<0x100000003ab/picture-6.jpg v808>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000541:[<0x100000003ab/picture-6.jpg v1046>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.809+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml auth v1048 ap=1 s=10258 n(v0 rc2023-10-05T15:18:08.357145+0000 b10258 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430450100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f5:[<0x100000003ab/article-65.xml v148>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f5:[<0x100000003ab/article-65.xml v1048>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.810+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000780 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml auth v1050 ap=1 s=2649 n(v0 rc2023-10-05T15:18:10.722124+0000 b2649 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430450680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000780:[<0x100000003ab/comment-58.xml v940>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000780:[<0x100000003ab/comment-58.xml v1050>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.810+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fe [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml auth v1052 ap=1 s=21526 n(v0 rc2023-10-05T15:18:08.370145+0000 b21526 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430450c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003fe:[<0x100000003ab/article-62.xml v166>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003fe:[<0x100000003ab/article-62.xml v1052>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.811+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml auth v1054 ap=1 s=7863 n(v0 rc2023-10-05T15:18:10.753123+0000 b7863 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430451180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000078c:[<0x100000003ab/comment-55.xml v946>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000078c:[<0x100000003ab/comment-55.xml v1054>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.812+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml auth v1056 ap=1 s=28020 n(v0 rc2023-10-05T15:18:08.541144+0000 b28020 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430451700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046f:[<0x100000003ab/article-24.xml v394>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000046f:[<0x100000003ab/article-24.xml v1056>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.812+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml auth v1058 ap=1 s=2783 n(v0 rc2023-10-05T15:18:10.951122+0000 b2783 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007d4:[<0x100000003ab/comment-34.xml v974>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007d4:[<0x100000003ab/comment-34.xml v1058>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.970 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.813+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml auth v1060 ap=1 s=5389 n(v0 rc2023-10-05T15:18:11.055121+0000 b5389 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007fb:[<0x100000003ab/comment-25.xml v988>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007fb:[<0x100000003ab/comment-25.xml v1060>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.971 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.813+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg auth v1062 ap=1 s=30870 n(v0 rc2023-10-05T15:18:08.873141+0000 b30870 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f5:[<0x100000003ab/picture-28.jpg v676>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f5:[<0x100000003ab/picture-28.jpg v1062>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.971 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.814+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-85.xml auth v1064 ap=1 s=13147 n(v0 rc2023-10-05T15:18:08.266146+0000 b13147 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b9:[<0x100000003ab/article-85.xml v28>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b9:[<0x100000003ab/article-85.xml v1064>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.971 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.815+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml auth v1066 ap=1 s=19047 n(v0 rc2023-10-05T15:18:08.253146+0000 b19047 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b1:[<0x100000003ab/article-88.xml v10>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b1:[<0x100000003ab/article-88.xml v1066>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.971 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.815+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml auth v1068 ap=1 s=3062 n(v0 rc2023-10-05T15:18:10.879122+0000 b3062 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007bb:[<0x100000003ab/comment-41.xml v960>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007bb:[<0x100000003ab/comment-41.xml v1068>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.971 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.815+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ef [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml auth v1070 ap=1 s=6852 n(v0 rc2023-10-05T15:18:08.348145+0000 b6852 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ef:[<0x100000003ab/article-67.xml v136>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ef:[<0x100000003ab/article-67.xml v1070>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.971 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.816+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000743 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml auth v1072 ap=1 s=7995 n(v0 rc2023-10-05T15:18:10.561125+0000 b7995 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000743:[<0x100000003ab/comment-75.xml v932>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000743:[<0x100000003ab/comment-75.xml v1072>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.817+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004da [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg auth v1074 ap=1 s=17389 n(v0 rc2023-10-05T15:18:08.803141+0000 b17389 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004da:[<0x100000003ab/picture-37.jpg v622>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004da:[<0x100000003ab/picture-37.jpg v1074>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.817+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000516 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg auth v1076 ap=1 s=45889 n(v0 rc2023-10-05T15:18:08.960140+0000 b45889 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000516:[<0x100000003ab/picture-17.jpg v742>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000516:[<0x100000003ab/picture-17.jpg v1076>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.818+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml auth v1078 ap=1 s=22934 n(v0 rc2023-10-05T15:18:08.677142+0000 b22934 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@5},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614305d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a7:[<0x100000003ab/article-3.xml v520>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a7:[<0x100000003ab/article-3.xml v1078>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.819+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000501 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg auth v1080 ap=1 s=29233 n(v0 rc2023-10-05T15:18:08.905140+0000 b29233 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143060e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000501:[<0x100000003ab/picture-24.jpg v700>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000501:[<0x100000003ab/picture-24.jpg v1080>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.819+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg auth v1082 ap=1 s=16081 n(v0 rc2023-10-05T15:18:08.834141+0000 b16081 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143060e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e6:[<0x100000003ab/picture-33.jpg v646>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e6:[<0x100000003ab/picture-33.jpg v1082>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.820+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml auth v1084 ap=1 s=25809 n(v0 rc2023-10-05T15:18:08.647143+0000 b25809 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143060eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049b:[<0x100000003ab/article-7.xml v496>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000049b:[<0x100000003ab/article-7.xml v1084>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.820+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg auth v1086 ap=1 s=45264 n(v0 rc2023-10-05T15:18:08.766142+0000 b45264 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143060f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004cb:[<0x100000003ab/picture-42.jpg v592>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004cb:[<0x100000003ab/picture-42.jpg v1086>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.972 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.821+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg auth v1088 ap=1 s=31072 n(v0 rc2023-10-05T15:18:08.788141+0000 b31072 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143060f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d4:[<0x100000003ab/picture-39.jpg v610>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d4:[<0x100000003ab/picture-39.jpg v1088>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.822+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000805 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml auth v1090 ap=1 s=8341 n(v0 rc2023-10-05T15:18:11.081120+0000 b8341 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143060fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000805:[<0x100000003ab/comment-23.xml v994>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000805:[<0x100000003ab/comment-23.xml v1090>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.822+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000800 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml auth v1092 ap=1 s=7794 n(v0 rc2023-10-05T15:18:11.068120+0000 b7794 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430610100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000800:[<0x100000003ab/comment-24.xml v992>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000800:[<0x100000003ab/comment-24.xml v1092>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.823+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000413 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml auth v1025 ap=1 s=27118 n(v0 rc2023-10-05T15:18:08.402145+0000 b27118 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430610680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000413:[<0x100000003ab/article-55.xml v208>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000413:[<0x100000003ab/article-55.xml v1025>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.824+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fe [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg auth v1027 ap=1 s=57581 n(v0 rc2023-10-05T15:18:08.897140+0000 b57581 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430610c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004fe:[<0x100000003ab/picture-25.jpg v694>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004fe:[<0x100000003ab/picture-25.jpg v1027>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.826+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ac [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml auth v1029 ap=1 s=4362 n(v0 rc2023-10-05T15:18:09.275137+0000 b4362 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430611180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ac:[<0x100000003ab/comment-97.xml v856>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ac:[<0x100000003ab/comment-97.xml v1029>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.826+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000498 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml auth v1031 ap=1 s=5460 n(v0 rc2023-10-05T15:18:08.639143+0000 b5460 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430611700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000498:[<0x100000003ab/article-8.xml v490>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000498:[<0x100000003ab/article-8.xml v1031>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.827+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml auth v1033 ap=1 s=6441 n(v0 rc2023-10-05T15:18:10.819123+0000 b6441 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a6:[<0x100000003ab/comment-47.xml v955>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a6:[<0x100000003ab/comment-47.xml v1033>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.827+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml auth v1035 ap=1 s=2724 n(v0 rc2023-10-05T15:18:10.828123+0000 b2724 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a9:[<0x100000003ab/comment-46.xml v957>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a9:[<0x100000003ab/comment-46.xml v1035>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.828+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ec [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg auth v1037 ap=1 s=49760 n(v0 rc2023-10-05T15:18:08.849141+0000 b49760 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ec:[<0x100000003ab/picture-31.jpg v658>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ec:[<0x100000003ab/picture-31.jpg v1037>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.973 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.828+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ec [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml auth v1039 ap=1 s=11522 n(v0 rc2023-10-05T15:18:08.343146+0000 b11522 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ec:[<0x100000003ab/article-68.xml v130>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ec:[<0x100000003ab/article-68.xml v1039>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.828+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml auth v1041 ap=1 s=7940 n(v0 rc2023-10-05T15:18:10.601125+0000 b7940 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000075a:[<0x100000003ab/comment-70.xml v934>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000075a:[<0x100000003ab/comment-70.xml v1041>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.829+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg auth v1043 ap=1 s=44840 n(v0 rc2023-10-05T15:18:08.714142+0000 b44840 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b6:[<0x100000003ab/picture-49.jpg v550>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b6:[<0x100000003ab/picture-49.jpg v1043>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.830+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000539 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg auth v1047 ap=1 s=55099 n(v0 rc2023-10-05T15:18:09.048139+0000 b55099 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000539:[<0x100000003ab/picture-8.jpg v796>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000539:[<0x100000003ab/picture-8.jpg v1047>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.831+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg auth v1049 ap=1 s=16106 n(v0 rc2023-10-05T15:18:08.889141+0000 b16106 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004fb:[<0x100000003ab/picture-26.jpg v688>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004fb:[<0x100000003ab/picture-26.jpg v1049>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.831+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml auth v1051 ap=1 s=4640 n(v0 rc2023-10-05T15:18:09.258137+0000 b4640 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a8:[<0x100000003ab/comment-98.xml v850>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a8:[<0x100000003ab/comment-98.xml v1051>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.831+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000458 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml auth v1053 ap=1 s=17173 n(v0 rc2023-10-05T15:18:08.506144+0000 b17173 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143061f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000458:[<0x100000003ab/article-32.xml v346>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000458:[<0x100000003ab/article-32.xml v1053>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.832+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml auth v1055 ap=1 s=9533 n(v0 rc2023-10-05T15:18:10.497126+0000 b9533 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430640000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000071d:[<0x100000003ab/comment-83.xml v910>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000071d:[<0x100000003ab/comment-83.xml v1055>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.833+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml auth v1057 ap=1 s=4845 n(v0 rc2023-10-05T15:18:10.609125+0000 b4845 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430640580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000075f:[<0x100000003ab/comment-69.xml v937>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000075f:[<0x100000003ab/comment-69.xml v1057>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.974 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.834+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000475 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml auth v1059 ap=1 s=6504 n(v0 rc2023-10-05T15:18:08.553144+0000 b6504 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430640b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000475:[<0x100000003ab/article-21.xml v412>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000475:[<0x100000003ab/article-21.xml v1059>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.836+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml auth v1061 ap=1 s=15019 n(v0 rc2023-10-05T15:18:08.515144+0000 b15019 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430641080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000045e:[<0x100000003ab/article-30.xml v358>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000045e:[<0x100000003ab/article-30.xml v1061>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.836+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005dc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml auth v1063 ap=1 s=3661 n(v0 rc2023-10-05T15:18:10.333127+0000 b3661 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430641600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005dc:[<0x100000003ab/comment-89.xml v904>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005dc:[<0x100000003ab/comment-89.xml v1063>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.837+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000747 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml auth v1065 ap=1 s=6587 n(v0 rc2023-10-05T15:18:10.569125+0000 b6587 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430641b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000747:[<0x100000003ab/comment-74.xml v916>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000747:[<0x100000003ab/comment-74.xml v1065>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.838+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml auth v1067 ap=1 s=5104 n(v0 rc2023-10-05T15:18:09.386136+0000 b5104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430642100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d6:[<0x100000003ab/comment-90.xml v898>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d6:[<0x100000003ab/comment-90.xml v1067>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.839+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml auth v1069 ap=1 s=4334 n(v0 rc2023-10-05T15:18:10.932122+0000 b4334 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430642680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007cd:[<0x100000003ab/comment-36.xml v969>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007cd:[<0x100000003ab/comment-36.xml v1069>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.840+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000489 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml auth v1071 ap=1 s=23127 n(v0 rc2023-10-05T15:18:08.603143+0000 b23127 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430642c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000489:[<0x100000003ab/article-13.xml v460>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000489:[<0x100000003ab/article-13.xml v1071>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.841+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml auth v1073 ap=1 s=3765 n(v0 rc2023-10-05T15:18:10.669124+0000 b3765 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430643180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000076e:[<0x100000003ab/comment-64.xml v941>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000076e:[<0x100000003ab/comment-64.xml v1073>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.842+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000751 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml auth v1075 ap=1 s=5303 n(v0 rc2023-10-05T15:18:10.585125+0000 b5303 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430643700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000751:[<0x100000003ab/comment-72.xml v932>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000751:[<0x100000003ab/comment-72.xml v1075>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.843+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000422 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml auth v1079 ap=1 s=11793 n(v0 rc2023-10-05T15:18:08.425145+0000 b11793 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143064e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000422:[<0x100000003ab/article-50.xml v238>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000422:[<0x100000003ab/article-50.xml v1079>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.975 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.845+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml auth v1081 ap=1 s=24325 n(v0 rc2023-10-05T15:18:08.655143+0000 b24325 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143064eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049e:[<0x100000003ab/article-6.xml v502>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000049e:[<0x100000003ab/article-6.xml v1081>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.846+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004aa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml auth v1083 ap=1 s=1804 n(v0 rc2023-10-05T15:18:08.685142+0000 b1804 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@5},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143064f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004aa:[<0x100000003ab/article-2.xml v526>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004aa:[<0x100000003ab/article-2.xml v1083>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.847+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000765 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml auth v1087 ap=1 s=9543 n(v0 rc2023-10-05T15:18:10.628124+0000 b9543 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143064fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000765:[<0x100000003ab/comment-67.xml v939>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000765:[<0x100000003ab/comment-67.xml v1087>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.848+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg auth v1089 ap=1 s=62841 n(v0 rc2023-10-05T15:18:08.865141+0000 b62841 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430650100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f2:[<0x100000003ab/picture-29.jpg v670>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f2:[<0x100000003ab/picture-29.jpg v1089>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.850+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000410 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml auth v1093 ap=1 s=20823 n(v0 rc2023-10-05T15:18:08.397145+0000 b20823 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430650c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000410:[<0x100000003ab/article-56.xml v202>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000410:[<0x100000003ab/article-56.xml v1093>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.851+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml auth v1026 ap=1 s=6165 n(v0 rc2023-10-05T15:18:11.093120+0000 b6165 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430651180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000080a:[<0x100000003ab/comment-22.xml v996>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000080a:[<0x100000003ab/comment-22.xml v1026>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.852+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml auth v1030 ap=1 s=2986 n(v0 rc2023-10-05T15:18:10.847122+0000 b2986 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b1:[<0x100000003ab/comment-44.xml v956>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007b1:[<0x100000003ab/comment-44.xml v1030>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.853+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000437 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml auth v1032 ap=1 s=24907 n(v0 rc2023-10-05T15:18:08.457144+0000 b24907 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000437:[<0x100000003ab/article-43.xml v280>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000437:[<0x100000003ab/article-43.xml v1032>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.854+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000455 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml auth v1034 ap=1 s=29753 n(v0 rc2023-10-05T15:18:08.502144+0000 b29753 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000455:[<0x100000003ab/article-33.xml v340>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000455:[<0x100000003ab/article-33.xml v1034>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.855+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml auth v1036 ap=1 s=7251 n(v0 rc2023-10-05T15:18:09.340136+0000 b7251 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c5:[<0x100000003ab/comment-93.xml v880>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005c5:[<0x100000003ab/comment-93.xml v1036>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.976 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.855+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000545 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg auth v1038 ap=1 s=41635 n(v0 rc2023-10-05T15:18:09.067139+0000 b41635 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000545:[<0x100000003ab/picture-5.jpg v814>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000545:[<0x100000003ab/picture-5.jpg v1038>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.977 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.856+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml auth v1040 ap=1 s=6902 n(v0 rc2023-10-05T15:18:11.031121+0000 b6902 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f2:[<0x100000003ab/comment-27.xml v980>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007f2:[<0x100000003ab/comment-27.xml v1040>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.977 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.856+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg auth v1042 ap=1 s=24019 n(v0 rc2023-10-05T15:18:08.707142+0000 b24019 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b3:[<0x100000003ab/picture-50.jpg v544>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b3:[<0x100000003ab/picture-50.jpg v1042>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.977 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.857+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml auth v1044 ap=1 s=4538 n(v0 rc2023-10-05T15:18:10.554125+0000 b4538 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000073e:[<0x100000003ab/comment-76.xml v914>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000073e:[<0x100000003ab/comment-76.xml v1044>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.977 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.858+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml auth v1046 ap=1 s=26278 n(v0 rc2023-10-05T15:18:08.393145+0000 b26278 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000040d:[<0x100000003ab/article-57.xml v196>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000040d:[<0x100000003ab/article-57.xml v1046>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.977 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.858+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000795 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml auth v1048 ap=1 s=2522 n(v0 rc2023-10-05T15:18:10.775123+0000 b2522 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000795:[<0x100000003ab/comment-52.xml v952>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000795:[<0x100000003ab/comment-52.xml v1048>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.977 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.859+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000768 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml auth v1050 ap=1 s=8554 n(v0 rc2023-10-05T15:18:10.651124+0000 b8554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614307e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000768:[<0x100000003ab/comment-66.xml v918>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000768:[<0x100000003ab/comment-66.xml v1050>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.860+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-79.xml auth v1054 ap=1 s=9884 n(v0 rc2023-10-05T15:18:08.294146+0000 b9884 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430814580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cb:[<0x100000003ab/article-79.xml v64>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003cb:[<0x100000003ab/article-79.xml v1054>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.861+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml auth v1058 ap=1 s=13406 n(v0 rc2023-10-05T15:18:08.389145+0000 b13406 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430815080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000040a:[<0x100000003ab/article-58.xml v190>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000040a:[<0x100000003ab/article-58.xml v1058>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.862+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000419 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml auth v1060 ap=1 s=1865 n(v0 rc2023-10-05T15:18:08.411145+0000 b1865 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430815600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000419:[<0x100000003ab/article-53.xml v220>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000419:[<0x100000003ab/article-53.xml v1060>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.863+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml auth v1062 ap=1 s=7907 n(v0 rc2023-10-05T15:18:10.861122+0000 b7907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430815b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b4:[<0x100000003ab/comment-43.xml v958>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007b4:[<0x100000003ab/comment-43.xml v1062>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.864+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000464 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml auth v1066 ap=1 s=10782 n(v0 rc2023-10-05T15:18:08.523144+0000 b10782 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430816680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000464:[<0x100000003ab/article-28.xml v370>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000464:[<0x100000003ab/article-28.xml v1066>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.865+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml auth v1070 ap=1 s=7840 n(v0 rc2023-10-05T15:18:08.415145+0000 b7840 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430817180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000041c:[<0x100000003ab/article-52.xml v226>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000041c:[<0x100000003ab/article-52.xml v1070>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.865+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml auth v1072 ap=1 s=4070 n(v0 rc2023-10-05T15:18:09.244137+0000 b4070 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430817700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a3:[<0x100000003ab/comment-99.xml v844>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a3:[<0x100000003ab/comment-99.xml v1072>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.978 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.866+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg auth v1074 ap=1 s=32964 n(v0 rc2023-10-05T15:18:08.699142+0000 b32964 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143082e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b0:[<0x100000003ab/picture-51.jpg v538>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b0:[<0x100000003ab/picture-51.jpg v1074>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.867+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ad [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml auth v1076 ap=1 s=7998 n(v0 rc2023-10-05T15:18:10.837123+0000 b7998 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143082e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ad:[<0x100000003ab/comment-45.xml v954>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ad:[<0x100000003ab/comment-45.xml v1076>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.868+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000719 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml auth v1078 ap=1 s=2677 n(v0 rc2023-10-05T15:18:10.488126+0000 b2677 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143082eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000719:[<0x100000003ab/comment-84.xml v910>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000719:[<0x100000003ab/comment-84.xml v1078>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.868+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg auth v1080 ap=1 s=44371 n(v0 rc2023-10-05T15:18:08.736142+0000 b44371 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143082f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004bf:[<0x100000003ab/picture-46.jpg v568>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004bf:[<0x100000003ab/picture-46.jpg v1080>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.869+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000727 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml auth v1025 ap=1 s=5858 n(v0 rc2023-10-05T15:18:10.513126+0000 b5858 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143082f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000727:[<0x100000003ab/comment-81.xml v920>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000727:[<0x100000003ab/comment-81.xml v1025>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.870+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg auth v1029 ap=1 s=30354 n(v0 rc2023-10-05T15:18:09.079139+0000 b30354 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@5},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430830100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000054d:[<0x100000003ab/picture-3.jpg v826>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000054d:[<0x100000003ab/picture-3.jpg v1029>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.871+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000792 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml auth v1031 ap=1 s=7408 n(v0 rc2023-10-05T15:18:10.767123+0000 b7408 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430830680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000792:[<0x100000003ab/comment-53.xml v949>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000792:[<0x100000003ab/comment-53.xml v1031>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.872+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000715 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml auth v1035 ap=1 s=5910 n(v0 rc2023-10-05T15:18:10.480126+0000 b5910 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430831180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000715:[<0x100000003ab/comment-85.xml v918>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000715:[<0x100000003ab/comment-85.xml v1035>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.873+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg auth v1037 ap=1 s=54514 n(v0 rc2023-10-05T15:18:09.018139+0000 b54514 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430831700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000052d:[<0x100000003ab/picture-11.jpg v778>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000052d:[<0x100000003ab/picture-11.jpg v1037>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.874+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml auth v1039 ap=1 s=22369 n(v0 rc2023-10-05T15:18:08.662143+0000 b22369 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430854000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a1:[<0x100000003ab/article-5.xml v508>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a1:[<0x100000003ab/article-5.xml v1039>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.979 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.874+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000452 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml auth v1041 ap=1 s=25450 n(v0 rc2023-10-05T15:18:08.498144+0000 b25450 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430854580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000452:[<0x100000003ab/article-34.xml v334>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000452:[<0x100000003ab/article-34.xml v1041>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.875+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml auth v1043 ap=1 s=7418 n(v0 rc2023-10-05T15:18:10.942122+0000 b7418 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430854b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007d0:[<0x100000003ab/comment-35.xml v969>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007d0:[<0x100000003ab/comment-35.xml v1043>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.876+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ed [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml auth v1045 ap=1 s=4132 n(v0 rc2023-10-05T15:18:11.018121+0000 b4132 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430855080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ed:[<0x100000003ab/comment-28.xml v977>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007ed:[<0x100000003ab/comment-28.xml v1045>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.876+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000784 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml auth v1047 ap=1 s=5795 n(v0 rc2023-10-05T15:18:10.734124+0000 b5795 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430855600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000784:[<0x100000003ab/comment-57.xml v944>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000784:[<0x100000003ab/comment-57.xml v1047>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.877+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-81.xml auth v1049 ap=1 s=4010 n(v0 rc2023-10-05T15:18:10.428126+0000 b4010 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430855b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006f9:[<0x100000003ab/article-81.xml v911>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006f9:[<0x100000003ab/article-81.xml v1049>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.877+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ce [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml auth v1051 ap=1 s=19632 n(v0 rc2023-10-05T15:18:08.298146+0000 b19632 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430856100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ce:[<0x100000003ab/article-78.xml v70>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ce:[<0x100000003ab/article-78.xml v1051>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.878+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000461 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml auth v1053 ap=1 s=21595 n(v0 rc2023-10-05T15:18:08.519144+0000 b21595 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430856680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000461:[<0x100000003ab/article-29.xml v364>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000461:[<0x100000003ab/article-29.xml v1053>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.879+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000404 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml auth v1055 ap=1 s=30285 n(v0 rc2023-10-05T15:18:08.380145+0000 b30285 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430856c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000404:[<0x100000003ab/article-60.xml v178>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000404:[<0x100000003ab/article-60.xml v1055>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.880+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg auth v1057 ap=1 s=25574 n(v0 rc2023-10-05T15:18:08.780142+0000 b25574 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430857180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d1:[<0x100000003ab/picture-40.jpg v604>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d1:[<0x100000003ab/picture-40.jpg v1057>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.980 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.880+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000777 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-61.xml auth v1059 ap=1 s=5353 n(v0 rc2023-10-05T15:18:10.696124+0000 b5353 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430857700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000777:[<0x100000003ab/comment-61.xml v942>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000777:[<0x100000003ab/comment-61.xml v1059>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.881+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000473 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml auth v1061 ap=1 s=4001 n(v0 rc2023-10-05T15:18:08.548144+0000 b4001 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430868000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000473:[<0x100000003ab/article-22.xml v406>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000473:[<0x100000003ab/article-22.xml v1061>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.882+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml auth v1063 ap=1 s=6787 n(v0 rc2023-10-05T15:18:10.906122+0000 b6787 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430868580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c6:[<0x100000003ab/comment-38.xml v963>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007c6:[<0x100000003ab/comment-38.xml v1063>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.882+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000762 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml auth v1065 ap=1 s=5594 n(v0 rc2023-10-05T15:18:10.622125+0000 b5594 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430868b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000762:[<0x100000003ab/comment-68.xml v936>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000762:[<0x100000003ab/comment-68.xml v1065>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.883+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg auth v1067 ap=1 s=34528 n(v0 rc2023-10-05T15:18:10.377127+0000 b34528 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430869080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006e6:[<0x100000003ab/picture-87.jpg v907>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006e6:[<0x100000003ab/picture-87.jpg v1067>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.884+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000425 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml auth v1069 ap=1 s=3224 n(v0 rc2023-10-05T15:18:08.429145+0000 b3224 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430869600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000425:[<0x100000003ab/article-49.xml v244>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000425:[<0x100000003ab/article-49.xml v1069>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.885+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml auth v1073 ap=1 s=6363 n(v0 rc2023-10-05T15:18:10.521125+0000 b6363 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143086a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000072b:[<0x100000003ab/comment-80.xml v922>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000072b:[<0x100000003ab/comment-80.xml v1073>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.886+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000504 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg auth v1025 ap=1 s=59917 n(v0 rc2023-10-05T15:18:08.913140+0000 b59917 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143086a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000504:[<0x100000003ab/picture-23.jpg v706>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000504:[<0x100000003ab/picture-23.jpg v1025>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.888+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg auth v1029 ap=1 s=31623 n(v0 rc2023-10-05T15:18:08.743142+0000 b31623 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143086b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c2:[<0x100000003ab/picture-45.jpg v574>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c2:[<0x100000003ab/picture-45.jpg v1029>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.981 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.889+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ce [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg auth v1031 ap=1 s=56323 n(v0 rc2023-10-05T15:18:08.773142+0000 b56323 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143086b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ce:[<0x100000003ab/picture-41.jpg v598>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ce:[<0x100000003ab/picture-41.jpg v1031>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.982 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.889+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-84.xml auth v1033 ap=1 s=1649 n(v0 rc2023-10-05T15:18:08.271146+0000 b1649 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430888000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bc:[<0x100000003ab/article-84.xml v34>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003bc:[<0x100000003ab/article-84.xml v1033>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.982 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.890+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000773 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml auth v1035 ap=1 s=4518 n(v0 rc2023-10-05T15:18:10.687124+0000 b4518 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430888580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000773:[<0x100000003ab/comment-62.xml v935>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000773:[<0x100000003ab/comment-62.xml v1035>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.982 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.890+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml auth v1037 ap=1 s=31229 n(v0 rc2023-10-05T15:18:08.443145+0000 b31229 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430888b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000042e:[<0x100000003ab/article-46.xml v262>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000042e:[<0x100000003ab/article-46.xml v1037>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.982 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.891+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml auth v1039 ap=1 s=9035 n(v0 rc2023-10-05T15:18:08.439145+0000 b9035 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430889080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000042b:[<0x100000003ab/article-47.xml v256>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000042b:[<0x100000003ab/article-47.xml v1039>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.982 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.892+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml auth v1041 ap=1 s=7356 n(v0 rc2023-10-05T15:18:08.330146+0000 b7356 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430889600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e3:[<0x100000003ab/article-71.xml v112>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e3:[<0x100000003ab/article-71.xml v1041>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.983 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.892+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000507 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg auth v1043 ap=1 s=32829 n(v0 rc2023-10-05T15:18:08.921140+0000 b32829 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430889b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000507:[<0x100000003ab/picture-22.jpg v712>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000507:[<0x100000003ab/picture-22.jpg v1043>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.983 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.893+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml auth v1045 ap=1 s=22377 n(v0 rc2023-10-05T15:18:08.618143+0000 b22377 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143088a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048f:[<0x100000003ab/article-11.xml v472>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000048f:[<0x100000003ab/article-11.xml v1045>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.983 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.894+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-59.xml auth v1047 ap=1 s=9521 n(v0 rc2023-10-05T15:18:10.712124+0000 b9521 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143088a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000077d:[<0x100000003ab/comment-59.xml v937>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000077d:[<0x100000003ab/comment-59.xml v1047>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.983 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.895+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000480 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml auth v1049 ap=1 s=11722 n(v0 rc2023-10-05T15:18:08.580143+0000 b11722 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143088ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000480:[<0x100000003ab/article-16.xml v442>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000480:[<0x100000003ab/article-16.xml v1049>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.896+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000739 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml auth v1051 ap=1 s=5109 n(v0 rc2023-10-05T15:18:10.545125+0000 b5109 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143088b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000739:[<0x100000003ab/comment-77.xml v929>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000739:[<0x100000003ab/comment-77.xml v1051>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.896+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000416 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml auth v1053 ap=1 s=4640 n(v0 rc2023-10-05T15:18:08.406145+0000 b4640 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143088b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000416:[<0x100000003ab/article-54.xml v214>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000416:[<0x100000003ab/article-54.xml v1053>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.897+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml auth v1055 ap=1 s=28237 n(v0 rc2023-10-05T15:18:08.532144+0000 b28237 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046a:[<0x100000003ab/article-26.xml v382>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000046a:[<0x100000003ab/article-26.xml v1055>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.898+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg auth v1057 ap=1 s=34219 n(v0 rc2023-10-05T15:18:08.976140+0000 b34219 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000051c:[<0x100000003ab/picture-15.jpg v754>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000051c:[<0x100000003ab/picture-15.jpg v1057>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.899+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg auth v1059 ap=1 s=17766 n(v0 rc2023-10-05T15:18:08.729142+0000 b17766 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004bc:[<0x100000003ab/picture-47.jpg v562>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004bc:[<0x100000003ab/picture-47.jpg v1059>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.899+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000492 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml auth v1061 ap=1 s=9833 n(v0 rc2023-10-05T15:18:08.624143+0000 b9833 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000492:[<0x100000003ab/article-10.xml v478>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000492:[<0x100000003ab/article-10.xml v1061>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.900+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000529 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg auth v1063 ap=1 s=42411 n(v0 rc2023-10-05T15:18:09.008139+0000 b42411 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000529:[<0x100000003ab/picture-12.jpg v772>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000529:[<0x100000003ab/picture-12.jpg v1063>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.900+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg auth v1065 ap=1 s=33053 n(v0 rc2023-10-05T15:18:08.751142+0000 b33053 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c5:[<0x100000003ab/picture-44.jpg v580>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c5:[<0x100000003ab/picture-44.jpg v1065>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.984 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.901+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml auth v1067 ap=1 s=6333 n(v0 rc2023-10-05T15:18:10.793123+0000 b6333 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000079c:[<0x100000003ab/comment-50.xml v950>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000079c:[<0x100000003ab/comment-50.xml v1067>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.902+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000428 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml auth v1069 ap=1 s=9631 n(v0 rc2023-10-05T15:18:08.434145+0000 b9631 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000428:[<0x100000003ab/article-48.xml v250>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000428:[<0x100000003ab/article-48.xml v1069>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.902+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml auth v1071 ap=1 s=7538 n(v0 rc2023-10-05T15:18:10.812123+0000 b7538 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a3:[<0x100000003ab/comment-48.xml v952>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a3:[<0x100000003ab/comment-48.xml v1071>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.903+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml auth v1073 ap=1 s=9749 n(v0 rc2023-10-05T15:18:08.670143+0000 b9749 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004a4:[<0x100000003ab/article-4.xml v514>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004a4:[<0x100000003ab/article-4.xml v1073>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.904+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml auth v1075 ap=1 s=13447 n(v0 rc2023-10-05T15:18:08.536144+0000 b13447 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143089f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046d:[<0x100000003ab/article-25.xml v388>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000046d:[<0x100000003ab/article-25.xml v1075>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.905+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000446 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml auth v1077 ap=1 s=19846 n(v0 rc2023-10-05T15:18:08.480144+0000 b19846 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000446:[<0x100000003ab/article-38.xml v310>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000446:[<0x100000003ab/article-38.xml v1077>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.905+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007df [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-31.xml auth v1079 ap=1 s=3922 n(v0 rc2023-10-05T15:18:10.985121+0000 b3922 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007df:[<0x100000003ab/comment-31.xml v978>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007df:[<0x100000003ab/comment-31.xml v1079>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.906+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml auth v1030 ap=1 s=8758 n(v0 rc2023-10-05T15:18:08.325146+0000 b8758 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003e0:[<0x100000003ab/article-72.xml v106>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003e0:[<0x100000003ab/article-72.xml v1030>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.907+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg auth v1032 ap=1 s=56981 n(v0 rc2023-10-05T15:18:08.929140+0000 b56981 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000050a:[<0x100000003ab/picture-21.jpg v718>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000050a:[<0x100000003ab/picture-21.jpg v1032>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.985 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.908+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml auth v1034 ap=1 s=26276 n(v0 rc2023-10-05T15:18:08.493144+0000 b26276 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000044f:[<0x100000003ab/article-35.xml v328>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000044f:[<0x100000003ab/article-35.xml v1034>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.986 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.908+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml auth v1036 ap=1 s=9388 n(v0 rc2023-10-05T15:18:10.577125+0000 b9388 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000074c:[<0x100000003ab/comment-73.xml v929>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000074c:[<0x100000003ab/comment-73.xml v1036>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.986 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.909+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-60.xml auth v1038 ap=1 s=7597 n(v0 rc2023-10-05T15:18:10.704124+0000 b7597 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000077a:[<0x100000003ab/comment-60.xml v943>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000077a:[<0x100000003ab/comment-60.xml v1038>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.986 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.909+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000735 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml auth v1040 ap=1 s=8657 n(v0 rc2023-10-05T15:18:10.537125+0000 b8657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000735:[<0x100000003ab/comment-78.xml v927>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000735:[<0x100000003ab/comment-78.xml v1040>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.987 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.910+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-86.xml auth v1042 ap=1 s=6360 n(v0 rc2023-10-05T15:18:08.262146+0000 b6360 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b6:[<0x100000003ab/article-86.xml v22>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b6:[<0x100000003ab/article-86.xml v1042>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.987 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.912+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml auth v1046 ap=1 s=3091 n(v0 rc2023-10-05T15:18:09.288137+0000 b3091 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b3:[<0x100000003ab/comment-96.xml v862>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005b3:[<0x100000003ab/comment-96.xml v1046>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.987 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.912+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000440 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml auth v1048 ap=1 s=19599 n(v0 rc2023-10-05T15:18:08.471144+0000 b19599 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000440:[<0x100000003ab/article-40.xml v298>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000440:[<0x100000003ab/article-40.xml v1048>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.987 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.912+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ef [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg auth v1050 ap=1 s=48183 n(v0 rc2023-10-05T15:18:08.857141+0000 b48183 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ef:[<0x100000003ab/picture-30.jpg v664>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ef:[<0x100000003ab/picture-30.jpg v1050>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.987 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.913+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-82.xml auth v1052 ap=1 s=25201 n(v0 rc2023-10-05T15:18:08.280146+0000 b25201 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c2:[<0x100000003ab/article-82.xml v46>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003c2:[<0x100000003ab/article-82.xml v1052>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.914+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ee [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml auth v1054 ap=1 s=2224 n(v0 rc2023-10-05T15:18:10.389127+0000 b2224 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ee:[<0x100000003ab/comment-88.xml v905>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ee:[<0x100000003ab/comment-88.xml v1054>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.914+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000483 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml auth v1056 ap=1 s=21480 n(v0 rc2023-10-05T15:18:08.588143+0000 b21480 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000483:[<0x100000003ab/article-15.xml v448>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000483:[<0x100000003ab/article-15.xml v1056>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.915+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000730 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml auth v1058 ap=1 s=10211 n(v0 rc2023-10-05T15:18:10.529125+0000 b10211 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000730:[<0x100000003ab/comment-79.xml v925>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000730:[<0x100000003ab/comment-79.xml v1058>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.916+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007be [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml auth v1060 ap=1 s=9292 n(v0 rc2023-10-05T15:18:10.886122+0000 b9292 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007be:[<0x100000003ab/comment-40.xml v961>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007be:[<0x100000003ab/comment-40.xml v1060>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.916+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml auth v1062 ap=1 s=8832 n(v0 rc2023-10-05T15:18:10.963121+0000 b8832 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007d7:[<0x100000003ab/comment-33.xml v973>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007d7:[<0x100000003ab/comment-33.xml v1062>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.917+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml auth v1064 ap=1 s=8119 n(v0 rc2023-10-05T15:18:10.894122+0000 b8119 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c2:[<0x100000003ab/comment-39.xml v965>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007c2:[<0x100000003ab/comment-39.xml v1064>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.988 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.917+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml auth v1066 ap=1 s=4682 n(v0 rc2023-10-05T15:18:10.474126+0000 b4682 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000070d:[<0x100000003ab/comment-86.xml v915>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000070d:[<0x100000003ab/comment-86.xml v1066>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.918+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg auth v1068 ap=1 s=41933 n(v0 rc2023-10-05T15:18:08.811141+0000 b41933 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004dd:[<0x100000003ab/picture-36.jpg v628>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004dd:[<0x100000003ab/picture-36.jpg v1068>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.919+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg auth v1070 ap=1 s=21095 n(v0 rc2023-10-05T15:18:08.758142+0000 b21095 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c8:[<0x100000003ab/picture-43.jpg v586>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004c8:[<0x100000003ab/picture-43.jpg v1070>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.920+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000479 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml auth v1072 ap=1 s=13455 n(v0 rc2023-10-05T15:18:08.563144+0000 b13455 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000479:[<0x100000003ab/article-19.xml v424>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000479:[<0x100000003ab/article-19.xml v1072>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.922+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg auth v1074 ap=1 s=21639 n(v0 rc2023-10-05T15:18:08.936140+0000 b21639 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000050d:[<0x100000003ab/picture-20.jpg v724>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000050d:[<0x100000003ab/picture-20.jpg v1074>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.923+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ae [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-89.xml auth v1076 ap=1 s=23076 n(v0 rc2023-10-05T15:18:08.248146+0000 b23076 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ae:[<0x100000003ab/article-89.xml v4>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003ae:[<0x100000003ab/article-89.xml v1076>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.925+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000722 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml auth v1078 ap=1 s=5675 n(v0 rc2023-10-05T15:18:10.505126+0000 b5675 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000722:[<0x100000003ab/comment-82.xml v917>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000722:[<0x100000003ab/comment-82.xml v1078>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.926+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007db [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml auth v1080 ap=1 s=6566 n(v0 rc2023-10-05T15:18:10.974121+0000 b6566 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007db:[<0x100000003ab/comment-32.xml v975>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007db:[<0x100000003ab/comment-32.xml v1080>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.927+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000770 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml auth v1082 ap=1 s=9614 n(v0 rc2023-10-05T15:18:10.678124+0000 b9614 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000770:[<0x100000003ab/comment-63.xml v939>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000770:[<0x100000003ab/comment-63.xml v1082>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.928+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml auth v1084 ap=1 s=2726 n(v0 rc2023-10-05T15:18:10.760123+0000 b2726 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000078f:[<0x100000003ab/comment-54.xml v947>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000078f:[<0x100000003ab/comment-54.xml v1084>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.989 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.928+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml auth v1086 ap=1 s=12520 n(v0 rc2023-10-05T15:18:08.462144+0000 b12520 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000043a:[<0x100000003ab/article-42.xml v286>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000043a:[<0x100000003ab/article-42.xml v1086>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.990 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.929+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml auth v1088 ap=1 s=10167 n(v0 rc2023-10-05T15:18:09.369136+0000 b10167 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d1:[<0x100000003ab/comment-91.xml v892>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d1:[<0x100000003ab/comment-91.xml v1088>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.990 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.930+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg auth v1090 ap=1 s=21344 n(v0 rc2023-10-05T15:18:08.796141+0000 b21344 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d7:[<0x100000003ab/picture-38.jpg v616>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004d7:[<0x100000003ab/picture-38.jpg v1090>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.990 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.931+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml auth v1049 ap=1 s=26928 n(v0 rc2023-10-05T15:18:08.361145+0000 b26928 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@24},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f8:[<0x100000003ab/article-64.xml v154>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f8:[<0x100000003ab/article-64.xml v1049>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.990 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.933+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-87.xml auth v1051 ap=1 s=9541 n(v0 rc2023-10-05T15:18:08.257146+0000 b9541 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b4:[<0x100000003ab/article-87.xml v16>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003b4:[<0x100000003ab/article-87.xml v1051>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:21.990 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.935+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml auth v1055 ap=1 s=6023 n(v0 rc2023-10-05T15:18:11.104120+0000 b6023 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000080e:[<0x100000003ab/comment-21.xml v997>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000080e:[<0x100000003ab/comment-21.xml v1055>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.315 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.939+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml auth v1057 ap=1 s=9487 n(v0 rc2023-10-05T15:18:11.043121+0000 b9487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f7:[<0x100000003ab/comment-26.xml v987>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007f7:[<0x100000003ab/comment-26.xml v1057>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.315 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.940+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml auth v1059 ap=1 s=21993 n(v0 rc2023-10-05T15:18:08.312146+0000 b21993 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d7:[<0x100000003ab/article-75.xml v88>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d7:[<0x100000003ab/article-75.xml v1059>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.941+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000449 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml auth v1061 ap=1 s=26509 n(v0 rc2023-10-05T15:18:08.484144+0000 b26509 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000449:[<0x100000003ab/article-37.xml v316>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000449:[<0x100000003ab/article-37.xml v1061>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.942+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg auth v1063 ap=1 s=54709 n(v0 rc2023-10-05T15:18:08.881141+0000 b54709 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004f8:[<0x100000003ab/picture-27.jpg v682>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004f8:[<0x100000003ab/picture-27.jpg v1063>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.943+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml auth v1065 ap=1 s=25723 n(v0 rc2023-10-05T15:18:08.321146+0000 b25723 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003dd:[<0x100000003ab/article-73.xml v100>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003dd:[<0x100000003ab/article-73.xml v1065>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.943+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000443 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml auth v1067 ap=1 s=30278 n(v0 rc2023-10-05T15:18:08.475144+0000 b30278 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000443:[<0x100000003ab/article-39.xml v304>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000443:[<0x100000003ab/article-39.xml v1067>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.944+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml auth v1069 ap=1 s=7793 n(v0 rc2023-10-05T15:18:08.489144+0000 b7793 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614308f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000044c:[<0x100000003ab/article-36.xml v322>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000044c:[<0x100000003ab/article-36.xml v1069>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.944+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml auth v1071 ap=1 s=13081 n(v0 rc2023-10-05T15:18:08.610143+0000 b13081 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430902000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048c:[<0x100000003ab/article-12.xml v466>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000048c:[<0x100000003ab/article-12.xml v1071>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.945+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ad [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml auth v1073 ap=1 s=12389 n(v0 rc2023-10-05T15:18:08.692142+0000 b12389 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430902580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ad:[<0x100000003ab/article-1.xml v532>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004ad:[<0x100000003ab/article-1.xml v1073>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.945+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml auth v1075 ap=1 s=5227 n(v0 rc2023-10-05T15:18:10.994121+0000 b5227 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430902b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007e4:[<0x100000003ab/comment-30.xml v981>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007e4:[<0x100000003ab/comment-30.xml v1075>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.319 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.946+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg auth v1077 ap=1 s=59982 n(v0 rc2023-10-05T15:18:08.826141+0000 b59982 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430903080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e3:[<0x100000003ab/picture-34.jpg v640>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e3:[<0x100000003ab/picture-34.jpg v1077>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.948+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml auth v1083 ap=1 s=7061 n(v0 rc2023-10-05T15:18:08.352145+0000 b7061 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430904100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003f2:[<0x100000003ab/article-66.xml v142>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003f2:[<0x100000003ab/article-66.xml v1083>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.948+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000519 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg auth v1085 ap=1 s=60161 n(v0 rc2023-10-05T15:18:08.967140+0000 b60161 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430904680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000519:[<0x100000003ab/picture-16.jpg v748>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000519:[<0x100000003ab/picture-16.jpg v1085>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.949+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml auth v1087 ap=1 s=23375 n(v0 rc2023-10-05T15:18:08.303146+0000 b23375 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430904c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d1:[<0x100000003ab/article-77.xml v76>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003d1:[<0x100000003ab/article-77.xml v1087>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.950+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml auth v1091 ap=1 s=8278 n(v0 rc2023-10-05T15:18:10.804123+0000 b8278 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430905700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a0:[<0x100000003ab/comment-49.xml v952>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007a0:[<0x100000003ab/comment-49.xml v1091>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.950+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fe [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml auth v1031 ap=1 s=4120 n(v0 rc2023-10-05T15:18:10.450126+0000 b4120 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006fe:[<0x100000003ab/comment-87.xml v905>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006fe:[<0x100000003ab/comment-87.xml v1031>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.951+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml auth v1033 ap=1 s=6284 n(v0 rc2023-10-05T15:18:10.871122+0000 b6284 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b8:[<0x100000003ab/comment-42.xml v960>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000007b8:[<0x100000003ab/comment-42.xml v1033>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.951+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml auth v1035 ap=1 s=2397 n(v0 rc2023-10-05T15:18:10.663124+0000 b2397 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000076b:[<0x100000003ab/comment-65.xml v923>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000076b:[<0x100000003ab/comment-65.xml v1035>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.952+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000471 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml auth v1037 ap=1 s=28278 n(v0 rc2023-10-05T15:18:08.544144+0000 b28278 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000471:[<0x100000003ab/article-23.xml v400>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000471:[<0x100000003ab/article-23.xml v1037>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.952+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml auth v1039 ap=1 s=1996 n(v0 rc2023-10-05T15:18:08.574143+0000 b1996 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047d:[<0x100000003ab/article-17.xml v436>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000047d:[<0x100000003ab/article-17.xml v1039>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.320 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.953+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg auth v1041 ap=1 s=64465 n(v0 rc2023-10-05T15:18:08.842141+0000 b64465 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@8},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004e9:[<0x100000003ab/picture-32.jpg v652>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004e9:[<0x100000003ab/picture-32.jpg v1041>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.954+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml auth v1043 ap=1 s=22369 n(v0 rc2023-10-05T15:18:08.366145+0000 b22369 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@22},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003fb:[<0x100000003ab/article-63.xml v160>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000003fb:[<0x100000003ab/article-63.xml v1043>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.954+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg auth v1045 ap=1 s=51252 n(v0 rc2023-10-05T15:18:08.721142+0000 b51252 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@10},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b9:[<0x100000003ab/picture-48.jpg v556>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000004b9:[<0x100000003ab/picture-48.jpg v1045>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.954+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000799 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml auth v1047 ap=1 s=9767 n(v0 rc2023-10-05T15:18:10.782123+0000 b9767 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000799:[<0x100000003ab/comment-51.xml v948>,<0x100000003a7/blog-2 v7458>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000799:[<0x100000003ab/comment-51.xml v1047>,<0x100000003a7/blog-2 v13697>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.955+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-59.xml auth v1111 ap=1 s=23650 n(v0 rc2023-10-05T15:18:09.237137+0000 b23650 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a2:[<0x1000000051d/article-59.xml v220>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a2:[<0x1000000051d/article-59.xml v1111>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.956+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000736 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-56.xml auth v1115 ap=1 s=7963 n(v0 rc2023-10-05T15:18:10.543125+0000 b7963 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d1c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000736:[<0x1000000051d/comment-56.xml v969>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000736:[<0x1000000051d/comment-56.xml v1115>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.957+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-92.xml auth v1117 ap=1 s=11945 n(v0 rc2023-10-05T15:18:09.015139+0000 b11945 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d1cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000052b:[<0x1000000051d/article-92.xml v22>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000052b:[<0x1000000051d/article-92.xml v1117>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.958+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-18.xml auth v1123 ap=1 s=20810 n(v0 rc2023-10-05T15:18:10.213128+0000 b20810 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d34000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c2:[<0x1000000051d/article-18.xml v752>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006c2:[<0x1000000051d/article-18.xml v1123>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.960+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005dd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-51.xml auth v1129 ap=1 s=20546 n(v0 rc2023-10-05T15:18:09.407136+0000 b20546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d35080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005dd:[<0x1000000051d/article-51.xml v368>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005dd:[<0x1000000051d/article-51.xml v1129>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.321 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.961+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-27.xml auth v1133 ap=1 s=6720 n(v0 rc2023-10-05T15:18:10.184129+0000 b6720 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d35b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b9:[<0x1000000051d/article-27.xml v698>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b9:[<0x1000000051d/article-27.xml v1133>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.963+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-70.xml auth v1137 ap=1 s=27554 n(v0 rc2023-10-05T15:18:10.286128+0000 b27554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d36680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006d3:[<0x1000000051d/article-70.xml v806>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006d3:[<0x1000000051d/article-70.xml v1137>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.964+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-20.xml auth v1139 ap=1 s=5418 n(v0 rc2023-10-05T15:18:10.204128+0000 b5418 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d36c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c0:[<0x1000000051d/article-20.xml v740>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006c0:[<0x1000000051d/article-20.xml v1139>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.965+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-83.xml auth v1143 ap=1 s=13306 n(v0 rc2023-10-05T15:18:09.083139+0000 b13306 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000054f:[<0x1000000051d/article-83.xml v76>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000054f:[<0x1000000051d/article-83.xml v1143>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.966+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-61.xml auth v1145 ap=1 s=8938 n(v0 rc2023-10-05T15:18:09.224137+0000 b8938 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d4a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000059d:[<0x1000000051d/article-61.xml v208>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000059d:[<0x1000000051d/article-61.xml v1145>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.966+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-41.xml auth v1147 ap=1 s=23412 n(v0 rc2023-10-05T15:18:09.941131+0000 b23412 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d4a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006a1:[<0x1000000051d/article-41.xml v546>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006a1:[<0x1000000051d/article-41.xml v1147>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.967+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000698 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-45.xml auth v1149 ap=1 s=20296 n(v0 rc2023-10-05T15:18:09.905131+0000 b20296 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d4ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000698:[<0x1000000051d/article-45.xml v489>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000698:[<0x1000000051d/article-45.xml v1149>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.968+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000585 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-69.xml auth v1151 ap=1 s=9037 n(v0 rc2023-10-05T15:18:09.165138+0000 b9037 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d4b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000585:[<0x1000000051d/article-69.xml v160>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000585:[<0x1000000051d/article-69.xml v1151>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.969+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-31.xml auth v1155 ap=1 s=29772 n(v0 rc2023-10-05T15:18:10.173129+0000 b29772 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d4bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b5:[<0x1000000051d/article-31.xml v674>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b5:[<0x1000000051d/article-31.xml v1155>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.322 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.971+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-80.xml auth v1111 ap=1 s=30274 n(v0 rc2023-10-05T15:18:09.101139+0000 b30274 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000055c:[<0x1000000051d/article-80.xml v94>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000055c:[<0x1000000051d/article-80.xml v1111>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.975+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006db [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-9.xml auth v1119 ap=1 s=27062 n(v0 rc2023-10-05T15:18:10.316127+0000 b27062 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006db:[<0x1000000051d/article-9.xml v831>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006db:[<0x1000000051d/article-9.xml v1119>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.975+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-44.xml auth v1121 ap=1 s=11633 n(v0 rc2023-10-05T15:18:09.911131+0000 b11633 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000069a:[<0x1000000051d/article-44.xml v502>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000069a:[<0x1000000051d/article-44.xml v1121>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.977+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000591 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-65.xml auth v1123 ap=1 s=20108 n(v0 rc2023-10-05T15:18:09.194138+0000 b20108 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000591:[<0x1000000051d/article-65.xml v184>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000591:[<0x1000000051d/article-65.xml v1123>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.977+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000728 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-58.xml auth v1125 ap=1 s=5873 n(v0 rc2023-10-05T15:18:10.519125+0000 b5873 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000728:[<0x1000000051d/comment-58.xml v951>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000728:[<0x1000000051d/comment-58.xml v1125>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.978+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059a [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-62.xml auth v1127 ap=1 s=30158 n(v0 rc2023-10-05T15:18:09.217137+0000 b30158 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000059a:[<0x1000000051d/article-62.xml v202>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000059a:[<0x1000000051d/article-62.xml v1127>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.978+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-55.xml auth v1129 ap=1 s=3737 n(v0 rc2023-10-05T15:18:10.554125+0000 b3737 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000073c:[<0x1000000051d/comment-55.xml v977>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000073c:[<0x1000000051d/comment-55.xml v1129>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.979+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bc [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-24.xml auth v1131 ap=1 s=21891 n(v0 rc2023-10-05T15:18:10.193128+0000 b21891 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006bc:[<0x1000000051d/article-24.xml v716>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006bc:[<0x1000000051d/article-24.xml v1131>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.981+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000547 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-85.xml auth v1139 ap=1 s=29331 n(v0 rc2023-10-05T15:18:09.071139+0000 b29331 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000547:[<0x1000000051d/article-85.xml v64>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000547:[<0x1000000051d/article-85.xml v1139>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.983+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-88.xml auth v1141 ap=1 s=9919 n(v0 rc2023-10-05T15:18:09.053139+0000 b9919 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000053b:[<0x1000000051d/article-88.xml v46>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000053b:[<0x1000000051d/article-88.xml v1141>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.985+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-67.xml auth v1145 ap=1 s=24862 n(v0 rc2023-10-05T15:18:09.180138+0000 b24862 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000058b:[<0x1000000051d/article-67.xml v172>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000058b:[<0x1000000051d/article-67.xml v1145>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.323 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.988+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000705 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-3.xml auth v1151 ap=1 s=15214 n(v0 rc2023-10-05T15:18:10.454126+0000 b15214 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000705:[<0x1000000051d/article-3.xml v905>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000705:[<0x1000000051d/article-3.xml v1151>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.991+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-7.xml auth v1157 ap=1 s=21268 n(v0 rc2023-10-05T15:18:10.369127+0000 b21268 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006e9:[<0x1000000051d/article-7.xml v863>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006e9:[<0x1000000051d/article-7.xml v1157>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.992+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000748 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-42.jpg auth v1159 ap=1 s=23375 n(v0 rc2023-10-05T15:18:10.575125+0000 b23375 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309f0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000748:[<0x1000000051d/picture-42.jpg v993>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000748:[<0x1000000051d/picture-42.jpg v1159>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.996+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005bb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-55.xml auth v1096 ap=1 s=1748 n(v0 rc2023-10-05T15:18:09.314137+0000 b1748 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@20},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430937700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005bb:[<0x1000000051d/article-55.xml v282>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005bb:[<0x1000000051d/article-55.xml v1096>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.997+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-95.xml auth v1100 ap=1 s=2321 n(v0 rc2023-10-05T15:18:08.984140+0000 b2321 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430952580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000051f:[<0x1000000051d/article-95.xml v4>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000051f:[<0x1000000051d/article-95.xml v1100>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:21.998+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006df [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-8.xml auth v1102 ap=1 s=30645 n(v0 rc2023-10-05T15:18:10.331127+0000 b30645 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430952b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006df:[<0x1000000051d/article-8.xml v845>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006df:[<0x1000000051d/article-8.xml v1102>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.002+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000588 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-68.xml auth v1110 ap=1 s=10477 n(v0 rc2023-10-05T15:18:09.172138+0000 b10477 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430954100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000588:[<0x1000000051d/article-68.xml v166>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000588:[<0x1000000051d/article-68.xml v1110>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.003+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-70.xml auth v1112 ap=1 s=9022 n(v0 rc2023-10-05T15:18:10.298128+0000 b9022 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@5},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430954680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006d5:[<0x1000000051d/comment-70.xml v815>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006d5:[<0x1000000051d/comment-70.xml v1112>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.005+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000056c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-76.xml auth v1114 ap=1 s=15409 n(v0 rc2023-10-05T15:18:09.124138+0000 b15409 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430954c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000056c:[<0x1000000051d/article-76.xml v118>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000056c:[<0x1000000051d/article-76.xml v1114>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.324 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.007+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b2 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-32.xml auth v1120 ap=1 s=22334 n(v0 rc2023-10-05T15:18:10.163129+0000 b22334 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b2:[<0x1000000051d/article-32.xml v656>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b2:[<0x1000000051d/article-32.xml v1120>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.008+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d9 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-69.xml auth v1122 ap=1 s=6627 n(v0 rc2023-10-05T15:18:10.312127+0000 b6627 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@5},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006d9:[<0x1000000051d/comment-69.xml v827>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006d9:[<0x1000000051d/comment-69.xml v1122>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.009+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-21.xml auth v1124 ap=1 s=11754 n(v0 rc2023-10-05T15:18:10.200128+0000 b11754 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006bf:[<0x1000000051d/article-21.xml v734>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006bf:[<0x1000000051d/article-21.xml v1124>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.009+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-30.xml auth v1126 ap=1 s=2888 n(v0 rc2023-10-05T15:18:10.176129+0000 b2888 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b6:[<0x1000000051d/article-30.xml v680>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b6:[<0x1000000051d/article-30.xml v1126>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.010+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000523 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-94.xml auth v1128 ap=1 s=18744 n(v0 rc2023-10-05T15:18:08.995140+0000 b18744 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000523:[<0x1000000051d/article-94.xml v10>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000523:[<0x1000000051d/article-94.xml v1128>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.011+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006cb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-13.xml auth v1132 ap=1 s=31534 n(v0 rc2023-10-05T15:18:10.257128+0000 b31534 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006cb:[<0x1000000051d/article-13.xml v782>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006cb:[<0x1000000051d/article-13.xml v1132>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.012+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-64.xml auth v1134 ap=1 s=6205 n(v0 rc2023-10-05T15:18:10.414126+0000 b6205 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006f8:[<0x1000000051d/comment-64.xml v885>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006f8:[<0x1000000051d/comment-64.xml v1134>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.013+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-50.xml auth v1138 ap=1 s=32729 n(v0 rc2023-10-05T15:18:09.427136+0000 b32729 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e7:[<0x1000000051d/article-50.xml v394>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005e7:[<0x1000000051d/article-50.xml v1138>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.014+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-6.xml auth v1140 ap=1 s=25108 n(v0 rc2023-10-05T15:18:10.389127+0000 b25108 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143095f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006f1:[<0x1000000051d/article-6.xml v873>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006f1:[<0x1000000051d/article-6.xml v1140>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.015+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000712 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-2.xml auth v1142 ap=1 s=18531 n(v0 rc2023-10-05T15:18:10.480126+0000 b18531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143096c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000712:[<0x1000000051d/article-2.xml v923>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000712:[<0x1000000051d/article-2.xml v1142>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.325 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.016+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-67.xml auth v1146 ap=1 s=3655 n(v0 rc2023-10-05T15:18:10.338127+0000 b3655 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143096cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006e1:[<0x1000000051d/comment-67.xml v849>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006e1:[<0x1000000051d/comment-67.xml v1146>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.326 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.017+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000533 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-90.xml auth v1148 ap=1 s=21179 n(v0 rc2023-10-05T15:18:09.036139+0000 b21179 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143096d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000533:[<0x1000000051d/article-90.xml v34>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000533:[<0x1000000051d/article-90.xml v1148>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.328 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.023+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069d [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-43.xml auth v1120 ap=1 s=17352 n(v0 rc2023-10-05T15:18:09.922131+0000 b17352 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cf5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000069d:[<0x1000000051d/article-43.xml v521>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000069d:[<0x1000000051d/article-43.xml v1120>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.328 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.024+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-33.xml auth v1122 ap=1 s=9641 n(v0 rc2023-10-05T15:18:10.156129+0000 b9641 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430cf5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b0:[<0x1000000051d/article-33.xml v643>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b0:[<0x1000000051d/article-33.xml v1122>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.026+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ae [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-57.xml auth v1126 ap=1 s=19299 n(v0 rc2023-10-05T15:18:09.277137+0000 b19299 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d0c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ae:[<0x1000000051d/article-57.xml v248>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005ae:[<0x1000000051d/article-57.xml v1126>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.027+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-66.xml auth v1130 ap=1 s=5299 n(v0 rc2023-10-05T15:18:10.357127+0000 b5299 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d0d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006e5:[<0x1000000051d/comment-66.xml v857>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006e5:[<0x1000000051d/comment-66.xml v1130>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.029+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000560 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-79.xml auth v1134 ap=1 s=26481 n(v0 rc2023-10-05T15:18:09.107139+0000 b26481 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d0db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000560:[<0x1000000051d/article-79.xml v100>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000560:[<0x1000000051d/article-79.xml v1134>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.030+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005aa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-58.xml auth v1138 ap=1 s=6865 n(v0 rc2023-10-05T15:18:09.257137+0000 b6865 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d0e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005aa:[<0x1000000051d/article-58.xml v230>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005aa:[<0x1000000051d/article-58.xml v1138>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.031+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005cd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-53.xml auth v1140 ap=1 s=14820 n(v0 rc2023-10-05T15:18:09.365136+0000 b14820 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@19},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d0ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005cd:[<0x1000000051d/article-53.xml v330>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005cd:[<0x1000000051d/article-53.xml v1140>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.033+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-28.xml auth v1146 ap=1 s=20991 n(v0 rc2023-10-05T15:18:10.182129+0000 b20991 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d1a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b8:[<0x1000000051d/article-28.xml v692>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b8:[<0x1000000051d/article-28.xml v1146>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.034+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-52.xml auth v1150 ap=1 s=13433 n(v0 rc2023-10-05T15:18:09.385136+0000 b13433 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d1ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d3:[<0x1000000051d/article-52.xml v348>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005d3:[<0x1000000051d/article-52.xml v1150>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.035+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006cf [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-77.jpg auth v1152 ap=1 s=14761 n(v0 rc2023-10-05T15:18:10.274128+0000 b14761 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430d1b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006cf:[<0x1000000051d/picture-77.jpg v796>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006cf:[<0x1000000051d/picture-77.jpg v1152>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.038+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000752 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-53.xml auth v1110 ap=1 s=7177 n(v0 rc2023-10-05T15:18:10.594125+0000 b7177 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143096ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000752:[<0x1000000051d/comment-53.xml v1007>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000752:[<0x1000000051d/comment-53.xml v1110>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.329 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.040+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-5.xml auth v1116 ap=1 s=17952 n(v0 rc2023-10-05T15:18:10.407127+0000 b17952 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430980000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006f6:[<0x1000000051d/article-5.xml v881>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006f6:[<0x1000000051d/article-5.xml v1116>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.041+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ae [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-34.xml auth v1118 ap=1 s=2758 n(v0 rc2023-10-05T15:18:10.146129+0000 b2758 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430980580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ae:[<0x1000000051d/article-34.xml v628>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ae:[<0x1000000051d/article-34.xml v1118>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.043+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-57.xml auth v1124 ap=1 s=7170 n(v0 rc2023-10-05T15:18:10.526125+0000 b7170 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430981600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000072e:[<0x1000000051d/comment-57.xml v957>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000072e:[<0x1000000051d/comment-57.xml v1124>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.044+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000557 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-81.xml auth v1126 ap=1 s=24229 n(v0 rc2023-10-05T15:18:09.095139+0000 b24229 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430981b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000557:[<0x1000000051d/article-81.xml v88>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000557:[<0x1000000051d/article-81.xml v1126>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.044+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000564 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-78.xml auth v1128 ap=1 s=11740 n(v0 rc2023-10-05T15:18:09.113138+0000 b11740 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430982100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000564:[<0x1000000051d/article-78.xml v106>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000564:[<0x1000000051d/article-78.xml v1128>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.045+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-29.xml auth v1130 ap=1 s=26172 n(v0 rc2023-10-05T15:18:10.179129+0000 b26172 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430982680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b7:[<0x1000000051d/article-29.xml v686>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006b7:[<0x1000000051d/article-29.xml v1130>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.046+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a0 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-60.xml auth v1132 ap=1 s=18901 n(v0 rc2023-10-05T15:18:09.232137+0000 b18901 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430982c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a0:[<0x1000000051d/article-60.xml v214>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005a0:[<0x1000000051d/article-60.xml v1132>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.047+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000756 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-40.jpg auth v1134 ap=1 s=33034 n(v0 rc2023-10-05T15:18:10.599125+0000 b33034 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430983180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000756:[<0x1000000051d/picture-40.jpg v1011>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000756:[<0x1000000051d/picture-40.jpg v1134>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.048+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-61.xml auth v1136 ap=1 s=4836 n(v0 rc2023-10-05T15:18:10.475126+0000 b4836 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430983700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000070f:[<0x1000000051d/comment-61.xml v917>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000070f:[<0x1000000051d/comment-61.xml v1136>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.330 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.048+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006be [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-22.xml auth v1138 ap=1 s=5985 n(v0 rc2023-10-05T15:18:10.198128+0000 b5985 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430990000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006be:[<0x1000000051d/article-22.xml v728>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006be:[<0x1000000051d/article-22.xml v1138>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.050+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006dd [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-68.xml auth v1142 ap=1 s=2242 n(v0 rc2023-10-05T15:18:10.322127+0000 b2242 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430990b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006dd:[<0x1000000051d/comment-68.xml v839>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006dd:[<0x1000000051d/comment-68.xml v1142>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.053+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ca [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-14.xml auth v1098 ap=1 s=22125 n(v0 rc2023-10-05T15:18:10.248128+0000 b22125 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430992100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ca:[<0x1000000051d/article-14.xml v776>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ca:[<0x1000000051d/article-14.xml v1098>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.053+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000724 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-45.jpg auth v1100 ap=1 s=18805 n(v0 rc2023-10-05T15:18:10.513126+0000 b18805 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430992680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000724:[<0x1000000051d/picture-45.jpg v947>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000724:[<0x1000000051d/picture-45.jpg v1100>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.054+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-41.jpg auth v1102 ap=1 s=21484 n(v0 rc2023-10-05T15:18:10.586125+0000 b21484 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430992c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000074e:[<0x1000000051d/picture-41.jpg v1001>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000074e:[<0x1000000051d/picture-41.jpg v1102>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.055+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-84.xml auth v1104 ap=1 s=26354 n(v0 rc2023-10-05T15:18:09.077139+0000 b26354 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430993180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000054b:[<0x1000000051d/article-84.xml v70>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000054b:[<0x1000000051d/article-84.xml v1104>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.056+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000708 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-62.xml auth v1106 ap=1 s=4671 n(v0 rc2023-10-05T15:18:10.459126+0000 b4671 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430993700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000708:[<0x1000000051d/comment-62.xml v909>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000708:[<0x1000000051d/comment-62.xml v1106>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.056+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000696 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-46.xml auth v1108 ap=1 s=4707 n(v0 rc2023-10-05T15:18:09.895131+0000 b4707 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000696:[<0x1000000051d/article-46.xml v477>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000696:[<0x1000000051d/article-46.xml v1108>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.057+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-91.xml auth v1110 ap=1 s=13683 n(v0 rc2023-10-05T15:18:09.026139+0000 b13683 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000052f:[<0x1000000051d/article-91.xml v28>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000052f:[<0x1000000051d/article-91.xml v1110>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.058+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000692 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-47.xml auth v1112 ap=1 s=31819 n(v0 rc2023-10-05T15:18:09.879131+0000 b31819 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000692:[<0x1000000051d/article-47.xml v453>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000692:[<0x1000000051d/article-47.xml v1112>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.331 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.059+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-71.xml auth v1114 ap=1 s=11548 n(v0 rc2023-10-05T15:18:09.155138+0000 b11548 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000057f:[<0x1000000051d/article-71.xml v148>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000057f:[<0x1000000051d/article-71.xml v1114>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.061+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-11.xml auth v1118 ap=1 s=9632 n(v0 rc2023-10-05T15:18:10.282128+0000 b9632 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006d1:[<0x1000000051d/article-11.xml v802>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006d1:[<0x1000000051d/article-11.xml v1118>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.061+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071b [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-59.xml auth v1120 ap=1 s=6756 n(v0 rc2023-10-05T15:18:10.497126+0000 b6756 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000071b:[<0x1000000051d/comment-59.xml v935>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000071b:[<0x1000000051d/comment-59.xml v1120>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.062+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c5 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-16.xml auth v1122 ap=1 s=23308 n(v0 rc2023-10-05T15:18:10.229128+0000 b23308 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c5:[<0x1000000051d/article-16.xml v764>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006c5:[<0x1000000051d/article-16.xml v1122>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.063+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-54.xml auth v1124 ap=1 s=26914 n(v0 rc2023-10-05T15:18:09.339136+0000 b26914 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c4:[<0x1000000051d/article-54.xml v306>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005c4:[<0x1000000051d/article-54.xml v1124>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.063+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ba [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-26.xml auth v1126 ap=1 s=21327 n(v0 rc2023-10-05T15:18:10.187129+0000 b21327 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ba:[<0x1000000051d/article-26.xml v704>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ba:[<0x1000000051d/article-26.xml v1126>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.064+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000527 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-93.xml auth v1130 ap=1 s=28667 n(v0 rc2023-10-05T15:18:09.005139+0000 b28667 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000527:[<0x1000000051d/article-93.xml v16>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000527:[<0x1000000051d/article-93.xml v1130>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.065+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-10.xml auth v1132 ap=1 s=22051 n(v0 rc2023-10-05T15:18:10.305127+0000 b22051 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006d7:[<0x1000000051d/article-10.xml v819>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006d7:[<0x1000000051d/article-10.xml v1132>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.067+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000732 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-44.jpg auth v1136 ap=1 s=51952 n(v0 rc2023-10-05T15:18:10.537125+0000 b51952 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000732:[<0x1000000051d/picture-44.jpg v965>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000732:[<0x1000000051d/picture-44.jpg v1136>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.332 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.068+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-48.xml auth v1140 ap=1 s=19037 n(v0 rc2023-10-05T15:18:09.455135+0000 b19037 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f3:[<0x1000000051d/article-48.xml v430>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000005f3:[<0x1000000051d/article-48.xml v1140>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.069+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000700 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-4.xml auth v1144 ap=1 s=7506 n(v0 rc2023-10-05T15:18:10.433126+0000 b7506 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000700:[<0x1000000051d/article-4.xml v893>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000700:[<0x1000000051d/article-4.xml v1144>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.070+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bb [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-25.xml auth v1146 ap=1 s=9588 n(v0 rc2023-10-05T15:18:10.190129+0000 b9588 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006bb:[<0x1000000051d/article-25.xml v710>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006bb:[<0x1000000051d/article-25.xml v1146>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.071+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a6 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-38.xml auth v1148 ap=1 s=22630 n(v0 rc2023-10-05T15:18:09.959131+0000 b22630 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309b9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006a6:[<0x1000000051d/article-38.xml v576>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006a6:[<0x1000000051d/article-38.xml v1148>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.072+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057c [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-72.xml auth v1111 ap=1 s=17835 n(v0 rc2023-10-05T15:18:09.148138+0000 b17835 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56143029f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000057c:[<0x1000000051d/article-72.xml v142>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000057c:[<0x1000000051d/article-72.xml v1111>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.074+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ab [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-35.xml auth v1089 ap=1 s=3522 n(v0 rc2023-10-05T15:18:09.982130+0000 b3522 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ab:[<0x1000000051d/article-35.xml v610>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ab:[<0x1000000051d/article-35.xml v1089>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.074+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000716 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-60.xml auth v1091 ap=1 s=6744 n(v0 rc2023-10-05T15:18:10.486126+0000 b6744 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000716:[<0x1000000051d/comment-60.xml v927>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000716:[<0x1000000051d/comment-60.xml v1091>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.075+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000543 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-86.xml auth v1093 ap=1 s=30639 n(v0 rc2023-10-05T15:18:09.065139+0000 b30639 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000543:[<0x1000000051d/article-86.xml v58>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000543:[<0x1000000051d/article-86.xml v1093>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.076+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-40.xml auth v1097 ap=1 s=18243 n(v0 rc2023-10-05T15:18:09.946131+0000 b18243 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006a3:[<0x1000000051d/article-40.xml v557>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006a3:[<0x1000000051d/article-40.xml v1097>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.077+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000553 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-82.xml auth v1101 ap=1 s=30072 n(v0 rc2023-10-05T15:18:09.089139+0000 b30072 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000553:[<0x1000000051d/article-82.xml v82>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000553:[<0x1000000051d/article-82.xml v1101>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.333 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.078+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c7 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-15.xml auth v1103 ap=1 s=31204 n(v0 rc2023-10-05T15:18:10.235128+0000 b31204 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614301ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c7:[<0x1000000051d/article-15.xml v770>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006c7:[<0x1000000051d/article-15.xml v1103>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.081+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-43.jpg auth v1117 ap=1 s=38394 n(v0 rc2023-10-05T15:18:10.559125+0000 b38394 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430934580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000073f:[<0x1000000051d/picture-43.jpg v981>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000073f:[<0x1000000051d/picture-43.jpg v1117>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.082+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c1 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-19.xml auth v1119 ap=1 s=11050 n(v0 rc2023-10-05T15:18:10.211128+0000 b11050 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430934b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c1:[<0x1000000051d/article-19.xml v746>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006c1:[<0x1000000051d/article-19.xml v1119>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.083+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000537 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-89.xml auth v1123 ap=1 s=7044 n(v0 rc2023-10-05T15:18:09.047139+0000 b7044 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430935600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000537:[<0x1000000051d/article-89.xml v40>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000537:[<0x1000000051d/article-89.xml v1123>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.084+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000702 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-63.xml auth v1127 ap=1 s=4854 n(v0 rc2023-10-05T15:18:10.448126+0000 b4854 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430936100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000702:[<0x1000000051d/comment-63.xml v899>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000702:[<0x1000000051d/comment-63.xml v1127>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.085+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000745 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-54.xml auth v1129 ap=1 s=6261 n(v0 rc2023-10-05T15:18:10.570125+0000 b6261 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430936680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000745:[<0x1000000051d/comment-54.xml v989>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000745:[<0x1000000051d/comment-54.xml v1129>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.086+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-42.xml auth v1131 ap=1 s=27026 n(v0 rc2023-10-05T15:18:09.934131+0000 b27026 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430936c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000069f:[<0x1000000051d/article-42.xml v538>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000069f:[<0x1000000051d/article-42.xml v1131>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.087+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000594 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-64.xml auth v1111 ap=1 s=17660 n(v0 rc2023-10-05T15:18:09.202138+0000 b17660 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309f2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000594:[<0x1000000051d/article-64.xml v190>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000594:[<0x1000000051d/article-64.xml v1111>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.087+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053f [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-87.xml auth v1113 ap=1 s=14933 n(v0 rc2023-10-05T15:18:09.060139+0000 b14933 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5614309f2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000053f:[<0x1000000051d/article-87.xml v52>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000053f:[<0x1000000051d/article-87.xml v1113>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.090+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000570 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-75.xml auth v1121 ap=1 s=32476 n(v0 rc2023-10-05T15:18:09.130138+0000 b32476 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a00000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000570:[<0x1000000051d/article-75.xml v124>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000570:[<0x1000000051d/article-75.xml v1121>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.334 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.090+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a8 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-37.xml auth v1123 ap=1 s=6088 n(v0 rc2023-10-05T15:18:09.966131+0000 b6088 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a00580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006a8:[<0x1000000051d/article-37.xml v589>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006a8:[<0x1000000051d/article-37.xml v1123>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.091+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000578 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-73.xml auth v1127 ap=1 s=21424 n(v0 rc2023-10-05T15:18:09.141138+0000 b21424 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a01080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000578:[<0x1000000051d/article-73.xml v136>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000578:[<0x1000000051d/article-73.xml v1127>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.092+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a4 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-39.xml auth v1129 ap=1 s=31213 n(v0 rc2023-10-05T15:18:09.953131+0000 b31213 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a01600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006a4:[<0x1000000051d/article-39.xml v565>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006a4:[<0x1000000051d/article-39.xml v1129>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.092+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006aa [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-36.xml auth v1131 ap=1 s=27123 n(v0 rc2023-10-05T15:18:09.976130+0000 b27123 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a01b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006aa:[<0x1000000051d/article-36.xml v602>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006aa:[<0x1000000051d/article-36.xml v1131>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.093+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ce [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-12.xml auth v1133 ap=1 s=18515 n(v0 rc2023-10-05T15:18:10.262128+0000 b18515 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a02100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ce:[<0x1000000051d/article-12.xml v788>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ce:[<0x1000000051d/article-12.xml v1133>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.093+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-1.xml auth v1135 ap=1 s=21490 n(v0 rc2023-10-05T15:18:10.502126+0000 b21490 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a02680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000071e:[<0x1000000051d/article-1.xml v939>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000071e:[<0x1000000051d/article-1.xml v1135>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.096+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058e [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-66.xml auth v1145 ap=1 s=23833 n(v0 rc2023-10-05T15:18:09.187138+0000 b23833 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000058e:[<0x1000000051d/article-66.xml v178>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x1000000058e:[<0x1000000051d/article-66.xml v1145>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.097+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000568 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-77.xml auth v1149 ap=1 s=15779 n(v0 rc2023-10-05T15:18:09.118138+0000 b15779 1=1+0) (ifile excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsLsXsFsxcrwb/pFscr@2},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a0f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000568:[<0x1000000051d/article-77.xml v112>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000568:[<0x1000000051d/article-77.xml v1149>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.099+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ed [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-65.xml auth v1157 ap=1 s=7119 n(v0 rc2023-10-05T15:18:10.382127+0000 b7119 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ed:[<0x1000000051d/comment-65.xml v869>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006ed:[<0x1000000051d/comment-65.xml v1157>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.100+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c3 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-17.xml auth v1161 ap=1 s=31517 n(v0 rc2023-10-05T15:18:10.216128+0000 b31517 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=15483 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c3:[<0x1000000051d/article-17.xml v758>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x100000006c3:[<0x1000000051d/article-17.xml v1161>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:18:22.101+0000 7fb559774700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000597 [4,head] /volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-63.xml auth v1165 ap=1 s=15395 n(v0 rc2023-10-05T15:18:09.209138+0000 b15395 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15483=0-4194304@3} caps={15483=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15483 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561430a26000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000597:[<0x1000000051d/article-63.xml v196>,<0x100000003a7/blog-3 v6430>,<0x10000000208/blogtest_in v306>,<0x10000000201/src v1743>,<0x10000000006/blogbench-1.0 v1477>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v28>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v42>,<0x10000000001/sv_1 v66>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[3]","memoryvalue":"(4)0x10000000597:[<0x1000000051d/article-63.xml v1165>,<0x100000003a7/blog-3 v13711>,<0x10000000208/blogtest_in v339>,<0x10000000201/src v1754>,<0x10000000006/blogbench-1.0 v1485>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf v44>,<0x10000000001/sv_1 v36>,<0x10000000000/_nogroup v29>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-05T15:18:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub queued for path: / 2023-10-05T15:18:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000427 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-88.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000476 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000418 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000046c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-86.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-81.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000424 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000040c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-65.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.587 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-69.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000421 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000400 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-62.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000430 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000050b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000415 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-70.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-71.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-63.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000442 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-84.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000487 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-79.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000043f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000406 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.590 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-66.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-80.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000490 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004bd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000412 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000042d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.591 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000436 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-72.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000409 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-73.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000493 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-75.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000466 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.593 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000044e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.593 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000439 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.593 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000049c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.593 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000448 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.593 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000472 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.593 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000041e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000454 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000041b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-67.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-90.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-74.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-76.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000045a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000042a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.595 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000782 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000787 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.596 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000794 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000079f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000078b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000815 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.597 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000810 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007bd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000080c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007cc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007d2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.599 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.600 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000807 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.600 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.600 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.600 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000797 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.600 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.600 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000803 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000791 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000079b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.601 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.602 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.602 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.602 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.602 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.602 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.602 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000811 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000057a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000581 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000059c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000056a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.606 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000584 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.606 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000590 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.606 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.606 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.606 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.606 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000587 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000080d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.607 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000566 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000059f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000572 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000055e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000576 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000596 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000058a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000704 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000706 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.609 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.610 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000562 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.610 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.610 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000808 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.610 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.610 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000599 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.610 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.611 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.611 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.611 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000593 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.611 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.611 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.611 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000055a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000402 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000592 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000583 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.612 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000580 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000042f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000049a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000742 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000540 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000076a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.613 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004af (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.614 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000058f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.614 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.614 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000045f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.614 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000044d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.614 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.614 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000048e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000059e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000059b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000776 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000453 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000714 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000055d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000056d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000548 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000524 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000530 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:22.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000414 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000569 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000550 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000050c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ea (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000565 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000048b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000491 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000558 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000411 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000459 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000488 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000072d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.621 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000040b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.622 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000408 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.622 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.622 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000497 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.622 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000429 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.622 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000506 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.622 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000515 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.623 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000758 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.623 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.623 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.623 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.623 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000485 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.623 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000494 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000438 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000571 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.624 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000528 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000447 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000441 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000575 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.625 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.626 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.626 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000041a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.626 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000049d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.626 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000058c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.626 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.626 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000512 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.627 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.627 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000595 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.627 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000051b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.627 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000043e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.627 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.627 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000469 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000579 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000482 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000463 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000554 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000053c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000520 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000057d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.629 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000045d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.630 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000534 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.630 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.630 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000046b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.630 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000561 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.630 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000465 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000047f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000503 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000544 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000500 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.631 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000589 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ea (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000050f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000793 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000080f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.635 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.636 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.637 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.638 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.638 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.638 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.638 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.638 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.638 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.639 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.640 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: active paths [/] 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000614 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000744 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000072c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000605 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000063d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000729 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000061c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.644 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000661 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-82.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000769 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000690 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000076f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000665 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-78.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000609 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000656 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-93.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.645 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000063b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000740 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-89.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000612 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000622 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000060a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.646 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000761 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000630 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000757 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000753 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000772 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.647 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000646 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000660 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-83.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000623 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000763 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000060e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000611 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000637 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.648 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000657 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-92.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000060c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000068e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000731 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000065e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-85.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000064c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000711 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000067a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000648 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000689 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000066f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000068c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000618 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000070e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000647 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000060b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000682 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000603 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000075b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000065b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-88.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000709 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000062f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000654 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-95.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000063a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000631 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000642 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000061d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000649 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000064d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000067d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.653 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000617 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.654 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000065d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-86.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.654 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000653 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-96.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.654 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000655 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-94.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.654 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000624 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.654 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000062e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.654 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000662 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-81.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000766 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000681 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000679 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000616 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000672 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000600 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.655 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000615 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000061a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000633 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000061b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000666 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000675 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000685 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000076c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000067c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000074d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000066d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-70.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000064a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.657 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000062d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.658 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.658 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000650 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-99.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.658 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000601 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.658 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-71.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.658 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000632 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.658 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000613 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000674 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000068b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000639 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000065f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-84.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000061e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.659 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000717 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.660 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000664 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-79.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.660 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000641 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.660 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000686 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.660 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000068a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.660 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.660 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000677 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000621 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000671 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000663 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-80.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000620 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000658 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-91.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000071a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000644 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.662 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-97.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.662 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000063f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.662 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000619 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.662 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000635 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.662 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000073a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000067b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000645 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000749 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000687 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000061f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000064b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000636 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000066b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-72.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000678 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000629 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000607 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000066a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-73.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000071f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000062c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000668 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-75.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000064f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-100.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000627 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000640 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000651 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-98.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000068f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000688 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000063c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000723 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000625 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000068d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000060f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000604 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000703 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000606 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000628 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000062b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000067f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000643 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000064e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000067e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000670 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000659 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-90.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000060d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000737 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000602 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000669 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-74.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000638 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000063e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000667 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-76.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000610 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000683 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.669 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000407 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000525 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000789 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000513 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000047b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000510 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000467 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000549 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.670 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000551 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000477 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000521 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.671 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000401 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.672 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000043d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.672 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000431 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.672 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.672 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.672 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000053d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.672 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000045b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000535 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000813 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000755 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000531 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.673 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000555 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.674 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000495 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.674 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000434 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.674 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000541 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.674 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.674 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000780 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.674 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000078c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000046f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000743 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000516 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000501 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000049b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000805 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000413 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000498 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.678 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000075a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000539 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000458 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000071d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000075f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000475 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000045e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000747 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000489 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000076e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000751 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000422 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000049e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000765 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000410 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000080a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000437 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000455 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000545 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000073e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000040d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000795 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000768 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000040a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000419 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000464 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000041c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000719 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000727 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000054d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000792 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000715 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000052d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000452 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000784 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000461 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000404 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000777 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000473 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000762 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000425 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000072b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000504 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000773 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000042e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000507 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000048f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000077d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000480 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000739 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000416 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000046a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000051c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000492 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000529 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000079c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000428 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000046d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000446 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000050a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000044f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000074c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000077a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000735 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000440 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000483 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000730 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000070d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000479 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000050d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000722 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000770 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000078f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000043a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:22 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000080e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.718 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub queued for path: / 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000427 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-88.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000476 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000418 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000046c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.719 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-86.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-81.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000424 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000040c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-65.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-69.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000421 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000400 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-62.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000430 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.720 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000050b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000415 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-70.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-71.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-63.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000442 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-84.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000487 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-79.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.721 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000043f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000406 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-66.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-80.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000490 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004bd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000412 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000042d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000436 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.722 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-72.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000409 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-73.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000493 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-75.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000466 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000044e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000439 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000049c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000448 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000472 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000041e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.723 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000454 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000041b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-67.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-90.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-74.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-76.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000045a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000042a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.724 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000782 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000787 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000794 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000079f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000078b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000815 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000810 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007bd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000080c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007cc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007d2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000807 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000797 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000803 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000791 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000079b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000811 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000057a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000581 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000059c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000056a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000584 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000590 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000587 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000080d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000566 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000059f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000572 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000055e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000576 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000596 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000058a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000704 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000706 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.732 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000562 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000808 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000599 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000593 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.733 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000055a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000402 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000592 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000583 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000580 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000042f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000049a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000742 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000540 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000076a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004af (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000058f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000045f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000044d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000048e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000059e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.735 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000059b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000776 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000453 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000714 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000055d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000056d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000548 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000524 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000530 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000414 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000569 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000550 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000050c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ea (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000565 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000048b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000491 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.738 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000558 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000411 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.739 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000459 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000488 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000072d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000040b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000408 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000497 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000429 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000506 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000515 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000758 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000485 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000494 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000438 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.743 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000571 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.743 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.743 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.743 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000528 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.743 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.743 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000447 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000441 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000575 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000041a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000049d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000058c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000512 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000595 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000051b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000043e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000469 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000579 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000482 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000463 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000554 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000053c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000520 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000057d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000045d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000534 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000046b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000561 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000465 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000047f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000503 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000544 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000500 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000589 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ea (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000050f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000793 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000080f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.750 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.751 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.752 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.753 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.755 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: active paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.757 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000614 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000744 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000072c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000605 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000063d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000729 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000061c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000661 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-82.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000769 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000690 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000076f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000665 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-78.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.758 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000609 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000656 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-93.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000063b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000740 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-89.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000612 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000622 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000060a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000761 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000630 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000757 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.759 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000753 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000772 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000646 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000660 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-83.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000623 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000763 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000060e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.761 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000611 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000637 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000657 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-92.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000060c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000068e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000731 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000065e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-85.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000064c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000711 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.762 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000067a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000648 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000689 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000066f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000068c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000618 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000070e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000647 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000060b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000682 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000603 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.763 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000075b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000065b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-88.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000709 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000062f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000654 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-95.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000063a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000631 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000642 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000061d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000649 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000064d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000067d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000617 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000065d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-86.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000653 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-96.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000655 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-94.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000624 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000062e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000662 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-81.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000766 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000681 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000679 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000616 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000672 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000600 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000615 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000061a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000633 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000061b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000666 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.766 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000675 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000685 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000076c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000067c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000074d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000066d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-70.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000064a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000062d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000650 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-99.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000601 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-71.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.767 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000632 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000613 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000674 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000068b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000639 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000065f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-84.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000061e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000717 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000664 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-79.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000641 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000686 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.768 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000068a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000677 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000621 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000671 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000663 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-80.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000620 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000658 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-91.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000071a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000644 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-97.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000063f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000619 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000635 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000073a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000067b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000645 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000749 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000687 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000061f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000064b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000636 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000066b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-72.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000678 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000629 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000607 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000066a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-73.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000071f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000062c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000668 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-75.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000064f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-100.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000627 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.771 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000640 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000651 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-98.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000068f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000688 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000063c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000723 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000625 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000068d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000060f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000604 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000703 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000606 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000628 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000062b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000067f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000643 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000064e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000067e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000670 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000659 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-90.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000060d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000737 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000602 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000669 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-74.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000638 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000063e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000667 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-76.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000610 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000683 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000407 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000525 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000789 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000513 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000047b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000510 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000467 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000549 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000551 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000477 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000521 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000401 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000043d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000431 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000053d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000045b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000535 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000813 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000755 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000531 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000555 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000495 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000434 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000541 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000780 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000078c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000046f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000743 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000516 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000501 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000049b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000805 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000413 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000498 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000075a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000539 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000458 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000071d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000075f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000475 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000045e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000747 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.780 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000489 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000076e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000751 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000422 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000049e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000765 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000410 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000080a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000437 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000455 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000545 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000073e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000040d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000795 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000768 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.782 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000040a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000419 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000464 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000041c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000719 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000727 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000054d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.783 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000792 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000715 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000052d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000452 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000784 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000461 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000404 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.784 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000777 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000473 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000762 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000425 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000072b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000504 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000773 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000042e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000507 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000048f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000077d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000480 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000739 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000416 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000046a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000051c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000492 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000529 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000079c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000428 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000046d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000446 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.787 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000050a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000044f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000074c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000077a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000735 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000440 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000483 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000730 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000070d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000479 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000050d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000722 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.789 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000770 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000078f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000043a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:22 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000080e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub queued for path: / 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000427 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-88.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.791 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000476 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000418 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000046c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-86.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-81.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000424 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000040c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-65.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-69.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000421 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.792 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000400 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-62.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000430 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000050b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000415 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-70.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-71.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-63.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000442 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-84.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000487 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-79.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000043f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000406 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-66.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-80.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000490 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004bd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000412 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000042d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.794 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000436 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-72.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000409 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-73.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000493 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-75.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000466 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000044e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000439 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000049c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000448 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000472 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.795 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000041e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000454 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000041b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-67.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-90.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-74.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-76.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000045a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000042a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000782 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000787 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000794 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000079f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000078b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000815 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000810 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007bd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000080c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007cc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007d2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000807 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000797 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000803 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000791 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000079b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000811 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000057a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000581 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000059c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000056a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000584 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000590 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000587 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000080d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000566 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000059f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000572 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000055e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000576 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000596 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000058a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000704 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000706 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.804 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000562 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000808 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000599 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000593 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000055a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000402 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000592 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000583 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000580 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000042f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000049a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000742 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.806 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000540 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000076a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004af (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000058f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000045f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000044d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000048e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000059e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000059b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.807 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000776 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000453 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000714 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000055d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.808 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000056d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000548 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000524 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000530 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000414 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000569 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000550 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000050c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ea (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000565 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000048b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000491 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.810 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000558 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000411 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000459 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000488 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000072d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000040b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000408 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000497 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000429 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000506 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000515 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000758 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000485 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000494 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000438 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.812 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000571 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000528 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000447 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000441 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000575 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000041a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.813 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000049d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000058c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000512 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000595 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000051b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000043e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000469 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.814 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000579 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000482 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000463 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000554 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000053c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000520 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000057d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000045d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000534 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000046b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000561 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000465 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000047f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000503 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000544 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000500 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.816 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000589 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ea (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000050f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000793 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000080f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.817 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.818 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.820 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.821 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.822 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: active paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000614 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000744 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000072c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.825 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000605 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000063d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000729 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000061c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000661 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-82.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000769 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000690 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000076f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000665 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-78.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000609 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.826 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000656 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-93.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000063b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000740 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-89.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005fc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000612 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000622 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000060a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000761 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000630 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000757 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000753 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000772 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000646 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000660 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-83.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000623 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000763 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000060e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000611 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000637 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ff (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005fa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000657 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-92.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000060c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000068e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000731 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000065e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-85.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000064c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000711 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006eb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000067a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000648 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000689 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.829 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000066f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000068c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000618 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000070e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000647 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000060b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000682 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000603 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000075b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000065b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-88.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000709 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000062f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000654 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-95.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000063a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000631 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000642 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000061d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000649 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000064d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000067d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000617 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000065d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-86.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000653 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-96.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000655 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-94.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000624 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000062e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000662 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-81.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000766 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000681 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000679 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000616 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000672 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000600 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.832 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000615 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000061a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000633 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000061b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000666 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000675 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000685 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000076c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000067c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000074d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000066d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-70.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000064a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000062d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000650 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-99.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000601 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-71.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000632 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000613 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000674 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000068b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000639 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.834 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000065f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-84.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000061e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000717 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000664 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-79.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000641 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000686 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000068a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000677 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000621 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000671 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.835 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000663 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-80.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000620 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000658 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-91.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000071a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000644 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-97.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000063f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000619 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000635 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000073a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000067b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.836 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000645 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000749 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000687 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000061f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000064b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000636 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000066b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-72.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000678 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000629 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000607 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000066a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-73.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000071f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000062c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000668 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-75.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000064f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-100.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000627 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005fd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000640 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000651 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-98.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.838 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000068f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000688 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000063c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000723 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000625 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000068d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000060f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000604 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000703 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000606 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000628 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000062b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.839 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000067f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000643 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000064e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000067e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000670 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000659 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-90.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000060d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000737 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000602 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000669 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-74.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000638 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.840 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000063e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000667 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-76.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000610 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000683 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000407 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000525 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000789 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000513 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000047b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000510 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007e8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000467 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000549 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000551 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000477 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000521 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000401 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000043d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000431 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000053d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000045b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000535 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000813 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000755 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000531 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.843 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000555 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000495 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000434 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000541 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000780 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000078c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000046f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.844 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000743 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004da (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000516 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000501 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000049b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000805 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000413 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ac (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000498 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ec (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000075a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000539 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000458 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000071d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000075f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000475 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000045e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000747 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000489 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000076e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000751 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000422 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000049e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000765 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000410 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000080a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.848 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007b1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000437 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000455 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000545 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000073e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000040d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000795 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000768 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.849 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000040a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000419 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000464 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000041c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000719 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000727 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.850 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000054d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000792 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000715 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000052d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000452 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007d0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000784 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006f9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000461 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.851 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000404 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000777 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000473 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007c6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000762 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006e6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000425 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000072b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000504 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.852 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000773 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000042e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000507 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000048f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000077d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000480 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000739 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000416 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000046a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.853 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000051c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000492 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000529 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000079c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000428 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000046d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000446 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.854 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003e0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000050a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000044f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000074c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000077a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000735 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005b3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000440 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ef (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ee (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000483 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000730 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000070d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004c8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000479 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000050d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.856 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000722 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000770 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000078f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000043a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003b4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:22.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:22 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000080e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:18:23.342+0000 7fc4d5ab8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: pgmap v51: 129 pgs: 129 active+clean; 42 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 590 op/s 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000449 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000443 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000044c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000048c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000519 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000007b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000076b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000471 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000047d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000003fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000004b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000799 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000736 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000052b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-92.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000054f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000059d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000698 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000585 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000069a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000591 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000728 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000059a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000073c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000547 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000053b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000058b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000705 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000748 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000051f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-95.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000588 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006d5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000056c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000523 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-94.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000712 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006e1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000533 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-90.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000069d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000560 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000752 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000072e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000557 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000564 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000756 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000070f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000724 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000074e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000054b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000708 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000696 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.678 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000052f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-91.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000692 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000057f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000071b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000527 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-93.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000732 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000005f3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000700 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000057c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000716 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000543 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000553 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000073f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000537 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000702 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000745 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000069f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000594 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000053f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000570 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000578 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000071e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x1000000058e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000568 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x100000006c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: Scrub error on inode 0x10000000597 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:23 smithi060 ceph-mon[99238]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: pgmap v51: 129 pgs: 129 active+clean; 42 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 590 op/s 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000449 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000443 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000044c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000048c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000519 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000007b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000076b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000471 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000047d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000003fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000004b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000799 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000736 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000052b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-92.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000054f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000059d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000698 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000585 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000069a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000591 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000728 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000059a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000073c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000547 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000053b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000058b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000705 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000748 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000051f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-95.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000588 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006d5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000056c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000523 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-94.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000712 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006e1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000533 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-90.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000069d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000560 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000752 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000072e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000557 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000564 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000756 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000070f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000724 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000074e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000054b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000708 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000696 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000052f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-91.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000692 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000057f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000071b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000527 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-93.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000732 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000005f3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000700 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000057c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000716 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000543 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000553 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000073f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000537 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000702 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000745 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000069f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000594 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000053f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000570 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000578 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000071e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x1000000058e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.698 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000568 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.699 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.699 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x100000006c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.699 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: Scrub error on inode 0x10000000597 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.699 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:23 smithi092 ceph-mon[102944]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:23.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: pgmap v51: 129 pgs: 129 active+clean; 42 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 590 op/s 2023-10-05T15:18:23.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007f7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000449 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000443 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000044c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000048c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004ad (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007e4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003f2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000519 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006fe (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000007b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000076b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000471 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000047d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000003fb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000004b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000799 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000736 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-56.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000052b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-92.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006c2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-18.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-51.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-27.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006c0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-20.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000054f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-83.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000059d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006a1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-41.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000698 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-45.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000585 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-31.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-80.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006db (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-9.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000069a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-44.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000591 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000728 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000059a (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000073c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006bc (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-24.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000547 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-85.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000053b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-88.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000058b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000705 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-3.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006e9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-7.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000748 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-42.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-55.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000051f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-95.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006df (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-8.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000588 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006d5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-70.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000056c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-76.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b2 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-32.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006d9 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-69.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006bf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-21.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-30.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000523 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-94.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006cb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-13.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006f8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005e7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-50.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006f1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-6.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000712 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-2.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006e1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-67.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000533 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-90.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000069d (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-43.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-33.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006e5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000560 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-79.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-58.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005cd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-28.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005d3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-52.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006cf (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-77.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000752 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-53.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006f6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-5.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ae (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-34.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000072e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-57.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000557 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-81.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000564 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-78.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006b7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-29.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000756 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-40.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000070f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-61.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006be (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-22.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006dd (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-68.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ca (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-14.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000724 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-45.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000074e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-41.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000054b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-84.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000708 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-62.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000696 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-46.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000052f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-91.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000692 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-47.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000057f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-71.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006d1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-11.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000071b (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-59.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006c5 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-16.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005c4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ba (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-26.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000527 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-93.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006d7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-10.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000732 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-44.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000005f3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-48.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000700 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-4.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006bb (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-25.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006a6 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-38.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000057c (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-72.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ab (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-35.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000716 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-60.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000543 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-86.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006a3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-40.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000553 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-82.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006c7 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-15.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000073f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-43.jpg) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.842 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006c1 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-19.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000537 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-89.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000702 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000745 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-54.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000069f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-42.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000594 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-64.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000053f (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-87.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000570 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-75.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006a8 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-37.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000578 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-73.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006a4 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-39.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006aa (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-36.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ce (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-12.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000071e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-1.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x1000000058e (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-66.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000568 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-77.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006ed (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-65.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x100000006c3 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-17.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: Scrub error on inode 0x10000000597 (/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-63.xml) see mds.i log and `damage ls` output for details 2023-10-05T15:18:23.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:23 smithi135 ceph-mon[103360]: scrub summary: idle+waiting paths [/] 2023-10-05T15:18:24.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:24 smithi060 ceph-mon[99238]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-05T15:18:24.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:24 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:active 2023-10-05T15:18:24.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:24 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:24 smithi092 ceph-mon[102944]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-05T15:18:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:24 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:active 2023-10-05T15:18:24.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:24 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:24.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:24 smithi135 ceph-mon[103360]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-05T15:18:24.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:24 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] up:active 2023-10-05T15:18:24.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:24 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:25.144 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:24 smithi135 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f.service: Service RestartSec=10s expired, scheduling restart. 2023-10-05T15:18:25.144 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:24 smithi135 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f.service: Scheduled restart job, restart counter is at 1. 2023-10-05T15:18:25.144 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:24 smithi135 systemd[1]: Stopped Ceph mds.f for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:18:25.144 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:24 smithi135 systemd[1]: Starting Ceph mds.f for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:18:25.429 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:25 smithi135 podman[142908]: 2023-10-05T15:18:25.430 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:25 smithi135 bash[142908]: 43cdf4bc08eaabc828aaf81666a878bb5b116fe310860d18dfe71ec8e53bf9f5 2023-10-05T15:18:25.430 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:25 smithi135 ceph-mon[103360]: pgmap v52: 129 pgs: 129 active+clean; 42 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 3.7 MiB/s wr, 560 op/s 2023-10-05T15:18:25.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:25 smithi060 ceph-mon[99238]: pgmap v52: 129 pgs: 129 active+clean; 42 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 3.7 MiB/s wr, 560 op/s 2023-10-05T15:18:25.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:25 smithi092 ceph-mon[102944]: pgmap v52: 129 pgs: 129 active+clean; 42 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 3.7 MiB/s wr, 560 op/s 2023-10-05T15:18:25.831 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:25 smithi135 ceph-mds[142948]: -- 172.21.15.135:0/412831123 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55857bfc91e0 con 0x55857bf9e800 2023-10-05T15:18:25.831 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[142924]: starting mds.f at 2023-10-05T15:18:25.831 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:18:25 smithi135 systemd[1]: Started Ceph mds.f for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:18:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 -- 172.21.15.60:0/1076074856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42800fffd0 msgr2=0x7f42801003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 --2- 172.21.15.60:0/1076074856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42800fffd0 0x7f42801003b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4270009990 tx=0x7f4270009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 -- 172.21.15.60:0/1076074856 shutdown_connections 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 --2- 172.21.15.60:0/1076074856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42801050f0 0x7f428010cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 --2- 172.21.15.60:0/1076074856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42800fffd0 0x7f42801003b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 --2- 172.21.15.60:0/1076074856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4280100980 0x7f42801049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 -- 172.21.15.60:0/1076074856 >> 172.21.15.60:0/1076074856 conn(0x7f42800fb830 msgr2=0x7f42800fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 -- 172.21.15.60:0/1076074856 shutdown_connections 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.117+0000 7f42852c6700 1 -- 172.21.15.60:0/1076074856 wait complete. 2023-10-05T15:18:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 Processor -- start 2023-10-05T15:18:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 -- start start 2023-10-05T15:18:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42800fffd0 0x7f42801981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 0x7f42801986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801a1040 0x7f42801a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801a3a00 con 0x7f42801050f0 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801a3b40 con 0x7f42800fffd0 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f42852c6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801a3d00 con 0x7f42801a1040 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 0x7f42801986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 0x7f42801986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40040/0 (socket says 172.21.15.60:40040) 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f427e7fc700 1 -- 172.21.15.60:0/2018149624 learned_addr learned my addr 172.21.15.60:0/2018149624 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.118+0000 7f427f7fe700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801a1040 0x7f42801a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427effd700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42800fffd0 0x7f42801981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427e7fc700 1 -- 172.21.15.60:0/2018149624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801a1040 msgr2=0x7f42801a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427e7fc700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801a1040 0x7f42801a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427e7fc700 1 -- 172.21.15.60:0/2018149624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42800fffd0 msgr2=0x7f42801981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427e7fc700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42800fffd0 0x7f42801981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427e7fc700 1 -- 172.21.15.60:0/2018149624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700095f0 con 0x7f42801050f0 2023-10-05T15:18:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f427e7fc700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 0x7f42801986f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f426800e970 tx=0x7f426800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f4277fff700 1 -- 172.21.15.60:0/2018149624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268009790 con 0x7f42801050f0 2023-10-05T15:18:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42801a3fe0 con 0x7f42801050f0 2023-10-05T15:18:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f4277fff700 1 -- 172.21.15.60:0/2018149624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f426800c7e0 con 0x7f42801050f0 2023-10-05T15:18:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f4277fff700 1 -- 172.21.15.60:0/2018149624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680054e0 con 0x7f42801050f0 2023-10-05T15:18:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.119+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42801a4460 con 0x7f42801050f0 2023-10-05T15:18:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.121+0000 7f4277fff700 1 -- 172.21.15.60:0/2018149624 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f426800c950 con 0x7f42801050f0 2023-10-05T15:18:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.122+0000 7f4277fff700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f426c0a15f0 0x7f426c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.122+0000 7f427effd700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f426c0a15f0 0x7f426c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.122+0000 7f4277fff700 1 -- 172.21.15.60:0/2018149624 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4268014070 con 0x7f42801050f0 2023-10-05T15:18:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f427effd700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f426c0a15f0 0x7f426c0a3ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f427000b2e0 tx=0x7f4270005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 Processor -- start 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 -- start start 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c2efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c39e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5b98400 con 0x5598b5c2f520 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5b89bc0 con 0x5598b5c2ec00 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.123+0000 7f42914b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5b874e0 con 0x5598b5c3a3d0 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c39e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c2efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c39e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40048/0 (socket says 172.21.15.60:40048) 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 -- 172.21.15.60:0/4145032230 learned_addr learned my addr 172.21.15.60:0/4145032230 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427f7fe700 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 -- 172.21.15.60:0/4145032230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 msgr2=0x5598b5c3c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 -- 172.21.15.60:0/4145032230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 msgr2=0x5598b5c2efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c2efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 -- 172.21.15.60:0/4145032230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b59add80 con 0x5598b5c2f520 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427effd700 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c2efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f427e7fc700 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c39e90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f42680a2170 tx=0x7f426800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a1818225f8c3ab server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f42757fa700 1 -- 172.21.15.60:0/4145032230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426809e460 con 0x5598b5c2f520 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f42757fa700 1 -- 172.21.15.60:0/4145032230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42680a26a0 con 0x5598b5c2f520 2023-10-05T15:18:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.124+0000 7f42757fa700 1 -- 172.21.15.60:0/4145032230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680cd2f0 con 0x5598b5c2f520 2023-10-05T15:18:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 -- 172.21.15.60:0/4145032230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 msgr2=0x5598b5c39e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c39e90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f42680a2170 tx=0x7f426800cc50 comp rx=0 tx=0).stop 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 -- 172.21.15.60:0/4145032230 shutdown_connections 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c2efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 --2- 172.21.15.60:0/4145032230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c39e90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 -- 172.21.15.60:0/4145032230 >> 172.21.15.60:0/4145032230 conn(0x5598b5ba4200 msgr2=0x5598b5c2b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 -- 172.21.15.60:0/4145032230 shutdown_connections 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 -- 172.21.15.60:0/4145032230 wait complete. 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.125+0000 7f42914b0b80 1 -- start start 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 Processor -- start 2023-10-05T15:18:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c37180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c37c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5b82dd0 con 0x5598b5c2f520 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5b1f6b0 con 0x5598b5c3a3d0 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5b1f350 con 0x5598b5c2ec00 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42914b0b80 10 client.0 _ll_register_callbacks cb 0x5598b597c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c376c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40054/0 (socket says 172.21.15.60:40054) 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 -- 172.21.15.60:0/1364781229 learned_addr learned my addr 172.21.15.60:0/1364781229 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427effd700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c37180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427f7fe700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c37c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 -- 172.21.15.60:0/1364781229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 msgr2=0x5598b5c37180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c37180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 -- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 msgr2=0x5598b5c37c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c37c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 -- 172.21.15.60:0/1364781229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428010d4e0 con 0x5598b5c2f520 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f427e7fc700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c376c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4268096810 tx=0x7f426800c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc1d1146805a641 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.126+0000 7f42667fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42667fc700 1 -- 172.21.15.60:0/1364781229 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268005720 con 0x5598b5c2f520 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42667fc700 1 -- 172.21.15.60:0/1364781229 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f42680b0070 con 0x5598b5c2f520 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598b5c22d50 con 0x5598b5c2f520 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42667fc700 1 -- 172.21.15.60:0/1364781229 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42680cd2f0 con 0x5598b5c2f520 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 10 client.16296 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f42801a4460 con 0x5598b5c2f520 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42667fc700 1 -- 172.21.15.60:0/1364781229 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5598b5c22d50 con 0x5598b5c2f520 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42667fc700 1 -- 172.21.15.60:0/1364781229 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4268099800 con 0x5598b5c2f520 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 10 client.16296 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 20 client.16296 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c49cc0 0x5598b5c4c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 4 client.16296 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598b5b7bdb0 con 0x5598b5c49cc0 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.127+0000 7f427effd700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c49cc0 0x5598b5c4c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.128+0000 7f427effd700 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c49cc0 0x5598b5c4c0e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8797fd0b786e5e74 server_cookie=284fa4e668684ac7 in_seq=0 out_seq=0 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.128+0000 7f42667fc700 10 client.16296 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.128+0000 7f42667fc700 1 -- 172.21.15.60:0/1364781229 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5598b5b7bdb0 con 0x5598b5c49cc0 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.128+0000 7f42667fc700 10 client.16296 handle_command_reply: tid=0 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.128+0000 7f42914b0b80 1 client.16296 shutdown 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 msgr2=0x5598b5c376c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c376c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4268096810 tx=0x7f426800c3d0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 shutdown_connections 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c49cc0 0x5598b5c4c0e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c37c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c37180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42667fc700 0 client.16296 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1364781229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c376c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 >> 172.21.15.60:0/1364781229 conn(0x5598b5ba4200 msgr2=0x5598b5c2ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 shutdown_connections 2023-10-05T15:18:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 1 -- 172.21.15.60:0/1364781229 wait complete. 2023-10-05T15:18:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.129+0000 7f42914b0b80 20 client.16296 trim_cache size 0 max 16384 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 Processor -- start 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 -- start start 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c36430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c37a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5a038c0 con 0x5598b5c2f520 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5c2f230 con 0x5598b5c3a3d0 2023-10-05T15:18:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f42914b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5c33010 con 0x5598b5c2ec00 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c37a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c37a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40060/0 (socket says 172.21.15.60:40060) 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f427f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.144+0000 7f427e7fc700 1 -- 172.21.15.60:0/1092367173 learned_addr learned my addr 172.21.15.60:0/1092367173 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427effd700 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c36430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427f7fe700 1 -- 172.21.15.60:0/1092367173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 msgr2=0x5598b5c36430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427f7fe700 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c36430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427f7fe700 1 -- 172.21.15.60:0/1092367173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 msgr2=0x5598b5c37a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427f7fe700 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c37a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427f7fe700 1 -- 172.21.15.60:0/1092367173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b5996c00 con 0x5598b5c3a3d0 2023-10-05T15:18:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427e7fc700 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c37a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:26.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427effd700 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c36430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:26.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f427f7fe700 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c34430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42780094c0 tx=0x7f4278009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3830f87bcd5004c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:26.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f4275ffb700 1 -- 172.21.15.60:0/1092367173 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e040 con 0x5598b5c3a3d0 2023-10-05T15:18:26.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f4275ffb700 1 -- 172.21.15.60:0/1092367173 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f427801b070 con 0x5598b5c3a3d0 2023-10-05T15:18:26.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.145+0000 7f4275ffb700 1 -- 172.21.15.60:0/1092367173 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780045f0 con 0x5598b5c3a3d0 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- 172.21.15.60:0/1092367173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 msgr2=0x5598b5c34430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c34430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42780094c0 tx=0x7f4278009920 comp rx=0 tx=0).stop 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- 172.21.15.60:0/1092367173 shutdown_connections 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c3a3d0 0x5598b5c34430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c2ec00 0x5598b5c36430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- 172.21.15.60:0/1092367173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c37a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- 172.21.15.60:0/1092367173 >> 172.21.15.60:0/1092367173 conn(0x5598b5ba4200 msgr2=0x5598b5c31320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- 172.21.15.60:0/1092367173 shutdown_connections 2023-10-05T15:18:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- 172.21.15.60:0/1092367173 wait complete. 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- start start 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 Processor -- start 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c40f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c3f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.146+0000 7f42914b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5c3ff40 con 0x5598b5c2f520 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42914b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5c400b0 con 0x5598b5c2ec00 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42914b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b5c9dac0 con 0x5598b5c3a3d0 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42914b0b80 10 client.0 _ll_register_callbacks cb 0x7f4270005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c3f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c3f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40066/0 (socket says 172.21.15.60:40066) 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c40f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 -- 172.21.15.60:0/2845413557 learned_addr learned my addr 172.21.15.60:0/2845413557 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427f7fe700 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 -- 172.21.15.60:0/2845413557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 msgr2=0x5598b5c3f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 -- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 msgr2=0x5598b5c40f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c40f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 -- 172.21.15.60:0/2845413557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42801a4460 con 0x5598b5c2f520 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f427e7fc700 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c3f290 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f42680cb080 tx=0x7f4268099ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80b0f9f7c364be server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42667fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42667fc700 1 -- 172.21.15.60:0/2845413557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680cd500 con 0x5598b5c2f520 2023-10-05T15:18:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42680a26a0 con 0x5598b5c2f520 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42667fc700 1 -- 172.21.15.60:0/2845413557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f42680b0070 con 0x5598b5c2f520 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42667fc700 1 -- 172.21.15.60:0/2845413557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426800cc50 con 0x5598b5c2f520 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42914b0b80 10 client.16302 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.147+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f42780091a0 con 0x5598b5c2f520 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42667fc700 1 -- 172.21.15.60:0/2845413557 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42680a26a0 con 0x5598b5c2f520 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42667fc700 1 -- 172.21.15.60:0/2845413557 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4268004b50 con 0x5598b5c2f520 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42914b0b80 10 client.16302 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42914b0b80 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42914b0b80 20 client.16302 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42914b0b80 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c9ed90 0x5598b5ca11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42914b0b80 4 client.16302 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:18:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5598b5b7bad0 con 0x5598b5c9ed90 2023-10-05T15:18:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f427effd700 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c9ed90 0x5598b5ca11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f42667fc700 10 client.16302 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.148+0000 7f427effd700 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c9ed90 0x5598b5ca11b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252a5a686a82037b server_cookie=7e406632f2eb6d7d in_seq=0 out_seq=0 2023-10-05T15:18:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.222+0000 7f42667fc700 1 -- 172.21.15.60:0/2845413557 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5598b5b7bad0 con 0x5598b5c9ed90 2023-10-05T15:18:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.222+0000 7f42667fc700 10 client.16302 handle_command_reply: tid=0 2023-10-05T15:18:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 client.16302 shutdown 2023-10-05T15:18:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 msgr2=0x5598b5c3f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c3f290 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f42680cb080 tx=0x7f4268099ec0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 shutdown_connections 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5598b5c9ed90 0x5598b5ca11b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b5c3a3d0 0x5598b5c3f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5598b5c2ec00 0x5598b5c40f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42667fc700 0 client.16302 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 --2- 172.21.15.60:0/2845413557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598b5c2f520 0x5598b5c3f290 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 >> 172.21.15.60:0/2845413557 conn(0x5598b5ba4200 msgr2=0x5598b5c38a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 shutdown_connections 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 1 -- 172.21.15.60:0/2845413557 wait complete. 2023-10-05T15:18:26.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42914b0b80 20 client.16302 trim_cache size 0 max 16384 2023-10-05T15:18:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:18:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:18:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:18:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f426c0a15f0 msgr2=0x7f426c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42852c6700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f426c0a15f0 0x7f426c0a3ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f427000b2e0 tx=0x7f4270005960 comp rx=0 tx=0).stop 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 msgr2=0x7f42801986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42852c6700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 0x7f42801986f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f426800e970 tx=0x7f426800ec80 comp rx=0 tx=0).stop 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.223+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 shutdown_connections 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801a1040 0x7f42801a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f426c0a15f0 0x7f426c0a3ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42800fffd0 0x7f42801981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 --2- 172.21.15.60:0/2018149624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42801050f0 0x7f42801986f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 >> 172.21.15.60:0/2018149624 conn(0x7f42800fb830 msgr2=0x7f42800fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 shutdown_connections 2023-10-05T15:18:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:26.224+0000 7f42852c6700 1 -- 172.21.15.60:0/2018149624 wait complete. 2023-10-05T15:18:26.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:26 smithi060 ceph-mon[99238]: daemon mds.f restarted 2023-10-05T15:18:26.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:26 smithi060 ceph-mon[99238]: osdmap e94: 12 total, 12 up, 12 in 2023-10-05T15:18:26.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:26 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6834/2042143293,v1:172.21.15.135:6835/2042143293] up:boot 2023-10-05T15:18:26.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:26 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:26.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:26 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:18:26.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:26 smithi092 ceph-mon[102944]: daemon mds.f restarted 2023-10-05T15:18:26.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:26 smithi092 ceph-mon[102944]: osdmap e94: 12 total, 12 up, 12 in 2023-10-05T15:18:26.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:26 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6834/2042143293,v1:172.21.15.135:6835/2042143293] up:boot 2023-10-05T15:18:26.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:26 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:26.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:26 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:18:26.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:26 smithi135 ceph-mon[103360]: daemon mds.f restarted 2023-10-05T15:18:26.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:26 smithi135 ceph-mon[103360]: osdmap e94: 12 total, 12 up, 12 in 2023-10-05T15:18:26.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:26 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6834/2042143293,v1:172.21.15.135:6835/2042143293] up:boot 2023-10-05T15:18:26.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:26 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:18:26.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:26 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:18:27.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:27 smithi060 ceph-mon[99238]: pgmap v53: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 665 op/s 2023-10-05T15:18:27.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:27 smithi092 ceph-mon[102944]: pgmap v53: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 665 op/s 2023-10-05T15:18:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:27 smithi135 ceph-mon[103360]: pgmap v53: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 665 op/s 2023-10-05T15:18:28.242 INFO:tasks.workunit.client.0.smithi060.stdout: 12 82927 252 54877 191 18690 357 2023-10-05T15:18:29.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:29 smithi060 ceph-mon[99238]: pgmap v55: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 160 op/s 2023-10-05T15:18:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:29 smithi092 ceph-mon[102944]: pgmap v55: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 160 op/s 2023-10-05T15:18:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:29 smithi135 ceph-mon[103360]: pgmap v55: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 160 op/s 2023-10-05T15:18:31.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:31 smithi060 ceph-mon[99238]: pgmap v56: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 160 op/s 2023-10-05T15:18:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:31 smithi092 ceph-mon[102944]: pgmap v56: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 160 op/s 2023-10-05T15:18:31.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:31 smithi135 ceph-mon[103360]: pgmap v56: 129 pgs: 129 active+clean; 44 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 160 op/s 2023-10-05T15:18:33.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:33 smithi060 ceph-mon[99238]: pgmap v57: 129 pgs: 129 active+clean; 46 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 981 KiB/s wr, 270 op/s 2023-10-05T15:18:33.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:33 smithi060 ceph-mon[99238]: scrub summary: idle 2023-10-05T15:18:33.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:33 smithi060 ceph-mon[99238]: scrub summary: idle 2023-10-05T15:18:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:33 smithi092 ceph-mon[102944]: pgmap v57: 129 pgs: 129 active+clean; 46 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 981 KiB/s wr, 270 op/s 2023-10-05T15:18:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:33 smithi092 ceph-mon[102944]: scrub summary: idle 2023-10-05T15:18:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:33 smithi092 ceph-mon[102944]: scrub summary: idle 2023-10-05T15:18:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:33 smithi135 ceph-mon[103360]: pgmap v57: 129 pgs: 129 active+clean; 46 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 981 KiB/s wr, 270 op/s 2023-10-05T15:18:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:33 smithi135 ceph-mon[103360]: scrub summary: idle 2023-10-05T15:18:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:33 smithi135 ceph-mon[103360]: scrub summary: idle 2023-10-05T15:18:35.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:35 smithi060 ceph-mon[99238]: pgmap v58: 129 pgs: 129 active+clean; 46 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 981 KiB/s wr, 270 op/s 2023-10-05T15:18:35.675 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:35 smithi092 ceph-mon[102944]: pgmap v58: 129 pgs: 129 active+clean; 46 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 981 KiB/s wr, 270 op/s 2023-10-05T15:18:35.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:35 smithi135 ceph-mon[103360]: pgmap v58: 129 pgs: 129 active+clean; 46 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 981 KiB/s wr, 270 op/s 2023-10-05T15:18:37.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:37 smithi060 ceph-mon[99238]: pgmap v59: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.9 MiB/s wr, 220 op/s 2023-10-05T15:18:37.675 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:37 smithi092 ceph-mon[102944]: pgmap v59: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.9 MiB/s wr, 220 op/s 2023-10-05T15:18:37.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:37 smithi135 ceph-mon[103360]: pgmap v59: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.9 MiB/s wr, 220 op/s 2023-10-05T15:18:38.243 INFO:tasks.workunit.client.0.smithi060.stdout: 42 238633 1607 135565 1401 63089 549 2023-10-05T15:18:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.556+0000 7fa8b2b02700 1 -- 172.21.15.60:0/3525104042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac105110 msgr2=0x7fa8ac0ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.556+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/3525104042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac105110 0x7fa8ac0ff6f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009990 tx=0x7fa89c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.557+0000 7fa8b2b02700 1 -- 172.21.15.60:0/3525104042 shutdown_connections 2023-10-05T15:18:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.557+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/3525104042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac105110 0x7fa8ac0ff6f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.557+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/3525104042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac100a70 0x7fa8ac100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.557+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/3525104042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac101420 0x7fa8ac104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.557+0000 7fa8b2b02700 1 -- 172.21.15.60:0/3525104042 >> 172.21.15.60:0/3525104042 conn(0x7fa8ac075010 msgr2=0x7fa8ac075420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.562+0000 7fa8b2b02700 1 -- 172.21.15.60:0/3525104042 shutdown_connections 2023-10-05T15:18:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.571+0000 7fa8b2b02700 1 -- 172.21.15.60:0/3525104042 wait complete. 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 Processor -- start 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 -- start start 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac100a70 0x7fa8ac107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 0x7fa8ac107d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac1082c0 0x7fa8ac071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac071e90 con 0x7fa8ac100a70 2023-10-05T15:18:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac072000 con 0x7fa8ac1082c0 2023-10-05T15:18:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.572+0000 7fa8b2b02700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0721c0 con 0x7fa8ac105110 2023-10-05T15:18:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.576+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 0x7fa8ac107d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.577+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 0x7fa8ac107d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53610/0 (socket says 172.21.15.60:53610) 2023-10-05T15:18:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.577+0000 7fa8abfff700 1 -- 172.21.15.60:0/1551276983 learned_addr learned my addr 172.21.15.60:0/1551276983 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.577+0000 7fa8b109f700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac1082c0 0x7fa8ac071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.580+0000 7fa8abfff700 1 -- 172.21.15.60:0/1551276983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac1082c0 msgr2=0x7fa8ac071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.580+0000 7fa8abfff700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac1082c0 0x7fa8ac071920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.580+0000 7fa8abfff700 1 -- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac100a70 msgr2=0x7fa8ac107840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.580+0000 7fa8abfff700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac100a70 0x7fa8ac107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.580+0000 7fa8abfff700 1 -- 172.21.15.60:0/1551276983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0095f0 con 0x7fa8ac105110 2023-10-05T15:18:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.591+0000 7fa8abfff700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 0x7fa8ac107d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000e940 tx=0x7fa8a000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.593+0000 7fa8a9ffb700 1 -- 172.21.15.60:0/1551276983 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0009730 con 0x7fa8ac105110 2023-10-05T15:18:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.593+0000 7fa8a9ffb700 1 -- 172.21.15.60:0/1551276983 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8a000cbd0 con 0x7fa8ac105110 2023-10-05T15:18:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.593+0000 7fa8a9ffb700 1 -- 172.21.15.60:0/1551276983 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0018680 con 0x7fa8ac105110 2023-10-05T15:18:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.594+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0724a0 con 0x7fa8ac105110 2023-10-05T15:18:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.594+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac072930 con 0x7fa8ac105110 2023-10-05T15:18:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.600+0000 7fa8bececb80 1 Processor -- start 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.604+0000 7fa8bececb80 1 -- start start 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.605+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543503fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.605+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a54350ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.605+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435117c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.605+0000 7fa8bececb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a54346d400 con 0x55a543503c00 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.605+0000 7fa8bececb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a54345ebc0 con 0x55a54350f3d0 2023-10-05T15:18:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.605+0000 7fa8bececb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a54345c4e0 con 0x55a543504520 2023-10-05T15:18:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.606+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.608+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53506/0 (socket says 172.21.15.60:53506) 2023-10-05T15:18:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.608+0000 7fa8abfff700 1 -- 172.21.15.60:0/3022880425 learned_addr learned my addr 172.21.15.60:0/3022880425 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.610+0000 7fa8abfff700 1 -- 172.21.15.60:0/3022880425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 msgr2=0x55a54350ee90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:18:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.610+0000 7fa8abfff700 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a54350ee90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.610+0000 7fa8abfff700 1 -- 172.21.15.60:0/3022880425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 msgr2=0x55a543503fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.610+0000 7fa8abfff700 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543503fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.610+0000 7fa8abfff700 1 -- 172.21.15.60:0/3022880425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a543282d80 con 0x55a54350f3d0 2023-10-05T15:18:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.610+0000 7fa8a9ffb700 1 -- 172.21.15.60:0/1551276983 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa8a0010430 con 0x7fa8ac105110 2023-10-05T15:18:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.611+0000 7fa8a9ffb700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa8940a1800 0x7fa8940a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.611+0000 7fa8abfff700 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435117c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00d18c0 tx=0x7fa8a00d4920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b7728f14a899e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.611+0000 7fa8a9ffb700 1 -- 172.21.15.60:0/1551276983 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fa8a0014070 con 0x7fa8ac105110 2023-10-05T15:18:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.612+0000 7fa892ffd700 1 -- 172.21.15.60:0/3022880425 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a009d400 con 0x55a54350f3d0 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.612+0000 7fa892ffd700 1 -- 172.21.15.60:0/3022880425 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8a00d7030 con 0x55a54350f3d0 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.612+0000 7fa892ffd700 1 -- 172.21.15.60:0/3022880425 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00a0c90 con 0x55a54350f3d0 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.612+0000 7fa8b109f700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa8940a1800 0x7fa8940a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 -- 172.21.15.60:0/3022880425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 msgr2=0x55a5435117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435117c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00d18c0 tx=0x7fa8a00d4920 comp rx=0 tx=0).stop 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8b109f700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa8940a1800 0x7fa8940a3cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0098e0 tx=0x7fa89c005fd0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 -- 172.21.15.60:0/3022880425 shutdown_connections 2023-10-05T15:18:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435117c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543503fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3022880425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a54350ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 -- 172.21.15.60:0/3022880425 >> 172.21.15.60:0/3022880425 conn(0x55a543479200 msgr2=0x55a543500080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 -- 172.21.15.60:0/3022880425 shutdown_connections 2023-10-05T15:18:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.613+0000 7fa8bececb80 1 -- 172.21.15.60:0/3022880425 wait complete. 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.614+0000 7fa8bececb80 1 -- start start 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.614+0000 7fa8bececb80 1 Processor -- start 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543503c00 0x55a54350edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543504520 0x55a54350c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a54350c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a543457dd0 con 0x55a543504520 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5433f46b0 con 0x55a54350f3d0 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5433f4350 con 0x55a543503c00 2023-10-05T15:18:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.615+0000 7fa8bececb80 10 client.0 _ll_register_callbacks cb 0x55a5432517a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.618+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543504520 0x55a54350c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.618+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543504520 0x55a54350c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40094/0 (socket says 172.21.15.60:40094) 2023-10-05T15:18:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.618+0000 7fa8abfff700 1 -- 172.21.15.60:0/2100181737 learned_addr learned my addr 172.21.15.60:0/2100181737 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.620+0000 7fa8b089e700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543503c00 0x55a54350edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.621+0000 7fa8b109f700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a54350c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.624+0000 7fa8b109f700 1 -- 172.21.15.60:0/2100181737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543503c00 msgr2=0x55a54350edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.624+0000 7fa8b109f700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543503c00 0x55a54350edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.624+0000 7fa8b109f700 1 -- 172.21.15.60:0/2100181737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543504520 msgr2=0x55a54350c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.624+0000 7fa8b109f700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543504520 0x55a54350c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.624+0000 7fa8b109f700 1 -- 172.21.15.60:0/2100181737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac072930 con 0x55a54350f3d0 2023-10-05T15:18:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.625+0000 7fa8b109f700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a54350c690 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009990 tx=0x7fa89c005460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a8a8407edaed11 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.626+0000 7fa88bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:18:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.627+0000 7fa88bfff700 1 -- 172.21.15.60:0/2100181737 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c01e070 con 0x55a54350f3d0 2023-10-05T15:18:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.627+0000 7fa88bfff700 1 -- 172.21.15.60:0/2100181737 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fa89c004810 con 0x55a54350f3d0 2023-10-05T15:18:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.627+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5434f7d50 con 0x55a54350f3d0 2023-10-05T15:18:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.630+0000 7fa88bfff700 1 -- 172.21.15.60:0/2100181737 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa89c0049d0 con 0x55a54350f3d0 2023-10-05T15:18:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.630+0000 7fa8bececb80 10 client.25979 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.630+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a54326bc00 con 0x55a54350f3d0 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.631+0000 7fa88bfff700 1 -- 172.21.15.60:0/2100181737 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a5434f7d50 con 0x55a54350f3d0 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.631+0000 7fa88bfff700 1 -- 172.21.15.60:0/2100181737 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fa89c026430 con 0x55a54350f3d0 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.632+0000 7fa8bececb80 10 client.25979 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.632+0000 7fa8bececb80 10 client.25979 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.632+0000 7fa8bececb80 20 client.25979 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.632+0000 7fa8bececb80 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a54351ef40 0x55a543521360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.632+0000 7fa8bececb80 4 client.25979 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.632+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a543450db0 con 0x55a54351ef40 2023-10-05T15:18:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.633+0000 7fa8b089e700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a54351ef40 0x55a543521360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.639+0000 7fa8b089e700 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a54351ef40 0x55a543521360 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2c7ede75c8aadef server_cookie=8e68c908c92de0d in_seq=0 out_seq=0 2023-10-05T15:18:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.639+0000 7fa88bfff700 10 client.25979 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.640+0000 7fa88bfff700 1 -- 172.21.15.60:0/2100181737 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a543450db0 con 0x55a54351ef40 2023-10-05T15:18:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.640+0000 7fa88bfff700 10 client.25979 handle_command_reply: tid=0 2023-10-05T15:18:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.640+0000 7fa8bececb80 1 client.25979 shutdown 2023-10-05T15:18:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.643+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 msgr2=0x55a54350c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.643+0000 7fa8bececb80 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a54350c690 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009990 tx=0x7fa89c005460 comp rx=0 tx=0).stop 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 shutdown_connections 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa8bececb80 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a54351ef40 0x55a543521360 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa8bececb80 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a54350c690 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa8bececb80 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543503c00 0x55a54350edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa8bececb80 1 --2- 172.21.15.60:0/2100181737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543504520 0x55a54350c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 >> 172.21.15.60:0/2100181737 conn(0x55a543479200 msgr2=0x55a5434ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.644+0000 7fa88bfff700 0 client.25979 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.658+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 shutdown_connections 2023-10-05T15:18:39.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:39 smithi060 ceph-mon[99238]: pgmap v60: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 191 op/s 2023-10-05T15:18:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.673+0000 7fa8bececb80 1 -- 172.21.15.60:0/2100181737 wait complete. 2023-10-05T15:18:39.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:39 smithi092 ceph-mon[102944]: pgmap v60: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 191 op/s 2023-10-05T15:18:39.687 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.684+0000 7fa8bececb80 20 client.25979 trim_cache size 0 max 16384 2023-10-05T15:18:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 Processor -- start 2023-10-05T15:18:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 -- start start 2023-10-05T15:18:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a543503c00 0x55a54350bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543515f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 0x55a54350b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5432d88c0 con 0x55a54350f3d0 2023-10-05T15:18:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a543516490 con 0x55a543503c00 2023-10-05T15:18:39.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.725+0000 7fa8bececb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a54350a5f0 con 0x55a543504520 2023-10-05T15:18:39.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 0x55a54350b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 0x55a54350b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40098/0 (socket says 172.21.15.60:40098) 2023-10-05T15:18:39.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 -- 172.21.15.60:0/3837968979 learned_addr learned my addr 172.21.15.60:0/3837968979 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:39.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 -- 172.21.15.60:0/3837968979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 msgr2=0x55a543515f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:18:39.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543515f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 -- 172.21.15.60:0/3837968979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a543503c00 msgr2=0x55a54350bff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:18:39.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a543503c00 0x55a54350bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.726+0000 7fa8b109f700 1 -- 172.21.15.60:0/3837968979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5432a91f0 con 0x55a54350f3d0 2023-10-05T15:18:39.731 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.729+0000 7fa8b109f700 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 0x55a54350b850 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa89c026840 tx=0x7fa89c00b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c37027cae662cf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:39.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.732+0000 7fa8937fe700 1 -- 172.21.15.60:0/3837968979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0269b0 con 0x55a54350f3d0 2023-10-05T15:18:39.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.732+0000 7fa8937fe700 1 -- 172.21.15.60:0/3837968979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa89c026b10 con 0x55a54350f3d0 2023-10-05T15:18:39.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.732+0000 7fa8937fe700 1 -- 172.21.15.60:0/3837968979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c030ac0 con 0x55a54350f3d0 2023-10-05T15:18:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.733+0000 7fa8bececb80 1 -- 172.21.15.60:0/3837968979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 msgr2=0x55a54350b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.733+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 0x55a54350b850 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa89c026840 tx=0x7fa89c00b2c0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 -- 172.21.15.60:0/3837968979 shutdown_connections 2023-10-05T15:18:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a54350f3d0 0x55a54350b850 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a543503c00 0x55a54350bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 --2- 172.21.15.60:0/3837968979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543515f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 -- 172.21.15.60:0/3837968979 >> 172.21.15.60:0/3837968979 conn(0x55a543479200 msgr2=0x55a54351b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 -- 172.21.15.60:0/3837968979 shutdown_connections 2023-10-05T15:18:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.735+0000 7fa8bececb80 1 -- 172.21.15.60:0/3837968979 wait complete. 2023-10-05T15:18:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 -- start start 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 Processor -- start 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543513f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543514470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435149b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a543571d70 con 0x55a543503c00 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a543571eb0 con 0x55a54350f3d0 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a543571ff0 con 0x55a543504520 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.736+0000 7fa8bececb80 10 client.0 _ll_register_callbacks cb 0x7fa89c00b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.737+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543514470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.737+0000 7fa8abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543514470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53632/0 (socket says 172.21.15.60:53632) 2023-10-05T15:18:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.737+0000 7fa8abfff700 1 -- 172.21.15.60:0/1326624952 learned_addr learned my addr 172.21.15.60:0/1326624952 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.738+0000 7fa8b109f700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.738+0000 7fa8b089e700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543513f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.739+0000 7fa8b089e700 1 -- 172.21.15.60:0/1326624952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 msgr2=0x55a543514470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.739+0000 7fa8b089e700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543514470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.739+0000 7fa8b089e700 1 -- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 msgr2=0x55a5435149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.739+0000 7fa8b089e700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.739+0000 7fa8b089e700 1 -- 172.21.15.60:0/1326624952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a54326bc00 con 0x55a543503c00 2023-10-05T15:18:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.740+0000 7fa8b089e700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543513f30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55a543521c40 tx=0x7fa8a4009320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f27138fc074ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.744+0000 7fa88bfff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.744+0000 7fa88bfff700 1 -- 172.21.15.60:0/1326624952 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400e040 con 0x55a543503c00 2023-10-05T15:18:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.744+0000 7fa88bfff700 1 -- 172.21.15.60:0/1326624952 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fa8a401b370 con 0x55a543503c00 2023-10-05T15:18:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.746+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8a00d7030 con 0x55a543503c00 2023-10-05T15:18:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.750+0000 7fa88bfff700 1 -- 172.21.15.60:0/1326624952 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8a401be60 con 0x55a543503c00 2023-10-05T15:18:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.751+0000 7fa8bececb80 10 client.16314 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.751+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a543281250 con 0x55a543503c00 2023-10-05T15:18:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa88bfff700 1 -- 172.21.15.60:0/1326624952 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8a00d7030 con 0x55a543503c00 2023-10-05T15:18:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa88bfff700 1 -- 172.21.15.60:0/1326624952 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fa8a4004140 con 0x55a543503c00 2023-10-05T15:18:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa8bececb80 10 client.16314 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa8bececb80 10 client.16314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa8bececb80 20 client.16314 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa8bececb80 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5435737d0 0x55a543575bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa8bececb80 4 client.16314 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.753+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a543450ad0 con 0x55a5435737d0 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.754+0000 7fa8abfff700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5435737d0 0x55a543575bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.755+0000 7fa8abfff700 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5435737d0 0x55a543575bf0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cacdb813e4d2430 server_cookie=d43f41f0b90accde in_seq=0 out_seq=0 2023-10-05T15:18:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:39.755+0000 7fa88bfff700 10 client.16314 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:39.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:39 smithi135 ceph-mon[103360]: pgmap v60: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 191 op/s 2023-10-05T15:18:40.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:40 smithi135 ceph-mon[103360]: pgmap v61: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 183 op/s 2023-10-05T15:18:40.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:40 smithi060 ceph-mon[99238]: pgmap v61: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 183 op/s 2023-10-05T15:18:40.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:40 smithi092 ceph-mon[102944]: pgmap v61: 129 pgs: 129 active+clean; 56 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 183 op/s 2023-10-05T15:18:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.398+0000 7fa88bfff700 1 -- 172.21.15.60:0/1326624952 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a543450ad0 con 0x55a5435737d0 2023-10-05T15:18:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.398+0000 7fa88bfff700 10 client.16314 handle_command_reply: tid=0 2023-10-05T15:18:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.398+0000 7fa8bececb80 1 client.16314 shutdown 2023-10-05T15:18:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 msgr2=0x55a543513f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543513f30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55a543521c40 tx=0x7fa8a4009320 comp rx=0 tx=0).stop 2023-10-05T15:18:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 shutdown_connections 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5435737d0 0x55a543575bf0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54350f3d0 0x55a5435149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a543503c00 0x55a543513f30 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 --2- 172.21.15.60:0/1326624952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a543504520 0x55a543514470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 >> 172.21.15.60:0/1326624952 conn(0x55a543479200 msgr2=0x55a54351b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.400+0000 7fa88bfff700 0 client.16314 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.401+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 shutdown_connections 2023-10-05T15:18:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.401+0000 7fa8bececb80 1 -- 172.21.15.60:0/1326624952 wait complete. 2023-10-05T15:18:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.401+0000 7fa8bececb80 20 client.16314 trim_cache size 0 max 16384 2023-10-05T15:18:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:18:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:18:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:18:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa8940a1800 msgr2=0x7fa8940a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa8940a1800 0x7fa8940a3cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0098e0 tx=0x7fa89c005fd0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 msgr2=0x7fa8ac107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 0x7fa8ac107d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000e940 tx=0x7fa8a000ed00 comp rx=0 tx=0).stop 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 shutdown_connections 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa8940a1800 0x7fa8940a3cc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac1082c0 0x7fa8ac071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ac100a70 0x7fa8ac107840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 --2- 172.21.15.60:0/1551276983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8ac105110 0x7fa8ac107d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.402+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 >> 172.21.15.60:0/1551276983 conn(0x7fa8ac075010 msgr2=0x7fa8ac10dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.405+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 shutdown_connections 2023-10-05T15:18:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:41.405+0000 7fa8b2b02700 1 -- 172.21.15.60:0/1551276983 wait complete. 2023-10-05T15:18:43.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:43 smithi060 ceph-mon[99238]: pgmap v62: 129 pgs: 129 active+clean; 163 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 603 op/s 2023-10-05T15:18:43.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:43 smithi092 ceph-mon[102944]: pgmap v62: 129 pgs: 129 active+clean; 163 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 603 op/s 2023-10-05T15:18:43.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:43 smithi135 ceph-mon[103360]: pgmap v62: 129 pgs: 129 active+clean; 163 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 603 op/s 2023-10-05T15:18:45.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:45 smithi060 ceph-mon[99238]: pgmap v63: 129 pgs: 129 active+clean; 163 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 482 op/s 2023-10-05T15:18:45.425 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:45 smithi092 ceph-mon[102944]: pgmap v63: 129 pgs: 129 active+clean; 163 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 482 op/s 2023-10-05T15:18:45.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:45 smithi135 ceph-mon[103360]: pgmap v63: 129 pgs: 129 active+clean; 163 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 482 op/s 2023-10-05T15:18:47.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:47 smithi060 ceph-mon[99238]: pgmap v64: 129 pgs: 129 active+clean; 166 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 614 op/s 2023-10-05T15:18:47.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:47 smithi092 ceph-mon[102944]: pgmap v64: 129 pgs: 129 active+clean; 166 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 614 op/s 2023-10-05T15:18:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:47 smithi135 ceph-mon[103360]: pgmap v64: 129 pgs: 129 active+clean; 166 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 614 op/s 2023-10-05T15:18:48.243 INFO:tasks.workunit.client.0.smithi060.stdout: 57 879760 1053 519977 762 127446 44 2023-10-05T15:18:49.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:49 smithi060 ceph-mon[99238]: pgmap v65: 129 pgs: 129 active+clean; 170 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 606 op/s 2023-10-05T15:18:49.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:49 smithi092 ceph-mon[102944]: pgmap v65: 129 pgs: 129 active+clean; 170 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 606 op/s 2023-10-05T15:18:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:49 smithi135 ceph-mon[103360]: pgmap v65: 129 pgs: 129 active+clean; 170 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 606 op/s 2023-10-05T15:18:50.958 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:18:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 -- 172.21.15.60:0/2556510170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810100080 msgr2=0x7ff81010ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 --2- 172.21.15.60:0/2556510170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810100080 0x7ff81010ff50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff80800b0d0 tx=0x7ff80800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 -- 172.21.15.60:0/2556510170 shutdown_connections 2023-10-05T15:18:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 --2- 172.21.15.60:0/2556510170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810100080 0x7ff81010ff50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 --2- 172.21.15.60:0/2556510170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff810101c20 0x7ff810102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 --2- 172.21.15.60:0/2556510170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8100ff6c0 0x7ff8100ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 -- 172.21.15.60:0/2556510170 >> 172.21.15.60:0/2556510170 conn(0x7ff8100761d0 msgr2=0x7ff8100765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 -- 172.21.15.60:0/2556510170 shutdown_connections 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.123+0000 7ff81806f700 1 -- 172.21.15.60:0/2556510170 wait complete. 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 Processor -- start 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 -- start start 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 0x7ff8101991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 0x7ff8101996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810101c20 0x7ff81019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81019e180 con 0x7ff810101c20 2023-10-05T15:18:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81019e2f0 con 0x7ff8100ff6c0 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81806f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81019e4b0 con 0x7ff810100080 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 0x7ff8101991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81560a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 0x7ff8101996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81560a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 0x7ff8101996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53648/0 (socket says 172.21.15.60:53648) 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 0x7ff8101991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53538/0 (socket says 172.21.15.60:53538) 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81560a700 1 -- 172.21.15.60:0/256097429 learned_addr learned my addr 172.21.15.60:0/256097429 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.124+0000 7ff81660c700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810101c20 0x7ff81019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81660c700 1 -- 172.21.15.60:0/256097429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 msgr2=0x7ff8101996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81660c700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 0x7ff8101996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81660c700 1 -- 172.21.15.60:0/256097429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 msgr2=0x7ff8101991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81660c700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 0x7ff8101991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81660c700 1 -- 172.21.15.60:0/256097429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009520 con 0x7ff810101c20 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff815e0b700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 0x7ff8101991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81560a700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 0x7ff8101996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81660c700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810101c20 0x7ff81019db40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff80800b770 tx=0x7ff808007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff806ffd700 1 -- 172.21.15.60:0/256097429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800e040 con 0x7ff810101c20 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff806ffd700 1 -- 172.21.15.60:0/256097429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff80801d930 con 0x7ff810101c20 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff808009d00 con 0x7ff810101c20 2023-10-05T15:18:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff806ffd700 1 -- 172.21.15.60:0/256097429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80801b820 con 0x7ff810101c20 2023-10-05T15:18:51.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.125+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8101a5df0 con 0x7ff810101c20 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.128+0000 7ff806ffd700 1 -- 172.21.15.60:0/256097429 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff80801d470 con 0x7ff810101c20 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.128+0000 7ff806ffd700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff7fc0a15f0 0x7ff7fc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.129+0000 7ff806ffd700 1 -- 172.21.15.60:0/256097429 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ff8080ce6e0 con 0x7ff810101c20 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.129+0000 7ff815e0b700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff7fc0a15f0 0x7ff7fc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.129+0000 7ff815e0b700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff7fc0a15f0 0x7ff7fc0a3ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff80c011490 tx=0x7ff80c009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.129+0000 7ff824259b80 1 Processor -- start 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 -- start start 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d294a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d299e0 0x558c50d34350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d36c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50c92460 con 0x558c50d34890 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50c83c20 con 0x558c50d299e0 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff824259b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50c81540 con 0x558c50d290c0 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff81660c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d36c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d294a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53654/0 (socket says 172.21.15.60:53654) 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 -- 172.21.15.60:0/1096831685 learned_addr learned my addr 172.21.15.60:0/1096831685 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff81560a700 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d299e0 0x558c50d34350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 -- 172.21.15.60:0/1096831685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d299e0 msgr2=0x558c50d34350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d299e0 0x558c50d34350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 -- 172.21.15.60:0/1096831685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 msgr2=0x558c50d36c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d36c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff815e0b700 1 -- 172.21.15.60:0/1096831685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c50aa7de0 con 0x558c50d290c0 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.130+0000 7ff81660c700 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d36c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.131+0000 7ff815e0b700 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d294a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0043c0 tx=0x7ff80c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba41b603775190f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.131+0000 7ff7fbfff700 1 -- 172.21.15.60:0/1096831685 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c003d10 con 0x558c50d290c0 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.131+0000 7ff7fbfff700 1 -- 172.21.15.60:0/1096831685 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff80c003e70 con 0x558c50d290c0 2023-10-05T15:18:51.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.131+0000 7ff7fbfff700 1 -- 172.21.15.60:0/1096831685 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c01e7e0 con 0x558c50d290c0 2023-10-05T15:18:51.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 -- 172.21.15.60:0/1096831685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 msgr2=0x558c50d294a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d294a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0043c0 tx=0x7ff80c014000 comp rx=0 tx=0).stop 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 -- 172.21.15.60:0/1096831685 shutdown_connections 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d36c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d294a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 --2- 172.21.15.60:0/1096831685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d299e0 0x558c50d34350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 -- 172.21.15.60:0/1096831685 >> 172.21.15.60:0/1096831685 conn(0x558c50c9e260 msgr2=0x558c50d25450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 -- 172.21.15.60:0/1096831685 shutdown_connections 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 -- 172.21.15.60:0/1096831685 wait complete. 2023-10-05T15:18:51.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 -- start start 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.132+0000 7ff824259b80 1 Processor -- start 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d34350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d315d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d34890 0x558c50d31d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50c7ce30 con 0x558c50d299e0 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50c19710 con 0x558c50d34890 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50c193b0 con 0x558c50d290c0 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff824259b80 10 client.0 _ll_register_callbacks cb 0x558c50a76800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d34350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d34350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53660/0 (socket says 172.21.15.60:53660) 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 -- 172.21.15.60:0/3063358914 learned_addr learned my addr 172.21.15.60:0/3063358914 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff81560a700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff81660c700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d34890 0x558c50d31d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 -- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d34890 msgr2=0x558c50d31d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d34890 0x558c50d31d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 -- 172.21.15.60:0/3063358914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 msgr2=0x558c50d315d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d315d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff815e0b700 1 -- 172.21.15.60:0/3063358914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8101a5df0 con 0x558c50d290c0 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.133+0000 7ff81560a700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d315d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff815e0b700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d34350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff80c004390 tx=0x7ff80c0266e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f9ede500feae27 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff7f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3063358914 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c02b070 con 0x558c50d290c0 2023-10-05T15:18:51.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3063358914 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ff80c026b90 con 0x558c50d290c0 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c50d1cf10 con 0x558c50d290c0 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3063358914 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff80c005030 con 0x558c50d290c0 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff824259b80 10 client.25864 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7ff80c017070 con 0x558c50d290c0 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.134+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3063358914 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558c50d1cf10 con 0x558c50d290c0 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3063358914 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7ff80c024020 con 0x558c50d290c0 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff824259b80 10 client.25864 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff824259b80 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff824259b80 20 client.25864 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff824259b80 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff824259b80 4 client.25864 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:51.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c50c75e10 con 0x558c50d44290 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff81560a700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff7f97fa700 10 client.25864 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.135+0000 7ff81560a700 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d466b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb6852b50e7e5b56 server_cookie=312a340b4ed5a38e in_seq=0 out_seq=0 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3063358914 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c50c75e10 con 0x558c50d44290 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff7f97fa700 10 client.25864 handle_command_reply: tid=0 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 client.25864 shutdown 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 msgr2=0x558c50d34350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d34350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff80c004390 tx=0x7ff80c0266e0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 shutdown_connections 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d466b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d34890 0x558c50d31d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff7f97fa700 0 client.25864 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:51.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d290c0 0x558c50d34350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 --2- 172.21.15.60:0/3063358914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d315d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 >> 172.21.15.60:0/3063358914 conn(0x558c50c9e260 msgr2=0x558c50d24fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 shutdown_connections 2023-10-05T15:18:51.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 1 -- 172.21.15.60:0/3063358914 wait complete. 2023-10-05T15:18:51.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.136+0000 7ff824259b80 20 client.25864 trim_cache size 0 max 16384 2023-10-05T15:18:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 Processor -- start 2023-10-05T15:18:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 -- start start 2023-10-05T15:18:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d2c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d3b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d34890 0x558c50d30df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50afd920 con 0x558c50d299e0 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50d3b990 con 0x558c50d290c0 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.156+0000 7ff824259b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50d32720 con 0x558c50d34890 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d3b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d3b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40140/0 (socket says 172.21.15.60:40140) 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 -- 172.21.15.60:0/1765691798 learned_addr learned my addr 172.21.15.60:0/1765691798 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff815e0b700 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d2c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81660c700 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d34890 0x558c50d30df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 -- 172.21.15.60:0/1765691798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d34890 msgr2=0x558c50d30df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d34890 0x558c50d30df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 -- 172.21.15.60:0/1765691798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 msgr2=0x558c50d2c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d2c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 -- 172.21.15.60:0/1765691798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c50a90c60 con 0x558c50d299e0 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff815e0b700 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d2c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff81560a700 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d3b3e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff81019a7b0 tx=0x7ff800009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5ebb62d748302c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff804ff9700 1 -- 172.21.15.60:0/1765691798 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800004220 con 0x558c50d299e0 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff804ff9700 1 -- 172.21.15.60:0/1765691798 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff800018040 con 0x558c50d299e0 2023-10-05T15:18:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.157+0000 7ff804ff9700 1 -- 172.21.15.60:0/1765691798 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800003bb0 con 0x558c50d299e0 2023-10-05T15:18:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 -- 172.21.15.60:0/1765691798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 msgr2=0x558c50d3b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d3b3e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff81019a7b0 tx=0x7ff800009260 comp rx=0 tx=0).stop 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 -- 172.21.15.60:0/1765691798 shutdown_connections 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d34890 0x558c50d30df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d2c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 --2- 172.21.15.60:0/1765691798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d299e0 0x558c50d3b3e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 -- 172.21.15.60:0/1765691798 >> 172.21.15.60:0/1765691798 conn(0x558c50c9e260 msgr2=0x558c50d24660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 -- 172.21.15.60:0/1765691798 shutdown_connections 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.158+0000 7ff824259b80 1 -- 172.21.15.60:0/1765691798 wait complete. 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 -- start start 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 Processor -- start 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d3af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d299e0 0x558c50d393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d39900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50d39e40 con 0x558c50d34890 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50d39fb0 con 0x558c50d290c0 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c50d3a170 con 0x558c50d299e0 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff824259b80 10 client.0 _ll_register_callbacks cb 0x7ff808009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d3af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff81660c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d39900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff815e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d3af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53566/0 (socket says 172.21.15.60:53566) 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff815e0b700 1 -- 172.21.15.60:0/3512596644 learned_addr learned my addr 172.21.15.60:0/3512596644 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.159+0000 7ff81560a700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d299e0 0x558c50d393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff815e0b700 1 -- 172.21.15.60:0/3512596644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d299e0 msgr2=0x558c50d393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff815e0b700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d299e0 0x558c50d393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff815e0b700 1 -- 172.21.15.60:0/3512596644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 msgr2=0x558c50d39900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff815e0b700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d39900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff815e0b700 1 -- 172.21.15.60:0/3512596644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c017070 con 0x558c50d290c0 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff81660c700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d39900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff815e0b700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d3af70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff80c011be0 tx=0x7ff80c0304a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77351cbca3108682 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff7f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3512596644 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c02b030 con 0x558c50d290c0 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3512596644 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ff80c02c070 con 0x558c50d290c0 2023-10-05T15:18:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff80c003e70 con 0x558c50d290c0 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3512596644 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff80c026da0 con 0x558c50d290c0 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff824259b80 10 client.26000 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7ff800010730 con 0x558c50d290c0 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.160+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3512596644 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff80c003e70 con 0x558c50d290c0 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3512596644 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7ff80c003680 con 0x558c50d290c0 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 10 client.26000 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 10 client.26000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 20 client.26000 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d9b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 4 client.26000 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558c50c75b30 con 0x558c50d44290 2023-10-05T15:18:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff81560a700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d9b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff81560a700 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d9b0c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f2fc20f9442aeb server_cookie=d1d43855c02fb295 in_seq=0 out_seq=0 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff7f97fa700 10 client.26000 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff7f97fa700 1 -- 172.21.15.60:0/3512596644 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558c50c75b30 con 0x558c50d44290 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff7f97fa700 10 client.26000 handle_command_reply: tid=0 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.161+0000 7ff824259b80 1 client.26000 shutdown 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 msgr2=0x558c50d3af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d3af70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff80c011be0 tx=0x7ff80c0304a0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 shutdown_connections 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558c50d44290 0x558c50d9b0c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558c50d34890 0x558c50d39900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c50d290c0 0x558c50d3af70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 --2- 172.21.15.60:0/3512596644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c50d299e0 0x558c50d393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff7f97fa700 0 client.26000 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 >> 172.21.15.60:0/3512596644 conn(0x558c50c9e260 msgr2=0x558c50d24ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 shutdown_connections 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 1 -- 172.21.15.60:0/3512596644 wait complete. 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff824259b80 20 client.26000 trim_cache size 0 max 16384 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2023-10-05T15:18:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2023-10-05T15:18:51.175 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:18:51.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff7fc0a15f0 msgr2=0x7ff7fc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff7fc0a15f0 0x7ff7fc0a3ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff80c011490 tx=0x7ff80c009260 comp rx=0 tx=0).stop 2023-10-05T15:18:51.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810101c20 msgr2=0x7ff81019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810101c20 0x7ff81019db40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff80800b770 tx=0x7ff808007870 comp rx=0 tx=0).stop 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 shutdown_connections 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff810101c20 0x7ff81019db40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ff7fc0a15f0 0x7ff7fc0a3ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8100ff6c0 0x7ff8101991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 --2- 172.21.15.60:0/256097429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810100080 0x7ff8101996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.162+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 >> 172.21.15.60:0/256097429 conn(0x7ff8100761d0 msgr2=0x7ff8100fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.163+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 shutdown_connections 2023-10-05T15:18:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.163+0000 7ff81806f700 1 -- 172.21.15.60:0/256097429 wait complete. 2023-10-05T15:18:51.177 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-05T15:18:51.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:18:51.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 -- 172.21.15.60:0/160987576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 msgr2=0x7f49b810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 --2- 172.21.15.60:0/160987576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b810d8c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b0a0 tx=0x7f49b000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 -- 172.21.15.60:0/160987576 shutdown_connections 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 --2- 172.21.15.60:0/160987576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b810d8c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 --2- 172.21.15.60:0/160987576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 --2- 172.21.15.60:0/160987576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8102970 0x7f49b810ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 -- 172.21.15.60:0/160987576 >> 172.21.15.60:0/160987576 conn(0x7f49b80fb7f0 msgr2=0x7f49b80fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 -- 172.21.15.60:0/160987576 shutdown_connections 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.307+0000 7f49bd569700 1 -- 172.21.15.60:0/160987576 wait complete. 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 Processor -- start 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 -- start start 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8102970 0x7f49b81975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b819c050 con 0x7f49b810b420 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b819c1c0 con 0x7f49b8102050 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.308+0000 7f49bd569700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b819c380 con 0x7f49b8102970 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53580/0 (socket says 172.21.15.60:53580) 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 -- 172.21.15.60:0/1405319506 learned_addr learned my addr 172.21.15.60:0/1405319506 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b67fc700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8102970 0x7f49b81975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 -- 172.21.15.60:0/1405319506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8102970 msgr2=0x7f49b81975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8102970 0x7f49b81975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 -- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 msgr2=0x7f49b819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 -- 172.21.15.60:0/1405319506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009520 con 0x7f49b8102050 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b77fe700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49b6ffd700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8197070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49a800eb30 tx=0x7f49a800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8009880 con 0x7f49b8102050 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b0009d00 con 0x7f49b8102050 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49a80044e0 con 0x7f49b8102050 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b819c850 con 0x7f49b8102050 2023-10-05T15:18:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.309+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8003d80 con 0x7f49b8102050 2023-10-05T15:18:51.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.310+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b81065a0 con 0x7f49b8102050 2023-10-05T15:18:51.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.312+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f49a8003f00 con 0x7f49b8102050 2023-10-05T15:18:51.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.312+0000 7f499ffff700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f49a00a1630 0x7f49a00a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.312+0000 7f49b67fc700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f49a00a1630 0x7f49a00a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.313+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f49a8014070 con 0x7f49b8102050 2023-10-05T15:18:51.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.313+0000 7f49b67fc700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f49a00a1630 0x7f49a00a3af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b8198680 tx=0x7f49ac009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.320+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f49a8096af0 con 0x7f49b8102050 2023-10-05T15:18:51.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:51 smithi060 ceph-mon[99238]: pgmap v66: 129 pgs: 129 active+clean; 170 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 606 op/s 2023-10-05T15:18:51.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:51 smithi092 ceph-mon[102944]: pgmap v66: 129 pgs: 129 active+clean; 170 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 606 op/s 2023-10-05T15:18:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:51 smithi135 ceph-mon[103360]: pgmap v66: 129 pgs: 129 active+clean; 170 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 606 op/s 2023-10-05T15:18:51.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.590+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49b8067cd0 con 0x7f49b8102050 2023-10-05T15:18:51.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.591+0000 7f499ffff700 1 -- 172.21.15.60:0/1405319506 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+11374 (secure 0 0 0) 0x7f49a809a110 con 0x7f49b8102050 2023-10-05T15:18:51.593 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:18:51.593 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:18:26.076394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":58,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25822":{"gid":25822,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/2042143293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2042143293},{"type":"v1","addr":"172.21.15.135:6835","nonce":2042143293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:18:51.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f49a00a1630 msgr2=0x7f49a00a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f49a00a1630 0x7f49a00a3af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b8198680 tx=0x7f49ac009260 comp rx=0 tx=0).stop 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 msgr2=0x7f49b8197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8197070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49a800eb30 tx=0x7f49a800ee40 comp rx=0 tx=0).stop 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 shutdown_connections 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b810b420 0x7f49b819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f49a00a1630 0x7f49a00a3af0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b8102050 0x7f49b8197070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 --2- 172.21.15.60:0/1405319506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8102970 0x7f49b81975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 >> 172.21.15.60:0/1405319506 conn(0x7f49b80fb7f0 msgr2=0x7f49b810d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.593+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 shutdown_connections 2023-10-05T15:18:51.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.594+0000 7f49bd569700 1 -- 172.21.15.60:0/1405319506 wait complete. 2023-10-05T15:18:51.597 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 32 2023-10-05T15:18:51.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-05T15:18:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3181969907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 msgr2=0x7fa9f00698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3181969907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f00698e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009990 tx=0x7fa9e0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3181969907 shutdown_connections 2023-10-05T15:18:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3181969907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 0x7fa9f010dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3181969907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f00698e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3181969907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0069eb0 0x7fa9f0105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3181969907 >> 172.21.15.60:0/3181969907 conn(0x7fa9f0077cb0 msgr2=0x7fa9f00780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.739+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3181969907 shutdown_connections 2023-10-05T15:18:51.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.740+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3181969907 wait complete. 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.740+0000 7fa9f5de2700 1 Processor -- start 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 -- start start 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 0x7fa9f0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f019dca0 0x7fa9f019e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f019e720 con 0x7fa9f0069500 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f019e890 con 0x7fa9f0106230 2023-10-05T15:18:51.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9f5de2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f019ea50 con 0x7fa9f019dca0 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f0199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40172/0 (socket says 172.21.15.60:40172) 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3803652310 learned_addr learned my addr 172.21.15.60:0/3803652310 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 0x7fa9f0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9effff700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f019dca0 0x7fa9f019e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3803652310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f019dca0 msgr2=0x7fa9f019e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f019dca0 0x7fa9f019e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3803652310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 msgr2=0x7fa9f0199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 0x7fa9f0199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3803652310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e8009c40 con 0x7fa9f0069500 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.741+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 0x7fa9f0199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.742+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f0199300 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0005910 tx=0x7fa9e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.742+0000 7fa9ecff9700 1 -- 172.21.15.60:0/3803652310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e001d070 con 0x7fa9f0069500 2023-10-05T15:18:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.742+0000 7fa9ecff9700 1 -- 172.21.15.60:0/3803652310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9e0022470 con 0x7fa9f0069500 2023-10-05T15:18:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.742+0000 7fa9ecff9700 1 -- 172.21.15.60:0/3803652310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0017650 con 0x7fa9f0069500 2023-10-05T15:18:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.742+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e00095f0 con 0x7fa9f0069500 2023-10-05T15:18:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.742+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01a6190 con 0x7fa9f0069500 2023-10-05T15:18:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.744+0000 7fa9ecff9700 1 -- 172.21.15.60:0/3803652310 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa9e00225e0 con 0x7fa9f0069500 2023-10-05T15:18:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.745+0000 7fa9ecff9700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa9d80a15f0 0x7fa9d80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.745+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa9d80a15f0 0x7fa9d80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.745+0000 7fa9ecff9700 1 -- 172.21.15.60:0/3803652310 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fa9e00ce600 con 0x7fa9f0069500 2023-10-05T15:18:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.745+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa9d80a15f0 0x7fa9d80a3ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9f019a910 tx=0x7fa9e4009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 Processor -- start 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 -- start start 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299edd44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299eddf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299eddf890 0x56299ede1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ed3d460 con 0x56299eddf890 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ed2ec20 con 0x56299edd40c0 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7faa01fccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ed2c540 con 0x56299edd49e0 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299edd44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7fa9effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299eddf890 0x56299ede1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299edd44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53602/0 (socket says 172.21.15.60:53602) 2023-10-05T15:18:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/2565453370 learned_addr learned my addr 172.21.15.60:0/2565453370 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.746+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299eddf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/2565453370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 msgr2=0x56299eddf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299eddf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/2565453370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299eddf890 msgr2=0x56299ede1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299eddf890 0x56299ede1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/2565453370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299eb52de0 con 0x56299edd40c0 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299edd44a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9e009b280 tx=0x7fa9e009aeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e20ee5d6fa7528 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9d5ffb700 1 -- 172.21.15.60:0/2565453370 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e009b2f0 con 0x56299edd40c0 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9d5ffb700 1 -- 172.21.15.60:0/2565453370 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9e009f440 con 0x56299edd40c0 2023-10-05T15:18:51.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.747+0000 7fa9d5ffb700 1 -- 172.21.15.60:0/2565453370 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00229a0 con 0x56299edd40c0 2023-10-05T15:18:51.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 -- 172.21.15.60:0/2565453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 msgr2=0x56299edd44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299edd44a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9e009b280 tx=0x7fa9e009aeb0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 -- 172.21.15.60:0/2565453370 shutdown_connections 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299eddf890 0x56299ede1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299edd44a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2565453370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299eddf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 -- 172.21.15.60:0/2565453370 >> 172.21.15.60:0/2565453370 conn(0x56299ed49260 msgr2=0x56299edd0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 -- 172.21.15.60:0/2565453370 shutdown_connections 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 -- 172.21.15.60:0/2565453370 wait complete. 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.748+0000 7faa01fccb80 1 -- start start 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 Processor -- start 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 0x56299eddfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299ede01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299eddf890 0x56299ede0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ed27e30 con 0x56299edd40c0 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ecc4710 con 0x56299eddf890 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ecc43b0 con 0x56299edd49e0 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7faa01fccb80 10 client.0 _ll_register_callbacks cb 0x56299eb21800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 0x56299eddfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 0x56299eddfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40186/0 (socket says 172.21.15.60:40186) 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/2561437972 learned_addr learned my addr 172.21.15.60:0/2561437972 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299ede01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9effff700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299eddf890 0x56299ede0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9eeffd700 1 -- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299eddf890 msgr2=0x56299ede0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299eddf890 0x56299ede0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9eeffd700 1 -- 172.21.15.60:0/2561437972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 msgr2=0x56299eddfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 0x56299eddfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9eeffd700 1 -- 172.21.15.60:0/2561437972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01a6190 con 0x56299edd49e0 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 0x56299eddfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.749+0000 7fa9effff700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299eddf890 0x56299ede0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299ede01b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00690f0 tx=0x7fa9e40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=911f96bc1d4626bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9ceffd700 1 -- 172.21.15.60:0/2561437972 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e401e800 con 0x56299edd49e0 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56299edc7f10 con 0x56299edd49e0 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9ceffd700 1 -- 172.21.15.60:0/2561437972 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fa9e401e960 con 0x56299edd49e0 2023-10-05T15:18:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9ceffd700 1 -- 172.21.15.60:0/2561437972 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9e401eb20 con 0x56299edd49e0 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7faa01fccb80 10 client.25888 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56299eb3bc60 con 0x56299edd49e0 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9ceffd700 1 -- 172.21.15.60:0/2561437972 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56299edc7f10 con 0x56299edd49e0 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7fa9ceffd700 1 -- 172.21.15.60:0/2561437972 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fa9e4028bf0 con 0x56299edd49e0 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7faa01fccb80 10 client.25888 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7faa01fccb80 10 client.25888 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.750+0000 7faa01fccb80 20 client.25888 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.751+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299edef0b0 0x56299edf14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.751+0000 7faa01fccb80 4 client.25888 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.751+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56299ed20e10 con 0x56299edef0b0 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.751+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299edef0b0 0x56299edf14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.751+0000 7fa9ceffd700 10 client.25888 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.751+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299edef0b0 0x56299edf14d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=18e1c519b91fa2b1 server_cookie=f95769644e36b673 in_seq=0 out_seq=0 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7fa9ceffd700 1 -- 172.21.15.60:0/2561437972 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56299ed20e10 con 0x56299edef0b0 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7fa9ceffd700 10 client.25888 handle_command_reply: tid=0 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 client.25888 shutdown 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 msgr2=0x56299ede01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299ede01b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00690f0 tx=0x7fa9e40047c0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 shutdown_connections 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299eddf890 0x56299ede0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299edef0b0 0x56299edf14d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd40c0 0x56299eddfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7fa9ceffd700 0 client.25888 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 --2- 172.21.15.60:0/2561437972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299edd49e0 0x56299ede01b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 >> 172.21.15.60:0/2561437972 conn(0x56299ed49260 msgr2=0x56299edcffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 shutdown_connections 2023-10-05T15:18:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 1 -- 172.21.15.60:0/2561437972 wait complete. 2023-10-05T15:18:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.752+0000 7faa01fccb80 20 client.25888 trim_cache size 0 max 16384 2023-10-05T15:18:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.766+0000 7faa01fccb80 1 Processor -- start 2023-10-05T15:18:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.766+0000 7faa01fccb80 1 -- start start 2023-10-05T15:18:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299edea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299eddbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7faa01fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299eba8920 con 0x56299edd49e0 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7faa01fccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299edda870 con 0x56299edd40c0 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7faa01fccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299edd1d40 con 0x56299eddf890 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299edea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299edea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40196/0 (socket says 172.21.15.60:40196) 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9eeffd700 1 -- 172.21.15.60:0/3397363303 learned_addr learned my addr 172.21.15.60:0/3397363303 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9effff700 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299eddbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3397363303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 msgr2=0x56299eddbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299eddbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3397363303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 msgr2=0x56299edea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299edea400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/3397363303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299eddf320 con 0x56299edd40c0 2023-10-05T15:18:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede9ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0022d00 tx=0x7fa9e001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c4c45eaf5d53eac server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.767+0000 7fa9d67fc700 1 -- 172.21.15.60:0/3397363303 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00b7070 con 0x56299edd40c0 2023-10-05T15:18:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7fa9d67fc700 1 -- 172.21.15.60:0/3397363303 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9e0099690 con 0x56299edd40c0 2023-10-05T15:18:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7fa9d67fc700 1 -- 172.21.15.60:0/3397363303 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00ce220 con 0x56299edd40c0 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 -- 172.21.15.60:0/3397363303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 msgr2=0x56299ede9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede9ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0022d00 tx=0x7fa9e001a040 comp rx=0 tx=0).stop 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 -- 172.21.15.60:0/3397363303 shutdown_connections 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299eddbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede9ec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 --2- 172.21.15.60:0/3397363303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299edea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 -- 172.21.15.60:0/3397363303 >> 172.21.15.60:0/3397363303 conn(0x56299ed49260 msgr2=0x56299edd9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 -- 172.21.15.60:0/3397363303 shutdown_connections 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.768+0000 7faa01fccb80 1 -- 172.21.15.60:0/3397363303 wait complete. 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 -- start start 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 Processor -- start 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299ede27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299ee41ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ede30f0 con 0x56299edd49e0 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ee423e0 con 0x56299edd40c0 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299ee42520 con 0x56299eddf890 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7faa01fccb80 10 client.0 _ll_register_callbacks cb 0x7fa9e40045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53622/0 (socket says 172.21.15.60:53622) 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7fa9eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299ede27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/1211938384 learned_addr learned my addr 172.21.15.60:0/1211938384 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7fa9effff700 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299ee41ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.769+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/1211938384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 msgr2=0x56299ee41ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299ee41ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/1211938384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 msgr2=0x56299ede27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299ede27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ef7fe700 1 -- 172.21.15.60:0/1211938384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56299eb52de0 con 0x56299edd40c0 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ef7fe700 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede22a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00977a0 tx=0x7fa9e009ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87eb37db27958d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:18:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ceffd700 1 -- 172.21.15.60:0/1211938384 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00b7070 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9e009f440 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ceffd700 1 -- 172.21.15.60:0/1211938384 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fa9e00228c0 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ceffd700 1 -- 172.21.15.60:0/1211938384 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9e009ae30 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7faa01fccb80 10 client.26024 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56299eb79250 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ceffd700 1 -- 172.21.15.60:0/1211938384 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9e00a7080 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7fa9ceffd700 1 -- 172.21.15.60:0/1211938384 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fa9e007d020 con 0x56299edd40c0 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7faa01fccb80 10 client.26024 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7faa01fccb80 10 client.26024 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.770+0000 7faa01fccb80 20 client.26024 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299ee43740 0x56299ee45b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 4 client.26024 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 --> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56299ed20b30 con 0x56299ee43740 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299ee43740 0x56299ee45b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7fa9ceffd700 10 client.26024 ms_handle_connect on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7fa9eeffd700 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299ee43740 0x56299ee45b30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d74d0d6eaa291c6c server_cookie=ed18ed90cac9629b in_seq=0 out_seq=0 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7fa9ceffd700 1 -- 172.21.15.60:0/1211938384 <== mds.4 v2:172.21.15.92:6834/2553924574 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56299ed20b30 con 0x56299ee43740 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7fa9ceffd700 10 client.26024 handle_command_reply: tid=0 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 client.26024 shutdown 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 msgr2=0x56299ede22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede22a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00977a0 tx=0x7fa9e009ac50 comp rx=0 tx=0).stop 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 shutdown_connections 2023-10-05T15:18:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299eddf890 0x56299ee41ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299edd40c0 0x56299ede22a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.92:6834/2553924574,v1:172.21.15.92:6835/2553924574] conn(0x56299ee43740 0x56299ee45b30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 --2- 172.21.15.60:0/1211938384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56299edd49e0 0x56299ede27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7fa9ceffd700 0 client.26024 ms_handle_reset on v2:172.21.15.92:6834/2553924574 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 >> 172.21.15.60:0/1211938384 conn(0x56299ed49260 msgr2=0x56299edd88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.771+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 shutdown_connections 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7faa01fccb80 1 -- 172.21.15.60:0/1211938384 wait complete. 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7faa01fccb80 20 client.26024 trim_cache size 0 max 16384 2023-10-05T15:18:51.780 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa9d80a15f0 msgr2=0x7fa9d80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa9d80a15f0 0x7fa9d80a3ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9f019a910 tx=0x7fa9e4009260 comp rx=0 tx=0).stop 2023-10-05T15:18:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 msgr2=0x7fa9f0199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f0199300 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0005910 tx=0x7fa9e0004730 comp rx=0 tx=0).stop 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 shutdown_connections 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f019dca0 0x7fa9f019e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9f0069500 0x7fa9f0199300 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa9d80a15f0 0x7fa9d80a3ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 --2- 172.21.15.60:0/3803652310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9f0106230 0x7fa9f0199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 >> 172.21.15.60:0/3803652310 conn(0x7fa9f0077cb0 msgr2=0x7fa9f00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 shutdown_connections 2023-10-05T15:18:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.772+0000 7fa9f5de2700 1 -- 172.21.15.60:0/3803652310 wait complete. 2023-10-05T15:18:51.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-05T15:18:51.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 -- 172.21.15.60:0/77896279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 msgr2=0x7f730810cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 --2- 172.21.15.60:0/77896279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f730810cc30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7300009990 tx=0x7f7300009ca0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 -- 172.21.15.60:0/77896279 shutdown_connections 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 --2- 172.21.15.60:0/77896279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f730810cc30 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 --2- 172.21.15.60:0/77896279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 --2- 172.21.15.60:0/77896279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308100940 0x7f7308104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 -- 172.21.15.60:0/77896279 >> 172.21.15.60:0/77896279 conn(0x7f73080fb830 msgr2=0x7f73080fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 -- 172.21.15.60:0/77896279 shutdown_connections 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.921+0000 7f730ce59700 1 -- 172.21.15.60:0/77896279 wait complete. 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 Processor -- start 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 -- start start 2023-10-05T15:18:51.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f73081982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73081988a0 0x7f73081a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081a35b0 con 0x7f73081050b0 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081a3720 con 0x7f73080fff90 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730ce59700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081a38e0 con 0x7f73081988a0 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f73081982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f73081982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40214/0 (socket says 172.21.15.60:40214) 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f7305d9b700 1 -- 172.21.15.60:0/2606105819 learned_addr learned my addr 172.21.15.60:0/2606105819 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f730659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53636/0 (socket says 172.21.15.60:53636) 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f7306d9d700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73081988a0 0x7f73081a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.922+0000 7f7305d9b700 1 -- 172.21.15.60:0/2606105819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73081988a0 msgr2=0x7f73081a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73081988a0 0x7f73081a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f7305d9b700 1 -- 172.21.15.60:0/2606105819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 msgr2=0x7f7308197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f7305d9b700 1 -- 172.21.15.60:0/2606105819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009c40 con 0x7f73081050b0 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f730659c700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f7306d9d700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73081988a0 0x7f73081a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f73081982c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00e970 tx=0x7f72fc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f72f77fe700 1 -- 172.21.15.60:0/2606105819 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc009790 con 0x7f73081050b0 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f72f77fe700 1 -- 172.21.15.60:0/2606105819 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72fc00c7e0 con 0x7f73081050b0 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73000095f0 con 0x7f73081050b0 2023-10-05T15:18:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f72f77fe700 1 -- 172.21.15.60:0/2606105819 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0054e0 con 0x7f73081050b0 2023-10-05T15:18:51.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.923+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73081a3f40 con 0x7f73081050b0 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.925+0000 7f72f77fe700 1 -- 172.21.15.60:0/2606105819 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f72fc00c950 con 0x7f73081050b0 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.926+0000 7f72f77fe700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f72f00a15f0 0x7f72f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.926+0000 7f72f77fe700 1 -- 172.21.15.60:0/2606105819 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f72fc014070 con 0x7f73081050b0 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.926+0000 7f730659c700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f72f00a15f0 0x7f72f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.926+0000 7f730659c700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f72f00a15f0 0x7f72f00a3ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72f8007610 tx=0x7f72f800b040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 Processor -- start 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 -- start start 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be56760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be59090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bdb0460 con 0x55b61be470c0 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bda1c20 con 0x55b61be479e0 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7319043b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bd9f540 con 0x55b61be56ca0 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be56760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f730659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be56760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53646/0 (socket says 172.21.15.60:53646) 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7305d9b700 1 -- 172.21.15.60:0/2594674805 learned_addr learned my addr 172.21.15.60:0/2594674805 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.927+0000 7f7306d9d700 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be59090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f7305d9b700 1 -- 172.21.15.60:0/2594674805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 msgr2=0x55b61be59090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be59090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f7305d9b700 1 -- 172.21.15.60:0/2594674805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 msgr2=0x55b61be474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f7305d9b700 1 -- 172.21.15.60:0/2594674805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b61bbc5de0 con 0x55b61be479e0 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be56760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0a20f0 tx=0x7f72fc099f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722f3389a905ff9d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f72f4ff9700 1 -- 172.21.15.60:0/2594674805 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc094ea0 con 0x55b61be479e0 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f72f4ff9700 1 -- 172.21.15.60:0/2594674805 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72fc09e3e0 con 0x55b61be479e0 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.928+0000 7f72f4ff9700 1 -- 172.21.15.60:0/2594674805 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0cd270 con 0x55b61be479e0 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 -- 172.21.15.60:0/2594674805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 msgr2=0x55b61be56760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be56760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0a20f0 tx=0x7f72fc099f00 comp rx=0 tx=0).stop 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 -- 172.21.15.60:0/2594674805 shutdown_connections 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be59090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 --2- 172.21.15.60:0/2594674805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be56760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 -- 172.21.15.60:0/2594674805 >> 172.21.15.60:0/2594674805 conn(0x55b61bdbc260 msgr2=0x55b61be43450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 -- 172.21.15.60:0/2594674805 shutdown_connections 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 -- 172.21.15.60:0/2594674805 wait complete. 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 -- start start 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.929+0000 7f7319043b80 1 Processor -- start 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be53a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be53f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bd9ae30 con 0x55b61be470c0 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bd37710 con 0x55b61be479e0 2023-10-05T15:18:51.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bd373b0 con 0x55b61be56ca0 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7319043b80 10 client.0 _ll_register_callbacks cb 0x55b61bb94800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f730659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be53a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be53f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7306d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be53f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53652/0 (socket says 172.21.15.60:53652) 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f730659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be53a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40228/0 (socket says 172.21.15.60:40228) 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 -- 172.21.15.60:0/1480217921 learned_addr learned my addr 172.21.15.60:0/1480217921 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 -- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 msgr2=0x55b61be544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 -- 172.21.15.60:0/1480217921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 msgr2=0x55b61be53a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be53a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 -- 172.21.15.60:0/1480217921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73081a3f40 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f730659c700 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be53a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f7305d9b700 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be53f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0caab0 tx=0x7f72fc09a190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50dee0796d4eb81 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.930+0000 7f72edffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f72edffb700 1 -- 172.21.15.60:0/1480217921 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc094ea0 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b61be3af10 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f72edffb700 1 -- 172.21.15.60:0/1480217921 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f72fc0a2620 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f72edffb700 1 -- 172.21.15.60:0/1480217921 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72fc0cd270 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 10 client.26036 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b61bbaec60 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f72edffb700 1 -- 172.21.15.60:0/1480217921 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72fc07f080 con 0x55b61be479e0 2023-10-05T15:18:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f72edffb700 1 -- 172.21.15.60:0/1480217921 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f72fc0a2190 con 0x55b61be479e0 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 10 client.26036 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 10 client.26036 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 20 client.26036 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61be662d0 0x55b61be686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 4 client.26036 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b61bd93e10 con 0x55b61be662d0 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.931+0000 7f730659c700 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61be662d0 0x55b61be686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.932+0000 7f72edffb700 10 client.26036 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.932+0000 7f730659c700 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61be662d0 0x55b61be686c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23bd0add9135247c server_cookie=349e1f409fb3c36a in_seq=0 out_seq=0 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.932+0000 7f72edffb700 1 -- 172.21.15.60:0/1480217921 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b61bd93e10 con 0x55b61be662d0 2023-10-05T15:18:51.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.932+0000 7f72edffb700 10 client.26036 handle_command_reply: tid=0 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 client.26036 shutdown 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 msgr2=0x55b61be53f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be53f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0caab0 tx=0x7f72fc09a190 comp rx=0 tx=0).stop 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 shutdown_connections 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61be662d0 0x55b61be686c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f72edffb700 0 client.26036 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be470c0 0x55b61be53a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 --2- 172.21.15.60:0/1480217921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be53f60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 >> 172.21.15.60:0/1480217921 conn(0x55b61bdbc260 msgr2=0x55b61be43040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 shutdown_connections 2023-10-05T15:18:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 1 -- 172.21.15.60:0/1480217921 wait complete. 2023-10-05T15:18:51.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.933+0000 7f7319043b80 20 client.26036 trim_cache size 0 max 16384 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 Processor -- start 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 -- start start 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 0x55b61be542d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be479e0 0x55b61be52690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be52bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61bc1b920 con 0x55b61be479e0 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61be48020 con 0x55b61be470c0 2023-10-05T15:18:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7319043b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61be4f590 con 0x55b61be56ca0 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f730659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 0x55b61be542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be479e0 0x55b61be52690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f730659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 0x55b61be542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53658/0 (socket says 172.21.15.60:53658) 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f730659c700 1 -- 172.21.15.60:0/3874938182 learned_addr learned my addr 172.21.15.60:0/3874938182 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.952+0000 7f7306d9d700 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be52bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f730659c700 1 -- 172.21.15.60:0/3874938182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 msgr2=0x55b61be52bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f730659c700 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be52bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f730659c700 1 -- 172.21.15.60:0/3874938182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be479e0 msgr2=0x55b61be52690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f730659c700 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be479e0 0x55b61be52690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f730659c700 1 -- 172.21.15.60:0/3874938182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b61bbec250 con 0x55b61be470c0 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f7306d9d700 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f730659c700 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 0x55b61be542d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009550 tx=0x7f72f8009050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3e118942edf009 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f72f57fa700 1 -- 172.21.15.60:0/3874938182 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8017aa0 con 0x55b61be470c0 2023-10-05T15:18:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f72f57fa700 1 -- 172.21.15.60:0/3874938182 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72f800f040 con 0x55b61be470c0 2023-10-05T15:18:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.953+0000 7f72f57fa700 1 -- 172.21.15.60:0/3874938182 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8025d50 con 0x55b61be470c0 2023-10-05T15:18:51.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 -- 172.21.15.60:0/3874938182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 msgr2=0x55b61be542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 0x55b61be542d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009550 tx=0x7f72f8009050 comp rx=0 tx=0).stop 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 -- 172.21.15.60:0/3874938182 shutdown_connections 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be56ca0 0x55b61be52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be470c0 0x55b61be542d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 --2- 172.21.15.60:0/3874938182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be479e0 0x55b61be52690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 -- 172.21.15.60:0/3874938182 >> 172.21.15.60:0/3874938182 conn(0x55b61bdbc260 msgr2=0x55b61be51f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 -- 172.21.15.60:0/3874938182 shutdown_connections 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 -- 172.21.15.60:0/3874938182 wait complete. 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 -- start start 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.954+0000 7f7319043b80 1 Processor -- start 2023-10-05T15:18:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 0x55b61be5d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be5b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be56ca0 0x55b61be5be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61be5c410 con 0x55b61be56ca0 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61be5c550 con 0x55b61be479e0 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61be5c710 con 0x55b61be470c0 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7319043b80 10 client.0 _ll_register_callbacks cb 0x7f72f8009250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 0x55b61be5d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 0x55b61be5d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53772/0 (socket says 172.21.15.60:53772) 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7305d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be5b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 -- 172.21.15.60:0/2495089255 learned_addr learned my addr 172.21.15.60:0/2495089255 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:51.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7306d9d700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be56ca0 0x55b61be5be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 -- 172.21.15.60:0/2495089255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 msgr2=0x55b61be5b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be5b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 -- 172.21.15.60:0/2495089255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be56ca0 msgr2=0x55b61be5be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be56ca0 0x55b61be5be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 -- 172.21.15.60:0/2495089255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730810d4a0 con 0x55b61be470c0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be5b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f730659c700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 0x55b61be5d690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009f60 tx=0x7f72f80098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895e91141995843b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.955+0000 7f72edffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f72edffb700 1 -- 172.21.15.60:0/2495089255 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8025610 con 0x55b61be470c0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f72edffb700 1 -- 172.21.15.60:0/2495089255 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f72f8037020 con 0x55b61be470c0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72fc09e3e0 con 0x55b61be470c0 2023-10-05T15:18:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f72edffb700 1 -- 172.21.15.60:0/2495089255 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72f8025770 con 0x55b61be470c0 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 10 client.25912 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f72f800ea70 con 0x55b61be470c0 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f72edffb700 1 -- 172.21.15.60:0/2495089255 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72fc09e3e0 con 0x55b61be470c0 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f72edffb700 1 -- 172.21.15.60:0/2495089255 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f72f8033b00 con 0x55b61be470c0 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 10 client.25912 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 10 client.25912 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 20 client.25912 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61bebb570 0x55b61bebd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 4 client.25912 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 --> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b61bd93b30 con 0x55b61bebb570 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.956+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61bebb570 0x55b61bebd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f72edffb700 10 client.25912 ms_handle_connect on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:51.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7305d9b700 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61bebb570 0x55b61bebd990 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4b75f256ab1ba481 server_cookie=a69d19100d3f26b8 in_seq=0 out_seq=0 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f72edffb700 1 -- 172.21.15.60:0/2495089255 <== mds.3 v2:172.21.15.135:6836/2461370959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b61bd93b30 con 0x55b61bebb570 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f72edffb700 10 client.25912 handle_command_reply: tid=0 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 client.25912 shutdown 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 msgr2=0x55b61be5d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 0x55b61be5d690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009f60 tx=0x7f72f80098a0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 shutdown_connections 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:6836/2461370959,v1:172.21.15.135:6837/2461370959] conn(0x55b61bebb570 0x55b61bebd990 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61be56ca0 0x55b61be5be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61be470c0 0x55b61be5d690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 --2- 172.21.15.60:0/2495089255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61be479e0 0x55b61be5b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f72edffb700 0 client.25912 ms_handle_reset on v2:172.21.15.135:6836/2461370959 2023-10-05T15:18:51.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 >> 172.21.15.60:0/2495089255 conn(0x55b61bdbc260 msgr2=0x55b61be52810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 shutdown_connections 2023-10-05T15:18:51.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 1 -- 172.21.15.60:0/2495089255 wait complete. 2023-10-05T15:18:51.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.957+0000 7f7319043b80 20 client.25912 trim_cache size 0 max 16384 2023-10-05T15:18:51.966 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f72f00a15f0 msgr2=0x7f72f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f72f00a15f0 0x7f72f00a3ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72f8007610 tx=0x7f72f800b040 comp rx=0 tx=0).stop 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 msgr2=0x7f73081982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f73081982c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00e970 tx=0x7f72fc00ec80 comp rx=0 tx=0).stop 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 shutdown_connections 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73081988a0 0x7f73081a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f72f00a15f0 0x7f72f00a3ab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73080fff90 0x7f7308197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 --2- 172.21.15.60:0/2606105819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73081050b0 0x7f73081982c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 >> 172.21.15.60:0/2606105819 conn(0x7f73080fb830 msgr2=0x7f73080fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 shutdown_connections 2023-10-05T15:18:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:51.958+0000 7f730ce59700 1 -- 172.21.15.60:0/2606105819 wait complete. 2023-10-05T15:18:51.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-05T15:18:52.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1427119318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0108870 msgr2=0x7f9ff0114750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1427119318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0108870 0x7f9ff0114750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800b0a0 tx=0x7f9fe800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1427119318 shutdown_connections 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1427119318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0108870 0x7f9ff0114750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1427119318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1427119318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff0107eb0 0x7f9ff0108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.139+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1427119318 >> 172.21.15.60:0/1427119318 conn(0x7f9ff006d400 msgr2=0x7f9ff006d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.140+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1427119318 shutdown_connections 2023-10-05T15:18:52.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.140+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1427119318 wait complete. 2023-10-05T15:18:52.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 Processor -- start 2023-10-05T15:18:52.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 -- start start 2023-10-05T15:18:52.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0107eb0 0x7f9ff01176b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff0108870 0x7f9ff0117c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff011c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff011c750 con 0x7f9ff0108870 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff011c8c0 con 0x7f9ff0107eb0 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.141+0000 7f9ff75a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff011ca80 con 0x7f9ff010d890 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff011c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff011c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53788/0 (socket says 172.21.15.60:53788) 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1763792999 learned_addr learned my addr 172.21.15.60:0/1763792999 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1763792999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0107eb0 msgr2=0x7f9ff01176b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:18:52.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0107eb0 0x7f9ff01176b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff0108870 msgr2=0x7f9ff0117c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff0108870 0x7f9ff0117c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1763792999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8009d00 con 0x7f9ff010d890 2023-10-05T15:18:52.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff011c0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80062a0 tx=0x7f9fe80124a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9fe67fc700 1 -- 172.21.15.60:0/1763792999 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800e040 con 0x7f9ff010d890 2023-10-05T15:18:52.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff011cd00 con 0x7f9ff010d890 2023-10-05T15:18:52.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9fe67fc700 1 -- 172.21.15.60:0/1763792999 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fe8012e50 con 0x7f9ff010d890 2023-10-05T15:18:52.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.142+0000 7f9fe67fc700 1 -- 172.21.15.60:0/1763792999 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80057a0 con 0x7f9ff010d890 2023-10-05T15:18:52.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.143+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff01bb4c0 con 0x7f9ff010d890 2023-10-05T15:18:52.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.145+0000 7f9fe67fc700 1 -- 172.21.15.60:0/1763792999 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9fe8003c00 con 0x7f9ff010d890 2023-10-05T15:18:52.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.146+0000 7f9fe67fc700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fdc0a1620 0x7f9fdc0a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.146+0000 7f9ff533e700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fdc0a1620 0x7f9fdc0a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.146+0000 7f9fe67fc700 1 -- 172.21.15.60:0/1763792999 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f9fe80ce7e0 con 0x7f9ff010d890 2023-10-05T15:18:52.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.146+0000 7fa00378cb80 1 Processor -- start 2023-10-05T15:18:52.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 -- start start 2023-10-05T15:18:52.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff533e700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fdc0a1620 0x7f9fdc0a3ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009710 tx=0x7f9fec006c60 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 0x55f7766234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776630c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f77658c460 con 0x55f77662e890 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f77657dc20 con 0x55f7766239e0 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7fa00378cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f77657b540 con 0x55f7766230c0 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff4b3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776630c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff4b3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53686/0 (socket says 172.21.15.60:53686) 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776630c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40266/0 (socket says 172.21.15.60:40266) 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff4b3d700 1 -- 172.21.15.60:0/1237827934 learned_addr learned my addr 172.21.15.60:0/1237827934 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1237827934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 msgr2=0x55f7766234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 0x55f7766234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1237827934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 msgr2=0x55f77662e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.147+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/1237827934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7763a1de0 con 0x55f77662e890 2023-10-05T15:18:52.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.148+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776630c80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80cbc10 tx=0x7f9fe809b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1706a6b38f3a63a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.148+0000 7f9fdb7fe700 1 -- 172.21.15.60:0/1237827934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe809f680 con 0x55f77662e890 2023-10-05T15:18:52.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.148+0000 7f9fdb7fe700 1 -- 172.21.15.60:0/1237827934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fe80a3830 con 0x55f77662e890 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.148+0000 7f9fdb7fe700 1 -- 172.21.15.60:0/1237827934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80cc060 con 0x55f77662e890 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 -- 172.21.15.60:0/1237827934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 msgr2=0x55f776630c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776630c80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80cbc10 tx=0x7f9fe809b410 comp rx=0 tx=0).stop 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 -- 172.21.15.60:0/1237827934 shutdown_connections 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776630c80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 0x55f7766234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1237827934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 -- 172.21.15.60:0/1237827934 >> 172.21.15.60:0/1237827934 conn(0x55f776598260 msgr2=0x55f77661f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 -- 172.21.15.60:0/1237827934 shutdown_connections 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.149+0000 7fa00378cb80 1 -- 172.21.15.60:0/1237827934 wait complete. 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 -- start start 2023-10-05T15:18:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 Processor -- start 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 0x55f77662ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776639cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f776576e30 con 0x55f77662e890 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f776513710 con 0x55f7766239e0 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7765133b0 con 0x55f7766230c0 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.150+0000 7fa00378cb80 10 client.0 _ll_register_callbacks cb 0x55f776370800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776639cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776639cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40272/0 (socket says 172.21.15.60:40272) 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/127608364 learned_addr learned my addr 172.21.15.60:0/127608364 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/127608364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 msgr2=0x55f77662ee60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:18:52.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 0x55f77662ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 msgr2=0x55f77662f3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 -- 172.21.15.60:0/127608364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff01bb4c0 con 0x55f77662e890 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.151+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776639cf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8097fa0 tx=0x7f9fe800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1b66479b442f56 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7f9fd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/127608364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8099990 con 0x55f77662e890 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/127608364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f9fe8097c40 con 0x55f77662e890 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f776616f10 con 0x55f77662e890 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/127608364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fe8097e00 con 0x55f77662e890 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7fa00378cb80 10 client.16380 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f77638ac60 con 0x55f77662e890 2023-10-05T15:18:52.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/127608364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f776616f10 con 0x55f77662e890 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/127608364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f9fe8062030 con 0x55f77662e890 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7fa00378cb80 10 client.16380 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.153+0000 7fa00378cb80 10 client.16380 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7fa00378cb80 20 client.16380 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7fa00378cb80 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f77663dd50 0x55f776640170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7fa00378cb80 4 client.16380 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f77656fe10 con 0x55f77663dd50 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7f9ff533e700 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f77663dd50 0x55f776640170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7f9fd8ff9700 10 client.16380 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.154+0000 7f9ff533e700 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f77663dd50 0x55f776640170 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=49a4f136b11def64 server_cookie=c1b653e04ba4bfe in_seq=0 out_seq=0 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/127608364 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f77656fe10 con 0x55f77663dd50 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7f9fd8ff9700 10 client.16380 handle_command_reply: tid=0 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 client.16380 shutdown 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 msgr2=0x55f776639cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776639cf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8097fa0 tx=0x7f9fe800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 shutdown_connections 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f77663dd50 0x55f776640170 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f77662e890 0x55f776639cf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7766230c0 0x55f77662ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 --2- 172.21.15.60:0/127608364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f77662f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 >> 172.21.15.60:0/127608364 conn(0x55f776598260 msgr2=0x55f77661f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7f9fd8ff9700 0 client.16380 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 shutdown_connections 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.156+0000 7fa00378cb80 1 -- 172.21.15.60:0/127608364 wait complete. 2023-10-05T15:18:52.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.157+0000 7fa00378cb80 20 client.16380 trim_cache size 0 max 16384 2023-10-05T15:18:52.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 Processor -- start 2023-10-05T15:18:52.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 -- start start 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 0x55f77662f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f776628110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f77662e890 0x55f776639360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7763f7920 con 0x55f7766230c0 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f77662e1c0 con 0x55f7766239e0 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7fa00378cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7766234a0 con 0x55f77662e890 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7f9ff4b3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f776628110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7f9ff533e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 0x55f77662f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7f9ff4b3d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f776628110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53700/0 (socket says 172.21.15.60:53700) 2023-10-05T15:18:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7f9ff533e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 0x55f77662f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40276/0 (socket says 172.21.15.60:40276) 2023-10-05T15:18:52.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.183+0000 7f9ff4b3d700 1 -- 172.21.15.60:0/2565283424 learned_addr learned my addr 172.21.15.60:0/2565283424 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9ff533e700 1 -- 172.21.15.60:0/2565283424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f77662e890 msgr2=0x55f776639360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:18:52.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9ff533e700 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f77662e890 0x55f776639360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9ff533e700 1 -- 172.21.15.60:0/2565283424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 msgr2=0x55f776628110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9ff533e700 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f776628110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9ff533e700 1 -- 172.21.15.60:0/2565283424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f77662d6b0 con 0x55f7766230c0 2023-10-05T15:18:52.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9ff533e700 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 0x55f77662f380 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55f776640a50 tx=0x7f9fec00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b9977ecc2e3b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9fdbfff700 1 -- 172.21.15.60:0/2565283424 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec01a040 con 0x55f7766230c0 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9fdbfff700 1 -- 172.21.15.60:0/2565283424 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fec013d20 con 0x55f7766230c0 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.184+0000 7f9fdbfff700 1 -- 172.21.15.60:0/2565283424 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec012d30 con 0x55f7766230c0 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 -- 172.21.15.60:0/2565283424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 msgr2=0x55f77662f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 0x55f77662f380 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55f776640a50 tx=0x7f9fec00e000 comp rx=0 tx=0).stop 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 -- 172.21.15.60:0/2565283424 shutdown_connections 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f77662e890 0x55f776639360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766230c0 0x55f77662f380 secure :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55f776640a50 tx=0x7f9fec00e000 comp rx=0 tx=0).stop 2023-10-05T15:18:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 --2- 172.21.15.60:0/2565283424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7766239e0 0x55f776628110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 -- 172.21.15.60:0/2565283424 >> 172.21.15.60:0/2565283424 conn(0x55f776598260 msgr2=0x55f77662ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 -- 172.21.15.60:0/2565283424 shutdown_connections 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.185+0000 7fa00378cb80 1 -- 172.21.15.60:0/2565283424 wait complete. 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 -- start start 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 Processor -- start 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 0x55f7766335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f77662e890 0x55f776633b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f776631930 0x55f776631db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7766323d0 con 0x55f7766239e0 2023-10-05T15:18:52.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f776632510 con 0x55f77662e890 2023-10-05T15:18:52.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7766326d0 con 0x55f776631930 2023-10-05T15:18:52.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.186+0000 7fa00378cb80 10 client.0 _ll_register_callbacks cb 0x7f9fe809b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:52.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.187+0000 7f9ff533e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 0x55f7766335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 0x55f7766335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40282/0 (socket says 172.21.15.60:40282) 2023-10-05T15:18:52.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 -- 172.21.15.60:0/1244393978 learned_addr learned my addr 172.21.15.60:0/1244393978 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff5b3f700 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f776631930 0x55f776631db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 -- 172.21.15.60:0/1244393978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f776631930 msgr2=0x55f776631db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f776631930 0x55f776631db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 -- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f77662e890 msgr2=0x55f776633b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f77662e890 0x55f776633b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 -- 172.21.15.60:0/1244393978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec01f980 con 0x55f7766239e0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9ff533e700 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 0x55f7766335c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9fec022000 tx=0x7f9fec01f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aebdca09a159dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9fd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/1244393978 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec01a050 con 0x55f7766239e0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/1244393978 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f9fec012890 con 0x55f7766239e0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fe80a3830 con 0x55f7766239e0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/1244393978 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fec012a50 con 0x55f7766239e0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.188+0000 7fa00378cb80 10 client.16386 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f7763c8250 con 0x55f7766239e0 2023-10-05T15:18:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/1244393978 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fe80a3830 con 0x55f7766239e0 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/1244393978 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f9fec003740 con 0x55f7766239e0 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 10 client.16386 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 10 client.16386 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 20 client.16386 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f776693000 0x55f776695420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 4 client.16386 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 --> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f77656fb30 con 0x55f776693000 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.189+0000 7f9ff4b3d700 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f776693000 0x55f776695420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.190+0000 7f9fd8ff9700 10 client.16386 ms_handle_connect on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.190+0000 7f9ff4b3d700 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f776693000 0x55f776695420 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b8c61810c79f2ab server_cookie=c4123b6701ae3a62 in_seq=0 out_seq=0 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7f9fd8ff9700 1 -- 172.21.15.60:0/1244393978 <== mds.2 v2:172.21.15.92:6836/1596160002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f77656fb30 con 0x55f776693000 2023-10-05T15:18:52.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7f9fd8ff9700 10 client.16386 handle_command_reply: tid=0 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 client.16386 shutdown 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 msgr2=0x55f7766335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 0x55f7766335c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9fec022000 tx=0x7f9fec01f6a0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 shutdown_connections 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:6836/1596160002,v1:172.21.15.92:6837/1596160002] conn(0x55f776693000 0x55f776695420 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f776631930 0x55f776631db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7f9fd8ff9700 0 client.16386 ms_handle_reset on v2:172.21.15.92:6836/1596160002 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7766239e0 0x55f7766335c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 --2- 172.21.15.60:0/1244393978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f77662e890 0x55f776633b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.191+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 >> 172.21.15.60:0/1244393978 conn(0x55f776598260 msgr2=0x55f77662c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 shutdown_connections 2023-10-05T15:18:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7fa00378cb80 1 -- 172.21.15.60:0/1244393978 wait complete. 2023-10-05T15:18:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7fa00378cb80 20 client.16386 trim_cache size 0 max 16384 2023-10-05T15:18:52.198 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fdc0a1620 msgr2=0x7f9fdc0a3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fdc0a1620 0x7f9fdc0a3ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009710 tx=0x7f9fec006c60 comp rx=0 tx=0).stop 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 msgr2=0x7f9ff011c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff011c0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80062a0 tx=0x7f9fe80124a0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 shutdown_connections 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff010d890 0x7f9ff011c0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fdc0a1620 0x7f9fdc0a3ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff0107eb0 0x7f9ff01176b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 --2- 172.21.15.60:0/1763792999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff0108870 0x7f9ff0117c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 >> 172.21.15.60:0/1763792999 conn(0x7f9ff006d400 msgr2=0x7f9ff010b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 shutdown_connections 2023-10-05T15:18:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.192+0000 7f9ff75a2700 1 -- 172.21.15.60:0/1763792999 wait complete. 2023-10-05T15:18:52.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-05T15:18:52.233 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:52 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1405319506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:18:52.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 -- 172.21.15.60:0/2521430329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 msgr2=0x7f5db41003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 --2- 172.21.15.60:0/2521430329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db41003d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009f90 tx=0x7f5dac00b330 comp rx=0 tx=0).stop 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 -- 172.21.15.60:0/2521430329 shutdown_connections 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 --2- 172.21.15.60:0/2521430329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 --2- 172.21.15.60:0/2521430329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db41003d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 --2- 172.21.15.60:0/2521430329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db41009a0 0x7f5db41049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.347+0000 7f5db8f77700 1 -- 172.21.15.60:0/2521430329 >> 172.21.15.60:0/2521430329 conn(0x7f5db40fb890 msgr2=0x7f5db40fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.348+0000 7f5db8f77700 1 -- 172.21.15.60:0/2521430329 shutdown_connections 2023-10-05T15:18:52.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.348+0000 7f5db8f77700 1 -- 172.21.15.60:0/2521430329 wait complete. 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.348+0000 7f5db8f77700 1 Processor -- start 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.348+0000 7f5db8f77700 1 -- start start 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db8f77700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db4199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db8f77700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db41996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db8f77700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db419db10 0x7f5db419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db8f77700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db419e590 con 0x7f5db4105110 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db8f77700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db419e700 con 0x7f5db40ffff0 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db8f77700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db419e8c0 con 0x7f5db419db10 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db41996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db4199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db4199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53718/0 (socket says 172.21.15.60:53718) 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 -- 172.21.15.60:0/536539394 learned_addr learned my addr 172.21.15.60:0/536539394 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db41996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40298/0 (socket says 172.21.15.60:40298) 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db419db10 0x7f5db419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 -- 172.21.15.60:0/536539394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db419db10 msgr2=0x7f5db419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db419db10 0x7f5db419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 -- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 msgr2=0x7f5db41996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db41996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 -- 172.21.15.60:0/536539394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80095f0 con 0x7f5db40ffff0 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db41996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:52.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.349+0000 7f5db259c700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db4199170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00b6c0 tx=0x7f5dac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.350+0000 7f5da37fe700 1 -- 172.21.15.60:0/536539394 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00e040 con 0x7f5db40ffff0 2023-10-05T15:18:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.350+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac009c40 con 0x7f5db40ffff0 2023-10-05T15:18:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.350+0000 7f5da37fe700 1 -- 172.21.15.60:0/536539394 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dac00bbf0 con 0x7f5db40ffff0 2023-10-05T15:18:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.350+0000 7f5da37fe700 1 -- 172.21.15.60:0/536539394 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac01b6b0 con 0x7f5db40ffff0 2023-10-05T15:18:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.350+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db41a60b0 con 0x7f5db40ffff0 2023-10-05T15:18:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.353+0000 7f5da37fe700 1 -- 172.21.15.60:0/536539394 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5dac01d480 con 0x7f5db40ffff0 2023-10-05T15:18:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5da37fe700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5d9c0a15f0 0x7f5d9c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 Processor -- start 2023-10-05T15:18:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5d9c0a15f0 0x7f5d9c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5da37fe700 1 -- 172.21.15.60:0/536539394 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f5dac0ce8b0 con 0x7f5db40ffff0 2023-10-05T15:18:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 -- start start 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad469e0 0x55b43ad51350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad51890 0x55b43ad53c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43acaf460 con 0x55b43ad460c0 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43aca0c20 con 0x55b43ad469e0 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ac9e540 con 0x55b43ad51890 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5d9c0a15f0 0x7f5d9c0a3ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5db419a780 tx=0x7f5da4009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40304/0 (socket says 172.21.15.60:40304) 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad51890 0x55b43ad53c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db259c700 1 -- 172.21.15.60:0/4147172586 learned_addr learned my addr 172.21.15.60:0/4147172586 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.354+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad469e0 0x55b43ad51350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db259c700 1 -- 172.21.15.60:0/4147172586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad51890 msgr2=0x55b43ad53c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db259c700 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad51890 0x55b43ad53c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db259c700 1 -- 172.21.15.60:0/4147172586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad469e0 msgr2=0x55b43ad51350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db259c700 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad469e0 0x55b43ad51350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db259c700 1 -- 172.21.15.60:0/4147172586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b43aac4de0 con 0x55b43ad460c0 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad51890 0x55b43ad53c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5db259c700 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad464a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5dac097b00 tx=0x7f5dac009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96ac9ccde259b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5da0ff9700 1 -- 172.21.15.60:0/4147172586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac09bd00 con 0x55b43ad460c0 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5da0ff9700 1 -- 172.21.15.60:0/4147172586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dac09b600 con 0x55b43ad460c0 2023-10-05T15:18:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.355+0000 7f5da0ff9700 1 -- 172.21.15.60:0/4147172586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac097ea0 con 0x55b43ad460c0 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 -- 172.21.15.60:0/4147172586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 msgr2=0x55b43ad464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad464a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5dac097b00 tx=0x7f5dac009ba0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 -- 172.21.15.60:0/4147172586 shutdown_connections 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad51890 0x55b43ad53c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad464a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/4147172586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad469e0 0x55b43ad51350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 -- 172.21.15.60:0/4147172586 >> 172.21.15.60:0/4147172586 conn(0x55b43acbb260 msgr2=0x55b43ad42450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 -- 172.21.15.60:0/4147172586 shutdown_connections 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 -- 172.21.15.60:0/4147172586 wait complete. 2023-10-05T15:18:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 -- start start 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.356+0000 7f5dc5161b80 1 Processor -- start 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad51c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad5ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ac99e30 con 0x55b43ad460c0 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ac36710 con 0x55b43ad51890 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ac363b0 con 0x55b43ad469e0 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5dc5161b80 10 client.0 _ll_register_callbacks cb 0x55b43aa93800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad51c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad51c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40310/0 (socket says 172.21.15.60:40310) 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 -- 172.21.15.60:0/2047097369 learned_addr learned my addr 172.21.15.60:0/2047097369 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad5ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 -- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 msgr2=0x55b43ad521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 -- 172.21.15.60:0/2047097369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 msgr2=0x55b43ad5ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad5ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 -- 172.21.15.60:0/2047097369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da8009b60 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5db259c700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad51c70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0ceb90 tx=0x7f5dac097a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a2c8b917c67269 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5d99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2047097369 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac09bd00 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.357+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2047097369 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f5dac09f750 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b43ad39f10 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2047097369 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dac0a3900 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 10 client.16398 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f5db41a60b0 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2047097369 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b43ad39f10 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2047097369 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f5dac09abf0 con 0x55b43ad460c0 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 10 client.16398 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 10 client.16398 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 20 client.16398 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43ad60bd0 0x55b43ad62ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 4 client.16398 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b43ac92e10 con 0x55b43ad60bd0 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.358+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43ad60bd0 0x55b43ad62ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.359+0000 7f5d99ffb700 10 client.16398 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.359+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43ad60bd0 0x55b43ad62ff0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1caa202ad7a3ac7c server_cookie=efb8db2a6399e1d1 in_seq=0 out_seq=0 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.361+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2047097369 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b43ac92e10 con 0x55b43ad60bd0 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.361+0000 7f5d99ffb700 10 client.16398 handle_command_reply: tid=0 2023-10-05T15:18:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.361+0000 7f5dc5161b80 1 client.16398 shutdown 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.361+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 msgr2=0x55b43ad51c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad51c70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0ceb90 tx=0x7f5dac097a70 comp rx=0 tx=0).stop 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 shutdown_connections 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43ad60bd0 0x55b43ad62ff0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad5ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad51c70 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5d99ffb700 0 client.16398 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2047097369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 >> 172.21.15.60:0/2047097369 conn(0x55b43acbb260 msgr2=0x55b43ad41fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 shutdown_connections 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2047097369 wait complete. 2023-10-05T15:18:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.362+0000 7f5dc5161b80 20 client.16398 trim_cache size 0 max 16384 2023-10-05T15:18:52.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 Processor -- start 2023-10-05T15:18:52.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 -- start start 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad4fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad4c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ab1a920 con 0x55b43ad460c0 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ad47320 con 0x55b43ad51890 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ad50f50 con 0x55b43ad469e0 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad4fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad4fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40318/0 (socket says 172.21.15.60:40318) 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 -- 172.21.15.60:0/3198409133 learned_addr learned my addr 172.21.15.60:0/3198409133 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db1d9b700 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad4c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 -- 172.21.15.60:0/3198409133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 msgr2=0x55b43ad4bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad4bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 -- 172.21.15.60:0/3198409133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 msgr2=0x55b43ad4c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad4c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 -- 172.21.15.60:0/3198409133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b43ad3e140 con 0x55b43ad460c0 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.375+0000 7f5db259c700 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad4fd60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5dac097b00 tx=0x7f5dac009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7b73ca7bf17f8c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5da17fa700 1 -- 172.21.15.60:0/3198409133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac09bd00 con 0x55b43ad460c0 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5da17fa700 1 -- 172.21.15.60:0/3198409133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dac09f750 con 0x55b43ad460c0 2023-10-05T15:18:52.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5da17fa700 1 -- 172.21.15.60:0/3198409133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac09ad50 con 0x55b43ad460c0 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 -- 172.21.15.60:0/3198409133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 msgr2=0x55b43ad4fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad4fd60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5dac097b00 tx=0x7f5dac009ba0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 -- 172.21.15.60:0/3198409133 shutdown_connections 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad51890 0x55b43ad4c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad460c0 0x55b43ad4fd60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/3198409133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 -- 172.21.15.60:0/3198409133 >> 172.21.15.60:0/3198409133 conn(0x55b43acbb260 msgr2=0x55b43ad40bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 -- 172.21.15.60:0/3198409133 shutdown_connections 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.376+0000 7f5dc5161b80 1 -- 172.21.15.60:0/3198409133 wait complete. 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 -- start start 2023-10-05T15:18:52.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 Processor -- start 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad460c0 0x55b43ad54e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad55390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 0x55b43adb39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43ad55b20 con 0x55b43ad51890 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43adb3f30 con 0x55b43ad460c0 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43adb40f0 con 0x55b43ad469e0 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5dc5161b80 10 client.0 _ll_register_callbacks cb 0x7f5da4004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 0x55b43adb39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad460c0 0x55b43ad54e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db1d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad55390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 0x55b43adb39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40328/0 (socket says 172.21.15.60:40328) 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 -- 172.21.15.60:0/2545167381 learned_addr learned my addr 172.21.15.60:0/2545167381 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad460c0 0x55b43ad54e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53746/0 (socket says 172.21.15.60:53746) 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 -- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 msgr2=0x55b43ad55390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad55390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 -- 172.21.15.60:0/2545167381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad460c0 msgr2=0x55b43ad54e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad460c0 0x55b43ad54e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.377+0000 7f5db2d9d700 1 -- 172.21.15.60:0/2545167381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db41a60b0 con 0x55b43ad51890 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5db2d9d700 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 0x55b43adb39c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5da8012c90 tx=0x7f5da8009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e66101da3e72ce server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5d99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2545167381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8017040 con 0x55b43ad51890 2023-10-05T15:18:52.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2545167381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f5da8004250 con 0x55b43ad51890 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5dac09b600 con 0x55b43ad51890 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2545167381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5da8004410 con 0x55b43ad51890 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5dc5161b80 10 client.16404 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b43aaadc60 con 0x55b43ad51890 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.378+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2545167381 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dac09b600 con 0x55b43ad51890 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2545167381 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f5da8004c50 con 0x55b43ad51890 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5dc5161b80 10 client.16404 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5dc5161b80 10 client.16404 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5dc5161b80 20 client.16404 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43adb5a30 0x55b43adb7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5dc5161b80 4 client.16404 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:52.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 --> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b43ac92b30 con 0x55b43adb5a30 2023-10-05T15:18:52.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5db259c700 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43adb5a30 0x55b43adb7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:52.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5db259c700 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43adb5a30 0x55b43adb7e50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da89ad591f845907 server_cookie=cb68ae0edd575e79 in_seq=0 out_seq=0 2023-10-05T15:18:52.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.379+0000 7f5d99ffb700 10 client.16404 ms_handle_connect on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:52.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5d99ffb700 1 -- 172.21.15.60:0/2545167381 <== mds.1 v2:172.21.15.135:6838/1073230370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+222774 (crc 0 0 0) 0x55b43ac92b30 con 0x55b43adb5a30 2023-10-05T15:18:52.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5d99ffb700 10 client.16404 handle_command_reply: tid=0 2023-10-05T15:18:52.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 client.16404 shutdown 2023-10-05T15:18:52.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 msgr2=0x55b43adb39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 0x55b43adb39c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5da8012c90 tx=0x7f5da8009f00 comp rx=0 tx=0).stop 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 shutdown_connections 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:6838/1073230370,v1:172.21.15.135:6839/1073230370] conn(0x55b43adb5a30 0x55b43adb7e50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b43ad51890 0x55b43adb39c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b43ad460c0 0x55b43ad54e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 --2- 172.21.15.60:0/2545167381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b43ad469e0 0x55b43ad55390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 >> 172.21.15.60:0/2545167381 conn(0x55b43acbb260 msgr2=0x55b43ad4bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5d99ffb700 0 client.16404 ms_handle_reset on v2:172.21.15.135:6838/1073230370 2023-10-05T15:18:52.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 shutdown_connections 2023-10-05T15:18:52.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 1 -- 172.21.15.60:0/2545167381 wait complete. 2023-10-05T15:18:52.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.386+0000 7f5dc5161b80 20 client.16404 trim_cache size 0 max 16384 2023-10-05T15:18:52.395 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-05T15:18:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 262475, 2023-10-05T15:18:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629072, 2023-10-05T15:18:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg" 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2942399, 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629607, 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml" 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 11873024, 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629431, 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg" 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 12886878, 2023-10-05T15:18:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629773, 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml" 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 21292099, 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628312, 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.c" 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 28523260, 2023-10-05T15:18:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629187, 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg" 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 47260748, 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629313, 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml" 2023-10-05T15:18:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 53247184, 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629358, 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml" 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 55808713, 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629030, 2023-10-05T15:18:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg" 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 56516343, 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629514, 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-14.xml" 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 60708697, 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629045, 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg" 2023-10-05T15:18:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 64730798, 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629148, 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-80.xml" 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 68615978, 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628768, 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml" 2023-10-05T15:18:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 75619829, 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629307, 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-84.xml" 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 76543106, 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628871, 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-46.xml" 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 81936539, 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628911, 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml" 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 82845733, 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628955, 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml" 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 89081014, 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629654, 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-40.jpg" 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 90088781, 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628769, 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-65.xml" 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 97856289, 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628697, 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.o" 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 110598143, 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629674, 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-2.jpg" 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 111779062, 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629143, 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-81.xml" 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 111843068, 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629448, 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg" 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 120123935, 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629169, 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-23.jpg" 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 123555350, 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629673, 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg" 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 123608015, 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629595, 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-59.xml" 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 124068985, 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628753, 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml" 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 139743199, 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629084, 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg" 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 143151592, 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629632, 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg" 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 145440470, 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629078, 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg" 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 146957350, 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629733, 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-60.xml" 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 147378442, 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629273, 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg" 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 162209682, 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628901, 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml" 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 162800264, 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629550, 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml" 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.413 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 168808920, 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629157, 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg" 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 171717001, 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629352, 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml" 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.414 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 173613667, 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629303, 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg" 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 180211033, 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629050, 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-55.jpg" 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.415 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 184952996, 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628309, 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/globals.h" 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 187205784, 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628939, 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml" 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.416 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 188088305, 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629406, 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-85.jpg" 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 195132781, 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629047, 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-56.jpg" 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 197157037, 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629346, 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml" 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 198038612, 2023-10-05T15:18:52.418 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629323, 2023-10-05T15:18:52.419 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml" 2023-10-05T15:18:52.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.419 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.419 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 198774112, 2023-10-05T15:18:52.419 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628299, 2023-10-05T15:18:52.420 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.c" 2023-10-05T15:18:52.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.420 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.420 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 203314365, 2023-10-05T15:18:52.420 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628991, 2023-10-05T15:18:52.421 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg" 2023-10-05T15:18:52.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.421 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.421 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 222068251, 2023-10-05T15:18:52.421 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628738, 2023-10-05T15:18:52.422 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-82.xml" 2023-10-05T15:18:52.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.422 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.422 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 230036940, 2023-10-05T15:18:52.422 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628745, 2023-10-05T15:18:52.423 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-69.xml" 2023-10-05T15:18:52.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.423 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.423 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 233942452, 2023-10-05T15:18:52.423 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629066, 2023-10-05T15:18:52.424 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg" 2023-10-05T15:18:52.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.424 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.424 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 244746421, 2023-10-05T15:18:52.424 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629707, 2023-10-05T15:18:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-68.xml" 2023-10-05T15:18:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 246386320, 2023-10-05T15:18:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629139, 2023-10-05T15:18:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-82.xml" 2023-10-05T15:18:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 249482825, 2023-10-05T15:18:52.427 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629409, 2023-10-05T15:18:52.427 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-82.jpg" 2023-10-05T15:18:52.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.427 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.427 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 250974320, 2023-10-05T15:18:52.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628906, 2023-10-05T15:18:52.428 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml" 2023-10-05T15:18:52.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.428 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.429 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 251508486, 2023-10-05T15:18:52.429 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629755, 2023-10-05T15:18:52.429 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml" 2023-10-05T15:18:52.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.429 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.430 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 253899559, 2023-10-05T15:18:52.430 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629398, 2023-10-05T15:18:52.430 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-93.jpg" 2023-10-05T15:18:52.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.431 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.431 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 257421790, 2023-10-05T15:18:52.431 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629359, 2023-10-05T15:18:52.431 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml" 2023-10-05T15:18:52.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.432 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.432 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 258650239, 2023-10-05T15:18:52.432 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629814, 2023-10-05T15:18:52.432 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml" 2023-10-05T15:18:52.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.433 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.433 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 259138298, 2023-10-05T15:18:52.433 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629723, 2023-10-05T15:18:52.433 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-63.xml" 2023-10-05T15:18:52.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.434 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.434 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 259398604, 2023-10-05T15:18:52.434 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628784, 2023-10-05T15:18:52.434 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-62.xml" 2023-10-05T15:18:52.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.435 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.435 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 259475820, 2023-10-05T15:18:52.435 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629345, 2023-10-05T15:18:52.435 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml" 2023-10-05T15:18:52.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.436 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.436 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 260793858, 2023-10-05T15:18:52.436 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629456, 2023-10-05T15:18:52.436 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg" 2023-10-05T15:18:52.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.437 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.437 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 262309341, 2023-10-05T15:18:52.437 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629640, 2023-10-05T15:18:52.437 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-42.jpg" 2023-10-05T15:18:52.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.438 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.438 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 264958023, 2023-10-05T15:18:52.438 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628727, 2023-10-05T15:18:52.439 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-71.xml" 2023-10-05T15:18:52.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.439 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.439 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 268920083, 2023-10-05T15:18:52.439 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629266, 2023-10-05T15:18:52.440 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg" 2023-10-05T15:18:52.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.440 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.440 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 273375888, 2023-10-05T15:18:52.440 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629618, 2023-10-05T15:18:52.441 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-44.jpg" 2023-10-05T15:18:52.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.441 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.441 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 275392067, 2023-10-05T15:18:52.442 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629274, 2023-10-05T15:18:52.442 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg" 2023-10-05T15:18:52.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.442 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.443 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 276894453, 2023-10-05T15:18:52.443 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629819, 2023-10-05T15:18:52.443 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml" 2023-10-05T15:18:52.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.444 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.444 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 277746144, 2023-10-05T15:18:52.444 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629033, 2023-10-05T15:18:52.444 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg" 2023-10-05T15:18:52.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.445 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.445 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 278789188, 2023-10-05T15:18:52.445 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629115, 2023-10-05T15:18:52.445 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-88.xml" 2023-10-05T15:18:52.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.446 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.446 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 279968186, 2023-10-05T15:18:52.446 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629836, 2023-10-05T15:18:52.446 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-34.xml" 2023-10-05T15:18:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 280119609, 2023-10-05T15:18:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629300, 2023-10-05T15:18:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg" 2023-10-05T15:18:52.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.448 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.448 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 280225414, 2023-10-05T15:18:52.448 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629236, 2023-10-05T15:18:52.449 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-32.jpg" 2023-10-05T15:18:52.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.449 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.449 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 284990794, 2023-10-05T15:18:52.449 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629007, 2023-10-05T15:18:52.450 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-12.jpg" 2023-10-05T15:18:52.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.450 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.450 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 287621113, 2023-10-05T15:18:52.451 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629582, 2023-10-05T15:18:52.451 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg" 2023-10-05T15:18:52.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.451 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.451 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 297447843, 2023-10-05T15:18:52.452 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628301, 2023-10-05T15:18:52.452 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.c" 2023-10-05T15:18:52.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.452 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.453 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 302636097, 2023-10-05T15:18:52.453 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629453, 2023-10-05T15:18:52.453 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg" 2023-10-05T15:18:52.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.453 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.454 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 303847621, 2023-10-05T15:18:52.454 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629268, 2023-10-05T15:18:52.454 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg" 2023-10-05T15:18:52.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 310060283, 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628813, 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml" 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.455 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 315469002, 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628789, 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml" 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 318195995, 2023-10-05T15:18:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629714, 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml" 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 329022481, 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629447, 2023-10-05T15:18:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg" 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 338668422, 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629736, 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-59.xml" 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 341092270, 2023-10-05T15:18:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629383, 2023-10-05T15:18:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml" 2023-10-05T15:18:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 341227669, 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629056, 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-53.jpg" 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 342823335, 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629490, 2023-10-05T15:18:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-32.xml" 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 350830498, 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628976, 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg" 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 355397723, 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628837, 2023-10-05T15:18:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml" 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 355459816, 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629363, 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml" 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 357792149, 2023-10-05T15:18:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629057, 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg" 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 367261102, 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629164, 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-76.xml" 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 370630590, 2023-10-05T15:18:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629540, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg" 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 370777298, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629205, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-12.jpg" 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 383470836, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629253, 2023-10-05T15:18:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml" 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 384930661, 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629541, 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-66.xml" 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 393193824, 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629614, 2023-10-05T15:18:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-57.xml" 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 395317022, 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629212, 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-42.jpg" 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 395755777, 2023-10-05T15:18:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628908, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-29.jpg" 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 400200515, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629200, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml" 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 405326896, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629087, 2023-10-05T15:18:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-95.xml" 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 407190328, 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628720, 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-89.jpg" 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 409897524, 2023-10-05T15:18:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628930, 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-35.xml" 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 420057187, 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629075, 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg" 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 422772641, 2023-10-05T15:18:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628775, 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-64.xml" 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 432073472, 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629496, 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-28.xml" 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.470 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 432128895, 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629390, 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml" 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 445089039, 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629008, 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml" 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.471 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 447994923, 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628798, 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml" 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 466342115, 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629446, 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg" 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.472 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 466343993, 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629568, 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-4.xml" 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 467711061, 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629549, 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-65.xml" 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.473 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 468334882, 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628707, 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.o" 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 470371899, 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628792, 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml" 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 481285050, 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629336, 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml" 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 483704559, 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628708, 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po" 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 492691889, 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628952, 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml" 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 494214135, 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628996, 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml" 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 495440466, 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629067, 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg" 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 497076684, 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629105, 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg" 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 508359513, 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629831, 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-35.xml" 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 514760562, 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629780, 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml" 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 519405323, 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629342, 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml" 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 535561332, 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628861, 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml" 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 539085598, 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629413, 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-78.jpg" 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 550769299, 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629180, 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-72.xml" 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 552018230, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629298, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg" 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 555124730, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628895, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml" 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 562333429, 2023-10-05T15:18:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628873, 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml" 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 566044589, 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629560, 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-64.xml" 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 567423155, 2023-10-05T15:18:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628943, 2023-10-05T15:18:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml" 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 568266001, 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629213, 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-61.xml" 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 572862280, 2023-10-05T15:18:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628807, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml" 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 577352948, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628690, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po" 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 581110877, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628802, 2023-10-05T15:18:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-59.xml" 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 589027520, 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629276, 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml" 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 595718694, 2023-10-05T15:18:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628956, 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-20.jpg" 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 596751669, 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628867, 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml" 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 604784576, 2023-10-05T15:18:52.489 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629502, 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-22.xml" 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 607387791, 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629503, 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-21.xml" 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 609978891, 2023-10-05T15:18:52.490 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629813, 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-39.xml" 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 614866282, 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629827, 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-36.xml" 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 615293392, 2023-10-05T15:18:52.491 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628962, 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg" 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 649770909, 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628912, 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg" 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 655833977, 2023-10-05T15:18:52.492 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629444, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg" 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 660787665, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628918, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-26.jpg" 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 666709593, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629112, 2023-10-05T15:18:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-37.jpg" 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 670645981, 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629321, 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml" 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 684771367, 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629146, 2023-10-05T15:18:52.494 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-17.xml" 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 696221997, 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628848, 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg" 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 708575853, 2023-10-05T15:18:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628827, 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-53.jpg" 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 710169786, 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628724, 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-87.xml" 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 712266441, 2023-10-05T15:18:52.496 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628774, 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml" 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 713654583, 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628870, 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml" 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 717452605, 2023-10-05T15:18:52.497 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629319, 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml" 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 718850451, 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628935, 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-23.jpg" 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 719616441, 2023-10-05T15:18:52.498 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629698, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-70.xml" 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 721744860, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628975, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml" 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 727871810, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628671, 2023-10-05T15:18:52.499 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile" 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 732939382, 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629529, 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-69.xml" 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 733047330, 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629572, 2023-10-05T15:18:52.500 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-59.jpg" 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 737438485, 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629458, 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-47.xml" 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 740557574, 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629737, 2023-10-05T15:18:52.501 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml" 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 743273219, 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629734, 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml" 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 744319639, 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628721, 2023-10-05T15:18:52.502 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml" 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 747503887, 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628856, 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-49.xml" 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 749885430, 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629832, 2023-10-05T15:18:52.503 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml" 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 754715738, 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629809, 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml" 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 754998215, 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629603, 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg" 2023-10-05T15:18:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 757169923, 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629744, 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-57.xml" 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 757959748, 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629176, 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-73.xml" 2023-10-05T15:18:52.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 761174576, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628801, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml" 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 765615769, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629386, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml" 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 768581328, 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629348, 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml" 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 770108872, 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628893, 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-42.xml" 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.507 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 770958218, 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629287, 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-50.xml" 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 773433625, 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629585, 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg" 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.508 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 783302852, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629284, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-12.jpg" 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 787037280, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629107, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-90.xml" 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 795361070, 2023-10-05T15:18:52.509 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629349, 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml" 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 797557464, 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629104, 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-39.jpg" 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.510 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 797835000, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628734, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-84.jpg" 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 799735912, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629593, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml" 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 803547081, 2023-10-05T15:18:52.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629679, 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg" 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 803893151, 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629412, 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-79.jpg" 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 804290949, 2023-10-05T15:18:52.512 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628954, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml" 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 813606828, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628305, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h" 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 816450468, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628759, 2023-10-05T15:18:52.513 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml" 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 823346934, 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629421, 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-70.jpg" 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 832507786, 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629658, 2023-10-05T15:18:52.514 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml" 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 840277943, 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629230, 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-57.xml" 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 854288842, 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629022, 2023-10-05T15:18:52.515 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg" 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 855494957, 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629669, 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml" 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 863547391, 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629396, 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-95.jpg" 2023-10-05T15:18:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 863988208, 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629708, 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml" 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.518 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.518 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 872741973, 2023-10-05T15:18:52.518 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629136, 2023-10-05T15:18:52.518 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg" 2023-10-05T15:18:52.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.519 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.519 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 877513541, 2023-10-05T15:18:52.519 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628825, 2023-10-05T15:18:52.519 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml" 2023-10-05T15:18:52.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 878090355, 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628303, 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench_p.h" 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.520 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 880454505, 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628902, 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-30.jpg" 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.521 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 893003076, 2023-10-05T15:18:52.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629189, 2023-10-05T15:18:52.522 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-69.xml" 2023-10-05T15:18:52.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.522 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.522 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 897260739, 2023-10-05T15:18:52.523 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629527, 2023-10-05T15:18:52.523 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-10.xml" 2023-10-05T15:18:52.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.523 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.523 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 897286164, 2023-10-05T15:18:52.524 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629747, 2023-10-05T15:18:52.524 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-56.xml" 2023-10-05T15:18:52.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.524 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.524 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 901154256, 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628758, 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-76.jpg" 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 909254722, 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629545, 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-7.xml" 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.525 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 918574412, 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629384, 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml" 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 924141303, 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628803, 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-61.jpg" 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 931343959, 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628812, 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-58.jpg" 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 937462845, 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629498, 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-26.xml" 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 944009917, 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629547, 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg" 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 952563063, 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628986, 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg" 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 959436403, 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629443, 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg" 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 961676411, 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629770, 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml" 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.529 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 966477230, 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629478, 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-38.xml" 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 969184977, 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628723, 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-88.jpg" 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 971854385, 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629137, 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg" 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 976394768, 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628314, 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.c" 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 981170760, 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629027, 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg" 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 981434334, 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629438, 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg" 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.532 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 984303985, 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629715, 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml" 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 987341510, 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628887, 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg" 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.533 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 995683552, 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629678, 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml" 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1006621406, 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629591, 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg" 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1010733986, 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629036, 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg" 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1014254599, 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629804, 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml" 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.535 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1017751071, 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628695, 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.o" 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1025619800, 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629791, 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-31.xml" 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.536 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1027212657, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629778, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-47.xml" 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1031787351, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629340, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml" 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1032328066, 2023-10-05T15:18:52.537 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629294, 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg" 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1042478130, 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628757, 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-67.xml" 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.538 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1048694656, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629430, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg" 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1050939308, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628885, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml" 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1052834937, 2023-10-05T15:18:52.539 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629141, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg" 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1063533768, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628973, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml" 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1064794261, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628872, 2023-10-05T15:18:52.540 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-38.jpg" 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1067068370, 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629818, 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml" 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1069307847, 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628964, 2023-10-05T15:18:52.541 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml" 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1071318692, 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628815, 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-57.jpg" 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.542 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1071374211, 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628791, 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-65.jpg" 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1073857510, 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629041, 2023-10-05T15:18:52.543 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-58.jpg" 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1075589258, 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629466, 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-44.xml" 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.544 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1085418349, 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628764, 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-74.jpg" 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1087298811, 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629535, 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-8.xml" 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.545 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1094898344, 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629589, 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml" 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1097272030, 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629145, 2023-10-05T15:18:52.546 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4" 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1099448322, 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628897, 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml" 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1100543848, 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629800, 2023-10-05T15:18:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml" 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1108570340, 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629445, 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg" 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1123337463, 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628999, 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml" 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1125263090, 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629263, 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg" 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1136427777, 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629049, 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg" 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1137265543, 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629381, 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml" 2023-10-05T15:18:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1140157674, 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629449, 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg" 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1141719834, 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629343, 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml" 2023-10-05T15:18:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1143739724, 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629425, 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg" 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1144443697, 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629371, 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml" 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1144577282, 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628890, 2023-10-05T15:18:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg" 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1156425619, 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629074, 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-47.jpg" 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1157025077, 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628820, 2023-10-05T15:18:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml" 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1157335252, 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629719, 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-64.xml" 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1157815207, 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629150, 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-16.xml" 2023-10-05T15:18:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1162813167, 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628928, 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml" 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1165897522, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629101, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg" 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1167454477, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629506, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-18.xml" 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1180366807, 2023-10-05T15:18:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629686, 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-1.jpg" 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1185192083, 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629140, 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-30.jpg" 2023-10-05T15:18:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1185367288, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628909, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml" 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1195416750, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629211, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-10.jpg" 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1204817021, 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629077, 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-46.jpg" 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1206199497, 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629533, 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-68.xml" 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1207055548, 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629422, 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg" 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1207856456, 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629408, 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-83.jpg" 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1211201574, 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629525, 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-70.xml" 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1215232232, 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629235, 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml" 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1217746771, 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629021, 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg" 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1235439605, 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628842, 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg" 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1241171361, 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629277, 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-51.xml" 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1248031604, 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629048, 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg" 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1252846644, 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628726, 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-86.xml" 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1256065579, 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628797, 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-63.jpg" 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1259057628, 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629161, 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg" 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1270993823, 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629840, 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-33.xml" 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.566 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1275449461, 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629577, 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg" 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1279012899, 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629824, 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml" 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.567 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1286196109, 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629434, 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg" 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1287791427, 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629805, 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml" 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.568 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1302343648, 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629721, 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml" 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1303500181, 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629252, 2023-10-05T15:18:52.569 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-54.xml" 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1309238521, 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628710, 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench" 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1312575918, 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628703, 2023-10-05T15:18:52.570 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.o" 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1326005805, 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629100, 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-40.jpg" 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1330275660, 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629225, 2023-10-05T15:18:52.571 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-37.jpg" 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1331230828, 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628818, 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-56.jpg" 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.572 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1343823811, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629563, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg" 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1346804076, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628921, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml" 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1354845375, 2023-10-05T15:18:52.573 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628913, 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml" 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1355987835, 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629646, 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-41.jpg" 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1360772867, 2023-10-05T15:18:52.574 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629424, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg" 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1364695028, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628709, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.o" 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1368942439, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628944, 2023-10-05T15:18:52.575 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-22.jpg" 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1369603717, 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629451, 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg" 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1370037053, 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629411, 2023-10-05T15:18:52.576 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-80.jpg" 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1393973603, 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629741, 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml" 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1395556805, 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628855, 2023-10-05T15:18:52.577 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml" 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1397076657, 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628926, 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg" 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1400216759, 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628903, 2023-10-05T15:18:52.578 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml" 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1405349559, 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628679, 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps" 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.579 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1407742551, 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629334, 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml" 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1409298078, 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629676, 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg" 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.580 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1421154087, 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629002, 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-11.xml" 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1422858746, 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628981, 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml" 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.581 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1423051435, 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629435, 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg" 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1430460245, 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629215, 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-41.jpg" 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.582 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1433701029, 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628817, 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml" 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1442208767, 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629645, 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg" 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.583 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1446636184, 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629282, 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg" 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1447585274, 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629154, 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml" 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.584 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1447742709, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629329, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml" 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1457385941, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629583, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-61.xml" 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1465523115, 2023-10-05T15:18:52.585 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629241, 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml" 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1466726888, 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628728, 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-86.jpg" 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.586 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1469587315, 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628881, 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg" 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1470735419, 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629249, 2023-10-05T15:18:52.587 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg" 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1471471490, 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629407, 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-84.jpg" 2023-10-05T15:18:52.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1471529731, 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629217, 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-40.jpg" 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.589 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1478314453, 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629244, 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-29.jpg" 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1483395551, 2023-10-05T15:18:52.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629246, 2023-10-05T15:18:52.591 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-28.jpg" 2023-10-05T15:18:52.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.591 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.591 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1487534431, 2023-10-05T15:18:52.591 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628786, 2023-10-05T15:18:52.592 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml" 2023-10-05T15:18:52.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.592 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.592 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1488361111, 2023-10-05T15:18:52.592 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629511, 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-15.xml" 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1488366868, 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629315, 2023-10-05T15:18:52.593 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml" 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1490982318, 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629028, 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg" 2023-10-05T15:18:52.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1493313261, 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629322, 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml" 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1493413232, 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629024, 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg" 2023-10-05T15:18:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1498348684, 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629254, 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg" 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1498872862, 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628862, 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-48.xml" 2023-10-05T15:18:52.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1499752760, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629369, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml" 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1511731828, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629423, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg" 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1513108592, 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629099, 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-92.xml" 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1517414719, 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629523, 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-70.xml" 2023-10-05T15:18:52.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1527028320, 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629837, 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml" 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1529908088, 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628779, 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-69.jpg" 2023-10-05T15:18:52.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1530557912, 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628790, 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-61.xml" 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1538432877, 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629125, 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg" 2023-10-05T15:18:52.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1541998922, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628731, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-85.jpg" 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1552656769, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629639, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml" 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1555466150, 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628978, 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-19.xml" 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1572090604, 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628297, 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.c" 2023-10-05T15:18:52.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1583943121, 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629650, 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-53.xml" 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1585040909, 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629768, 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-50.xml" 2023-10-05T15:18:52.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1594134297, 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629414, 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-77.jpg" 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1603816000, 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629388, 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml" 2023-10-05T15:18:52.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1606793190, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629347, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml" 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1608729098, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628963, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml" 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1623061048, 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629745, 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml" 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1625452614, 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629623, 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg" 2023-10-05T15:18:52.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1630633353, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629488, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-33.xml" 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1647112196, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629328, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml" 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1647595242, 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628931, 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml" 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1649799545, 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629636, 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg" 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1654221795, 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629132, 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-32.jpg" 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1666064425, 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629613, 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-5.jpg" 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1667119159, 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629258, 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-23.jpg" 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1674869113, 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629223, 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-38.jpg" 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1676038831, 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629360, 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml" 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1678462366, 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629817, 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-38.xml" 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1683297577, 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629108, 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-38.jpg" 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1685345178, 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629039, 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg" 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.612 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1686997581, 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629170, 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-11.xml" 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1687312502, 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628933, 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml" 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.613 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1689001289, 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629542, 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg" 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1691747899, 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629440, 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg" 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.614 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1691857307, 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629133, 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg" 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1694723890, 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628743, 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-81.jpg" 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.615 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1702626501, 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629391, 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-100.jpg" 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1705154564, 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629567, 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg" 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.616 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1710489155, 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629566, 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml" 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1716425846, 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628828, 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml" 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.617 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1716683016, 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629198, 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-66.xml" 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1716896697, 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629209, 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-43.jpg" 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.618 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1725150487, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629655, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg" 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1726272313, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629788, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-1.xml" 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1754997246, 2023-10-05T15:18:52.619 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629018, 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg" 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1762615920, 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629752, 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml" 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1766688671, 2023-10-05T15:18:52.620 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629609, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg" 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1774129096, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629843, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml" 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1775949558, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628958, 2023-10-05T15:18:52.621 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml" 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1792207735, 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628694, 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/writer.Po" 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1798817470, 2023-10-05T15:18:52.622 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628810, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml" 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1810301240, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629751, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-55.xml" 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1813531171, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628993, 2023-10-05T15:18:52.623 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-14.xml" 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1813961218, 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628970, 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml" 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1817673011, 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628977, 2023-10-05T15:18:52.624 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg" 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1831403378, 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629436, 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg" 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1832146508, 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628969, 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml" 2023-10-05T15:18:52.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1838184712, 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628729, 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-85.xml" 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1840074463, 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629202, 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-13.jpg" 2023-10-05T15:18:52.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1846795852, 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629376, 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml" 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1847102268, 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629168, 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-75.xml" 2023-10-05T15:18:52.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1847760612, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629455, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg" 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1850787979, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628967, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml" 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1850801027, 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629429, 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg" 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1856585788, 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629486, 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-34.xml" 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1860256210, 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628847, 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-51.xml" 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1867516416, 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629713, 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-66.xml" 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1873256828, 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628311, 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.c" 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1873818167, 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629261, 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-53.xml" 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.631 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1873844130, 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628819, 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml" 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1882285020, 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628782, 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-68.jpg" 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.632 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1885978029, 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628771, 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml" 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1891475587, 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628702, 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po" 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.633 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1893343750, 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629379, 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml" 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1897727657, 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629604, 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-45.jpg" 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.634 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1899659870, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629335, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml" 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1900543344, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629476, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-39.xml" 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1903755266, 2023-10-05T15:18:52.635 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628972, 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml" 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1912958077, 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629418, 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-73.jpg" 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1913291027, 2023-10-05T15:18:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628306, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.am" 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1913872499, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628302, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.h" 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1915933104, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629174, 2023-10-05T15:18:52.637 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-10.xml" 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1923493267, 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629111, 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-89.xml" 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1926904328, 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628304, 2023-10-05T15:18:52.638 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c" 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1936856130, 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629772, 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-49.xml" 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1937616230, 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629097, 2023-10-05T15:18:52.639 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg" 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1939635929, 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629450, 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg" 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1952068897, 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629651, 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg" 2023-10-05T15:18:52.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1953717409, 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629672, 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml" 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1964789378, 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629229, 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-35.jpg" 2023-10-05T15:18:52.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1965814097, 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629372, 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml" 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1973047450, 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629177, 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-21.jpg" 2023-10-05T15:18:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1980673111, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629306, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-85.xml" 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1991104502, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628971, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg" 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1994885917, 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629374, 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml" 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1996070105, 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629091, 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-94.xml" 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1999242855, 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629310, 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml" 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1999577061, 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628878, 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-36.jpg" 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2006660478, 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628998, 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg" 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2015378318, 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629480, 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-37.xml" 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2022904109, 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628915, 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml" 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2030123180, 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629766, 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml" 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2030494632, 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629301, 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg" 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2051493246, 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629495, 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-29.xml" 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2065221801, 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629119, 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-87.xml" 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2066215214, 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629687, 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-61.xml" 2023-10-05T15:18:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2067816869, 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629265, 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml" 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2074566299, 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629071, 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-48.jpg" 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2074863934, 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628712, 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0" 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2075639689, 2023-10-05T15:18:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629765, 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-2.xml" 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2077499765, 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629617, 2023-10-05T15:18:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg" 2023-10-05T15:18:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2086248517, 2023-10-05T15:18:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629680, 2023-10-05T15:18:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml" 2023-10-05T15:18:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2086288618, 2023-10-05T15:18:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628725, 2023-10-05T15:18:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-87.jpg" 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2091377691, 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629608, 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-58.xml" 2023-10-05T15:18:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2095579235, 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628966, 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml" 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2103865425, 2023-10-05T15:18:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629234, 2023-10-05T15:18:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-33.jpg" 2023-10-05T15:18:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2105625316, 2023-10-05T15:18:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629195, 2023-10-05T15:18:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-67.xml" 2023-10-05T15:18:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2109199439, 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628294, 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.am" 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2110767747, 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629571, 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg" 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2116230379, 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629324, 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml" 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2119490699, 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629338, 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml" 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2121893148, 2023-10-05T15:18:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629838, 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml" 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2131132072, 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628865, 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-47.xml" 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2131880096, 2023-10-05T15:18:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629029, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml" 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2137318972, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629417, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-74.jpg" 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2138046440, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629728, 2023-10-05T15:18:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml" 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2152709761, 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629416, 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-75.jpg" 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2159940263, 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629711, 2023-10-05T15:18:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml" 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2160011982, 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629845, 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-32.xml" 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2160780410, 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629521, 2023-10-05T15:18:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-11.xml" 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2172299214, 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629081, 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg" 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2178626280, 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629308, 2023-10-05T15:18:52.667 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-83.xml" 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2185977923, 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628824, 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-54.jpg" 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2189816363, 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629330, 2023-10-05T15:18:52.668 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml" 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2193450754, 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629509, 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-16.xml" 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2205305065, 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628907, 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml" 2023-10-05T15:18:52.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2209338658, 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629829, 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml" 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2211676874, 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629073, 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg" 2023-10-05T15:18:52.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2215509442, 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629839, 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml" 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2218188739, 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629178, 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml" 2023-10-05T15:18:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2219528187, 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628777, 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml" 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2220721925, 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629181, 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-20.jpg" 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2222723761, 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628925, 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml" 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2245150073, 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628795, 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml" 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2246869832, 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629428, 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg" 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.674 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2257037629, 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628914, 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg" 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2257228097, 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628780, 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml" 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.675 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2259760999, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629452, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg" 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2261504189, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629807, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-40.xml" 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2264994974, 2023-10-05T15:18:52.676 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628672, 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile" 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2266648484, 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629251, 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg" 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2271142609, 2023-10-05T15:18:52.677 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629730, 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-61.xml" 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2272366185, 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629032, 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml" 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.678 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2273623476, 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629537, 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-67.xml" 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2279553819, 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628851, 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-45.jpg" 2023-10-05T15:18:52.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2299312328, 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628307, 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.in" 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2313841855, 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629760, 2023-10-05T15:18:52.680 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-52.xml" 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2317595018, 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628783, 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml" 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2321782120, 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628843, 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml" 2023-10-05T15:18:52.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2323646269, 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629519, 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-77.jpg" 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2328557118, 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629127, 2023-10-05T15:18:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-85.xml" 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2332686003, 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629366, 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml" 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.683 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2334608700, 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628808, 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-58.xml" 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2337173300, 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629305, 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5" 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.684 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2339254974, 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629124, 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-34.jpg" 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2339465084, 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628833, 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-51.jpg" 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.685 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2341626642, 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628291, 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4" 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2341995789, 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629243, 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-55.xml" 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.686 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2342068477, 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629203, 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml" 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2348410760, 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629080, 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-45.jpg" 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.687 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2350300885, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629121, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg" 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2352536956, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629271, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg" 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2353095921, 2023-10-05T15:18:52.688 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628923, 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml" 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2355865625, 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628796, 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-60.xml" 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2363456508, 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629083, 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-44.jpg" 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2368951665, 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628940, 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml" 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2371650481, 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629590, 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-60.xml" 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2373263622, 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629775, 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-48.xml" 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.691 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2377299215, 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629351, 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml" 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2387457226, 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629364, 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml" 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2388916170, 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629051, 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg" 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2391602596, 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629683, 2023-10-05T15:18:52.693 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml" 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2395313906, 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628988, 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg" 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2399851924, 2023-10-05T15:18:52.694 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629377, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml" 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2409619662, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629570, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-63.xml" 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2411090202, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628744, 2023-10-05T15:18:52.695 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-80.xml" 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2416348334, 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629531, 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-9.xml" 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2418179447, 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628293, 2023-10-05T15:18:52.696 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/blogbench.8" 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2422332764, 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629188, 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml" 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2423222720, 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629493, 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-31.xml" 2023-10-05T15:18:52.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2424405093, 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629469, 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-43.xml" 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2438511400, 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629055, 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg" 2023-10-05T15:18:52.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2438979468, 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629574, 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml" 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2439175622, 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628313, 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.c" 2023-10-05T15:18:52.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2444751018, 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629716, 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-65.xml" 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.700 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2447303751, 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629786, 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-45.xml" 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.701 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2453431293, 2023-10-05T15:18:52.702 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629625, 2023-10-05T15:18:52.702 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml" 2023-10-05T15:18:52.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.702 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.702 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2456584397, 2023-10-05T15:18:52.703 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629653, 2023-10-05T15:18:52.703 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml" 2023-10-05T15:18:52.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.703 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2456841477, 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628778, 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-63.xml" 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.704 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2460990472, 2023-10-05T15:18:52.705 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629682, 2023-10-05T15:18:52.705 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg" 2023-10-05T15:18:52.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.705 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.705 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2465741872, 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628900, 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml" 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2474152557, 2023-10-05T15:18:52.706 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629803, 2023-10-05T15:18:52.707 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-41.xml" 2023-10-05T15:18:52.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.707 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.707 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2479630968, 2023-10-05T15:18:52.707 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629561, 2023-10-05T15:18:52.708 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-81.xml" 2023-10-05T15:18:52.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.708 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.708 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2482412129, 2023-10-05T15:18:52.708 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628866, 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg" 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2483516558, 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629644, 2023-10-05T15:18:52.709 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml" 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2485188857, 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629675, 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml" 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2486411771, 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628849, 2023-10-05T15:18:52.710 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml" 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2492456631, 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629798, 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-42.xml" 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2495231478, 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628951, 2023-10-05T15:18:52.711 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml" 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2510537230, 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629441, 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg" 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2512333535, 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628917, 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml" 2023-10-05T15:18:52.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2514686445, 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629626, 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg" 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2517526852, 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628704, 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po" 2023-10-05T15:18:52.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2518349419, 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629337, 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml" 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.714 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2524026902, 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629731, 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml" 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2531758816, 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629742, 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml" 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.715 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2546480407, 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628821, 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-55.jpg" 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2549324613, 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629399, 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-92.jpg" 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.716 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2549626344, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629630, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml" 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2549811183, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629375, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml" 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2553472232, 2023-10-05T15:18:52.717 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629312, 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-79.xml" 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2553776183, 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629641, 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg" 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2557903121, 2023-10-05T15:18:52.718 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629656, 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-3.jpg" 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2567618696, 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628884, 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg" 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2569706555, 2023-10-05T15:18:52.719 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629317, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml" 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2587919244, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628750, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml" 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2591775829, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629005, 2023-10-05T15:18:52.720 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-10.xml" 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2592692548, 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628949, 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml" 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2594961136, 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628761, 2023-10-05T15:18:52.721 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-75.jpg" 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2604309875, 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629309, 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml" 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2607774114, 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628713, 2023-10-05T15:18:52.722 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml" 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2618580283, 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629026, 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml" 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2624476365, 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629828, 2023-10-05T15:18:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml" 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2628810489, 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628836, 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-50.jpg" 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2635255202, 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628888, 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml" 2023-10-05T15:18:52.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2637421499, 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629014, 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml" 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.725 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2651067256, 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628736, 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-70.xml" 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2652506400, 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629700, 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml" 2023-10-05T15:18:52.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2659932493, 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629356, 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml" 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2665774566, 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629576, 2023-10-05T15:18:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-62.xml" 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2668740876, 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629190, 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg" 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.728 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2682627566, 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629497, 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-27.xml" 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2688969578, 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629649, 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml" 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.729 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2704347951, 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628877, 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-45.xml" 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2712165706, 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629361, 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml" 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.730 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2714524784, 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628947, 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-21.jpg" 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2715560795, 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628839, 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-49.jpg" 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.731 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2716231052, 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629368, 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml" 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2724765350, 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628298, 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.h" 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.732 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2730123436, 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629270, 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml" 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2732668487, 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629316, 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml" 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.733 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2735137725, 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628860, 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg" 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2738802307, 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629764, 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-51.xml" 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.734 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2746427492, 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628994, 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg" 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2747189110, 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628788, 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-66.jpg" 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2752909357, 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629216, 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-60.xml" 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2759704604, 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629096, 2023-10-05T15:18:52.736 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-41.jpg" 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2762197785, 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628716, 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-72.xml" 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2773208910, 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629103, 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-91.xml" 2023-10-05T15:18:52.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2781647902, 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629191, 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml" 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2782494411, 2023-10-05T15:18:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629117, 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg" 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2783220973, 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628997, 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg" 2023-10-05T15:18:52.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2786976028, 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628834, 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml" 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.740 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2794246319, 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628875, 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg" 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2795725845, 2023-10-05T15:18:52.741 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629670, 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg" 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2802209208, 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628794, 2023-10-05T15:18:52.742 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-64.jpg" 2023-10-05T15:18:52.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.743 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.743 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2803957766, 2023-10-05T15:18:52.743 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629821, 2023-10-05T15:18:52.744 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-37.xml" 2023-10-05T15:18:52.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.744 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.744 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2809047071, 2023-10-05T15:18:52.744 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629378, 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml" 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2827792400, 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629054, 2023-10-05T15:18:52.745 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg" 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2828994498, 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628869, 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg" 2023-10-05T15:18:52.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.747 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.747 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2830467865, 2023-10-05T15:18:52.747 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628693, 2023-10-05T15:18:52.747 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.o" 2023-10-05T15:18:52.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.748 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.748 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2839695695, 2023-10-05T15:18:52.748 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629634, 2023-10-05T15:18:52.748 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-4.jpg" 2023-10-05T15:18:52.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.749 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.749 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2843954870, 2023-10-05T15:18:52.749 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629224, 2023-10-05T15:18:52.749 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml" 2023-10-05T15:18:52.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2845831765, 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629586, 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-2.xml" 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.750 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2860224084, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629184, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg" 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2866566009, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629113, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg" 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2868411290, 2023-10-05T15:18:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628696, 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po" 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2877811190, 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629183, 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-71.xml" 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2880661962, 2023-10-05T15:18:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628845, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-47.jpg" 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2882312723, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629621, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml" 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2888503647, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629304, 2023-10-05T15:18:52.753 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg" 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2890810702, 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628987, 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-16.xml" 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2891579243, 2023-10-05T15:18:52.754 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629162, 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml" 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2891684884, 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628816, 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml" 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2894034970, 2023-10-05T15:18:52.755 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629667, 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg" 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2897562759, 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628919, 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml" 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2900774855, 2023-10-05T15:18:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629069, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg" 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2902169807, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629023, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-4.xml" 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2905359906, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629059, 2023-10-05T15:18:52.757 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-52.jpg" 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2906380675, 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629093, 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg" 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2909975027, 2023-10-05T15:18:52.758 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629016, 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg" 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2910127475, 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629116, 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-36.jpg" 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2911601158, 2023-10-05T15:18:52.759 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629693, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-59.xml" 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2911689646, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628840, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml" 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2912906421, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628752, 2023-10-05T15:18:52.760 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-78.jpg" 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2915750490, 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628767, 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-73.jpg" 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2925442774, 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628852, 2023-10-05T15:18:52.761 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml" 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2927072847, 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629462, 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-46.xml" 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2931154396, 2023-10-05T15:18:52.762 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629015, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg" 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2935360166, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628946, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml" 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2938899401, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629505, 2023-10-05T15:18:52.763 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-19.xml" 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2977641104, 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629454, 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg" 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2978484833, 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628804, 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml" 2023-10-05T15:18:52.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2986553789, 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629599, 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg" 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3006803315, 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628711, 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in" 2023-10-05T15:18:52.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3007768209, 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628984, 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml" 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3011775157, 2023-10-05T15:18:52.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629598, 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-1.xml" 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3013259186, 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628762, 2023-10-05T15:18:52.767 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml" 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3013926720, 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628746, 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-80.jpg" 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3015085747, 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629149, 2023-10-05T15:18:52.768 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-28.jpg" 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3018554244, 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629311, 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml" 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3025515318, 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628699, 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.o" 2023-10-05T15:18:52.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3028725104, 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629564, 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-7.jpg" 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3032684354, 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629256, 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg" 2023-10-05T15:18:52.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3035397361, 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629135, 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-83.xml" 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3049741900, 2023-10-05T15:18:52.771 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629612, 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg" 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3055108082, 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629415, 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-76.jpg" 2023-10-05T15:18:52.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3056450427, 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629782, 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-46.xml" 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3056978045, 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629622, 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-56.xml" 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.774 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3059739659, 2023-10-05T15:18:52.775 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629410, 2023-10-05T15:18:52.775 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-81.jpg" 2023-10-05T15:18:52.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.775 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.775 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3062420004, 2023-10-05T15:18:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629401, 2023-10-05T15:18:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-90.jpg" 2023-10-05T15:18:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3062613775, 2023-10-05T15:18:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629219, 2023-10-05T15:18:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml" 2023-10-05T15:18:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3063950050, 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628942, 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml" 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3066056797, 2023-10-05T15:18:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629173, 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-22.jpg" 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3095142893, 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628732, 2023-10-05T15:18:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-84.xml" 2023-10-05T15:18:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3095649736, 2023-10-05T15:18:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629628, 2023-10-05T15:18:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-55.xml" 2023-10-05T15:18:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3103872794, 2023-10-05T15:18:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629515, 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-13.xml" 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3114005395, 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628979, 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg" 2023-10-05T15:18:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3123647675, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629790, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-44.xml" 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3156575961, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629060, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg" 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3159253403, 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629757, 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-53.xml" 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3162159615, 2023-10-05T15:18:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628936, 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml" 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3162217563, 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629397, 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-94.jpg" 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3167406221, 2023-10-05T15:18:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629088, 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-43.jpg" 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3168036266, 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629499, 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-25.xml" 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3168749791, 2023-10-05T15:18:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629794, 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-43.xml" 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3181590676, 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629062, 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-51.jpg" 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3185007989, 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628735, 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml" 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3192251957, 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629232, 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-34.jpg" 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3192259382, 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628700, 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po" 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3203477027, 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628960, 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-25.xml" 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.789 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3213656481, 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629437, 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg" 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3219421520, 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629483, 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-35.xml" 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.790 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3224256389, 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629546, 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg" 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3231411161, 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629009, 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg" 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.791 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3232449778, 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629288, 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg" 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3238321320, 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629017, 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml" 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.792 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3243197550, 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629068, 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg" 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3243954138, 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629504, 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-20.xml" 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.793 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3246524773, 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629292, 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg" 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3250551881, 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629085, 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3" 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3260226359, 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629020, 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml" 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3277222111, 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629611, 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml" 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3286119911, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629419, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-72.jpg" 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3287943642, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629739, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-58.xml" 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3288636380, 2023-10-05T15:18:52.796 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629129, 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg" 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3296124346, 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628894, 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml" 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3298094782, 2023-10-05T15:18:52.797 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629201, 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-65.xml" 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3303643589, 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629165, 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg" 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3304633640, 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629278, 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-15.jpg" 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3312881909, 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629079, 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg" 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3313461829, 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629042, 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg" 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3316258421, 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629226, 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-58.xml" 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.800 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3325049855, 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629433, 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg" 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3325055985, 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628295, 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.in" 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.801 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3327525984, 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629394, 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-97.jpg" 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3330595854, 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628948, 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml" 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.802 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3334625549, 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629063, 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg" 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3343876452, 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629400, 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-91.jpg" 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.803 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3346633114, 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629616, 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml" 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3353661061, 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629787, 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml" 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.804 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3361018466, 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629426, 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg" 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3364709791, 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628785, 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-67.jpg" 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.805 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3366487925, 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628863, 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-41.jpg" 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3374320278, 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629289, 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-9.jpg" 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3376202958, 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629207, 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-63.xml" 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3380075558, 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629841, 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml" 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3385237460, 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629196, 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-15.jpg" 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3399840227, 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629594, 2023-10-05T15:18:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg" 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3401806608, 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629703, 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-69.xml" 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3402034141, 2023-10-05T15:18:52.809 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628809, 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-59.jpg" 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3404988417, 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629507, 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-17.xml" 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.810 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3410087722, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629089, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg" 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3412617709, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629259, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml" 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3414123413, 2023-10-05T15:18:52.811 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629796, 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml" 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3416838362, 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628718, 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-89.xml" 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3417424450, 2023-10-05T15:18:52.812 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629382, 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml" 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3423328494, 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629037, 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-8.jpg" 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3433204836, 2023-10-05T15:18:52.813 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628891, 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml" 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3443211933, 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629044, 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-57.jpg" 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.814 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3445925511, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628701, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.o" 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3447718328, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628698, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/reader.Po" 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3451987843, 2023-10-05T15:18:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629003, 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg" 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3457370010, 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629365, 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml" 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3458799609, 2023-10-05T15:18:52.816 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629385, 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml" 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3465445242, 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629353, 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml" 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3466315752, 2023-10-05T15:18:52.817 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629393, 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-98.jpg" 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3477498413, 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629665, 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg" 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3478143900, 2023-10-05T15:18:52.818 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629199, 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg" 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3479156614, 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628300, 2023-10-05T15:18:52.819 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.h" 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3480639786, 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629355, 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml" 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.820 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3502080517, 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629631, 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-43.jpg" 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3506174406, 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628889, 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml" 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.821 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3506706317, 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629109, 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg" 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3508148668, 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628737, 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-83.jpg" 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.822 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3512665745, 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628922, 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-25.jpg" 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3522034818, 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629011, 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml" 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.823 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3527820664, 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629092, 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-42.jpg" 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3528382523, 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628749, 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-79.jpg" 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.824 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3546383540, 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629392, 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-99.jpg" 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3548373761, 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628715, 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2" 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.825 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3552550144, 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629395, 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-96.jpg" 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3555529645, 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629405, 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-86.jpg" 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3572430311, 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629144, 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg" 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3593129960, 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628755, 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-77.jpg" 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3596677567, 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628853, 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml" 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3597496074, 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629295, 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg" 2023-10-05T15:18:52.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3610409182, 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628990, 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-15.xml" 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3614207137, 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629156, 2023-10-05T15:18:52.829 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-78.xml" 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3618018486, 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629373, 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml" 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.831 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.831 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3622633531, 2023-10-05T15:18:52.831 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629185, 2023-10-05T15:18:52.831 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml" 2023-10-05T15:18:52.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3634969295, 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629247, 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml" 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.832 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3638045678, 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629153, 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg" 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3643159729, 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629131, 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-84.xml" 2023-10-05T15:18:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3648308134, 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629326, 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml" 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3650111299, 2023-10-05T15:18:52.834 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628705, 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o" 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3654176555, 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628989, 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-15.jpg" 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.835 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3661105892, 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628310, 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.c" 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3661119291, 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629494, 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-30.xml" 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3667743696, 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629695, 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7" 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3669245453, 2023-10-05T15:18:52.837 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629314, 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml" 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3685754603, 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629815, 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml" 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.838 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3686253051, 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629500, 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-24.xml" 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3701657700, 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628770, 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-72.jpg" 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3708550361, 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629597, 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml" 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3711394843, 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628806, 2023-10-05T15:18:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-60.jpg" 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3714828214, 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629206, 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-44.jpg" 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.841 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3718474398, 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629727, 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-62.xml" 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3719256832, 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629280, 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg" 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3721960135, 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628961, 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml" 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3723792182, 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629053, 2023-10-05T15:18:52.843 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg" 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3731535925, 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628830, 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-52.jpg" 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3734308940, 2023-10-05T15:18:52.844 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628308, 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.c" 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3741812291, 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629635, 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml" 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.845 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3742077557, 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628876, 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml" 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3747443890, 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629210, 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-62.xml" 2023-10-05T15:18:52.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3748109328, 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629333, 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml" 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3759245791, 2023-10-05T15:18:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629220, 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-39.jpg" 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3765465531, 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628937, 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml" 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3768013623, 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629705, 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml" 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3769250728, 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629762, 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml" 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3769519507, 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628957, 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-26.xml" 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3769864619, 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629758, 2023-10-05T15:18:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml" 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3773858070, 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629344, 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml" 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3776695718, 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629557, 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg" 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3784084412, 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629038, 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-59.jpg" 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3785618105, 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629380, 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml" 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3787411731, 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629420, 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-71.jpg" 2023-10-05T15:18:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3797170833, 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628747, 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-79.xml" 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3802617433, 2023-10-05T15:18:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629299, 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-48.xml" 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3806318636, 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629341, 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml" 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3808534214, 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629128, 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-33.jpg" 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3809767276, 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629685, 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6" 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3811956813, 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629387, 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml" 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3817937757, 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628811, 2023-10-05T15:18:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-57.xml" 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3820239285, 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629471, 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-42.xml" 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3825038473, 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629192, 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-68.xml" 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3827872186, 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629123, 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-86.xml" 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3831968002, 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628841, 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-52.xml" 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3833067389, 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629464, 2023-10-05T15:18:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-45.xml" 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3837111348, 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629362, 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml" 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3869224506, 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629035, 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-60.jpg" 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3871726734, 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629748, 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml" 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3887786967, 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629242, 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-30.jpg" 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3889198836, 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629227, 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-36.jpg" 2023-10-05T15:18:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3889850791, 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629208, 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg" 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3892231045, 2023-10-05T15:18:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629558, 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-5.xml" 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3898676074, 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628854, 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-44.jpg" 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3902710427, 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629403, 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-88.jpg" 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3911038429, 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629214, 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-9.jpg" 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3926448335, 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629012, 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg" 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3947157862, 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629331, 2023-10-05T15:18:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml" 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3952937505, 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628691, 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.o" 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3953234635, 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628835, 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-53.xml" 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3958402361, 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629602, 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml" 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3959334966, 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629696, 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml" 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3963214783, 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629783, 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml" 2023-10-05T15:18:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3965635194, 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628896, 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-31.jpg" 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3969334136, 2023-10-05T15:18:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628883, 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml" 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3970416762, 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629776, 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml" 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3974137945, 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628800, 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-62.jpg" 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3976046950, 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629822, 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml" 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3976747811, 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629553, 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-6.xml" 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3982434838, 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628765, 2023-10-05T15:18:52.874 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml" 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3985412057, 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629318, 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml" 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3986457592, 2023-10-05T15:18:52.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629006, 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg" 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3986660066, 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629573, 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-3.xml" 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.876 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3990819142, 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628846, 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml" 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3997304778, 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629286, 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg" 2023-10-05T15:18:52.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 3997393100, 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629193, 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg" 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4003906387, 2023-10-05T15:18:52.878 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629194, 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-4.xml" 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4008291200, 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628776, 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-70.jpg" 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4011423714, 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629152, 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-79.xml" 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4013302101, 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629637, 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-54.xml" 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4018106674, 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629061, 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg" 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4019046801, 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629482, 2023-10-05T15:18:52.881 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-36.xml" 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4023940604, 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629367, 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml" 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.882 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4024504684, 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629332, 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml" 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4031886083, 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629158, 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-14.xml" 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.883 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4033126666, 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629690, 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-60.xml" 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4036540615, 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628751, 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml" 2023-10-05T15:18:52.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4037418390, 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629554, 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg" 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4041403324, 2023-10-05T15:18:52.885 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629389, 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml" 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4052105650, 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629666, 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml" 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.886 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4052583364, 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629228, 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml" 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4057443283, 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628692, 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/process.Po" 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4063300473, 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629799, 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml" 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4066968231, 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629659, 2023-10-05T15:18:52.888 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg" 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4081249142, 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629370, 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml" 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4087443389, 2023-10-05T15:18:52.889 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629239, 2023-10-05T15:18:52.890 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-31.jpg" 2023-10-05T15:18:52.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.890 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.890 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4089371977, 2023-10-05T15:18:52.890 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629475, 2023-10-05T15:18:52.893 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-40.xml" 2023-10-05T15:18:52.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.893 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4092081625, 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628822, 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml" 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4096025621, 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629000, 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg" 2023-10-05T15:18:52.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4096682688, 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629551, 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg" 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4102732270, 2023-10-05T15:18:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629518, 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-12.xml" 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4104837308, 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629834, 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml" 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.896 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4106827881, 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629402, 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-89.jpg" 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4108508174, 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629357, 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml" 2023-10-05T15:18:52.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4109599503, 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629588, 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-6.jpg" 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4110159504, 2023-10-05T15:18:52.898 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628982, 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg" 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4112153601, 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628717, 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-90.jpg" 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.899 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4112353442, 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628985, 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg" 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4115320304, 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628899, 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-40.xml" 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4117207518, 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628927, 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml" 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4142998214, 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629432, 2023-10-05T15:18:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg" 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4146673527, 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628879, 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml" 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4160026816, 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628706, 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po" 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4160423801, 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628864, 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml" 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4172986993, 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629327, 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml" 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4173075237, 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629442, 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg" 2023-10-05T15:18:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4173734614, 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629404, 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-87.jpg" 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4175151790, 2023-10-05T15:18:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629439, 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg" 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4176317226, 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628826, 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-54.xml" 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4176411517, 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628773, 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-71.jpg" 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4184161340, 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629717, 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml" 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4185659819, 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628714, 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1" 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4186395223, 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628995, 2023-10-05T15:18:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg" 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4195659186, 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629267, 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-52.xml" 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4197518548, 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629325, 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml" 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4203249962, 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628857, 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-43.jpg" 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4210217154, 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629339, 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml" 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4218923560, 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628905, 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-38.xml" 2023-10-05T15:18:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4219904671, 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628763, 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-66.xml" 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4220163110, 2023-10-05T15:18:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629724, 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml" 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4223147415, 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629663, 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml" 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4236933410, 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629095, 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-93.xml" 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4239828345, 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628740, 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-82.jpg" 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4243471464, 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629043, 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg" 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4247757017, 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628882, 2023-10-05T15:18:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml" 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4249538388, 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629810, 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml" 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4250867322, 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628858, 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml" 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4252103699, 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629473, 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-41.xml" 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4254626174, 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629581, 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml" 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4258560568, 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629120, 2023-10-05T15:18:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-35.jpg" 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4264865327, 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629754, 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-54.xml" 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4267227996, 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511628945, 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml" 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4272647333, 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629204, 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-64.xml" 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4277272152, 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629218, 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-59.xml" 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "damage_type": "backtrace", 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4293072036, 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 1099511629160, 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-77.xml" 2023-10-05T15:18:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:18:52.922 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-05T15:18:52.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:52 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1405319506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:18:52.923 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:52 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1405319506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:18:52.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5d9c0a15f0 msgr2=0x7f5d9c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5d9c0a15f0 0x7f5d9c0a3ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5db419a780 tx=0x7f5da4009260 comp rx=0 tx=0).stop 2023-10-05T15:18:52.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 msgr2=0x7f5db4199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:52.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db4199170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00b6c0 tx=0x7f5dac004ad0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 shutdown_connections 2023-10-05T15:18:52.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db419db10 0x7f5db419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5d9c0a15f0 0x7f5d9c0a3ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db40ffff0 0x7f5db4199170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 --2- 172.21.15.60:0/536539394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db4105110 0x7f5db41996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:52.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.387+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 >> 172.21.15.60:0/536539394 conn(0x7f5db40fb890 msgr2=0x7f5db4069940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:52.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.388+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 shutdown_connections 2023-10-05T15:18:52.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:52.388+0000 7f5db8f77700 1 -- 172.21.15.60:0/536539394 wait complete. 2023-10-05T15:18:52.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-05T15:18:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/3321129469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81010b0 msgr2=0x7fe3b8101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/3321129469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81010b0 0x7fe3b8101490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80098f0 tx=0x7fe3a8009c00 comp rx=0 tx=0).stop 2023-10-05T15:18:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/3321129469 shutdown_connections 2023-10-05T15:18:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/3321129469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b81061d0 0x7fe3b810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/3321129469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81010b0 0x7fe3b8101490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/3321129469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b8101a60 0x7fe3b8105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/3321129469 >> 172.21.15.60:0/3321129469 conn(0x7fe3b80fc950 msgr2=0x7fe3b80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/3321129469 shutdown_connections 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/3321129469 wait complete. 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.066+0000 7fe3bd5b5700 1 Processor -- start 2023-10-05T15:18:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 -- start start 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b81010b0 0x7fe3b8196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81061d0 0x7fe3b81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 0x7fe3b819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b819c3a0 con 0x7fe3b819b920 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b819c510 con 0x7fe3b81061d0 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3bd5b5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b819c6d0 con 0x7fe3b81010b0 2023-10-05T15:18:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81061d0 0x7fe3b81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 0x7fe3b819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b81010b0 0x7fe3b8196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 0x7fe3b819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40342/0 (socket says 172.21.15.60:40342) 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b81010b0 0x7fe3b8196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53868/0 (socket says 172.21.15.60:53868) 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 -- 172.21.15.60:0/194714652 learned_addr learned my addr 172.21.15.60:0/194714652 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 -- 172.21.15.60:0/194714652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b81010b0 msgr2=0x7fe3b8196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b81010b0 0x7fe3b8196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 -- 172.21.15.60:0/194714652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81061d0 msgr2=0x7fe3b81974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81061d0 0x7fe3b81974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 -- 172.21.15.60:0/194714652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0009d00 con 0x7fe3b819b920 2023-10-05T15:18:53.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81061d0 0x7fe3b81974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:53.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.067+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 0x7fe3b819bda0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000e3c0 tx=0x7fe3b000e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:53.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.068+0000 7fe39ffff700 1 -- 172.21.15.60:0/194714652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00090d0 con 0x7fe3b819b920 2023-10-05T15:18:53.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.068+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a8009520 con 0x7fe3b819b920 2023-10-05T15:18:53.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.068+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b81a3f80 con 0x7fe3b819b920 2023-10-05T15:18:53.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.068+0000 7fe39ffff700 1 -- 172.21.15.60:0/194714652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3b000f040 con 0x7fe3b819b920 2023-10-05T15:18:53.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.068+0000 7fe39ffff700 1 -- 172.21.15.60:0/194714652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0007b90 con 0x7fe3b819b920 2023-10-05T15:18:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.070+0000 7fe39ffff700 1 -- 172.21.15.60:0/194714652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe3b0007cf0 con 0x7fe3b819b920 2023-10-05T15:18:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.070+0000 7fe39ffff700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe3a00a15f0 0x7fe3a00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.070+0000 7fe39ffff700 1 -- 172.21.15.60:0/194714652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fe3b00cd070 con 0x7fe3b819b920 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.070+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe3a00a15f0 0x7fe3a00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.071+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe3a00a15f0 0x7fe3a00a3ab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009fd0 tx=0x7fe3a8019040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.071+0000 7fe3c979fb80 1 Processor -- start 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.071+0000 7fe3c979fb80 1 -- start start 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.071+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.071+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.071+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e426460 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e417c20 con 0x55ca9e4c8890 2023-10-05T15:18:53.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e415540 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40348/0 (socket says 172.21.15.60:40348) 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 -- 172.21.15.60:0/3284611243 learned_addr learned my addr 172.21.15.60:0/3284611243 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 -- 172.21.15.60:0/3284611243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 msgr2=0x55ca9e4bd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4bd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 -- 172.21.15.60:0/3284611243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 msgr2=0x55ca9e4cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 -- 172.21.15.60:0/3284611243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9e23bde0 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c8350 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac011540 tx=0x7fe3ac011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27445498510ae783 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe39d7fa700 1 -- 172.21.15.60:0/3284611243 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac004a30 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe39d7fa700 1 -- 172.21.15.60:0/3284611243 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3ac0054e0 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.072+0000 7fe39d7fa700 1 -- 172.21.15.60:0/3284611243 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00e910 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3284611243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 msgr2=0x55ca9e4c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c8350 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac011540 tx=0x7fe3ac011850 comp rx=0 tx=0).stop 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3284611243 shutdown_connections 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3284611243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c8350 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3284611243 >> 172.21.15.60:0/3284611243 conn(0x55ca9e432260 msgr2=0x55ca9e4b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3284611243 shutdown_connections 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.073+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3284611243 wait complete. 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 -- start start 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 Processor -- start 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e410e30 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e3ad710 con 0x55ca9e4c8890 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e3ad3b0 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3c979fb80 10 client.0 _ll_register_callbacks cb 0x55ca9e20a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:53.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40354/0 (socket says 172.21.15.60:40354) 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3b67fc700 1 -- 172.21.15.60:0/1523549079 learned_addr learned my addr 172.21.15.60:0/1523549079 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53882/0 (socket says 172.21.15.60:53882) 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.074+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 msgr2=0x55ca9e4c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/1523549079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 msgr2=0x55ca9e4c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/1523549079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b810e5c0 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4c8220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009810 tx=0x7fe3a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dee004d10f3c0e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe39aff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe39aff5700 1 -- 172.21.15.60:0/1523549079 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a802b040 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe39aff5700 1 -- 172.21.15.60:0/1523549079 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fe3a8005450 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca9e4b0f10 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe39aff5700 1 -- 172.21.15.60:0/1523549079 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3a8005610 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3c979fb80 10 client.25948 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fe3b81a3f80 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.075+0000 7fe39aff5700 1 -- 172.21.15.60:0/1523549079 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ca9e4b0f10 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe39aff5700 1 -- 172.21.15.60:0/1523549079 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fe3a8037070 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3c979fb80 10 client.25948 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:53.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3c979fb80 10 client.25948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3c979fb80 20 client.25948 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e4d83f0 0x55ca9e4da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3c979fb80 4 client.25948 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca9e409e10 con 0x55ca9e4d83f0 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e4d83f0 0x55ca9e4da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe39aff5700 10 client.25948 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.076+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e4d83f0 0x55ca9e4da810 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a7cf497798862 server_cookie=3a5a2c2882aa3c5c in_seq=0 out_seq=0 2023-10-05T15:18:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe39aff5700 1 -- 172.21.15.60:0/1523549079 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ca9e409e10 con 0x55ca9e4d83f0 2023-10-05T15:18:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe39aff5700 10 client.25948 handle_command_reply: tid=0 2023-10-05T15:18:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 client.25948 shutdown 2023-10-05T15:18:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 msgr2=0x55ca9e4c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4c8220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009810 tx=0x7fe3a8009c00 comp rx=0 tx=0).stop 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 shutdown_connections 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e4d83f0 0x55ca9e4da810 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4c8220 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/1523549079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe39aff5700 0 client.25948 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 >> 172.21.15.60:0/1523549079 conn(0x55ca9e432260 msgr2=0x55ca9e4b8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 shutdown_connections 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.077+0000 7fe3c979fb80 1 -- 172.21.15.60:0/1523549079 wait complete. 2023-10-05T15:18:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.078+0000 7fe3c979fb80 20 client.25948 trim_cache size 0 max 16384 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 Processor -- start 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 -- start start 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e291920 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e4cf970 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.091+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e4c3a00 con 0x55ca9e4c8890 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53782/0 (socket says 172.21.15.60:53782) 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3067688724 learned_addr learned my addr 172.21.15.60:0/3067688724 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3067688724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4c8890 msgr2=0x55ca9e4c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3067688724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 msgr2=0x55ca9e4c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3067688724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac009d10 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:18:53.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cf430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800bd10 tx=0x7fe3a8005a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f6610e56e5f717 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:53.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe39dffb700 1 -- 172.21.15.60:0/3067688724 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a802b040 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe39dffb700 1 -- 172.21.15.60:0/3067688724 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3a801d040 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.092+0000 7fe39dffb700 1 -- 172.21.15.60:0/3067688724 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8003680 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3067688724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 msgr2=0x55ca9e4cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cf430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800bd10 tx=0x7fe3a8005a40 comp rx=0 tx=0).stop 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3067688724 shutdown_connections 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4c8890 0x55ca9e4c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cf430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/3067688724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3067688724 >> 172.21.15.60:0/3067688724 conn(0x55ca9e432260 msgr2=0x55ca9e4c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3067688724 shutdown_connections 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 -- 172.21.15.60:0/3067688724 wait complete. 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 -- start start 2023-10-05T15:18:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.093+0000 7fe3c979fb80 1 Processor -- start 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e52f660 con 0x55ca9e4c8890 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e52f7d0 con 0x55ca9e4bd9e0 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9e52f990 con 0x55ca9e4bd0c0 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3c979fb80 10 client.0 _ll_register_callbacks cb 0x7fe3a800b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53790/0 (socket says 172.21.15.60:53790) 2023-10-05T15:18:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53896/0 (socket says 172.21.15.60:53896) 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b67fc700 1 -- 172.21.15.60:0/292137531 learned_addr learned my addr 172.21.15.60:0/292137531 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 -- 172.21.15.60:0/292137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 msgr2=0x55ca9e4cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 -- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 msgr2=0x55ca9e4cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 -- 172.21.15.60:0/292137531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b81a3f80 con 0x55ca9e4c8890 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b67fc700 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cbe90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00ca4a0 tx=0x7fe3b009a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e49d4f969549386 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.094+0000 7fe39aff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe39aff5700 1 -- 172.21.15.60:0/292137531 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b009df10 con 0x55ca9e4c8890 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe39aff5700 1 -- 172.21.15.60:0/292137531 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fe3b009d070 con 0x55ca9e4c8890 2023-10-05T15:18:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3ac0054e0 con 0x55ca9e4c8890 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe39aff5700 1 -- 172.21.15.60:0/292137531 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3b00a20c0 con 0x55ca9e4c8890 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 10 client.16422 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ca9e224c60 con 0x55ca9e4c8890 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe39aff5700 1 -- 172.21.15.60:0/292137531 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3ac0054e0 con 0x55ca9e4c8890 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe39aff5700 1 -- 172.21.15.60:0/292137531 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fe3b0011ba0 con 0x55ca9e4c8890 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 10 client.16422 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 20 client.16422 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e531140 0x55ca9e533560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 4 client.16422 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ca9e409b30 con 0x55ca9e531140 2023-10-05T15:18:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.095+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e531140 0x55ca9e533560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e531140 0x55ca9e533560 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d21a50de3300622c server_cookie=d9dd2dfd287b73be in_seq=0 out_seq=0 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe39aff5700 10 client.16422 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe39aff5700 1 -- 172.21.15.60:0/292137531 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ca9e409b30 con 0x55ca9e531140 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe39aff5700 10 client.16422 handle_command_reply: tid=0 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 client.16422 shutdown 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4c8890 msgr2=0x55ca9e4cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cbe90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00ca4a0 tx=0x7fe3b009a530 comp rx=0 tx=0).stop 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 shutdown_connections 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ca9e531140 0x55ca9e533560 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca9e4c8890 0x55ca9e4cbe90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe39aff5700 0 client.16422 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca9e4bd0c0 0x55ca9e4cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 --2- 172.21.15.60:0/292137531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca9e4bd9e0 0x55ca9e4cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 >> 172.21.15.60:0/292137531 conn(0x55ca9e432260 msgr2=0x55ca9e4beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 shutdown_connections 2023-10-05T15:18:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 1 -- 172.21.15.60:0/292137531 wait complete. 2023-10-05T15:18:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.096+0000 7fe3c979fb80 20 client.16422 trim_cache size 0 max 16384 2023-10-05T15:18:53.108 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2023-10-05T15:18:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe3a00a15f0 msgr2=0x7fe3a00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe3a00a15f0 0x7fe3a00a3ab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009fd0 tx=0x7fe3a8019040 comp rx=0 tx=0).stop 2023-10-05T15:18:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 msgr2=0x7fe3b819bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 0x7fe3b819bda0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000e3c0 tx=0x7fe3b000e6d0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 shutdown_connections 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3b819b920 0x7fe3b819bda0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b81010b0 0x7fe3b8196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe3a00a15f0 0x7fe3a00a3ab0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 --2- 172.21.15.60:0/194714652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81061d0 0x7fe3b81974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 >> 172.21.15.60:0/194714652 conn(0x7fe3b80fc950 msgr2=0x7fe3b8104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 shutdown_connections 2023-10-05T15:18:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:18:53.097+0000 7fe3bd5b5700 1 -- 172.21.15.60:0/194714652 wait complete. 2023-10-05T15:18:53.113 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 262475, 'ino': 1099511629072, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2942399, 'ino': 1099511629607, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 11873024, 'ino': 1099511629431, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 12886878, 'ino': 1099511629773, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 21292099, 'ino': 1099511628312, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.c'}, {'damage_type': 'backtrace', 'id': 28523260, 'ino': 1099511629187, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 47260748, 'ino': 1099511629313, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml'}, {'damage_type': 'backtrace', 'id': 53247184, 'ino': 1099511629358, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml'}, {'damage_type': 'backtrace', 'id': 55808713, 'ino': 1099511629030, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 56516343, 'ino': 1099511629514, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-14.xml'}, {'damage_type': 'backtrace', 'id': 60708697, 'ino': 1099511629045, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 64730798, 'ino': 1099511629148, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-80.xml'}, {'damage_type': 'backtrace', 'id': 68615978, 'ino': 1099511628768, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml'}, {'damage_type': 'backtrace', 'id': 75619829, 'ino': 1099511629307, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-84.xml'}, {'damage_type': 'backtrace', 'id': 76543106, 'ino': 1099511628871, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-46.xml'}, {'damage_type': 'backtrace', 'id': 81936539, 'ino': 1099511628911, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml'}, {'damage_type': 'backtrace', 'id': 82845733, 'ino': 1099511628955, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml'}, {'damage_type': 'backtrace', 'id': 89081014, 'ino': 1099511629654, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 90088781, 'ino': 1099511628769, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-65.xml'}, {'damage_type': 'backtrace', 'id': 97856289, 'ino': 1099511628697, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.o'}, {'damage_type': 'backtrace', 'id': 110598143, 'ino': 1099511629674, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 111779062, 'ino': 1099511629143, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-81.xml'}, {'damage_type': 'backtrace', 'id': 111843068, 'ino': 1099511629448, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 120123935, 'ino': 1099511629169, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 123555350, 'ino': 1099511629673, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 123608015, 'ino': 1099511629595, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 124068985, 'ino': 1099511628753, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml'}, {'damage_type': 'backtrace', 'id': 139743199, 'ino': 1099511629084, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 143151592, 'ino': 1099511629632, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 145440470, 'ino': 1099511629078, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 146957350, 'ino': 1099511629733, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-60.xml'}, {'damage_type': 'backtrace', 'id': 147378442, 'ino': 1099511629273, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 162209682, 'ino': 1099511628901, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml'}, {'damage_type': 'backtrace', 'id': 162800264, 'ino': 1099511629550, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 168808920, 'ino': 1099511629157, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 171717001, 'ino': 1099511629352, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml'}, {'damage_type': 'backtrace', 'id': 173613667, 'ino': 1099511629303, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 180211033, 'ino': 1099511629050, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 184952996, 'ino': 1099511628309, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/globals.h'}, {'damage_type': 'backtrace', 'id': 187205784, 'ino': 1099511628939, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml'}, {'damage_type': 'backtrace', 'id': 188088305, 'ino': 1099511629406, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 195132781, 'ino': 1099511629047, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 197157037, 'ino': 1099511629346, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml'}, {'damage_type': 'backtrace', 'id': 198038612, 'ino': 1099511629323, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml'}, {'damage_type': 'backtrace', 'id': 198774112, 'ino': 1099511628299, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.c'}, {'damage_type': 'backtrace', 'id': 203314365, 'ino': 1099511628991, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 222068251, 'ino': 1099511628738, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-82.xml'}, {'damage_type': 'backtrace', 'id': 230036940, 'ino': 1099511628745, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-69.xml'}, {'damage_type': 'backtrace', 'id': 233942452, 'ino': 1099511629066, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 244746421, 'ino': 1099511629707, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-68.xml'}, {'damage_type': 'backtrace', 'id': 246386320, 'ino': 1099511629139, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-82.xml'}, {'damage_type': 'backtrace', 'id': 249482825, 'ino': 1099511629409, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 250974320, 'ino': 1099511628906, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml'}, {'damage_type': 'backtrace', 'id': 251508486, 'ino': 1099511629755, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 253899559, 'ino': 1099511629398, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-93.jpg'}, {'damage_type': 'backtrace', 'id': 257421790, 'ino': 1099511629359, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml'}, {'damage_type': 'backtrace', 'id': 258650239, 'ino': 1099511629814, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 259138298, 'ino': 1099511629723, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-63.xml'}, {'damage_type': 'backtrace', 'id': 259398604, 'ino': 1099511628784, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-62.xml'}, {'damage_type': 'backtrace', 'id': 259475820, 'ino': 1099511629345, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml'}, {'damage_type': 'backtrace', 'id': 260793858, 'ino': 1099511629456, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 262309341, 'ino': 1099511629640, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 264958023, 'ino': 1099511628727, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-71.xml'}, {'damage_type': 'backtrace', 'id': 268920083, 'ino': 1099511629266, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 273375888, 'ino': 1099511629618, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 275392067, 'ino': 1099511629274, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 276894453, 'ino': 1099511629819, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 277746144, 'ino': 1099511629033, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 278789188, 'ino': 1099511629115, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-88.xml'}, {'damage_type': 'backtrace', 'id': 279968186, 'ino': 1099511629836, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-34.xml'}, {'damage_type': 'backtrace', 'id': 280119609, 'ino': 1099511629300, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 280225414, 'ino': 1099511629236, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 284990794, 'ino': 1099511629007, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 287621113, 'ino': 1099511629582, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 297447843, 'ino': 1099511628301, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.c'}, {'damage_type': 'backtrace', 'id': 302636097, 'ino': 1099511629453, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 303847621, 'ino': 1099511629268, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 310060283, 'ino': 1099511628813, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml'}, {'damage_type': 'backtrace', 'id': 315469002, 'ino': 1099511628789, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml'}, {'damage_type': 'backtrace', 'id': 318195995, 'ino': 1099511629714, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 329022481, 'ino': 1099511629447, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 338668422, 'ino': 1099511629736, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-59.xml'}, {'damage_type': 'backtrace', 'id': 341092270, 'ino': 1099511629383, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml'}, {'damage_type': 'backtrace', 'id': 341227669, 'ino': 1099511629056, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 342823335, 'ino': 1099511629490, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-32.xml'}, {'damage_type': 'backtrace', 'id': 350830498, 'ino': 1099511628976, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 355397723, 'ino': 1099511628837, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml'}, {'damage_type': 'backtrace', 'id': 355459816, 'ino': 1099511629363, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml'}, {'damage_type': 'backtrace', 'id': 357792149, 'ino': 1099511629057, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 367261102, 'ino': 1099511629164, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-76.xml'}, {'damage_type': 'backtrace', 'id': 370630590, 'ino': 1099511629540, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 370777298, 'ino': 1099511629205, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 383470836, 'ino': 1099511629253, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 384930661, 'ino': 1099511629541, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 393193824, 'ino': 1099511629614, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 395317022, 'ino': 1099511629212, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 395755777, 'ino': 1099511628908, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 400200515, 'ino': 1099511629200, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml'}, {'damage_type': 'backtrace', 'id': 405326896, 'ino': 1099511629087, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-95.xml'}, {'damage_type': 'backtrace', 'id': 407190328, 'ino': 1099511628720, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 409897524, 'ino': 1099511628930, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-35.xml'}, {'damage_type': 'backtrace', 'id': 420057187, 'ino': 1099511629075, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 422772641, 'ino': 1099511628775, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-64.xml'}, {'damage_type': 'backtrace', 'id': 432073472, 'ino': 1099511629496, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-28.xml'}, {'damage_type': 'backtrace', 'id': 432128895, 'ino': 1099511629390, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml'}, {'damage_type': 'backtrace', 'id': 445089039, 'ino': 1099511629008, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml'}, {'damage_type': 'backtrace', 'id': 447994923, 'ino': 1099511628798, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml'}, {'damage_type': 'backtrace', 'id': 466342115, 'ino': 1099511629446, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 466343993, 'ino': 1099511629568, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-4.xml'}, {'damage_type': 'backtrace', 'id': 467711061, 'ino': 1099511629549, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 468334882, 'ino': 1099511628707, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.o'}, {'damage_type': 'backtrace', 'id': 470371899, 'ino': 1099511628792, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml'}, {'damage_type': 'backtrace', 'id': 481285050, 'ino': 1099511629336, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml'}, {'damage_type': 'backtrace', 'id': 483704559, 'ino': 1099511628708, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po'}, {'damage_type': 'backtrace', 'id': 492691889, 'ino': 1099511628952, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml'}, {'damage_type': 'backtrace', 'id': 494214135, 'ino': 1099511628996, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml'}, {'damage_type': 'backtrace', 'id': 495440466, 'ino': 1099511629067, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 497076684, 'ino': 1099511629105, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 508359513, 'ino': 1099511629831, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-35.xml'}, {'damage_type': 'backtrace', 'id': 514760562, 'ino': 1099511629780, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 519405323, 'ino': 1099511629342, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml'}, {'damage_type': 'backtrace', 'id': 535561332, 'ino': 1099511628861, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml'}, {'damage_type': 'backtrace', 'id': 539085598, 'ino': 1099511629413, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 550769299, 'ino': 1099511629180, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-72.xml'}, {'damage_type': 'backtrace', 'id': 552018230, 'ino': 1099511629298, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 555124730, 'ino': 1099511628895, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml'}, {'damage_type': 'backtrace', 'id': 562333429, 'ino': 1099511628873, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml'}, {'damage_type': 'backtrace', 'id': 566044589, 'ino': 1099511629560, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 567423155, 'ino': 1099511628943, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml'}, {'damage_type': 'backtrace', 'id': 568266001, 'ino': 1099511629213, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-61.xml'}, {'damage_type': 'backtrace', 'id': 572862280, 'ino': 1099511628807, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml'}, {'damage_type': 'backtrace', 'id': 577352948, 'ino': 1099511628690, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po'}, {'damage_type': 'backtrace', 'id': 581110877, 'ino': 1099511628802, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-59.xml'}, {'damage_type': 'backtrace', 'id': 589027520, 'ino': 1099511629276, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 595718694, 'ino': 1099511628956, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 596751669, 'ino': 1099511628867, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml'}, {'damage_type': 'backtrace', 'id': 604784576, 'ino': 1099511629502, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-22.xml'}, {'damage_type': 'backtrace', 'id': 607387791, 'ino': 1099511629503, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-21.xml'}, {'damage_type': 'backtrace', 'id': 609978891, 'ino': 1099511629813, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-39.xml'}, {'damage_type': 'backtrace', 'id': 614866282, 'ino': 1099511629827, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-36.xml'}, {'damage_type': 'backtrace', 'id': 615293392, 'ino': 1099511628962, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 649770909, 'ino': 1099511628912, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 655833977, 'ino': 1099511629444, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 660787665, 'ino': 1099511628918, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 666709593, 'ino': 1099511629112, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 670645981, 'ino': 1099511629321, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml'}, {'damage_type': 'backtrace', 'id': 684771367, 'ino': 1099511629146, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-17.xml'}, {'damage_type': 'backtrace', 'id': 696221997, 'ino': 1099511628848, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 708575853, 'ino': 1099511628827, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 710169786, 'ino': 1099511628724, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-87.xml'}, {'damage_type': 'backtrace', 'id': 712266441, 'ino': 1099511628774, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml'}, {'damage_type': 'backtrace', 'id': 713654583, 'ino': 1099511628870, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml'}, {'damage_type': 'backtrace', 'id': 717452605, 'ino': 1099511629319, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml'}, {'damage_type': 'backtrace', 'id': 718850451, 'ino': 1099511628935, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 719616441, 'ino': 1099511629698, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-70.xml'}, {'damage_type': 'backtrace', 'id': 721744860, 'ino': 1099511628975, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml'}, {'damage_type': 'backtrace', 'id': 727871810, 'ino': 1099511628671, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile'}, {'damage_type': 'backtrace', 'id': 732939382, 'ino': 1099511629529, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 733047330, 'ino': 1099511629572, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 737438485, 'ino': 1099511629458, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-47.xml'}, {'damage_type': 'backtrace', 'id': 740557574, 'ino': 1099511629737, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 743273219, 'ino': 1099511629734, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 744319639, 'ino': 1099511628721, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml'}, {'damage_type': 'backtrace', 'id': 747503887, 'ino': 1099511628856, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-49.xml'}, {'damage_type': 'backtrace', 'id': 749885430, 'ino': 1099511629832, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 754715738, 'ino': 1099511629809, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 754998215, 'ino': 1099511629603, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 757169923, 'ino': 1099511629744, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-57.xml'}, {'damage_type': 'backtrace', 'id': 757959748, 'ino': 1099511629176, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-73.xml'}, {'damage_type': 'backtrace', 'id': 761174576, 'ino': 1099511628801, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml'}, {'damage_type': 'backtrace', 'id': 765615769, 'ino': 1099511629386, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml'}, {'damage_type': 'backtrace', 'id': 768581328, 'ino': 1099511629348, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml'}, {'damage_type': 'backtrace', 'id': 770108872, 'ino': 1099511628893, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-42.xml'}, {'damage_type': 'backtrace', 'id': 770958218, 'ino': 1099511629287, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-50.xml'}, {'damage_type': 'backtrace', 'id': 773433625, 'ino': 1099511629585, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 783302852, 'ino': 1099511629284, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 787037280, 'ino': 1099511629107, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-90.xml'}, {'damage_type': 'backtrace', 'id': 795361070, 'ino': 1099511629349, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml'}, {'damage_type': 'backtrace', 'id': 797557464, 'ino': 1099511629104, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 797835000, 'ino': 1099511628734, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 799735912, 'ino': 1099511629593, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 803547081, 'ino': 1099511629679, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 803893151, 'ino': 1099511629412, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 804290949, 'ino': 1099511628954, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml'}, {'damage_type': 'backtrace', 'id': 813606828, 'ino': 1099511628305, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h'}, {'damage_type': 'backtrace', 'id': 816450468, 'ino': 1099511628759, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml'}, {'damage_type': 'backtrace', 'id': 823346934, 'ino': 1099511629421, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 832507786, 'ino': 1099511629658, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 840277943, 'ino': 1099511629230, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-57.xml'}, {'damage_type': 'backtrace', 'id': 854288842, 'ino': 1099511629022, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 855494957, 'ino': 1099511629669, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 863547391, 'ino': 1099511629396, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-95.jpg'}, {'damage_type': 'backtrace', 'id': 863988208, 'ino': 1099511629708, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 872741973, 'ino': 1099511629136, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 877513541, 'ino': 1099511628825, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml'}, {'damage_type': 'backtrace', 'id': 878090355, 'ino': 1099511628303, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench_p.h'}, {'damage_type': 'backtrace', 'id': 880454505, 'ino': 1099511628902, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 893003076, 'ino': 1099511629189, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-69.xml'}, {'damage_type': 'backtrace', 'id': 897260739, 'ino': 1099511629527, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-10.xml'}, {'damage_type': 'backtrace', 'id': 897286164, 'ino': 1099511629747, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-56.xml'}, {'damage_type': 'backtrace', 'id': 901154256, 'ino': 1099511628758, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 909254722, 'ino': 1099511629545, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-7.xml'}, {'damage_type': 'backtrace', 'id': 918574412, 'ino': 1099511629384, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml'}, {'damage_type': 'backtrace', 'id': 924141303, 'ino': 1099511628803, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 931343959, 'ino': 1099511628812, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 937462845, 'ino': 1099511629498, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-26.xml'}, {'damage_type': 'backtrace', 'id': 944009917, 'ino': 1099511629547, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 952563063, 'ino': 1099511628986, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 959436403, 'ino': 1099511629443, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 961676411, 'ino': 1099511629770, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 966477230, 'ino': 1099511629478, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-38.xml'}, {'damage_type': 'backtrace', 'id': 969184977, 'ino': 1099511628723, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 971854385, 'ino': 1099511629137, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 976394768, 'ino': 1099511628314, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.c'}, {'damage_type': 'backtrace', 'id': 981170760, 'ino': 1099511629027, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 981434334, 'ino': 1099511629438, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 984303985, 'ino': 1099511629715, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml'}, {'damage_type': 'backtrace', 'id': 987341510, 'ino': 1099511628887, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 995683552, 'ino': 1099511629678, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1006621406, 'ino': 1099511629591, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1010733986, 'ino': 1099511629036, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1014254599, 'ino': 1099511629804, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1017751071, 'ino': 1099511628695, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.o'}, {'damage_type': 'backtrace', 'id': 1025619800, 'ino': 1099511629791, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 1027212657, 'ino': 1099511629778, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1031787351, 'ino': 1099511629340, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1032328066, 'ino': 1099511629294, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1042478130, 'ino': 1099511628757, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-67.xml'}, {'damage_type': 'backtrace', 'id': 1048694656, 'ino': 1099511629430, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1050939308, 'ino': 1099511628885, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1052834937, 'ino': 1099511629141, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1063533768, 'ino': 1099511628973, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1064794261, 'ino': 1099511628872, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1067068370, 'ino': 1099511629818, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1069307847, 'ino': 1099511628964, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1071318692, 'ino': 1099511628815, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1071374211, 'ino': 1099511628791, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 1073857510, 'ino': 1099511629041, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1075589258, 'ino': 1099511629466, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1085418349, 'ino': 1099511628764, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 1087298811, 'ino': 1099511629535, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1094898344, 'ino': 1099511629589, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 1097272030, 'ino': 1099511629145, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4'}, {'damage_type': 'backtrace', 'id': 1099448322, 'ino': 1099511628897, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1100543848, 'ino': 1099511629800, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 1108570340, 'ino': 1099511629445, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1123337463, 'ino': 1099511628999, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1125263090, 'ino': 1099511629263, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1136427777, 'ino': 1099511629049, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1137265543, 'ino': 1099511629381, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1140157674, 'ino': 1099511629449, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 1141719834, 'ino': 1099511629343, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1143739724, 'ino': 1099511629425, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 1144443697, 'ino': 1099511629371, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1144577282, 'ino': 1099511628890, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1156425619, 'ino': 1099511629074, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1157025077, 'ino': 1099511628820, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1157335252, 'ino': 1099511629719, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-64.xml'}, {'damage_type': 'backtrace', 'id': 1157815207, 'ino': 1099511629150, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1162813167, 'ino': 1099511628928, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1165897522, 'ino': 1099511629101, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1167454477, 'ino': 1099511629506, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1180366807, 'ino': 1099511629686, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1185192083, 'ino': 1099511629140, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1185367288, 'ino': 1099511628909, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1195416750, 'ino': 1099511629211, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1204817021, 'ino': 1099511629077, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1206199497, 'ino': 1099511629533, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 1207055548, 'ino': 1099511629422, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 1207856456, 'ino': 1099511629408, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 1211201574, 'ino': 1099511629525, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1215232232, 'ino': 1099511629235, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml'}, {'damage_type': 'backtrace', 'id': 1217746771, 'ino': 1099511629021, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1235439605, 'ino': 1099511628842, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1241171361, 'ino': 1099511629277, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1248031604, 'ino': 1099511629048, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1252846644, 'ino': 1099511628726, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-86.xml'}, {'damage_type': 'backtrace', 'id': 1256065579, 'ino': 1099511628797, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1259057628, 'ino': 1099511629161, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1270993823, 'ino': 1099511629840, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1275449461, 'ino': 1099511629577, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1279012899, 'ino': 1099511629824, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1286196109, 'ino': 1099511629434, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1287791427, 'ino': 1099511629805, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 1302343648, 'ino': 1099511629721, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 1303500181, 'ino': 1099511629252, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-54.xml'}, {'damage_type': 'backtrace', 'id': 1309238521, 'ino': 1099511628710, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench'}, {'damage_type': 'backtrace', 'id': 1312575918, 'ino': 1099511628703, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/helpers.o'}, {'damage_type': 'backtrace', 'id': 1326005805, 'ino': 1099511629100, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1330275660, 'ino': 1099511629225, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1331230828, 'ino': 1099511628818, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1343823811, 'ino': 1099511629563, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1346804076, 'ino': 1099511628921, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1354845375, 'ino': 1099511628913, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1355987835, 'ino': 1099511629646, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1360772867, 'ino': 1099511629424, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1364695028, 'ino': 1099511628709, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.o'}, {'damage_type': 'backtrace', 'id': 1368942439, 'ino': 1099511628944, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1369603717, 'ino': 1099511629451, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1370037053, 'ino': 1099511629411, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 1393973603, 'ino': 1099511629741, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1395556805, 'ino': 1099511628855, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1397076657, 'ino': 1099511628926, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1400216759, 'ino': 1099511628903, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1405349559, 'ino': 1099511628679, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps'}, {'damage_type': 'backtrace', 'id': 1407742551, 'ino': 1099511629334, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1409298078, 'ino': 1099511629676, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1421154087, 'ino': 1099511629002, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1422858746, 'ino': 1099511628981, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1423051435, 'ino': 1099511629435, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1430460245, 'ino': 1099511629215, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1433701029, 'ino': 1099511628817, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1442208767, 'ino': 1099511629645, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1446636184, 'ino': 1099511629282, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1447585274, 'ino': 1099511629154, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1447742709, 'ino': 1099511629329, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1457385941, 'ino': 1099511629583, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 1465523115, 'ino': 1099511629241, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 1466726888, 'ino': 1099511628728, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 1469587315, 'ino': 1099511628881, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1470735419, 'ino': 1099511629249, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1471471490, 'ino': 1099511629407, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 1471529731, 'ino': 1099511629217, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1478314453, 'ino': 1099511629244, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1483395551, 'ino': 1099511629246, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1487534431, 'ino': 1099511628786, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1488361111, 'ino': 1099511629511, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1488366868, 'ino': 1099511629315, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml'}, {'damage_type': 'backtrace', 'id': 1490982318, 'ino': 1099511629028, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1493313261, 'ino': 1099511629322, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1493413232, 'ino': 1099511629024, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1498348684, 'ino': 1099511629254, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1498872862, 'ino': 1099511628862, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1499752760, 'ino': 1099511629369, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1511731828, 'ino': 1099511629423, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1513108592, 'ino': 1099511629099, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-92.xml'}, {'damage_type': 'backtrace', 'id': 1517414719, 'ino': 1099511629523, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1527028320, 'ino': 1099511629837, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 1529908088, 'ino': 1099511628779, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 1530557912, 'ino': 1099511628790, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1538432877, 'ino': 1099511629125, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1541998922, 'ino': 1099511628731, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 1552656769, 'ino': 1099511629639, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 1555466150, 'ino': 1099511628978, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1572090604, 'ino': 1099511628297, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.c'}, {'damage_type': 'backtrace', 'id': 1583943121, 'ino': 1099511629650, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1585040909, 'ino': 1099511629768, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-50.xml'}, {'damage_type': 'backtrace', 'id': 1594134297, 'ino': 1099511629414, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 1603816000, 'ino': 1099511629388, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1606793190, 'ino': 1099511629347, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1608729098, 'ino': 1099511628963, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1623061048, 'ino': 1099511629745, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1625452614, 'ino': 1099511629623, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1630633353, 'ino': 1099511629488, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1647112196, 'ino': 1099511629328, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1647595242, 'ino': 1099511628931, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1649799545, 'ino': 1099511629636, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1654221795, 'ino': 1099511629132, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1666064425, 'ino': 1099511629613, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1667119159, 'ino': 1099511629258, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1674869113, 'ino': 1099511629223, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1676038831, 'ino': 1099511629360, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1678462366, 'ino': 1099511629817, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-38.xml'}, {'damage_type': 'backtrace', 'id': 1683297577, 'ino': 1099511629108, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1685345178, 'ino': 1099511629039, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1686997581, 'ino': 1099511629170, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1687312502, 'ino': 1099511628933, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1689001289, 'ino': 1099511629542, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 1691747899, 'ino': 1099511629440, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1691857307, 'ino': 1099511629133, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1694723890, 'ino': 1099511628743, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 1702626501, 'ino': 1099511629391, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-100.jpg'}, {'damage_type': 'backtrace', 'id': 1705154564, 'ino': 1099511629567, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1710489155, 'ino': 1099511629566, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 1716425846, 'ino': 1099511628828, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1716683016, 'ino': 1099511629198, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1716896697, 'ino': 1099511629209, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1725150487, 'ino': 1099511629655, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1726272313, 'ino': 1099511629788, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 1754997246, 'ino': 1099511629018, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1762615920, 'ino': 1099511629752, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1766688671, 'ino': 1099511629609, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1774129096, 'ino': 1099511629843, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1775949558, 'ino': 1099511628958, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1792207735, 'ino': 1099511628694, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/writer.Po'}, {'damage_type': 'backtrace', 'id': 1798817470, 'ino': 1099511628810, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1810301240, 'ino': 1099511629751, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1813531171, 'ino': 1099511628993, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1813961218, 'ino': 1099511628970, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1817673011, 'ino': 1099511628977, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1831403378, 'ino': 1099511629436, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1832146508, 'ino': 1099511628969, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1838184712, 'ino': 1099511628729, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-85.xml'}, {'damage_type': 'backtrace', 'id': 1840074463, 'ino': 1099511629202, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1846795852, 'ino': 1099511629376, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1847102268, 'ino': 1099511629168, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-75.xml'}, {'damage_type': 'backtrace', 'id': 1847760612, 'ino': 1099511629455, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1850787979, 'ino': 1099511628967, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1850801027, 'ino': 1099511629429, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 1856585788, 'ino': 1099511629486, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1860256210, 'ino': 1099511628847, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1867516416, 'ino': 1099511629713, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1873256828, 'ino': 1099511628311, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/rewriter.c'}, {'damage_type': 'backtrace', 'id': 1873818167, 'ino': 1099511629261, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1873844130, 'ino': 1099511628819, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1882285020, 'ino': 1099511628782, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1885978029, 'ino': 1099511628771, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml'}, {'damage_type': 'backtrace', 'id': 1891475587, 'ino': 1099511628702, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po'}, {'damage_type': 'backtrace', 'id': 1893343750, 'ino': 1099511629379, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1897727657, 'ino': 1099511629604, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1899659870, 'ino': 1099511629335, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1900543344, 'ino': 1099511629476, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1903755266, 'ino': 1099511628972, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1912958077, 'ino': 1099511629418, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 1913291027, 'ino': 1099511628306, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1913872499, 'ino': 1099511628302, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/fakesnprintf.h'}, {'damage_type': 'backtrace', 'id': 1915933104, 'ino': 1099511629174, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1923493267, 'ino': 1099511629111, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-89.xml'}, {'damage_type': 'backtrace', 'id': 1926904328, 'ino': 1099511628304, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c'}, {'damage_type': 'backtrace', 'id': 1936856130, 'ino': 1099511629772, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1937616230, 'ino': 1099511629097, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1939635929, 'ino': 1099511629450, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1952068897, 'ino': 1099511629651, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1953717409, 'ino': 1099511629672, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 1964789378, 'ino': 1099511629229, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1965814097, 'ino': 1099511629372, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1973047450, 'ino': 1099511629177, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1980673111, 'ino': 1099511629306, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-85.xml'}, {'damage_type': 'backtrace', 'id': 1991104502, 'ino': 1099511628971, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1994885917, 'ino': 1099511629374, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1996070105, 'ino': 1099511629091, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-94.xml'}, {'damage_type': 'backtrace', 'id': 1999242855, 'ino': 1099511629310, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml'}, {'damage_type': 'backtrace', 'id': 1999577061, 'ino': 1099511628878, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2006660478, 'ino': 1099511628998, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2015378318, 'ino': 1099511629480, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2022904109, 'ino': 1099511628915, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2030123180, 'ino': 1099511629766, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2030494632, 'ino': 1099511629301, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2051493246, 'ino': 1099511629495, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2065221801, 'ino': 1099511629119, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-87.xml'}, {'damage_type': 'backtrace', 'id': 2066215214, 'ino': 1099511629687, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 2067816869, 'ino': 1099511629265, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 2074566299, 'ino': 1099511629071, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2074863934, 'ino': 1099511628712, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0'}, {'damage_type': 'backtrace', 'id': 2075639689, 'ino': 1099511629765, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 2077499765, 'ino': 1099511629617, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2086248517, 'ino': 1099511629680, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2086288618, 'ino': 1099511628725, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 2091377691, 'ino': 1099511629608, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 2095579235, 'ino': 1099511628966, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2103865425, 'ino': 1099511629234, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2105625316, 'ino': 1099511629195, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2109199439, 'ino': 1099511628294, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2110767747, 'ino': 1099511629571, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2116230379, 'ino': 1099511629324, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2119490699, 'ino': 1099511629338, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2121893148, 'ino': 1099511629838, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2131132072, 'ino': 1099511628865, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2131880096, 'ino': 1099511629029, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2137318972, 'ino': 1099511629417, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 2138046440, 'ino': 1099511629728, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 2152709761, 'ino': 1099511629416, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2159940263, 'ino': 1099511629711, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2160011982, 'ino': 1099511629845, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2160780410, 'ino': 1099511629521, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2172299214, 'ino': 1099511629081, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2178626280, 'ino': 1099511629308, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-83.xml'}, {'damage_type': 'backtrace', 'id': 2185977923, 'ino': 1099511628824, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2189816363, 'ino': 1099511629330, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml'}, {'damage_type': 'backtrace', 'id': 2193450754, 'ino': 1099511629509, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2205305065, 'ino': 1099511628907, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2209338658, 'ino': 1099511629829, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 2211676874, 'ino': 1099511629073, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2215509442, 'ino': 1099511629839, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2218188739, 'ino': 1099511629178, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2219528187, 'ino': 1099511628777, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml'}, {'damage_type': 'backtrace', 'id': 2220721925, 'ino': 1099511629181, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2222723761, 'ino': 1099511628925, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2245150073, 'ino': 1099511628795, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2246869832, 'ino': 1099511629428, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2257037629, 'ino': 1099511628914, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2257228097, 'ino': 1099511628780, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2259760999, 'ino': 1099511629452, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2261504189, 'ino': 1099511629807, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2264994974, 'ino': 1099511628672, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile'}, {'damage_type': 'backtrace', 'id': 2266648484, 'ino': 1099511629251, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2271142609, 'ino': 1099511629730, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-61.xml'}, {'damage_type': 'backtrace', 'id': 2272366185, 'ino': 1099511629032, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2273623476, 'ino': 1099511629537, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2279553819, 'ino': 1099511628851, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2299312328, 'ino': 1099511628307, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2313841855, 'ino': 1099511629760, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-52.xml'}, {'damage_type': 'backtrace', 'id': 2317595018, 'ino': 1099511628783, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2321782120, 'ino': 1099511628843, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2323646269, 'ino': 1099511629519, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 2328557118, 'ino': 1099511629127, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-85.xml'}, {'damage_type': 'backtrace', 'id': 2332686003, 'ino': 1099511629366, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2334608700, 'ino': 1099511628808, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2337173300, 'ino': 1099511629305, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5'}, {'damage_type': 'backtrace', 'id': 2339254974, 'ino': 1099511629124, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 2339465084, 'ino': 1099511628833, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2341626642, 'ino': 1099511628291, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4'}, {'damage_type': 'backtrace', 'id': 2341995789, 'ino': 1099511629243, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-55.xml'}, {'damage_type': 'backtrace', 'id': 2342068477, 'ino': 1099511629203, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2348410760, 'ino': 1099511629080, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2350300885, 'ino': 1099511629121, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2352536956, 'ino': 1099511629271, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2353095921, 'ino': 1099511628923, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2355865625, 'ino': 1099511628796, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2363456508, 'ino': 1099511629083, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2368951665, 'ino': 1099511628940, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2371650481, 'ino': 1099511629590, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 2373263622, 'ino': 1099511629775, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2377299215, 'ino': 1099511629351, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2387457226, 'ino': 1099511629364, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2388916170, 'ino': 1099511629051, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2391602596, 'ino': 1099511629683, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 2395313906, 'ino': 1099511628988, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2399851924, 'ino': 1099511629377, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2409619662, 'ino': 1099511629570, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2411090202, 'ino': 1099511628744, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-80.xml'}, {'damage_type': 'backtrace', 'id': 2416348334, 'ino': 1099511629531, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2418179447, 'ino': 1099511628293, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/blogbench.8'}, {'damage_type': 'backtrace', 'id': 2422332764, 'ino': 1099511629188, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2423222720, 'ino': 1099511629493, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2424405093, 'ino': 1099511629469, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2438511400, 'ino': 1099511629055, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2438979468, 'ino': 1099511629574, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2439175622, 'ino': 1099511628313, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/writer.c'}, {'damage_type': 'backtrace', 'id': 2444751018, 'ino': 1099511629716, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2447303751, 'ino': 1099511629786, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2453431293, 'ino': 1099511629625, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 2456584397, 'ino': 1099511629653, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 2456841477, 'ino': 1099511628778, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2460990472, 'ino': 1099511629682, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2465741872, 'ino': 1099511628900, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2474152557, 'ino': 1099511629803, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2479630968, 'ino': 1099511629561, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-81.xml'}, {'damage_type': 'backtrace', 'id': 2482412129, 'ino': 1099511628866, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2483516558, 'ino': 1099511629644, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 2485188857, 'ino': 1099511629675, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2486411771, 'ino': 1099511628849, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2492456631, 'ino': 1099511629798, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2495231478, 'ino': 1099511628951, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2510537230, 'ino': 1099511629441, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2512333535, 'ino': 1099511628917, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2514686445, 'ino': 1099511629626, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2517526852, 'ino': 1099511628704, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po'}, {'damage_type': 'backtrace', 'id': 2518349419, 'ino': 1099511629337, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2524026902, 'ino': 1099511629731, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 2531758816, 'ino': 1099511629742, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2546480407, 'ino': 1099511628821, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 2549324613, 'ino': 1099511629399, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-92.jpg'}, {'damage_type': 'backtrace', 'id': 2549626344, 'ino': 1099511629630, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 2549811183, 'ino': 1099511629375, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2553472232, 'ino': 1099511629312, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-79.xml'}, {'damage_type': 'backtrace', 'id': 2553776183, 'ino': 1099511629641, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2557903121, 'ino': 1099511629656, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2567618696, 'ino': 1099511628884, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 2569706555, 'ino': 1099511629317, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml'}, {'damage_type': 'backtrace', 'id': 2587919244, 'ino': 1099511628750, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml'}, {'damage_type': 'backtrace', 'id': 2591775829, 'ino': 1099511629005, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2592692548, 'ino': 1099511628949, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2594961136, 'ino': 1099511628761, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2604309875, 'ino': 1099511629309, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml'}, {'damage_type': 'backtrace', 'id': 2607774114, 'ino': 1099511628713, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2618580283, 'ino': 1099511629026, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2624476365, 'ino': 1099511629828, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2628810489, 'ino': 1099511628836, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2635255202, 'ino': 1099511628888, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2637421499, 'ino': 1099511629014, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2651067256, 'ino': 1099511628736, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-70.xml'}, {'damage_type': 'backtrace', 'id': 2652506400, 'ino': 1099511629700, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2659932493, 'ino': 1099511629356, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2665774566, 'ino': 1099511629576, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 2668740876, 'ino': 1099511629190, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2682627566, 'ino': 1099511629497, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2688969578, 'ino': 1099511629649, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 2704347951, 'ino': 1099511628877, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2712165706, 'ino': 1099511629361, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2714524784, 'ino': 1099511628947, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2715560795, 'ino': 1099511628839, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2716231052, 'ino': 1099511629368, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2724765350, 'ino': 1099511628298, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/mysnprintf.h'}, {'damage_type': 'backtrace', 'id': 2730123436, 'ino': 1099511629270, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 2732668487, 'ino': 1099511629316, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2735137725, 'ino': 1099511628860, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2738802307, 'ino': 1099511629764, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2746427492, 'ino': 1099511628994, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2747189110, 'ino': 1099511628788, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 2752909357, 'ino': 1099511629216, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2759704604, 'ino': 1099511629096, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2762197785, 'ino': 1099511628716, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-72.xml'}, {'damage_type': 'backtrace', 'id': 2773208910, 'ino': 1099511629103, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-91.xml'}, {'damage_type': 'backtrace', 'id': 2781647902, 'ino': 1099511629191, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2782494411, 'ino': 1099511629117, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2783220973, 'ino': 1099511628997, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2786976028, 'ino': 1099511628834, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2794246319, 'ino': 1099511628875, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2795725845, 'ino': 1099511629670, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2802209208, 'ino': 1099511628794, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2803957766, 'ino': 1099511629821, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2809047071, 'ino': 1099511629378, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2827792400, 'ino': 1099511629054, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2828994498, 'ino': 1099511628869, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2830467865, 'ino': 1099511628693, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.o'}, {'damage_type': 'backtrace', 'id': 2839695695, 'ino': 1099511629634, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2843954870, 'ino': 1099511629224, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml'}, {'damage_type': 'backtrace', 'id': 2845831765, 'ino': 1099511629586, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2860224084, 'ino': 1099511629184, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2866566009, 'ino': 1099511629113, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2868411290, 'ino': 1099511628696, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po'}, {'damage_type': 'backtrace', 'id': 2877811190, 'ino': 1099511629183, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-71.xml'}, {'damage_type': 'backtrace', 'id': 2880661962, 'ino': 1099511628845, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2882312723, 'ino': 1099511629621, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 2888503647, 'ino': 1099511629304, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2890810702, 'ino': 1099511628987, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2891579243, 'ino': 1099511629162, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2891684884, 'ino': 1099511628816, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2894034970, 'ino': 1099511629667, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2897562759, 'ino': 1099511628919, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2900774855, 'ino': 1099511629069, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2902169807, 'ino': 1099511629023, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2905359906, 'ino': 1099511629059, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2906380675, 'ino': 1099511629093, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2909975027, 'ino': 1099511629016, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2910127475, 'ino': 1099511629116, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2911601158, 'ino': 1099511629693, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2911689646, 'ino': 1099511628840, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2912906421, 'ino': 1099511628752, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 2915750490, 'ino': 1099511628767, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 2925442774, 'ino': 1099511628852, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2927072847, 'ino': 1099511629462, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2931154396, 'ino': 1099511629015, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2935360166, 'ino': 1099511628946, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2938899401, 'ino': 1099511629505, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2977641104, 'ino': 1099511629454, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2978484833, 'ino': 1099511628804, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2986553789, 'ino': 1099511629599, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3006803315, 'ino': 1099511628711, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in'}, {'damage_type': 'backtrace', 'id': 3007768209, 'ino': 1099511628984, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3011775157, 'ino': 1099511629598, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3013259186, 'ino': 1099511628762, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3013926720, 'ino': 1099511628746, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 3015085747, 'ino': 1099511629149, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3018554244, 'ino': 1099511629311, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml'}, {'damage_type': 'backtrace', 'id': 3025515318, 'ino': 1099511628699, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/reader.o'}, {'damage_type': 'backtrace', 'id': 3028725104, 'ino': 1099511629564, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3032684354, 'ino': 1099511629256, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3035397361, 'ino': 1099511629135, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-83.xml'}, {'damage_type': 'backtrace', 'id': 3049741900, 'ino': 1099511629612, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3055108082, 'ino': 1099511629415, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3056450427, 'ino': 1099511629782, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3056978045, 'ino': 1099511629622, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3059739659, 'ino': 1099511629410, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 3062420004, 'ino': 1099511629401, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 3062613775, 'ino': 1099511629219, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml'}, {'damage_type': 'backtrace', 'id': 3063950050, 'ino': 1099511628942, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3066056797, 'ino': 1099511629173, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3095142893, 'ino': 1099511628732, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-84.xml'}, {'damage_type': 'backtrace', 'id': 3095649736, 'ino': 1099511629628, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 3103872794, 'ino': 1099511629515, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3114005395, 'ino': 1099511628979, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 3123647675, 'ino': 1099511629790, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3156575961, 'ino': 1099511629060, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3159253403, 'ino': 1099511629757, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3162159615, 'ino': 1099511628936, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3162217563, 'ino': 1099511629397, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-94.jpg'}, {'damage_type': 'backtrace', 'id': 3167406221, 'ino': 1099511629088, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3168036266, 'ino': 1099511629499, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3168749791, 'ino': 1099511629794, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3181590676, 'ino': 1099511629062, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3185007989, 'ino': 1099511628735, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml'}, {'damage_type': 'backtrace', 'id': 3192251957, 'ino': 1099511629232, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3192259382, 'ino': 1099511628700, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po'}, {'damage_type': 'backtrace', 'id': 3203477027, 'ino': 1099511628960, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3213656481, 'ino': 1099511629437, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3219421520, 'ino': 1099511629483, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-35.xml'}, {'damage_type': 'backtrace', 'id': 3224256389, 'ino': 1099511629546, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3231411161, 'ino': 1099511629009, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3232449778, 'ino': 1099511629288, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3238321320, 'ino': 1099511629017, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3243197550, 'ino': 1099511629068, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3243954138, 'ino': 1099511629504, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3246524773, 'ino': 1099511629292, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3250551881, 'ino': 1099511629085, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3'}, {'damage_type': 'backtrace', 'id': 3260226359, 'ino': 1099511629020, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3277222111, 'ino': 1099511629611, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 3286119911, 'ino': 1099511629419, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 3287943642, 'ino': 1099511629739, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3288636380, 'ino': 1099511629129, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3296124346, 'ino': 1099511628894, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3298094782, 'ino': 1099511629201, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3303643589, 'ino': 1099511629165, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3304633640, 'ino': 1099511629278, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3312881909, 'ino': 1099511629079, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3313461829, 'ino': 1099511629042, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 3316258421, 'ino': 1099511629226, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3325049855, 'ino': 1099511629433, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 3325055985, 'ino': 1099511628295, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/man/Makefile.in'}, {'damage_type': 'backtrace', 'id': 3327525984, 'ino': 1099511629394, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-97.jpg'}, {'damage_type': 'backtrace', 'id': 3330595854, 'ino': 1099511628948, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3334625549, 'ino': 1099511629063, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3343876452, 'ino': 1099511629400, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-91.jpg'}, {'damage_type': 'backtrace', 'id': 3346633114, 'ino': 1099511629616, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 3353661061, 'ino': 1099511629787, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3361018466, 'ino': 1099511629426, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3364709791, 'ino': 1099511628785, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 3366487925, 'ino': 1099511628863, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3374320278, 'ino': 1099511629289, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3376202958, 'ino': 1099511629207, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3380075558, 'ino': 1099511629841, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3385237460, 'ino': 1099511629196, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3399840227, 'ino': 1099511629594, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3401806608, 'ino': 1099511629703, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3402034141, 'ino': 1099511628809, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3404988417, 'ino': 1099511629507, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3410087722, 'ino': 1099511629089, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3412617709, 'ino': 1099511629259, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 3414123413, 'ino': 1099511629796, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 3416838362, 'ino': 1099511628718, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-89.xml'}, {'damage_type': 'backtrace', 'id': 3417424450, 'ino': 1099511629382, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3423328494, 'ino': 1099511629037, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3433204836, 'ino': 1099511628891, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3443211933, 'ino': 1099511629044, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 3445925511, 'ino': 1099511628701, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.o'}, {'damage_type': 'backtrace', 'id': 3447718328, 'ino': 1099511628698, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/reader.Po'}, {'damage_type': 'backtrace', 'id': 3451987843, 'ino': 1099511629003, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3457370010, 'ino': 1099511629365, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3458799609, 'ino': 1099511629385, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3465445242, 'ino': 1099511629353, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3466315752, 'ino': 1099511629393, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-98.jpg'}, {'damage_type': 'backtrace', 'id': 3477498413, 'ino': 1099511629665, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3478143900, 'ino': 1099511629199, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3479156614, 'ino': 1099511628300, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.h'}, {'damage_type': 'backtrace', 'id': 3480639786, 'ino': 1099511629355, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3502080517, 'ino': 1099511629631, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3506174406, 'ino': 1099511628889, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3506706317, 'ino': 1099511629109, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3508148668, 'ino': 1099511628737, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 3512665745, 'ino': 1099511628922, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3522034818, 'ino': 1099511629011, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3527820664, 'ino': 1099511629092, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3528382523, 'ino': 1099511628749, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 3546383540, 'ino': 1099511629392, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-99.jpg'}, {'damage_type': 'backtrace', 'id': 3548373761, 'ino': 1099511628715, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2'}, {'damage_type': 'backtrace', 'id': 3552550144, 'ino': 1099511629395, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-96.jpg'}, {'damage_type': 'backtrace', 'id': 3555529645, 'ino': 1099511629405, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 3572430311, 'ino': 1099511629144, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 3593129960, 'ino': 1099511628755, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 3596677567, 'ino': 1099511628853, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml'}, {'damage_type': 'backtrace', 'id': 3597496074, 'ino': 1099511629295, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3610409182, 'ino': 1099511628990, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3614207137, 'ino': 1099511629156, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-78.xml'}, {'damage_type': 'backtrace', 'id': 3618018486, 'ino': 1099511629373, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3622633531, 'ino': 1099511629185, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3634969295, 'ino': 1099511629247, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 3638045678, 'ino': 1099511629153, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3643159729, 'ino': 1099511629131, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-84.xml'}, {'damage_type': 'backtrace', 'id': 3648308134, 'ino': 1099511629326, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3650111299, 'ino': 1099511628705, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o'}, {'damage_type': 'backtrace', 'id': 3654176555, 'ino': 1099511628989, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3661105892, 'ino': 1099511628310, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/commenter.c'}, {'damage_type': 'backtrace', 'id': 3661119291, 'ino': 1099511629494, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3667743696, 'ino': 1099511629695, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7'}, {'damage_type': 'backtrace', 'id': 3669245453, 'ino': 1099511629314, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml'}, {'damage_type': 'backtrace', 'id': 3685754603, 'ino': 1099511629815, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3686253051, 'ino': 1099511629500, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3701657700, 'ino': 1099511628770, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 3708550361, 'ino': 1099511629597, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 3711394843, 'ino': 1099511628806, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 3714828214, 'ino': 1099511629206, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3718474398, 'ino': 1099511629727, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3719256832, 'ino': 1099511629280, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3721960135, 'ino': 1099511628961, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3723792182, 'ino': 1099511629053, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3731535925, 'ino': 1099511628830, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3734308940, 'ino': 1099511628308, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/process.c'}, {'damage_type': 'backtrace', 'id': 3741812291, 'ino': 1099511629635, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3742077557, 'ino': 1099511628876, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3747443890, 'ino': 1099511629210, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3748109328, 'ino': 1099511629333, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3759245791, 'ino': 1099511629220, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3765465531, 'ino': 1099511628937, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3768013623, 'ino': 1099511629705, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3769250728, 'ino': 1099511629762, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3769519507, 'ino': 1099511628957, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3769864619, 'ino': 1099511629758, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 3773858070, 'ino': 1099511629344, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml'}, {'damage_type': 'backtrace', 'id': 3776695718, 'ino': 1099511629557, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 3784084412, 'ino': 1099511629038, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3785618105, 'ino': 1099511629380, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3787411731, 'ino': 1099511629420, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3797170833, 'ino': 1099511628747, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-79.xml'}, {'damage_type': 'backtrace', 'id': 3802617433, 'ino': 1099511629299, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3806318636, 'ino': 1099511629341, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml'}, {'damage_type': 'backtrace', 'id': 3808534214, 'ino': 1099511629128, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3809767276, 'ino': 1099511629685, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6'}, {'damage_type': 'backtrace', 'id': 3811956813, 'ino': 1099511629387, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3817937757, 'ino': 1099511628811, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3820239285, 'ino': 1099511629471, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3825038473, 'ino': 1099511629192, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-68.xml'}, {'damage_type': 'backtrace', 'id': 3827872186, 'ino': 1099511629123, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-86.xml'}, {'damage_type': 'backtrace', 'id': 3831968002, 'ino': 1099511628841, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3833067389, 'ino': 1099511629464, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3837111348, 'ino': 1099511629362, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3869224506, 'ino': 1099511629035, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 3871726734, 'ino': 1099511629748, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3887786967, 'ino': 1099511629242, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 3889198836, 'ino': 1099511629227, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3889850791, 'ino': 1099511629208, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3892231045, 'ino': 1099511629558, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3898676074, 'ino': 1099511628854, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3902710427, 'ino': 1099511629403, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 3911038429, 'ino': 1099511629214, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3926448335, 'ino': 1099511629012, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3947157862, 'ino': 1099511629331, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml'}, {'damage_type': 'backtrace', 'id': 3952937505, 'ino': 1099511628691, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogbench.o'}, {'damage_type': 'backtrace', 'id': 3953234635, 'ino': 1099511628835, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3958402361, 'ino': 1099511629602, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 3959334966, 'ino': 1099511629696, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3963214783, 'ino': 1099511629783, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 3965635194, 'ino': 1099511628896, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3969334136, 'ino': 1099511628883, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3970416762, 'ino': 1099511629776, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3974137945, 'ino': 1099511628800, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 3976046950, 'ino': 1099511629822, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3976747811, 'ino': 1099511629553, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3982434838, 'ino': 1099511628765, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml'}, {'damage_type': 'backtrace', 'id': 3985412057, 'ino': 1099511629318, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml'}, {'damage_type': 'backtrace', 'id': 3986457592, 'ino': 1099511629006, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3986660066, 'ino': 1099511629573, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3990819142, 'ino': 1099511628846, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3997304778, 'ino': 1099511629286, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3997393100, 'ino': 1099511629193, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 4003906387, 'ino': 1099511629194, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-4.xml'}, {'damage_type': 'backtrace', 'id': 4008291200, 'ino': 1099511628776, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 4011423714, 'ino': 1099511629152, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-79.xml'}, {'damage_type': 'backtrace', 'id': 4013302101, 'ino': 1099511629637, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 4018106674, 'ino': 1099511629061, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 4019046801, 'ino': 1099511629482, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-36.xml'}, {'damage_type': 'backtrace', 'id': 4023940604, 'ino': 1099511629367, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml'}, {'damage_type': 'backtrace', 'id': 4024504684, 'ino': 1099511629332, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml'}, {'damage_type': 'backtrace', 'id': 4031886083, 'ino': 1099511629158, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-14.xml'}, {'damage_type': 'backtrace', 'id': 4033126666, 'ino': 1099511629690, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 4036540615, 'ino': 1099511628751, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml'}, {'damage_type': 'backtrace', 'id': 4037418390, 'ino': 1099511629554, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 4041403324, 'ino': 1099511629389, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml'}, {'damage_type': 'backtrace', 'id': 4052105650, 'ino': 1099511629666, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 4052583364, 'ino': 1099511629228, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml'}, {'damage_type': 'backtrace', 'id': 4057443283, 'ino': 1099511628692, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/process.Po'}, {'damage_type': 'backtrace', 'id': 4063300473, 'ino': 1099511629799, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 4066968231, 'ino': 1099511629659, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4081249142, 'ino': 1099511629370, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml'}, {'damage_type': 'backtrace', 'id': 4087443389, 'ino': 1099511629239, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 4089371977, 'ino': 1099511629475, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-40.xml'}, {'damage_type': 'backtrace', 'id': 4092081625, 'ino': 1099511628822, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml'}, {'damage_type': 'backtrace', 'id': 4096025621, 'ino': 1099511629000, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 4096682688, 'ino': 1099511629551, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 4102732270, 'ino': 1099511629518, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4104837308, 'ino': 1099511629834, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 4106827881, 'ino': 1099511629402, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 4108508174, 'ino': 1099511629357, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml'}, {'damage_type': 'backtrace', 'id': 4109599503, 'ino': 1099511629588, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 4110159504, 'ino': 1099511628982, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 4112153601, 'ino': 1099511628717, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 4112353442, 'ino': 1099511628985, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 4115320304, 'ino': 1099511628899, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-40.xml'}, {'damage_type': 'backtrace', 'id': 4117207518, 'ino': 1099511628927, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml'}, {'damage_type': 'backtrace', 'id': 4142998214, 'ino': 1099511629432, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 4146673527, 'ino': 1099511628879, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml'}, {'damage_type': 'backtrace', 'id': 4160026816, 'ino': 1099511628706, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po'}, {'damage_type': 'backtrace', 'id': 4160423801, 'ino': 1099511628864, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml'}, {'damage_type': 'backtrace', 'id': 4172986993, 'ino': 1099511629327, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml'}, {'damage_type': 'backtrace', 'id': 4173075237, 'ino': 1099511629442, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 4173734614, 'ino': 1099511629404, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 4175151790, 'ino': 1099511629439, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 4176317226, 'ino': 1099511628826, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-54.xml'}, {'damage_type': 'backtrace', 'id': 4176411517, 'ino': 1099511628773, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 4184161340, 'ino': 1099511629717, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 4185659819, 'ino': 1099511628714, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1'}, {'damage_type': 'backtrace', 'id': 4186395223, 'ino': 1099511628995, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 4195659186, 'ino': 1099511629267, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-52.xml'}, {'damage_type': 'backtrace', 'id': 4197518548, 'ino': 1099511629325, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml'}, {'damage_type': 'backtrace', 'id': 4203249962, 'ino': 1099511628857, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 4210217154, 'ino': 1099511629339, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml'}, {'damage_type': 'backtrace', 'id': 4218923560, 'ino': 1099511628905, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-38.xml'}, {'damage_type': 'backtrace', 'id': 4219904671, 'ino': 1099511628763, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-66.xml'}, {'damage_type': 'backtrace', 'id': 4220163110, 'ino': 1099511629724, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 4223147415, 'ino': 1099511629663, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 4236933410, 'ino': 1099511629095, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-93.xml'}, {'damage_type': 'backtrace', 'id': 4239828345, 'ino': 1099511628740, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 4243471464, 'ino': 1099511629043, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 4247757017, 'ino': 1099511628882, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml'}, {'damage_type': 'backtrace', 'id': 4249538388, 'ino': 1099511629810, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 4250867322, 'ino': 1099511628858, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml'}, {'damage_type': 'backtrace', 'id': 4252103699, 'ino': 1099511629473, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-41.xml'}, {'damage_type': 'backtrace', 'id': 4254626174, 'ino': 1099511629581, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 4258560568, 'ino': 1099511629120, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 4264865327, 'ino': 1099511629754, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/article-54.xml'}, {'damage_type': 'backtrace', 'id': 4267227996, 'ino': 1099511628945, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml'}, {'damage_type': 'backtrace', 'id': 4272647333, 'ino': 1099511629204, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-64.xml'}, {'damage_type': 'backtrace', 'id': 4277272152, 'ino': 1099511629218, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-59.xml'}, {'damage_type': 'backtrace', 'id': 4293072036, 'ino': 1099511629160, 'path': '/volumes/_nogroup/sv_1/f7fb4b41-fea6-4757-a2c9-34fcb383cdbf/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-3/article-77.xml'}] 2023-10-05T15:18:53.115 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-05T15:18:53.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:53 smithi060 ceph-mon[99238]: pgmap v67: 129 pgs: 129 active+clean; 179 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 661 op/s 2023-10-05T15:18:53.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:53 smithi092 ceph-mon[102944]: pgmap v67: 129 pgs: 129 active+clean; 179 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 661 op/s 2023-10-05T15:18:53.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:53 smithi135 ceph-mon[103360]: pgmap v67: 129 pgs: 129 active+clean; 179 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 661 op/s 2023-10-05T15:18:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 -- 172.21.15.60:0/46138744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce08105ef0 msgr2=0x7fce081062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 --2- 172.21.15.60:0/46138744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce08105ef0 0x7fce081062d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fce040098f0 tx=0x7fce04009c00 comp rx=0 tx=0).stop 2023-10-05T15:18:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 -- 172.21.15.60:0/46138744 shutdown_connections 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 --2- 172.21.15.60:0/46138744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce08100930 0x7fce0810cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 --2- 172.21.15.60:0/46138744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce08105ef0 0x7fce081062d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 --2- 172.21.15.60:0/46138744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce080fff70 0x7fce081003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 -- 172.21.15.60:0/46138744 >> 172.21.15.60:0/46138744 conn(0x7fce08076b70 msgr2=0x7fce08076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 -- 172.21.15.60:0/46138744 shutdown_connections 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.555+0000 7fce0f80a700 1 -- 172.21.15.60:0/46138744 wait complete. 2023-10-05T15:18:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 Processor -- start 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 -- start start 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 0x7fce08198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce08100930 0x7fce08198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce08105ef0 0x7fce081a2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081a3490 con 0x7fce080fff70 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081a3600 con 0x7fce08100930 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0f80a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081a37c0 con 0x7fce08105ef0 2023-10-05T15:18:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0d5a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 0x7fce08198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0d5a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 0x7fce08198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40380/0 (socket says 172.21.15.60:40380) 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0d5a6700 1 -- 172.21.15.60:0/2130652152 learned_addr learned my addr 172.21.15.60:0/2130652152 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0cda5700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce08100930 0x7fce08198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.556+0000 7fce0dda7700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce08105ef0 0x7fce081a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0d5a6700 1 -- 172.21.15.60:0/2130652152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce08105ef0 msgr2=0x7fce081a2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce08105ef0 0x7fce081a2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0d5a6700 1 -- 172.21.15.60:0/2130652152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce08100930 msgr2=0x7fce08198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce08100930 0x7fce08198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0d5a6700 1 -- 172.21.15.60:0/2130652152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009520 con 0x7fce080fff70 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 0x7fce08198020 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fce04009230 tx=0x7fce0400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/2130652152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0401c070 con 0x7fce080fff70 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce081a3a40 con 0x7fce080fff70 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/2130652152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce040058e0 con 0x7fce080fff70 2023-10-05T15:18:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/2130652152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040038e0 con 0x7fce080fff70 2023-10-05T15:18:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.557+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce081a3ef0 con 0x7fce080fff70 2023-10-05T15:18:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.560+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/2130652152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fce04020030 con 0x7fce080fff70 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.561+0000 7fcdfe7fc700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcdf40a15f0 0x7fcdf40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.561+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/2130652152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fce040ce460 con 0x7fce080fff70 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.561+0000 7fce0cda5700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcdf40a15f0 0x7fcdf40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.561+0000 7fce1b9f4b80 1 Processor -- start 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.561+0000 7fce1b9f4b80 1 -- start start 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.561+0000 7fce0cda5700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcdf40a15f0 0x7fcdf40a3ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce080693b0 tx=0x7fcdf8009310 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af32efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af32f520 0x55b2af339e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af33c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af298400 con 0x55b2af32ec00 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af289bc0 con 0x55b2af33a3d0 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af2874e0 con 0x55b2af32f520 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0d5a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af32efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0d5a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af32efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40388/0 (socket says 172.21.15.60:40388) 2023-10-05T15:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af32f520 0x55b2af339e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0d5a6700 1 -- 172.21.15.60:0/1233966660 learned_addr learned my addr 172.21.15.60:0/1233966660 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0dda7700 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af33c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 -- 172.21.15.60:0/1233966660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 msgr2=0x55b2af33c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af33c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 -- 172.21.15.60:0/1233966660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 msgr2=0x55b2af32efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af32efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 -- 172.21.15.60:0/1233966660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2af0add80 con 0x55b2af32f520 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af32efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fce0cda5700 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af32f520 0x55b2af339e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8004140 tx=0x7fcdf8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f7ae7a59e3919e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.562+0000 7fcdf37fe700 1 -- 172.21.15.60:0/1233966660 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8003a90 con 0x55b2af32f520 2023-10-05T15:18:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fcdf37fe700 1 -- 172.21.15.60:0/1233966660 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdf8004cf0 con 0x55b2af32f520 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fcdf37fe700 1 -- 172.21.15.60:0/1233966660 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8005500 con 0x55b2af32f520 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1233966660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af32f520 msgr2=0x55b2af339e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af32f520 0x55b2af339e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8004140 tx=0x7fcdf8014000 comp rx=0 tx=0).stop 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1233966660 shutdown_connections 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af33c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af32efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1233966660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af32f520 0x55b2af339e90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1233966660 >> 172.21.15.60:0/1233966660 conn(0x55b2af2a4200 msgr2=0x55b2af32b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1233966660 shutdown_connections 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.563+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1233966660 wait complete. 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 -- start start 2023-10-05T15:18:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 Processor -- start 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32ec00 0x55b2af339e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32f520 0x55b2af3370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af337820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af282dd0 con 0x55b2af32f520 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af21f6b0 con 0x55b2af32ec00 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af21f350 con 0x55b2af33a3d0 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce1b9f4b80 10 client.0 _ll_register_callbacks cb 0x55b2af07c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce0cda5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32f520 0x55b2af3370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce0cda5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32f520 0x55b2af3370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40396/0 (socket says 172.21.15.60:40396) 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.564+0000 7fce0cda5700 1 -- 172.21.15.60:0/372796907 learned_addr learned my addr 172.21.15.60:0/372796907 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32ec00 0x55b2af339e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0dda7700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af337820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 -- 172.21.15.60:0/372796907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 msgr2=0x55b2af337820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af337820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 -- 172.21.15.60:0/372796907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32f520 msgr2=0x55b2af3370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32f520 0x55b2af3370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 -- 172.21.15.60:0/372796907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce081a3ef0 con 0x55b2af32ec00 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32ec00 0x55b2af339e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce04097c20 tx=0x7fce04009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3328a68097b2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fcdf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/372796907 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0409b1b0 con 0x55b2af32ec00 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/372796907 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fce0409f300 con 0x55b2af32ec00 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2af322d50 con 0x55b2af32ec00 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/372796907 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce040a34b0 con 0x55b2af32ec00 2023-10-05T15:18:54.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce1b9f4b80 10 client.26099 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.565+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fcdf8017070 con 0x55b2af32ec00 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/372796907 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2af322d50 con 0x55b2af32ec00 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/372796907 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fce040ce150 con 0x55b2af32ec00 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce1b9f4b80 10 client.26099 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce1b9f4b80 10 client.26099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce1b9f4b80 20 client.26099 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af349b40 0x55b2af34bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce1b9f4b80 4 client.26099 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2af27bdb0 con 0x55b2af349b40 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce0cda5700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af349b40 0x55b2af34bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fcdf0ff9700 10 client.26099 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.566+0000 7fce0cda5700 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af349b40 0x55b2af34bf60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eba86c294e18103 server_cookie=ffcdb104330e5154 in_seq=0 out_seq=0 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/372796907 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2af27bdb0 con 0x55b2af349b40 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fcdf0ff9700 10 client.26099 handle_command_reply: tid=0 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 client.26099 shutdown 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32ec00 msgr2=0x55b2af339e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32ec00 0x55b2af339e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce04097c20 tx=0x7fce04009260 comp rx=0 tx=0).stop 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 shutdown_connections 2023-10-05T15:18:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af349b40 0x55b2af34bf60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af337820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32ec00 0x55b2af339e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/372796907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32f520 0x55b2af3370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 >> 172.21.15.60:0/372796907 conn(0x55b2af2a4200 msgr2=0x55b2af32ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.567+0000 7fcdf0ff9700 0 client.26099 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.568+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 shutdown_connections 2023-10-05T15:18:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.568+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/372796907 wait complete. 2023-10-05T15:18:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.568+0000 7fce1b9f4b80 20 client.26099 trim_cache size 0 max 16384 2023-10-05T15:18:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.586+0000 7fce1b9f4b80 1 Processor -- start 2023-10-05T15:18:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 -- start start 2023-10-05T15:18:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af3297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32f520 0x55b2af34bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af345670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af33cc80 con 0x55b2af32ec00 2023-10-05T15:18:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af1038c0 con 0x55b2af32f520 2023-10-05T15:18:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af332f70 con 0x55b2af33a3d0 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce0d5a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af3297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce0d5a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af3297b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40402/0 (socket says 172.21.15.60:40402) 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce0d5a6700 1 -- 172.21.15.60:0/1107749797 learned_addr learned my addr 172.21.15.60:0/1107749797 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.587+0000 7fce0dda7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af345670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0dda7700 1 -- 172.21.15.60:0/1107749797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32f520 msgr2=0x55b2af34bb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0dda7700 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32f520 0x55b2af34bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0dda7700 1 -- 172.21.15.60:0/1107749797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 msgr2=0x55b2af3297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0dda7700 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af3297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0dda7700 1 -- 172.21.15.60:0/1107749797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2af096c00 con 0x55b2af33a3d0 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af3297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fce0dda7700 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af345670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fce00007530 tx=0x7fce0000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec4f909d060ce2a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fcdf3fff700 1 -- 172.21.15.60:0/1107749797 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0000e040 con 0x55b2af33a3d0 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fcdf3fff700 1 -- 172.21.15.60:0/1107749797 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce0000f040 con 0x55b2af33a3d0 2023-10-05T15:18:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.588+0000 7fcdf3fff700 1 -- 172.21.15.60:0/1107749797 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00017410 con 0x55b2af33a3d0 2023-10-05T15:18:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1107749797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 msgr2=0x55b2af345670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af345670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fce00007530 tx=0x7fce0000b040 comp rx=0 tx=0).stop 2023-10-05T15:18:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1107749797 shutdown_connections 2023-10-05T15:18:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af33a3d0 0x55b2af345670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af3297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/1107749797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af32f520 0x55b2af34bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.589+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1107749797 >> 172.21.15.60:0/1107749797 conn(0x55b2af2a4200 msgr2=0x55b2af3508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.597+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1107749797 shutdown_connections 2023-10-05T15:18:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.600+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/1107749797 wait complete. 2023-10-05T15:18:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.600+0000 7fce1b9f4b80 1 -- start start 2023-10-05T15:18:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.600+0000 7fce1b9f4b80 1 Processor -- start 2023-10-05T15:18:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af334660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af334ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 0x55b2af333380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af341480 con 0x55b2af32ec00 2023-10-05T15:18:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af3338c0 con 0x55b2af33a3d0 2023-10-05T15:18:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2af333a80 con 0x55b2af399950 2023-10-05T15:18:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.601+0000 7fce1b9f4b80 10 client.0 _ll_register_callbacks cb 0x55b2af07c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:18:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 0x55b2af333380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 0x55b2af333380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:53938/0 (socket says 172.21.15.60:53938) 2023-10-05T15:18:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 -- 172.21.15.60:0/2114048185 learned_addr learned my addr 172.21.15.60:0/2114048185 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:18:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0cda5700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af334ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 -- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 msgr2=0x55b2af334ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af334ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 -- 172.21.15.60:0/2114048185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 msgr2=0x55b2af334660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af334660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 -- 172.21.15.60:0/2114048185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf8017070 con 0x55b2af399950 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0cda5700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af334ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce0dda7700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 0x55b2af333380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce00000f80 tx=0x7fce00005b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc7834489dabdb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fcdf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/2114048185 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0000e070 con 0x55b2af399950 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcdf8004cf0 con 0x55b2af399950 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.602+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/2114048185 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fce000052e0 con 0x55b2af399950 2023-10-05T15:18:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/2114048185 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce00024070 con 0x55b2af399950 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 10 client.25972 fetch_fsmap learned FSMap version 32 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fce00009240 con 0x55b2af399950 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/2114048185 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdf8004cf0 con 0x55b2af399950 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/2114048185 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fce0001d030 con 0x55b2af399950 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 10 client.25972 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 10 client.25972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 20 client.25972 populate_metadata read hostname 'smithi060' 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af3a72f0 0x55b2af3a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 4 client.25972 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2af27bad0 con 0x55b2af3a72f0 2023-10-05T15:18:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.603+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af3a72f0 0x55b2af3a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:18:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.604+0000 7fcdf0ff9700 10 client.25972 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.604+0000 7fce0d5a6700 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af3a72f0 0x55b2af3a9710 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b41b4a0006c73dc server_cookie=d7bd1fbd23ec9310 in_seq=0 out_seq=0 2023-10-05T15:18:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:18:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:18:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:18:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:18:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.861+0000 7fcdf0ff9700 1 -- 172.21.15.60:0/2114048185 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2af27bad0 con 0x55b2af3a72f0 2023-10-05T15:18:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.861+0000 7fcdf0ff9700 10 client.25972 handle_command_reply: tid=0 2023-10-05T15:18:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.861+0000 7fce1b9f4b80 1 client.25972 shutdown 2023-10-05T15:18:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 msgr2=0x55b2af333380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 0x55b2af333380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce00000f80 tx=0x7fce00005b90 comp rx=0 tx=0).stop 2023-10-05T15:18:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 shutdown_connections 2023-10-05T15:18:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b2af3a72f0 0x55b2af3a9710 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2af399950 0x55b2af333380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b2af32ec00 0x55b2af334660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 --2- 172.21.15.60:0/2114048185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2af33a3d0 0x55b2af334ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 >> 172.21.15.60:0/2114048185 conn(0x55b2af2a4200 msgr2=0x55b2af345670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fcdf0ff9700 0 client.25972 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.862+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 shutdown_connections 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.863+0000 7fce1b9f4b80 1 -- 172.21.15.60:0/2114048185 wait complete. 2023-10-05T15:18:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.866+0000 7fce1b9f4b80 20 client.25972 trim_cache size 0 max 16384 2023-10-05T15:18:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.972+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcdf40a15f0 msgr2=0x7fcdf40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.972+0000 7fce0f80a700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcdf40a15f0 0x7fcdf40a3ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce080693b0 tx=0x7fcdf8009310 comp rx=0 tx=0).stop 2023-10-05T15:18:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.972+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 msgr2=0x7fce08198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:18:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.972+0000 7fce0f80a700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 0x7fce08198020 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fce04009230 tx=0x7fce0400b610 comp rx=0 tx=0).stop 2023-10-05T15:18:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 shutdown_connections 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce08105ef0 0x7fce081a2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce080fff70 0x7fce08198020 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcdf40a15f0 0x7fcdf40a3ab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 --2- 172.21.15.60:0/2130652152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce08100930 0x7fce08198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 >> 172.21.15.60:0/2130652152 conn(0x7fce08076b70 msgr2=0x7fce080fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 shutdown_connections 2023-10-05T15:18:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:18:54.973+0000 7fce0f80a700 1 -- 172.21.15.60:0/2130652152 wait complete. 2023-10-05T15:18:55.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:55 smithi060 ceph-mon[99238]: pgmap v68: 129 pgs: 129 active+clean; 179 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2023-10-05T15:18:55.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:55 smithi092 ceph-mon[102944]: pgmap v68: 129 pgs: 129 active+clean; 179 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2023-10-05T15:18:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:55 smithi135 ceph-mon[103360]: pgmap v68: 129 pgs: 129 active+clean; 179 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2023-10-05T15:18:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:57 smithi135 ceph-mon[103360]: pgmap v69: 129 pgs: 129 active+clean; 186 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2023-10-05T15:18:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:57 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:18:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:57 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:57 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:57.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:57 smithi060 ceph-mon[99238]: pgmap v69: 129 pgs: 129 active+clean; 186 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2023-10-05T15:18:57.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:57 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:18:57.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:57 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:57.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:57 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:57 smithi092 ceph-mon[102944]: pgmap v69: 129 pgs: 129 active+clean; 186 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2023-10-05T15:18:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:57 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:18:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:57 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:57 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:58.243 INFO:tasks.workunit.client.0.smithi060.stdout: 81 954539 1365 610918 1119 92524 211 2023-10-05T15:18:58.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:18:58.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:18:58.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:18:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:18:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:58.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:18:58.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:18:58.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:18:59.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:18:59 smithi135 ceph-mon[103360]: pgmap v70: 129 pgs: 129 active+clean; 186 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 198 op/s 2023-10-05T15:18:59.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:18:59 smithi060 ceph-mon[99238]: pgmap v70: 129 pgs: 129 active+clean; 186 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 198 op/s 2023-10-05T15:18:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:18:59 smithi092 ceph-mon[102944]: pgmap v70: 129 pgs: 129 active+clean; 186 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 198 op/s 2023-10-05T15:19:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:01 smithi135 ceph-mon[103360]: pgmap v71: 129 pgs: 129 active+clean; 186 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 143 op/s 2023-10-05T15:19:01.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:01 smithi060 ceph-mon[99238]: pgmap v71: 129 pgs: 129 active+clean; 186 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 143 op/s 2023-10-05T15:19:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:01 smithi092 ceph-mon[102944]: pgmap v71: 129 pgs: 129 active+clean; 186 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 143 op/s 2023-10-05T15:19:03.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:03 smithi135 ceph-mon[103360]: pgmap v72: 129 pgs: 129 active+clean; 193 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-10-05T15:19:03.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:03 smithi060 ceph-mon[99238]: pgmap v72: 129 pgs: 129 active+clean; 193 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-10-05T15:19:03.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:03 smithi092 ceph-mon[102944]: pgmap v72: 129 pgs: 129 active+clean; 193 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-10-05T15:19:05.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:05 smithi135 ceph-mon[103360]: pgmap v73: 129 pgs: 129 active+clean; 193 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 150 op/s 2023-10-05T15:19:05.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:05 smithi060 ceph-mon[99238]: pgmap v73: 129 pgs: 129 active+clean; 193 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 150 op/s 2023-10-05T15:19:05.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:05 smithi092 ceph-mon[102944]: pgmap v73: 129 pgs: 129 active+clean; 193 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 150 op/s 2023-10-05T15:19:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:07 smithi135 ceph-mon[103360]: pgmap v74: 129 pgs: 129 active+clean; 213 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 214 op/s 2023-10-05T15:19:07.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:07 smithi060 ceph-mon[99238]: pgmap v74: 129 pgs: 129 active+clean; 213 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 214 op/s 2023-10-05T15:19:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:07 smithi092 ceph-mon[102944]: pgmap v74: 129 pgs: 129 active+clean; 213 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 214 op/s 2023-10-05T15:19:08.243 INFO:tasks.workunit.client.0.smithi060.stdout: 94 611204 622 388819 770 69240 811 2023-10-05T15:19:08.339 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 -- 172.21.15.60:0/2454686444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc100000 msgr2=0x7f3bfc1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/2454686444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc100000 0x7f3bfc1003e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009990 tx=0x7f3bec009ca0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 -- 172.21.15.60:0/2454686444 shutdown_connections 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/2454686444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bfc105120 0x7f3bfc10cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/2454686444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc100000 0x7f3bfc1003e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/2454686444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bfc1009b0 0x7f3bfc1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 -- 172.21.15.60:0/2454686444 >> 172.21.15.60:0/2454686444 conn(0x7f3bfc0fb860 msgr2=0x7f3bfc0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 -- 172.21.15.60:0/2454686444 shutdown_connections 2023-10-05T15:19:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.337+0000 7f3c00ec5700 1 -- 172.21.15.60:0/2454686444 wait complete. 2023-10-05T15:19:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 Processor -- start 2023-10-05T15:19:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 -- start start 2023-10-05T15:19:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bfc100000 0x7f3bfc196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bfc105120 0x7f3bfc197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 0x7f3bfc19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19c5f0 con 0x7f3bfc19bb70 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19c760 con 0x7f3bfc105120 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3c00ec5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19c920 con 0x7f3bfc100000 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 0x7f3bfc19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3bf9d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bfc105120 0x7f3bfc197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.338+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 0x7f3bfc19bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40424/0 (socket says 172.21.15.60:40424) 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 -- 172.21.15.60:0/896460517 learned_addr learned my addr 172.21.15.60:0/896460517 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bfc100000 0x7f3bfc196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 -- 172.21.15.60:0/896460517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bfc100000 msgr2=0x7f3bfc196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bfc100000 0x7f3bfc196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 -- 172.21.15.60:0/896460517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bfc105120 msgr2=0x7f3bfc197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bfc105120 0x7f3bfc197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 -- 172.21.15.60:0/896460517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0095f0 con 0x7f3bfc19bb70 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 0x7f3bfc19bff0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400b3d0 tx=0x7f3bf400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3beb7fe700 1 -- 172.21.15.60:0/896460517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4015070 con 0x7f3bfc19bb70 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc10d570 con 0x7f3bfc19bb70 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3beb7fe700 1 -- 172.21.15.60:0/896460517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf400be10 con 0x7f3bfc19bb70 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3beb7fe700 1 -- 172.21.15.60:0/896460517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4007c40 con 0x7f3bfc19bb70 2023-10-05T15:19:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.339+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc10da30 con 0x7f3bfc19bb70 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.341+0000 7f3beb7fe700 1 -- 172.21.15.60:0/896460517 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3bf4007500 con 0x7f3bfc19bb70 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.342+0000 7f3beb7fe700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f3be40a15f0 0x7f3be40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.342+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f3be40a15f0 0x7f3be40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.342+0000 7f3beb7fe700 1 -- 172.21.15.60:0/896460517 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f3bf40d0db0 con 0x7f3bfc19bb70 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.342+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f3be40a15f0 0x7f3be40a3ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b2e0 tx=0x7f3bec005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 Processor -- start 2023-10-05T15:19:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 -- start start 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584552fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a5845607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5844bc400 con 0x55a584552c00 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5844adbc0 con 0x55a58455e3d0 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5844ab4e0 con 0x55a584553520 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3bfa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584552fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3bfa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584552fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40428/0 (socket says 172.21.15.60:40428) 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3bfa59c700 1 -- 172.21.15.60:0/3271317826 learned_addr learned my addr 172.21.15.60:0/3271317826 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.343+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a5845607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfa59c700 1 -- 172.21.15.60:0/3271317826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 msgr2=0x55a58455de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfa59c700 1 -- 172.21.15.60:0/3271317826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 msgr2=0x55a5845607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a5845607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfa59c700 1 -- 172.21.15.60:0/3271317826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5842d1d80 con 0x55a584552c00 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a5845607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584552fe0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009990 tx=0x7f3bec020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb915d6a9ad6961d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3be8ff9700 1 -- 172.21.15.60:0/3271317826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec004700 con 0x55a584552c00 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3be8ff9700 1 -- 172.21.15.60:0/3271317826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bec01e040 con 0x55a584552c00 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.344+0000 7f3be8ff9700 1 -- 172.21.15.60:0/3271317826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00fac0 con 0x55a584552c00 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3271317826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 msgr2=0x55a584552fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584552fe0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009990 tx=0x7f3bec020000 comp rx=0 tx=0).stop 2023-10-05T15:19:08.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3271317826 shutdown_connections 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a5845607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584552fe0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3271317826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3271317826 >> 172.21.15.60:0/3271317826 conn(0x55a5844c8200 msgr2=0x55a58454f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3271317826 shutdown_connections 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3271317826 wait complete. 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 -- start start 2023-10-05T15:19:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.345+0000 7f3c0d0afb80 1 Processor -- start 2023-10-05T15:19:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a58455b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a58455bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5844a6dd0 con 0x55a58455e3d0 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5844436b0 con 0x55a584552c00 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a584443350 con 0x55a584553520 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3c0d0afb80 10 client.0 _ll_register_callbacks cb 0x55a5842a07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a58455bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a58455bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40438/0 (socket says 172.21.15.60:40438) 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bf9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 -- 172.21.15.60:0/3702550292 learned_addr learned my addr 172.21.15.60:0/3702550292 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a58455b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 -- 172.21.15.60:0/3702550292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 msgr2=0x55a58455b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 -- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 msgr2=0x55a58455b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a58455b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 -- 172.21.15.60:0/3702550292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf000b8e0 con 0x55a58455e3d0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a58455bc70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40ce1e0 tx=0x7f3bf409e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70223899ecdeb16 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.346+0000 7f3be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3be1ffb700 1 -- 172.21.15.60:0/3702550292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40a1b60 con 0x55a58455e3d0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3be1ffb700 1 -- 172.21.15.60:0/3702550292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f3bf40a5da0 con 0x55a58455e3d0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a584546d50 con 0x55a58455e3d0 2023-10-05T15:19:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3be1ffb700 1 -- 172.21.15.60:0/3702550292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bf4004ad0 con 0x55a58455e3d0 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 10 client.16449 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f3bfc10da30 con 0x55a58455e3d0 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3be1ffb700 1 -- 172.21.15.60:0/3702550292 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a584546d50 con 0x55a58455e3d0 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3be1ffb700 1 -- 172.21.15.60:0/3702550292 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f3bf409cf90 con 0x55a58455e3d0 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 10 client.16449 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 20 client.16449 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a58456e0e0 0x55a584570500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 4 client.16449 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.347+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a58449fdb0 con 0x55a58456e0e0 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.348+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a58456e0e0 0x55a584570500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.348+0000 7f3be1ffb700 10 client.16449 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.348+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a58456e0e0 0x55a584570500 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1edfa96560888c5 server_cookie=37b38567772942da in_seq=0 out_seq=0 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3be1ffb700 1 -- 172.21.15.60:0/3702550292 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a58449fdb0 con 0x55a58456e0e0 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3be1ffb700 10 client.16449 handle_command_reply: tid=0 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 client.16449 shutdown 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 msgr2=0x55a58455bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a58455bc70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40ce1e0 tx=0x7f3bf409e110 comp rx=0 tx=0).stop 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 shutdown_connections 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a58456e0e0 0x55a584570500 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a58455bc70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a58455b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3be1ffb700 0 client.16449 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/3702550292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 >> 172.21.15.60:0/3702550292 conn(0x55a5844c8200 msgr2=0x55a58454ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 shutdown_connections 2023-10-05T15:19:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/3702550292 wait complete. 2023-10-05T15:19:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.349+0000 7f3c0d0afb80 20 client.16449 trim_cache size 0 max 16384 2023-10-05T15:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 Processor -- start 2023-10-05T15:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 -- start start 2023-10-05T15:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a584564eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a5845564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5843278c0 con 0x55a58455e3d0 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a584569d20 con 0x55a584552c00 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a584557060 con 0x55a584553520 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a5845564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a5845564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40446/0 (socket says 172.21.15.60:40446) 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3bfad9d700 1 -- 172.21.15.60:0/39332921 learned_addr learned my addr 172.21.15.60:0/39332921 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.365+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a584564eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3bfad9d700 1 -- 172.21.15.60:0/39332921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 msgr2=0x55a58455baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3bfad9d700 1 -- 172.21.15.60:0/39332921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 msgr2=0x55a584564eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a584564eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3bfad9d700 1 -- 172.21.15.60:0/39332921 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc068df0 con 0x55a58455e3d0 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a5845564f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4099f10 tx=0x7f3bf40ce260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab41fa6a4456162 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3be97fa700 1 -- 172.21.15.60:0/39332921 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40a5bc0 con 0x55a58455e3d0 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3be97fa700 1 -- 172.21.15.60:0/39332921 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf4067070 con 0x55a58455e3d0 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3be97fa700 1 -- 172.21.15.60:0/39332921 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4004ad0 con 0x55a58455e3d0 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/39332921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 msgr2=0x55a5845564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a5845564f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4099f10 tx=0x7f3bf40ce260 comp rx=0 tx=0).stop 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.366+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/39332921 shutdown_connections 2023-10-05T15:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a58455e3d0 0x55a5845564f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a584552c00 0x55a584564eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/39332921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a58455baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/39332921 >> 172.21.15.60:0/39332921 conn(0x55a5844c8200 msgr2=0x55a584569610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/39332921 shutdown_connections 2023-10-05T15:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/39332921 wait complete. 2023-10-05T15:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- start start 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 Processor -- start 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584562ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a5845633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a584563920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5845c0f10 con 0x55a584552c00 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5845c1050 con 0x55a58455e3d0 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.367+0000 7f3c0d0afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5845c11e0 con 0x55a584553520 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3c0d0afb80 10 client.0 _ll_register_callbacks cb 0x7f3bf409d550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584562ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584562ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40448/0 (socket says 172.21.15.60:40448) 2023-10-05T15:19:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 -- 172.21.15.60:0/4008497871 learned_addr learned my addr 172.21.15.60:0/4008497871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a5845633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a584563920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 -- 172.21.15.60:0/4008497871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 msgr2=0x55a5845633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a5845633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 -- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 msgr2=0x55a584563920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a584563920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 -- 172.21.15.60:0/4008497871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc10da30 con 0x55a584552c00 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a5845633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfad9d700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a584563920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3bfa59c700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584562ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b690 tx=0x7f3bec00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76c388546371e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3be1ffb700 1 -- 172.21.15.60:0/4008497871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec03d150 con 0x55a584552c00 2023-10-05T15:19:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3be1ffb700 1 -- 172.21.15.60:0/4008497871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f3bec03d2b0 con 0x55a584552c00 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bec01e040 con 0x55a584552c00 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3be1ffb700 1 -- 172.21.15.60:0/4008497871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bec03d470 con 0x55a584552c00 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3c0d0afb80 10 client.16455 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.368+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a5842bac00 con 0x55a584552c00 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3be1ffb700 1 -- 172.21.15.60:0/4008497871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bec01e040 con 0x55a584552c00 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3be1ffb700 1 -- 172.21.15.60:0/4008497871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f3bec004600 con 0x55a584552c00 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3c0d0afb80 10 client.16455 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3c0d0afb80 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3c0d0afb80 20 client.16455 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5845c25e0 0x55a5845c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3c0d0afb80 4 client.16455 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:19:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a58449fad0 con 0x55a5845c25e0 2023-10-05T15:19:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5845c25e0 0x55a5845c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3be1ffb700 10 client.16455 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:08.369+0000 7f3bf9d9b700 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5845c25e0 0x55a5845c4a00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8022b6194d39bd34 server_cookie=cc985d7d1be55f7c in_seq=0 out_seq=0 2023-10-05T15:19:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:09 smithi135 ceph-mon[103360]: pgmap v75: 129 pgs: 129 active+clean; 302 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 476 op/s 2023-10-05T15:19:09.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:09 smithi060 ceph-mon[99238]: pgmap v75: 129 pgs: 129 active+clean; 302 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 476 op/s 2023-10-05T15:19:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:09 smithi092 ceph-mon[102944]: pgmap v75: 129 pgs: 129 active+clean; 302 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 476 op/s 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3be1ffb700 1 -- 172.21.15.60:0/4008497871 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a58449fad0 con 0x55a5845c25e0 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3be1ffb700 10 client.16455 handle_command_reply: tid=0 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 client.16455 shutdown 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 msgr2=0x55a584562ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584562ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b690 tx=0x7f3bec00bf30 comp rx=0 tx=0).stop 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 shutdown_connections 2023-10-05T15:19:10.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a5845c25e0 0x55a5845c4a00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a58455e3d0 0x55a584563920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3be1ffb700 0 client.16455 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a584552c00 0x55a584562ea0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 --2- 172.21.15.60:0/4008497871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a584553520 0x55a5845633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.234+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 >> 172.21.15.60:0/4008497871 conn(0x55a5844c8200 msgr2=0x55a5845564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 shutdown_connections 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c0d0afb80 1 -- 172.21.15.60:0/4008497871 wait complete. 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c0d0afb80 20 client.16455 trim_cache size 0 max 16384 2023-10-05T15:19:10.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:19:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:19:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:19:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:19:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f3be40a15f0 msgr2=0x7f3be40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f3be40a15f0 0x7f3be40a3ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b2e0 tx=0x7f3bec005960 comp rx=0 tx=0).stop 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 msgr2=0x7f3bfc19bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 0x7f3bfc19bff0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400b3d0 tx=0x7f3bf400b6e0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 shutdown_connections 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bfc19bb70 0x7f3bfc19bff0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bfc100000 0x7f3bfc196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f3be40a15f0 0x7f3be40a3ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 --2- 172.21.15.60:0/896460517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bfc105120 0x7f3bfc197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 >> 172.21.15.60:0/896460517 conn(0x7f3bfc0fb860 msgr2=0x7f3bfc0fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 shutdown_connections 2023-10-05T15:19:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:10.235+0000 7f3c00ec5700 1 -- 172.21.15.60:0/896460517 wait complete. 2023-10-05T15:19:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:11 smithi135 ceph-mon[103360]: pgmap v76: 129 pgs: 129 active+clean; 302 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 457 op/s 2023-10-05T15:19:11.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:11 smithi060 ceph-mon[99238]: pgmap v76: 129 pgs: 129 active+clean; 302 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 457 op/s 2023-10-05T15:19:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:11 smithi092 ceph-mon[102944]: pgmap v76: 129 pgs: 129 active+clean; 302 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 457 op/s 2023-10-05T15:19:13.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:13 smithi135 ceph-mon[103360]: pgmap v77: 129 pgs: 129 active+clean; 366 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 853 op/s 2023-10-05T15:19:13.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:13 smithi060 ceph-mon[99238]: pgmap v77: 129 pgs: 129 active+clean; 366 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 853 op/s 2023-10-05T15:19:13.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:13 smithi092 ceph-mon[102944]: pgmap v77: 129 pgs: 129 active+clean; 366 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 853 op/s 2023-10-05T15:19:15.580 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:15 smithi135 ceph-mon[103360]: pgmap v78: 129 pgs: 129 active+clean; 366 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 791 op/s 2023-10-05T15:19:15.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:15 smithi060 ceph-mon[99238]: pgmap v78: 129 pgs: 129 active+clean; 366 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 791 op/s 2023-10-05T15:19:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:15 smithi092 ceph-mon[102944]: pgmap v78: 129 pgs: 129 active+clean; 366 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 791 op/s 2023-10-05T15:19:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:17 smithi135 ceph-mon[103360]: pgmap v79: 129 pgs: 129 active+clean; 367 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 800 op/s 2023-10-05T15:19:17.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:17 smithi060 ceph-mon[99238]: pgmap v79: 129 pgs: 129 active+clean; 367 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 800 op/s 2023-10-05T15:19:17.675 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:17 smithi092 ceph-mon[102944]: pgmap v79: 129 pgs: 129 active+clean; 367 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 800 op/s 2023-10-05T15:19:18.243 INFO:tasks.workunit.client.0.smithi060.stdout: 104 1155667 485 752540 372 191589 468 2023-10-05T15:19:19.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:19 smithi135 ceph-mon[103360]: pgmap v80: 129 pgs: 129 active+clean; 371 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 771 op/s 2023-10-05T15:19:19.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:19 smithi060 ceph-mon[99238]: pgmap v80: 129 pgs: 129 active+clean; 371 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 771 op/s 2023-10-05T15:19:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:19 smithi092 ceph-mon[102944]: pgmap v80: 129 pgs: 129 active+clean; 371 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 771 op/s 2023-10-05T15:19:21.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:21 smithi135 ceph-mon[103360]: pgmap v81: 129 pgs: 129 active+clean; 371 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.2 MiB/s wr, 439 op/s 2023-10-05T15:19:21.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:21 smithi060 ceph-mon[99238]: pgmap v81: 129 pgs: 129 active+clean; 371 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.2 MiB/s wr, 439 op/s 2023-10-05T15:19:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:21 smithi092 ceph-mon[102944]: pgmap v81: 129 pgs: 129 active+clean; 371 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.2 MiB/s wr, 439 op/s 2023-10-05T15:19:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:23 smithi135 ceph-mon[103360]: pgmap v82: 129 pgs: 129 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.1 MiB/s wr, 502 op/s 2023-10-05T15:19:23.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:23 smithi060 ceph-mon[99238]: pgmap v82: 129 pgs: 129 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.1 MiB/s wr, 502 op/s 2023-10-05T15:19:23.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:23 smithi092 ceph-mon[102944]: pgmap v82: 129 pgs: 129 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.1 MiB/s wr, 502 op/s 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 -- 172.21.15.60:0/2995409822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f0107eb0 msgr2=0x7f70f0108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 --2- 172.21.15.60:0/2995409822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f0107eb0 0x7f70f0108290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009990 tx=0x7f70e4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 -- 172.21.15.60:0/2995409822 shutdown_connections 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 --2- 172.21.15.60:0/2995409822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0114000 0x7f70f01163f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 --2- 172.21.15.60:0/2995409822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f0107eb0 0x7f70f0108290 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 --2- 172.21.15.60:0/2995409822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f01087d0 0x7f70f0113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 -- 172.21.15.60:0/2995409822 >> 172.21.15.60:0/2995409822 conn(0x7f70f006cfa0 msgr2=0x7f70f006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 -- 172.21.15.60:0/2995409822 shutdown_connections 2023-10-05T15:19:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.677+0000 7f70f61f1700 1 -- 172.21.15.60:0/2995409822 wait complete. 2023-10-05T15:19:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.678+0000 7f70f61f1700 1 Processor -- start 2023-10-05T15:19:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.678+0000 7f70f61f1700 1 -- start start 2023-10-05T15:19:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70f61f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 0x7f70f019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70f61f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f01087d0 0x7f70f019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70f61f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0114000 0x7f70f01a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70f61f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f01a4950 con 0x7f70f01087d0 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70f61f1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f01a4ac0 con 0x7f70f0107eb0 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70f61f1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f01a4c80 con 0x7f70f0114000 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 0x7f70f019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 0x7f70f019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53886/0 (socket says 172.21.15.60:53886) 2023-10-05T15:19:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 -- 172.21.15.60:0/22862194 learned_addr learned my addr 172.21.15.60:0/22862194 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70eeffd700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f01087d0 0x7f70f019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70effff700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0114000 0x7f70f01a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 -- 172.21.15.60:0/22862194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0114000 msgr2=0x7f70f01a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0114000 0x7f70f01a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 -- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f01087d0 msgr2=0x7f70f019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f01087d0 0x7f70f019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.679+0000 7f70ef7fe700 1 -- 172.21.15.60:0/22862194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009520 con 0x7f70f0107eb0 2023-10-05T15:19:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.680+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 0x7f70f019f7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005910 tx=0x7f70e4004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.680+0000 7f70ecff9700 1 -- 172.21.15.60:0/22862194 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e401d070 con 0x7f70f0107eb0 2023-10-05T15:19:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.680+0000 7f70ecff9700 1 -- 172.21.15.60:0/22862194 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70e4022470 con 0x7f70f0107eb0 2023-10-05T15:19:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.680+0000 7f70ecff9700 1 -- 172.21.15.60:0/22862194 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4017650 con 0x7f70f0107eb0 2023-10-05T15:19:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.680+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e40095f0 con 0x7f70f0107eb0 2023-10-05T15:19:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.680+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f01a5140 con 0x7f70f0107eb0 2023-10-05T15:19:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.683+0000 7f70ecff9700 1 -- 172.21.15.60:0/22862194 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f70e40225e0 con 0x7f70f0107eb0 2023-10-05T15:19:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.684+0000 7f70ecff9700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f70d80a15f0 0x7f70d80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.685+0000 7f70ecff9700 1 -- 172.21.15.60:0/22862194 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f70e40ce690 con 0x7f70f0107eb0 2023-10-05T15:19:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.686+0000 7f70eeffd700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f70d80a15f0 0x7f70d80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.686+0000 7f70eeffd700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f70d80a15f0 0x7f70d80a3ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70f01a0fc0 tx=0x7f70e0009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.686+0000 7f71023dbb80 1 Processor -- start 2023-10-05T15:19:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 -- start start 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c1a70 0x557a391c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c2430 0x557a391bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a39124400 con 0x557a391c2430 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a39115bc0 con 0x557a391c1a70 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f71023dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a391134e0 con 0x557a391c4d10 2023-10-05T15:19:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54002/0 (socket says 172.21.15.60:54002) 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f70ef7fe700 1 -- 172.21.15.60:0/325767504 learned_addr learned my addr 172.21.15.60:0/325767504 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.687+0000 7f70eeffd700 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c1a70 0x557a391c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70ef7fe700 1 -- 172.21.15.60:0/325767504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c1a70 msgr2=0x557a391c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c1a70 0x557a391c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70ef7fe700 1 -- 172.21.15.60:0/325767504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c2430 msgr2=0x557a391bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c2430 0x557a391bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70ef7fe700 1 -- 172.21.15.60:0/325767504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a38f39d80 con 0x557a391c4d10 2023-10-05T15:19:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391c50f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70e40cc0c0 tx=0x7f70e409b230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d61b937403e105 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70d5ffb700 1 -- 172.21.15.60:0/325767504 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b0020 con 0x557a391c4d10 2023-10-05T15:19:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70d5ffb700 1 -- 172.21.15.60:0/325767504 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70e409bae0 con 0x557a391c4d10 2023-10-05T15:19:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.688+0000 7f70d5ffb700 1 -- 172.21.15.60:0/325767504 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4022a10 con 0x557a391c4d10 2023-10-05T15:19:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 -- 172.21.15.60:0/325767504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 msgr2=0x557a391c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391c50f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70e40cc0c0 tx=0x7f70e409b230 comp rx=0 tx=0).stop 2023-10-05T15:19:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 -- 172.21.15.60:0/325767504 shutdown_connections 2023-10-05T15:19:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c2430 0x557a391bbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391c50f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 --2- 172.21.15.60:0/325767504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c1a70 0x557a391c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.689+0000 7f71023dbb80 1 -- 172.21.15.60:0/325767504 >> 172.21.15.60:0/325767504 conn(0x557a39130200 msgr2=0x557a391b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.691+0000 7f71023dbb80 1 -- 172.21.15.60:0/325767504 shutdown_connections 2023-10-05T15:19:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.691+0000 7f71023dbb80 1 -- 172.21.15.60:0/325767504 wait complete. 2023-10-05T15:19:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.692+0000 7f71023dbb80 1 -- start start 2023-10-05T15:19:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.692+0000 7f71023dbb80 1 Processor -- start 2023-10-05T15:19:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c2430 0x557a391dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391d6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3910edd0 con 0x557a391c1a70 2023-10-05T15:19:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a390ab6b0 con 0x557a391c2430 2023-10-05T15:19:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a390ab350 con 0x557a391c4d10 2023-10-05T15:19:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f71023dbb80 10 client.0 _ll_register_callbacks cb 0x557a38f087a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391d6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391d6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54010/0 (socket says 172.21.15.60:54010) 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 -- 172.21.15.60:0/139557356 learned_addr learned my addr 172.21.15.60:0/139557356 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 -- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c2430 msgr2=0x557a391dcb60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c2430 0x557a391dcb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 -- 172.21.15.60:0/139557356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 msgr2=0x557a391dc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.693+0000 7f70effff700 1 -- 172.21.15.60:0/139557356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f01a5140 con 0x557a391c4d10 2023-10-05T15:19:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f70effff700 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391d6950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70e8011d00 tx=0x7f70e800f490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=314a1d1bac52324e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f70ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:19:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f70ceffd700 1 -- 172.21.15.60:0/139557356 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800e040 con 0x557a391c4d10 2023-10-05T15:19:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f70ceffd700 1 -- 172.21.15.60:0/139557356 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f70e8003a00 con 0x557a391c4d10 2023-10-05T15:19:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a391aed50 con 0x557a391c4d10 2023-10-05T15:19:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f70ceffd700 1 -- 172.21.15.60:0/139557356 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e8003bc0 con 0x557a391c4d10 2023-10-05T15:19:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.701+0000 7f71023dbb80 10 client.26002 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557a38f22c00 con 0x557a391c4d10 2023-10-05T15:19:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f70ceffd700 1 -- 172.21.15.60:0/139557356 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a391aed50 con 0x557a391c4d10 2023-10-05T15:19:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f70ceffd700 1 -- 172.21.15.60:0/139557356 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f70e8007c60 con 0x557a391c4d10 2023-10-05T15:19:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 10 client.26002 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 10 client.26002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 20 client.26002 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a391e6cd0 0x557a391e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 4 client.26002 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:19:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.702+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a39107db0 con 0x557a391e6cd0 2023-10-05T15:19:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.703+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a391e6cd0 0x557a391e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.703+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a391e6cd0 0x557a391e90f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc21a68259f25b83 server_cookie=3e8077704e41db6e in_seq=0 out_seq=0 2023-10-05T15:19:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.703+0000 7f70ceffd700 10 client.26002 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f70ceffd700 1 -- 172.21.15.60:0/139557356 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a39107db0 con 0x557a391e6cd0 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f70ceffd700 10 client.26002 handle_command_reply: tid=0 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 client.26002 shutdown 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 msgr2=0x557a391d6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391d6950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70e8011d00 tx=0x7f70e800f490 comp rx=0 tx=0).stop 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 shutdown_connections 2023-10-05T15:19:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a391e6cd0 0x557a391e90f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c4d10 0x557a391d6950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 --2- 172.21.15.60:0/139557356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c2430 0x557a391dcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 >> 172.21.15.60:0/139557356 conn(0x557a39130200 msgr2=0x557a391b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.704+0000 7f70ceffd700 0 client.26002 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.705+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 shutdown_connections 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.705+0000 7f71023dbb80 1 -- 172.21.15.60:0/139557356 wait complete. 2023-10-05T15:19:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.705+0000 7f71023dbb80 20 client.26002 trim_cache size 0 max 16384 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.737+0000 7f71023dbb80 1 Processor -- start 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 -- start start 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a391bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38f8f8c0 con 0x557a391c1a70 2023-10-05T15:19:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a391e41d0 con 0x557a391c4d10 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f71023dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a391b38b0 con 0x557a391c2430 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40486/0 (socket says 172.21.15.60:40486) 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 -- 172.21.15.60:0/3627087523 learned_addr learned my addr 172.21.15.60:0/3627087523 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70eeffd700 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70effff700 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a391bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 -- 172.21.15.60:0/3627087523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 msgr2=0x557a391dc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 -- 172.21.15.60:0/3627087523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 msgr2=0x557a391bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a391bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70ef7fe700 1 -- 172.21.15.60:0/3627087523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a391c5610 con 0x557a391c1a70 2023-10-05T15:19:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.738+0000 7f70effff700 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a391bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:19:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.739+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc1f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f70e40cbb70 tx=0x7f70e409bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb79a3188fa20fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.739+0000 7f70d67fc700 1 -- 172.21.15.60:0/3627087523 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b0070 con 0x557a391c1a70 2023-10-05T15:19:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.739+0000 7f70d67fc700 1 -- 172.21.15.60:0/3627087523 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70e40a36e0 con 0x557a391c1a70 2023-10-05T15:19:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.739+0000 7f70d67fc700 1 -- 172.21.15.60:0/3627087523 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40ce310 con 0x557a391c1a70 2023-10-05T15:19:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 -- 172.21.15.60:0/3627087523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 msgr2=0x557a391dc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc1f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f70e40cbb70 tx=0x7f70e409bc50 comp rx=0 tx=0).stop 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 -- 172.21.15.60:0/3627087523 shutdown_connections 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a391bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc1f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 --2- 172.21.15.60:0/3627087523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 -- 172.21.15.60:0/3627087523 >> 172.21.15.60:0/3627087523 conn(0x557a39130200 msgr2=0x557a391bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 -- 172.21.15.60:0/3627087523 shutdown_connections 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 -- 172.21.15.60:0/3627087523 wait complete. 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.740+0000 7f71023dbb80 1 -- start start 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 Processor -- start 2023-10-05T15:19:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a39232170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a39232720 con 0x557a391c1a70 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a39232890 con 0x557a391c4d10 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a39232a50 con 0x557a391c2430 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f71023dbb80 10 client.0 _ll_register_callbacks cb 0x557a38f087a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f70eeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f70eeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54024/0 (socket says 172.21.15.60:54024) 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40492/0 (socket says 172.21.15.60:40492) 2023-10-05T15:19:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f70eeffd700 1 -- 172.21.15.60:0/384794768 learned_addr learned my addr 172.21.15.60:0/384794768 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.741+0000 7f70effff700 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a39232170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70eeffd700 1 -- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 msgr2=0x557a39232170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70eeffd700 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a39232170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70eeffd700 1 -- 172.21.15.60:0/384794768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 msgr2=0x557a391dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70eeffd700 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70eeffd700 1 -- 172.21.15.60:0/384794768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a38f39d80 con 0x557a391c2430 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70eeffd700 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70e001dc80 tx=0x7f70e00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385807e6d57e3ade server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70ceffd700 1 -- 172.21.15.60:0/384794768 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0004320 con 0x557a391c2430 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f70ceffd700 1 -- 172.21.15.60:0/384794768 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f70e0004480 con 0x557a391c2430 2023-10-05T15:19:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.742+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70e409bae0 con 0x557a391c2430 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f70ceffd700 1 -- 172.21.15.60:0/384794768 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e001c790 con 0x557a391c2430 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 10 client.26008 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557a38f601f0 con 0x557a391c2430 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f70ceffd700 1 -- 172.21.15.60:0/384794768 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70e409bae0 con 0x557a391c2430 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f70ceffd700 1 -- 172.21.15.60:0/384794768 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f70e0003ab0 con 0x557a391c2430 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 10 client.26008 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 10 client.26008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 20 client.26008 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a3923b600 0x557a3923da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 4 client.26008 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:19:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a39107ad0 con 0x557a3923b600 2023-10-05T15:19:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.743+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a3923b600 0x557a3923da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.744+0000 7f70ef7fe700 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a3923b600 0x557a3923da20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d0f370dcfd1dc server_cookie=ec820ad4e925e54e in_seq=0 out_seq=0 2023-10-05T15:19:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.744+0000 7f70ceffd700 10 client.26008 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:23.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.931+0000 7f70ceffd700 1 -- 172.21.15.60:0/384794768 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a39107ad0 con 0x557a3923b600 2023-10-05T15:19:23.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.931+0000 7f70ceffd700 10 client.26008 handle_command_reply: tid=0 2023-10-05T15:19:23.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.931+0000 7f71023dbb80 1 client.26008 shutdown 2023-10-05T15:19:23.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.955+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 msgr2=0x557a391dc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.955+0000 7f71023dbb80 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70e001dc80 tx=0x7f70e00047c0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.956+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 shutdown_connections 2023-10-05T15:19:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.956+0000 7f71023dbb80 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557a3923b600 0x557a3923da20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.956+0000 7f71023dbb80 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a391c4d10 0x557a39232170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.956+0000 7f71023dbb80 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a391c1a70 0x557a391dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.956+0000 7f71023dbb80 1 --2- 172.21.15.60:0/384794768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a391c2430 0x557a391dc660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.956+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 >> 172.21.15.60:0/384794768 conn(0x557a39130200 msgr2=0x557a391c0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.957+0000 7f70ceffd700 0 client.26008 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.957+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 shutdown_connections 2023-10-05T15:19:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.957+0000 7f71023dbb80 1 -- 172.21.15.60:0/384794768 wait complete. 2023-10-05T15:19:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.957+0000 7f71023dbb80 20 client.26008 trim_cache size 0 max 16384 2023-10-05T15:19:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:19:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:19:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:19:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:19:23.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.980+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f70d80a15f0 msgr2=0x7f70d80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.980+0000 7f70f61f1700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f70d80a15f0 0x7f70d80a3ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70f01a0fc0 tx=0x7f70e0009260 comp rx=0 tx=0).stop 2023-10-05T15:19:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.980+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 msgr2=0x7f70f019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.980+0000 7f70f61f1700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 0x7f70f019f7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005910 tx=0x7f70e4004710 comp rx=0 tx=0).stop 2023-10-05T15:19:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 shutdown_connections 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0114000 0x7f70f01a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f70d80a15f0 0x7f70d80a3ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70f0107eb0 0x7f70f019f7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 --2- 172.21.15.60:0/22862194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f01087d0 0x7f70f019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 >> 172.21.15.60:0/22862194 conn(0x7f70f006cfa0 msgr2=0x7f70f006f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 shutdown_connections 2023-10-05T15:19:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:23.986+0000 7f70f61f1700 1 -- 172.21.15.60:0/22862194 wait complete. 2023-10-05T15:19:25.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:25 smithi135 ceph-mon[103360]: pgmap v83: 129 pgs: 129 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2023-10-05T15:19:25.601 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:25 smithi092 ceph-mon[102944]: pgmap v83: 129 pgs: 129 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2023-10-05T15:19:25.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:25 smithi060 ceph-mon[99238]: pgmap v83: 129 pgs: 129 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2023-10-05T15:19:27.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:27 smithi092 ceph-mon[102944]: pgmap v84: 129 pgs: 129 active+clean; 384 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 152 op/s 2023-10-05T15:19:27.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:27 smithi060 ceph-mon[99238]: pgmap v84: 129 pgs: 129 active+clean; 384 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 152 op/s 2023-10-05T15:19:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:27 smithi135 ceph-mon[103360]: pgmap v84: 129 pgs: 129 active+clean; 384 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 152 op/s 2023-10-05T15:19:28.243 INFO:tasks.workunit.client.0.smithi060.stdout: 116 1340296 817 876666 683 282062 1223 2023-10-05T15:19:29.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:29 smithi060 ceph-mon[99238]: pgmap v85: 129 pgs: 129 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2023-10-05T15:19:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:29 smithi092 ceph-mon[102944]: pgmap v85: 129 pgs: 129 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2023-10-05T15:19:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:29 smithi135 ceph-mon[103360]: pgmap v85: 129 pgs: 129 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2023-10-05T15:19:31.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:31 smithi060 ceph-mon[99238]: pgmap v86: 129 pgs: 129 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 187 op/s 2023-10-05T15:19:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:31 smithi092 ceph-mon[102944]: pgmap v86: 129 pgs: 129 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 187 op/s 2023-10-05T15:19:31.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:31 smithi135 ceph-mon[103360]: pgmap v86: 129 pgs: 129 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 187 op/s 2023-10-05T15:19:33.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:33 smithi060 ceph-mon[99238]: pgmap v87: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 233 op/s 2023-10-05T15:19:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:33 smithi092 ceph-mon[102944]: pgmap v87: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 233 op/s 2023-10-05T15:19:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:33 smithi135 ceph-mon[103360]: pgmap v87: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 233 op/s 2023-10-05T15:19:35.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:35 smithi135 ceph-mon[103360]: pgmap v88: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 170 op/s 2023-10-05T15:19:35.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:35 smithi060 ceph-mon[99238]: pgmap v88: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 170 op/s 2023-10-05T15:19:35.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:35 smithi092 ceph-mon[102944]: pgmap v88: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 170 op/s 2023-10-05T15:19:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.212+0000 7f0e5f292700 1 -- 172.21.15.60:0/1383008231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810fa90 msgr2=0x7f0e581083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.212+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1383008231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810fa90 0x7f0e581083f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009990 tx=0x7f0e48009ca0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.213+0000 7f0e5f292700 1 -- 172.21.15.60:0/1383008231 shutdown_connections 2023-10-05T15:19:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.213+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1383008231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e5811a690 0x7f0e5811ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.213+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1383008231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5810f620 0x7f0e58107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.213+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1383008231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810fa90 0x7f0e581083f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.213+0000 7f0e5f292700 1 -- 172.21.15.60:0/1383008231 >> 172.21.15.60:0/1383008231 conn(0x7f0e5806cfa0 msgr2=0x7f0e5806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:37.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.218+0000 7f0e5f292700 1 -- 172.21.15.60:0/1383008231 shutdown_connections 2023-10-05T15:19:37.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.222+0000 7f0e5f292700 1 -- 172.21.15.60:0/1383008231 wait complete. 2023-10-05T15:19:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.223+0000 7f0e5f292700 1 Processor -- start 2023-10-05T15:19:37.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 -- start start 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810f620 0x7f0e581a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e5810fa90 0x7f0e581a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5811a690 0x7f0e581aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581ab050 con 0x7f0e5810f620 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581ab1c0 con 0x7f0e5810fa90 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.225+0000 7f0e5f292700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581ab380 con 0x7f0e5811a690 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.226+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5811a690 0x7f0e581aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.226+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5811a690 0x7f0e581aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54036/0 (socket says 172.21.15.60:54036) 2023-10-05T15:19:37.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.226+0000 7f0e5d82f700 1 -- 172.21.15.60:0/1013456156 learned_addr learned my addr 172.21.15.60:0/1013456156 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.226+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810f620 0x7f0e581a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.227+0000 7f0e5d02e700 1 -- 172.21.15.60:0/1013456156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5811a690 msgr2=0x7f0e581aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.227+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5811a690 0x7f0e581aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.227+0000 7f0e5d02e700 1 -- 172.21.15.60:0/1013456156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e5810fa90 msgr2=0x7f0e581a63a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.227+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e5810fa90 0x7f0e581a63a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.227+0000 7f0e5d02e700 1 -- 172.21.15.60:0/1013456156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480095f0 con 0x7f0e5810f620 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.227+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810f620 0x7f0e581a5e60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ef10 tx=0x7f0e5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.228+0000 7f0e4e7fc700 1 -- 172.21.15.60:0/1013456156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000ca70 con 0x7f0e5810f620 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.228+0000 7f0e4e7fc700 1 -- 172.21.15.60:0/1013456156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e5000f040 con 0x7f0e5810f620 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.228+0000 7f0e4e7fc700 1 -- 172.21.15.60:0/1013456156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500146e0 con 0x7f0e5810f620 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.228+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e581ab600 con 0x7f0e5810f620 2023-10-05T15:19:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.228+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58110050 con 0x7f0e5810f620 2023-10-05T15:19:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.233+0000 7f0e6b47cb80 1 Processor -- start 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 -- start start 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 0x5636969a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a4520 0x5636969aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969af3d0 0x5636969b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369690d400 con 0x5636969a3c00 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636968febc0 con 0x5636969a4520 2023-10-05T15:19:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636968fc4e0 con 0x5636969af3d0 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 0x5636969a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 0x5636969a3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40510/0 (socket says 172.21.15.60:40510) 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e5d82f700 1 -- 172.21.15.60:0/1251468097 learned_addr learned my addr 172.21.15.60:0/1251468097 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.234+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a4520 0x5636969aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.235+0000 7f0e5d82f700 1 -- 172.21.15.60:0/1251468097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969af3d0 msgr2=0x5636969b17c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.235+0000 7f0e5d82f700 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969af3d0 0x5636969b17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.235+0000 7f0e5d82f700 1 -- 172.21.15.60:0/1251468097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a4520 msgr2=0x5636969aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.235+0000 7f0e5d82f700 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a4520 0x5636969aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.235+0000 7f0e5d82f700 1 -- 172.21.15.60:0/1251468097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563696722d80 con 0x5636969a3c00 2023-10-05T15:19:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.235+0000 7f0e5d82f700 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 0x5636969a3fe0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009ae0 tx=0x7f0e54009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105d0fa859ea12a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.240+0000 7f0e437fe700 1 -- 172.21.15.60:0/1251468097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400e990 con 0x5636969a3c00 2023-10-05T15:19:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.240+0000 7f0e437fe700 1 -- 172.21.15.60:0/1251468097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e54013470 con 0x5636969a3c00 2023-10-05T15:19:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.240+0000 7f0e437fe700 1 -- 172.21.15.60:0/1251468097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54012630 con 0x5636969a3c00 2023-10-05T15:19:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.241+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1251468097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 msgr2=0x5636969a3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.241+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 0x5636969a3fe0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009ae0 tx=0x7f0e54009df0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.242+0000 7f0e4e7fc700 1 -- 172.21.15.60:0/1013456156 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0e5000cbd0 con 0x7f0e5810f620 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e4e7fc700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e440a16f0 0x7f0e440a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e4e7fc700 1 -- 172.21.15.60:0/1013456156 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0e500cd6a0 con 0x7f0e5810f620 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1251468097 shutdown_connections 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969af3d0 0x5636969b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a3c00 0x5636969a3fe0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1251468097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a4520 0x5636969aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.243+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1251468097 >> 172.21.15.60:0/1251468097 conn(0x563696919200 msgr2=0x5636969a0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.244+0000 7f0e5d82f700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e440a16f0 0x7f0e440a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.246+0000 7f0e5d82f700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e440a16f0 0x7f0e440a3bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009ab0 tx=0x7f0e54008040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.248+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1251468097 shutdown_connections 2023-10-05T15:19:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.249+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1251468097 wait complete. 2023-10-05T15:19:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.250+0000 7f0e6b47cb80 1 -- start start 2023-10-05T15:19:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.250+0000 7f0e6b47cb80 1 Processor -- start 2023-10-05T15:19:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x5636969ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636968f7dd0 con 0x5636969a4520 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636968946b0 con 0x5636969af3d0 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563696894350 con 0x5636969a3c00 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e6b47cb80 10 client.0 _ll_register_callbacks cb 0x5636966f17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x5636969ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40520/0 (socket says 172.21.15.60:40520) 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 -- 172.21.15.60:0/2302135949 learned_addr learned my addr 172.21.15.60:0/2302135949 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 -- 172.21.15.60:0/2302135949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 msgr2=0x5636969aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 -- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 msgr2=0x5636969ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x5636969ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5c82d700 1 -- 172.21.15.60:0/2302135949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e54009710 con 0x5636969a4520 2023-10-05T15:19:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.251+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:19:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.252+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969abfd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009960 tx=0x7f0e4800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62c7ea84db052cc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.252+0000 7f0e40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.252+0000 7f0e40ff9700 1 -- 172.21.15.60:0/2302135949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4801d070 con 0x5636969a4520 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.252+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563696997d50 con 0x5636969a4520 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.252+0000 7f0e40ff9700 1 -- 172.21.15.60:0/2302135949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0e48022470 con 0x5636969a4520 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e40ff9700 1 -- 172.21.15.60:0/2302135949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e48022630 con 0x5636969a4520 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 10 client.16479 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56369670bc00 con 0x5636969a4520 2023-10-05T15:19:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e40ff9700 1 -- 172.21.15.60:0/2302135949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563696997d50 con 0x5636969a4520 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e40ff9700 1 -- 172.21.15.60:0/2302135949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f0e48017540 con 0x5636969a4520 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 10 client.16479 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 20 client.16479 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5636969befc0 0x5636969c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 4 client.16479 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.253+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636968f0db0 con 0x5636969befc0 2023-10-05T15:19:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.255+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5636969befc0 0x5636969c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.264+0000 7f0e40ff9700 10 client.16479 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.264+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5636969befc0 0x5636969c13e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b368bfd776758003 server_cookie=902338ddb04a27eb in_seq=0 out_seq=0 2023-10-05T15:19:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.281+0000 7f0e40ff9700 1 -- 172.21.15.60:0/2302135949 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5636968f0db0 con 0x5636969befc0 2023-10-05T15:19:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.281+0000 7f0e40ff9700 10 client.16479 handle_command_reply: tid=0 2023-10-05T15:19:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.281+0000 7f0e6b47cb80 1 client.16479 shutdown 2023-10-05T15:19:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.282+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 msgr2=0x5636969abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.282+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969abfd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009960 tx=0x7f0e4800ba10 comp rx=0 tx=0).stop 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.285+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 shutdown_connections 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.285+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5636969befc0 0x5636969c13e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.285+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x5636969ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.285+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.285+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/2302135949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969abfd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.285+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 >> 172.21.15.60:0/2302135949 conn(0x563696919200 msgr2=0x56369699fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.287+0000 7f0e40ff9700 0 client.16479 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.291+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 shutdown_connections 2023-10-05T15:19:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.293+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/2302135949 wait complete. 2023-10-05T15:19:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.299+0000 7f0e6b47cb80 20 client.16479 trim_cache size 0 max 16384 2023-10-05T15:19:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 Processor -- start 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 -- start start 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a3c00 0x5636969b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a4520 0x5636969ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969af3d0 0x5636969a9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636967788c0 con 0x5636969af3d0 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636969a6dd0 con 0x5636969a3c00 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.336+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636969ad3c0 con 0x5636969a4520 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969af3d0 0x5636969a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5d82f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969af3d0 0x5636969a9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40524/0 (socket says 172.21.15.60:40524) 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5d82f700 1 -- 172.21.15.60:0/1794293202 learned_addr learned my addr 172.21.15.60:0/1794293202 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a4520 0x5636969ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a3c00 0x5636969b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1794293202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a3c00 msgr2=0x5636969b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a3c00 0x5636969b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1794293202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969af3d0 msgr2=0x5636969a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969af3d0 0x5636969a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1794293202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636967491f0 con 0x5636969a4520 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.337+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a4520 0x5636969ae8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009990 tx=0x7f0e48017ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b19c5c305a650d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.338+0000 7f0e43fff700 1 -- 172.21.15.60:0/1794293202 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48017ea0 con 0x5636969a4520 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.338+0000 7f0e43fff700 1 -- 172.21.15.60:0/1794293202 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e4800b2c0 con 0x5636969a4520 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.338+0000 7f0e43fff700 1 -- 172.21.15.60:0/1794293202 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4801d070 con 0x5636969a4520 2023-10-05T15:19:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1794293202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a4520 msgr2=0x5636969ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a4520 0x5636969ae8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009990 tx=0x7f0e48017ce0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1794293202 shutdown_connections 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969af3d0 0x5636969a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969a3c00 0x5636969b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1794293202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a4520 0x5636969ae8f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.339+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1794293202 >> 172.21.15.60:0/1794293202 conn(0x563696919200 msgr2=0x5636969a7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.340+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1794293202 shutdown_connections 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.340+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1794293202 wait complete. 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.340+0000 7f0e6b47cb80 1 -- start start 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.340+0000 7f0e6b47cb80 1 Processor -- start 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x563696a10da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563696a11310 con 0x5636969a4520 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563696a11480 con 0x5636969af3d0 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563696a11640 con 0x5636969a3c00 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.341+0000 7f0e6b47cb80 10 client.0 _ll_register_callbacks cb 0x7f0e500097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40530/0 (socket says 172.21.15.60:40530) 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1595047503 learned_addr learned my addr 172.21.15.60:0/1595047503 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5d82f700 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x563696a10da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1595047503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 msgr2=0x5636969b2dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969b2dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 msgr2=0x563696a10da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x563696a10da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.342+0000 7f0e5c82d700 1 -- 172.21.15.60:0/1595047503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56369670bc00 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e5c82d700 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969b3310 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009350 tx=0x7f0e48022750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290f128514d616dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e40ff9700 1 -- 172.21.15.60:0/1595047503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4801d070 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e40ff9700 1 -- 172.21.15.60:0/1595047503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0e48000e40 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e54013470 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e40ff9700 1 -- 172.21.15.60:0/1595047503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e48017600 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e6b47cb80 10 client.16485 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.343+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563696721250 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e40ff9700 1 -- 172.21.15.60:0/1595047503 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e54013470 con 0x5636969a4520 2023-10-05T15:19:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e40ff9700 1 -- 172.21.15.60:0/1595047503 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f0e480099c0 con 0x5636969a4520 2023-10-05T15:19:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e6b47cb80 10 client.16485 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e6b47cb80 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e6b47cb80 20 client.16485 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563696a12aa0 0x563696a14ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e6b47cb80 4 client.16485 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:19:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.344+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5636968f0ad0 con 0x563696a12aa0 2023-10-05T15:19:37.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.355+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563696a12aa0 0x563696a14ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.368+0000 7f0e5d02e700 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563696a12aa0 0x563696a14ec0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722a9cf8cea68854 server_cookie=8dd2a25d47fae2e6 in_seq=0 out_seq=0 2023-10-05T15:19:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:37.369+0000 7f0e40ff9700 10 client.16485 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:37 smithi135 ceph-mon[103360]: pgmap v89: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 172 op/s 2023-10-05T15:19:37.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:37 smithi060 ceph-mon[99238]: pgmap v89: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 172 op/s 2023-10-05T15:19:37.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:37 smithi092 ceph-mon[102944]: pgmap v89: 129 pgs: 129 active+clean; 395 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 172 op/s 2023-10-05T15:19:38.243 INFO:tasks.workunit.client.0.smithi060.stdout: 127 1472227 536 983208 622 361246 632 2023-10-05T15:19:39.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:39 smithi135 ceph-mon[103360]: pgmap v90: 129 pgs: 129 active+clean; 423 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2023-10-05T15:19:39.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:39 smithi060 ceph-mon[99238]: pgmap v90: 129 pgs: 129 active+clean; 423 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2023-10-05T15:19:39.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:39 smithi092 ceph-mon[102944]: pgmap v90: 129 pgs: 129 active+clean; 423 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2023-10-05T15:19:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.564+0000 7f0e40ff9700 1 -- 172.21.15.60:0/1595047503 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5636968f0ad0 con 0x563696a12aa0 2023-10-05T15:19:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.564+0000 7f0e40ff9700 10 client.16485 handle_command_reply: tid=0 2023-10-05T15:19:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.564+0000 7f0e6b47cb80 1 client.16485 shutdown 2023-10-05T15:19:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 msgr2=0x5636969b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969b3310 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009350 tx=0x7f0e48022750 comp rx=0 tx=0).stop 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 shutdown_connections 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563696a12aa0 0x563696a14ec0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636969af3d0 0x563696a10da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636969a3c00 0x5636969b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 --2- 172.21.15.60:0/1595047503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5636969a4520 0x5636969b3310 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.565+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 >> 172.21.15.60:0/1595047503 conn(0x563696919200 msgr2=0x5636969a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.566+0000 7f0e40ff9700 0 client.16485 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.566+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 shutdown_connections 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.566+0000 7f0e6b47cb80 1 -- 172.21.15.60:0/1595047503 wait complete. 2023-10-05T15:19:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.566+0000 7f0e6b47cb80 20 client.16485 trim_cache size 0 max 16384 2023-10-05T15:19:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:19:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:19:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:19:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:19:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e440a16f0 msgr2=0x7f0e440a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e440a16f0 0x7f0e440a3bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009ab0 tx=0x7f0e54008040 comp rx=0 tx=0).stop 2023-10-05T15:19:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810f620 msgr2=0x7f0e581a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810f620 0x7f0e581a5e60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ef10 tx=0x7f0e5000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 shutdown_connections 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5811a690 0x7f0e581aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5810f620 0x7f0e581a5e60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0e440a16f0 0x7f0e440a3bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 --2- 172.21.15.60:0/1013456156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e5810fa90 0x7f0e581a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 >> 172.21.15.60:0/1013456156 conn(0x7f0e5806cfa0 msgr2=0x7f0e58118680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 shutdown_connections 2023-10-05T15:19:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:40.567+0000 7f0e5f292700 1 -- 172.21.15.60:0/1013456156 wait complete. 2023-10-05T15:19:41.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:41 smithi135 ceph-mon[103360]: pgmap v91: 129 pgs: 129 active+clean; 423 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 189 op/s 2023-10-05T15:19:41.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:41 smithi060 ceph-mon[99238]: pgmap v91: 129 pgs: 129 active+clean; 423 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 189 op/s 2023-10-05T15:19:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:41 smithi092 ceph-mon[102944]: pgmap v91: 129 pgs: 129 active+clean; 423 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 189 op/s 2023-10-05T15:19:43.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:43 smithi135 ceph-mon[103360]: pgmap v92: 129 pgs: 129 active+clean; 514 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-10-05T15:19:43.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:43 smithi060 ceph-mon[99238]: pgmap v92: 129 pgs: 129 active+clean; 514 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-10-05T15:19:43.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:43 smithi092 ceph-mon[102944]: pgmap v92: 129 pgs: 129 active+clean; 514 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-10-05T15:19:45.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:45 smithi135 ceph-mon[103360]: pgmap v93: 129 pgs: 129 active+clean; 514 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.36k op/s 2023-10-05T15:19:45.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:45 smithi060 ceph-mon[99238]: pgmap v93: 129 pgs: 129 active+clean; 514 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.36k op/s 2023-10-05T15:19:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:45 smithi092 ceph-mon[102944]: pgmap v93: 129 pgs: 129 active+clean; 514 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.36k op/s 2023-10-05T15:19:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:47 smithi135 ceph-mon[103360]: pgmap v94: 129 pgs: 129 active+clean; 510 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.36k op/s 2023-10-05T15:19:47.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:47 smithi060 ceph-mon[99238]: pgmap v94: 129 pgs: 129 active+clean; 510 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.36k op/s 2023-10-05T15:19:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:47 smithi092 ceph-mon[102944]: pgmap v94: 129 pgs: 129 active+clean; 510 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.36k op/s 2023-10-05T15:19:48.257 INFO:tasks.workunit.client.0.smithi060.stdout: 131 855781 220 581137 328 229884 815 2023-10-05T15:19:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:49 smithi135 ceph-mon[103360]: pgmap v95: 129 pgs: 129 active+clean; 512 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 1.40k op/s 2023-10-05T15:19:49.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:49 smithi060 ceph-mon[99238]: pgmap v95: 129 pgs: 129 active+clean; 512 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 1.40k op/s 2023-10-05T15:19:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:49 smithi092 ceph-mon[102944]: pgmap v95: 129 pgs: 129 active+clean; 512 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 1.40k op/s 2023-10-05T15:19:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:51 smithi135 ceph-mon[103360]: pgmap v96: 129 pgs: 129 active+clean; 512 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.7 MiB/s wr, 1.26k op/s 2023-10-05T15:19:51.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:51 smithi092 ceph-mon[102944]: pgmap v96: 129 pgs: 129 active+clean; 512 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.7 MiB/s wr, 1.26k op/s 2023-10-05T15:19:51.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:51 smithi060 ceph-mon[99238]: pgmap v96: 129 pgs: 129 active+clean; 512 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.7 MiB/s wr, 1.26k op/s 2023-10-05T15:19:53.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:53 smithi060 ceph-mon[99238]: pgmap v97: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.2 MiB/s wr, 1.33k op/s 2023-10-05T15:19:53.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:53 smithi092 ceph-mon[102944]: pgmap v97: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.2 MiB/s wr, 1.33k op/s 2023-10-05T15:19:53.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:53 smithi135 ceph-mon[103360]: pgmap v97: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.2 MiB/s wr, 1.33k op/s 2023-10-05T15:19:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 -- 172.21.15.60:0/2928518160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c11a340 msgr2=0x7faa8c11c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 --2- 172.21.15.60:0/2928518160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c11a340 0x7faa8c11c730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b0a0 tx=0x7faa8400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:19:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 -- 172.21.15.60:0/2928518160 shutdown_connections 2023-10-05T15:19:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 --2- 172.21.15.60:0/2928518160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c11a340 0x7faa8c11c730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 --2- 172.21.15.60:0/2928518160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c10d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 --2- 172.21.15.60:0/2928518160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa8c10d8b0 0x7faa8c119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.950+0000 7faa926ea700 1 -- 172.21.15.60:0/2928518160 >> 172.21.15.60:0/2928518160 conn(0x7faa8c0721d0 msgr2=0x7faa8c0725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.971+0000 7faa926ea700 1 -- 172.21.15.60:0/2928518160 shutdown_connections 2023-10-05T15:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.971+0000 7faa926ea700 1 -- 172.21.15.60:0/2928518160 wait complete. 2023-10-05T15:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.972+0000 7faa926ea700 1 Processor -- start 2023-10-05T15:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.972+0000 7faa926ea700 1 -- start start 2023-10-05T15:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa926ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa926ea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c10d8b0 0x7faa8c113480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa926ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa8c11a340 0x7faa8c1139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa926ea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c117b80 con 0x7faa8c11a340 2023-10-05T15:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa926ea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c117cf0 con 0x7faa8c10d8b0 2023-10-05T15:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa926ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c117eb0 con 0x7faa8c10cf90 2023-10-05T15:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa916e8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa916e8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c112f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54074/0 (socket says 172.21.15.60:54074) 2023-10-05T15:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.973+0000 7faa916e8700 1 -- 172.21.15.60:0/659651010 learned_addr learned my addr 172.21.15.60:0/659651010 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.982+0000 7faa916e8700 1 -- 172.21.15.60:0/659651010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c10d8b0 msgr2=0x7faa8c113480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.982+0000 7faa916e8700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c10d8b0 0x7faa8c113480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.982+0000 7faa916e8700 1 -- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa8c11a340 msgr2=0x7faa8c1139c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.982+0000 7faa916e8700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa8c11a340 0x7faa8c1139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.982+0000 7faa916e8700 1 -- 172.21.15.60:0/659651010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84009d00 con 0x7faa8c10cf90 2023-10-05T15:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:53.986+0000 7faa916e8700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c112f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa8800e9a0 tx=0x7faa8800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.000+0000 7faa827fc700 1 -- 172.21.15.60:0/659651010 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88009790 con 0x7faa8c10cf90 2023-10-05T15:19:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.001+0000 7faa827fc700 1 -- 172.21.15.60:0/659651010 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8800cbd0 con 0x7faa8c10cf90 2023-10-05T15:19:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.001+0000 7faa827fc700 1 -- 172.21.15.60:0/659651010 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88018680 con 0x7faa8c10cf90 2023-10-05T15:19:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.001+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c118190 con 0x7faa8c10cf90 2023-10-05T15:19:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.001+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c118650 con 0x7faa8c10cf90 2023-10-05T15:19:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.011+0000 7faa9fb36b80 1 Processor -- start 2023-10-05T15:19:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.018+0000 7faa827fc700 1 -- 172.21.15.60:0/659651010 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7faa88010430 con 0x7faa8c10cf90 2023-10-05T15:19:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 -- start start 2023-10-05T15:19:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 0x55754af0b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0b680 0x55754af15ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af18920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754ae74400 con 0x55754af16530 2023-10-05T15:19:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754ae65bc0 con 0x55754af0b680 2023-10-05T15:19:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.019+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754ae634e0 con 0x55754af0ad60 2023-10-05T15:19:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.020+0000 7faa91ee9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 0x55754af0b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.020+0000 7faa91ee9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 0x55754af0b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54082/0 (socket says 172.21.15.60:54082) 2023-10-05T15:19:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.020+0000 7faa91ee9700 1 -- 172.21.15.60:0/2528724451 learned_addr learned my addr 172.21.15.60:0/2528724451 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.020+0000 7faa916e8700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0b680 0x55754af15ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.020+0000 7faa91ee9700 1 -- 172.21.15.60:0/2528724451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0b680 msgr2=0x55754af15ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa90ee7700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af18920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa827fc700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faa780a1800 0x7faa780a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa91ee9700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0b680 0x55754af15ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa91ee9700 1 -- 172.21.15.60:0/2528724451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 msgr2=0x55754af18920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa91ee9700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af18920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa91ee9700 1 -- 172.21.15.60:0/2528724451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55754ac89d80 con 0x55754af0ad60 2023-10-05T15:19:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.025+0000 7faa827fc700 1 -- 172.21.15.60:0/659651010 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7faa88014070 con 0x7faa8c10cf90 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa90ee7700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af18920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa91ee9700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 0x55754af0b140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faa84009fd0 tx=0x7faa84009590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f85d7cc3a1e7903 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa916e8700 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0b680 0x55754af15ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa91ee9700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faa780a1800 0x7faa780a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa777fe700 1 -- 172.21.15.60:0/2528724451 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400e040 con 0x55754af0ad60 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa777fe700 1 -- 172.21.15.60:0/2528724451 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa84008ef0 con 0x55754af0ad60 2023-10-05T15:19:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.026+0000 7faa777fe700 1 -- 172.21.15.60:0/2528724451 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8401d6d0 con 0x55754af0ad60 2023-10-05T15:19:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.027+0000 7faa91ee9700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faa780a1800 0x7faa780a3cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa84021000 tx=0x7faa8401d950 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 -- 172.21.15.60:0/2528724451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 msgr2=0x55754af0b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 0x55754af0b140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faa84009fd0 tx=0x7faa84009590 comp rx=0 tx=0).stop 2023-10-05T15:19:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 -- 172.21.15.60:0/2528724451 shutdown_connections 2023-10-05T15:19:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af18920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0ad60 0x55754af0b140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/2528724451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0b680 0x55754af15ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 -- 172.21.15.60:0/2528724451 >> 172.21.15.60:0/2528724451 conn(0x55754ae80200 msgr2=0x55754af071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.029+0000 7faa9fb36b80 1 -- 172.21.15.60:0/2528724451 shutdown_connections 2023-10-05T15:19:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.030+0000 7faa9fb36b80 1 -- 172.21.15.60:0/2528724451 wait complete. 2023-10-05T15:19:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.030+0000 7faa9fb36b80 1 -- start start 2023-10-05T15:19:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.030+0000 7faa9fb36b80 1 Processor -- start 2023-10-05T15:19:54.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af15e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af13070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754ae5edd0 con 0x55754af16530 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754adfb6b0 con 0x55754af0ad60 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754adfb350 con 0x55754af0b680 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa9fb36b80 10 client.0 _ll_register_callbacks cb 0x55754ac587a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa916e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af15e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa916e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af15e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53980/0 (socket says 172.21.15.60:53980) 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.031+0000 7faa916e8700 1 -- 172.21.15.60:0/442883455 learned_addr learned my addr 172.21.15.60:0/442883455 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa91ee9700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa91ee9700 1 -- 172.21.15.60:0/442883455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 msgr2=0x55754af13070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa91ee9700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af13070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa91ee9700 1 -- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 msgr2=0x55754af15e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa91ee9700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af15e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa91ee9700 1 -- 172.21.15.60:0/442883455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c11d1c0 con 0x55754af16530 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.032+0000 7faa916e8700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af15e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa91ee9700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af135d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7faa84009a20 tx=0x7faa84024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8afcd63d924f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa74ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa74ff9700 1 -- 172.21.15.60:0/442883455 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84008ed0 con 0x55754af16530 2023-10-05T15:19:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55754ae57db0 con 0x55754af16530 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa74ff9700 1 -- 172.21.15.60:0/442883455 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7faa840079f0 con 0x55754af16530 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa74ff9700 1 -- 172.21.15.60:0/442883455 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa8400bab0 con 0x55754af16530 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa9fb36b80 10 client.16491 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.033+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55754ac72c00 con 0x55754af16530 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa74ff9700 1 -- 172.21.15.60:0/442883455 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8403c080 con 0x55754af16530 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa74ff9700 1 -- 172.21.15.60:0/442883455 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7faa84031430 con 0x55754af16530 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa9fb36b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa9fb36b80 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa9fb36b80 20 client.16491 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af25d30 0x55754af28150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa9fb36b80 4 client.16491 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:19:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55754ae57ad0 con 0x55754af25d30 2023-10-05T15:19:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa916e8700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af25d30 0x55754af28150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.034+0000 7faa74ff9700 10 client.16491 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.035+0000 7faa916e8700 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af25d30 0x55754af28150 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ce88876b92dbb0 server_cookie=6ac97639f5bd908c in_seq=0 out_seq=0 2023-10-05T15:19:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa74ff9700 1 -- 172.21.15.60:0/442883455 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55754ae57ad0 con 0x55754af25d30 2023-10-05T15:19:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa74ff9700 10 client.16491 handle_command_reply: tid=0 2023-10-05T15:19:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 client.16491 shutdown 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 msgr2=0x55754af135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af135d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7faa84009a20 tx=0x7faa84024000 comp rx=0 tx=0).stop 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 shutdown_connections 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af25d30 0x55754af28150 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af135d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af15e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/442883455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af13070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 >> 172.21.15.60:0/442883455 conn(0x55754ae80200 msgr2=0x55754af06da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.037+0000 7faa74ff9700 0 client.16491 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.038+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 shutdown_connections 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.038+0000 7faa9fb36b80 1 -- 172.21.15.60:0/442883455 wait complete. 2023-10-05T15:19:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.038+0000 7faa9fb36b80 20 client.16491 trim_cache size 0 max 16384 2023-10-05T15:19:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.057+0000 7faa9fb36b80 1 Processor -- start 2023-10-05T15:19:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.072+0000 7faa9fb36b80 1 -- start start 2023-10-05T15:19:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.073+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af0ad60 0x55754af1d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.073+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af15880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.073+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af16530 0x55754af15dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.073+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754acdf8c0 con 0x55754af0ad60 2023-10-05T15:19:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.073+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754af07f70 con 0x55754af16530 2023-10-05T15:19:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.073+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754af1d5b0 con 0x55754af0b680 2023-10-05T15:19:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.082+0000 7faa91ee9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af16530 0x55754af15dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.082+0000 7faa91ee9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af16530 0x55754af15dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:53988/0 (socket says 172.21.15.60:53988) 2023-10-05T15:19:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.082+0000 7faa91ee9700 1 -- 172.21.15.60:0/4197297973 learned_addr learned my addr 172.21.15.60:0/4197297973 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.087+0000 7faa90ee7700 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af15880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.087+0000 7faa90ee7700 1 -- 172.21.15.60:0/4197297973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af16530 msgr2=0x55754af15dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.087+0000 7faa90ee7700 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af16530 0x55754af15dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.087+0000 7faa90ee7700 1 -- 172.21.15.60:0/4197297973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af0ad60 msgr2=0x55754af1d070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:19:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.087+0000 7faa90ee7700 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af0ad60 0x55754af1d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.087+0000 7faa90ee7700 1 -- 172.21.15.60:0/4197297973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55754acb01f0 con 0x55754af0b680 2023-10-05T15:19:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.088+0000 7faa90ee7700 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af15880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55754af14720 tx=0x7faa7c009e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ccef9a57dc17c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.090+0000 7faa77fff700 1 -- 172.21.15.60:0/4197297973 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c004230 con 0x55754af0b680 2023-10-05T15:19:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.090+0000 7faa77fff700 1 -- 172.21.15.60:0/4197297973 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa7c004390 con 0x55754af0b680 2023-10-05T15:19:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.090+0000 7faa77fff700 1 -- 172.21.15.60:0/4197297973 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c003d20 con 0x55754af0b680 2023-10-05T15:19:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.091+0000 7faa9fb36b80 1 -- 172.21.15.60:0/4197297973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 msgr2=0x55754af15880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.091+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af15880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55754af14720 tx=0x7faa7c009e20 comp rx=0 tx=0).stop 2023-10-05T15:19:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.092+0000 7faa9fb36b80 1 -- 172.21.15.60:0/4197297973 shutdown_connections 2023-10-05T15:19:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.092+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af16530 0x55754af15dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.092+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af0ad60 0x55754af1d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.092+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/4197297973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af15880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.092+0000 7faa9fb36b80 1 -- 172.21.15.60:0/4197297973 >> 172.21.15.60:0/4197297973 conn(0x55754ae80200 msgr2=0x55754af0e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.096+0000 7faa9fb36b80 1 -- 172.21.15.60:0/4197297973 shutdown_connections 2023-10-05T15:19:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.096+0000 7faa9fb36b80 1 -- 172.21.15.60:0/4197297973 wait complete. 2023-10-05T15:19:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.097+0000 7faa9fb36b80 1 -- start start 2023-10-05T15:19:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.097+0000 7faa9fb36b80 1 Processor -- start 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af1a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af1ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af78b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754af1b720 con 0x55754af16530 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754af79060 con 0x55754af0ad60 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754af791a0 con 0x55754af0b680 2023-10-05T15:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.098+0000 7faa9fb36b80 10 client.0 _ll_register_callbacks cb 0x7faa88005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.101+0000 7faa90ee7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af1ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.101+0000 7faa90ee7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af1ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54106/0 (socket says 172.21.15.60:54106) 2023-10-05T15:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.101+0000 7faa90ee7700 1 -- 172.21.15.60:0/3706587346 learned_addr learned my addr 172.21.15.60:0/3706587346 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.101+0000 7faa91ee9700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af78b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa916e8700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af1a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa91ee9700 1 -- 172.21.15.60:0/3706587346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 msgr2=0x55754af1ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa91ee9700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af1ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa91ee9700 1 -- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 msgr2=0x55754af1a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa91ee9700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af1a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa91ee9700 1 -- 172.21.15.60:0/3706587346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c009820 con 0x55754af16530 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa90ee7700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af1ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.102+0000 7faa916e8700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af1a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:19:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.109+0000 7faa91ee9700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af78b20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7faa84002230 tx=0x7faa8400bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e48dbcd498b7baf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:19:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.109+0000 7faa74ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:19:54.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.116+0000 7faa74ff9700 1 -- 172.21.15.60:0/3706587346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840079c0 con 0x55754af16530 2023-10-05T15:19:54.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.116+0000 7faa74ff9700 1 -- 172.21.15.60:0/3706587346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7faa840319b0 con 0x55754af16530 2023-10-05T15:19:54.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.116+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55754aefeeb0 con 0x55754af16530 2023-10-05T15:19:54.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.119+0000 7faa74ff9700 1 -- 172.21.15.60:0/3706587346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa84031b90 con 0x55754af16530 2023-10-05T15:19:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.119+0000 7faa9fb36b80 10 client.16494 fetch_fsmap learned FSMap version 32 2023-10-05T15:19:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.119+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55754ac88250 con 0x55754af16530 2023-10-05T15:19:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.128+0000 7faa74ff9700 1 -- 172.21.15.60:0/3706587346 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55754aefeeb0 con 0x55754af16530 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.128+0000 7faa74ff9700 1 -- 172.21.15.60:0/3706587346 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7faa8401baf0 con 0x55754af16530 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.128+0000 7faa9fb36b80 10 client.16494 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.128+0000 7faa9fb36b80 10 client.16494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.129+0000 7faa9fb36b80 20 client.16494 populate_metadata read hostname 'smithi060' 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.129+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af7a570 0x55754af7c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.129+0000 7faa9fb36b80 4 client.16494 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:19:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.129+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55754acaaf10 con 0x55754af7a570 2023-10-05T15:19:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.139+0000 7faa916e8700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af7a570 0x55754af7c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:19:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.139+0000 7faa916e8700 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af7a570 0x55754af7c990 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df2406ff700239bb server_cookie=6625b42e521b5051 in_seq=0 out_seq=0 2023-10-05T15:19:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:54.139+0000 7faa74ff9700 10 client.16494 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa74ff9700 1 -- 172.21.15.60:0/3706587346 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55754acaaf10 con 0x55754af7a570 2023-10-05T15:19:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa74ff9700 10 client.16494 handle_command_reply: tid=0 2023-10-05T15:19:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 client.16494 shutdown 2023-10-05T15:19:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 msgr2=0x55754af78b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af78b20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7faa84002230 tx=0x7faa8400bb80 comp rx=0 tx=0).stop 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 shutdown_connections 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55754af7a570 0x55754af7c990 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55754af16530 0x55754af78b20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754af0ad60 0x55754af1a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 --2- 172.21.15.60:0/3706587346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754af0b680 0x55754af1ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 >> 172.21.15.60:0/3706587346 conn(0x55754ae80200 msgr2=0x55754af11820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.376+0000 7faa74ff9700 0 client.16494 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:19:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.377+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 shutdown_connections 2023-10-05T15:19:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.377+0000 7faa9fb36b80 1 -- 172.21.15.60:0/3706587346 wait complete. 2023-10-05T15:19:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.377+0000 7faa9fb36b80 20 client.16494 trim_cache size 0 max 16384 2023-10-05T15:19:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:19:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:19:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:19:55.381 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:19:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.440+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faa780a1800 msgr2=0x7faa780a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.440+0000 7faa926ea700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faa780a1800 0x7faa780a3cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa84021000 tx=0x7faa8401d950 comp rx=0 tx=0).stop 2023-10-05T15:19:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.440+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 msgr2=0x7faa8c112f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:19:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.440+0000 7faa926ea700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c112f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa8800e9a0 tx=0x7faa8800ed60 comp rx=0 tx=0).stop 2023-10-05T15:19:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 shutdown_connections 2023-10-05T15:19:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa8c11a340 0x7faa8c1139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa8c10cf90 0x7faa8c112f40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faa780a1800 0x7faa780a3cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 --2- 172.21.15.60:0/659651010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa8c10d8b0 0x7faa8c113480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:19:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 >> 172.21.15.60:0/659651010 conn(0x7faa8c0721d0 msgr2=0x7faa8c11b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:19:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.441+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 shutdown_connections 2023-10-05T15:19:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:19:55.442+0000 7faa926ea700 1 -- 172.21.15.60:0/659651010 wait complete. 2023-10-05T15:19:55.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:55 smithi060 ceph-mon[99238]: pgmap v98: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 772 KiB/s wr, 116 op/s 2023-10-05T15:19:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:55 smithi092 ceph-mon[102944]: pgmap v98: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 772 KiB/s wr, 116 op/s 2023-10-05T15:19:55.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:55 smithi135 ceph-mon[103360]: pgmap v98: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 772 KiB/s wr, 116 op/s 2023-10-05T15:19:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:57 smithi092 ceph-mon[102944]: pgmap v99: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 780 KiB/s wr, 129 op/s 2023-10-05T15:19:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:57 smithi135 ceph-mon[103360]: pgmap v99: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 780 KiB/s wr, 129 op/s 2023-10-05T15:19:57.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:57 smithi060 ceph-mon[99238]: pgmap v99: 129 pgs: 129 active+clean; 517 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 780 KiB/s wr, 129 op/s 2023-10-05T15:19:58.251 INFO:tasks.workunit.client.0.smithi060.stdout: 145 2234310 572 1513179 705 634344 1023 2023-10-05T15:19:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:19:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:58 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:19:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:58 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:19:58.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:58.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:58 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:59 smithi135 ceph-mon[103360]: pgmap v100: 129 pgs: 129 active+clean; 520 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 449 op/s 2023-10-05T15:19:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:59 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:19:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:59 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:19:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:19:59 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:59 smithi060 ceph-mon[99238]: pgmap v100: 129 pgs: 129 active+clean; 520 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 449 op/s 2023-10-05T15:19:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:59 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:19:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:59 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:19:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:19:59 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:19:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:59 smithi092 ceph-mon[102944]: pgmap v100: 129 pgs: 129 active+clean; 520 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 449 op/s 2023-10-05T15:19:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:59 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:19:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:59 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:19:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:19:59 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:20:00.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:19:59.999+0000 7fc4d5ab8700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:20:00.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:19:59.999+0000 7fc4d5ab8700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-05T15:20:00.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:19:59.999+0000 7fc4d5ab8700 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2023-10-05T15:20:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:00 smithi135 ceph-mon[103360]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:20:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:00 smithi135 ceph-mon[103360]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-05T15:20:00.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:00 smithi135 ceph-mon[103360]: mds.i(mds.1): Metadata damage detected 2023-10-05T15:20:00.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:00 smithi060 ceph-mon[99238]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:20:00.987 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:00 smithi060 ceph-mon[99238]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-05T15:20:00.987 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:00 smithi060 ceph-mon[99238]: mds.i(mds.1): Metadata damage detected 2023-10-05T15:20:00.988 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:00 smithi092 ceph-mon[102944]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:20:00.988 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:00 smithi092 ceph-mon[102944]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-05T15:20:00.988 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:00 smithi092 ceph-mon[102944]: mds.i(mds.1): Metadata damage detected 2023-10-05T15:20:01.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:01 smithi135 ceph-mon[103360]: pgmap v101: 129 pgs: 129 active+clean; 520 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2023-10-05T15:20:01.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:01 smithi060 ceph-mon[99238]: pgmap v101: 129 pgs: 129 active+clean; 520 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2023-10-05T15:20:01.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:01 smithi092 ceph-mon[102944]: pgmap v101: 129 pgs: 129 active+clean; 520 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2023-10-05T15:20:03.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:03 smithi135 ceph-mon[103360]: pgmap v102: 129 pgs: 129 active+clean; 534 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 476 op/s 2023-10-05T15:20:03.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:03 smithi060 ceph-mon[99238]: pgmap v102: 129 pgs: 129 active+clean; 534 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 476 op/s 2023-10-05T15:20:03.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:03 smithi092 ceph-mon[102944]: pgmap v102: 129 pgs: 129 active+clean; 534 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 476 op/s 2023-10-05T15:20:05.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:05 smithi135 ceph-mon[103360]: pgmap v103: 129 pgs: 129 active+clean; 546 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 494 op/s 2023-10-05T15:20:05.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:05 smithi060 ceph-mon[99238]: pgmap v103: 129 pgs: 129 active+clean; 546 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 494 op/s 2023-10-05T15:20:05.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:05 smithi092 ceph-mon[102944]: pgmap v103: 129 pgs: 129 active+clean; 546 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 494 op/s 2023-10-05T15:20:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:07 smithi135 ceph-mon[103360]: pgmap v104: 129 pgs: 129 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 498 op/s 2023-10-05T15:20:07.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:07 smithi060 ceph-mon[99238]: pgmap v104: 129 pgs: 129 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 498 op/s 2023-10-05T15:20:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:07 smithi092 ceph-mon[102944]: pgmap v104: 129 pgs: 129 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 498 op/s 2023-10-05T15:20:08.251 INFO:tasks.workunit.client.0.smithi060.stdout: 163 866382 856 595107 1034 282276 1209 2023-10-05T15:20:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 -- 172.21.15.60:0/1311389368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 msgr2=0x7f4e0010dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 --2- 172.21.15.60:0/1311389368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e0010dd00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009f90 tx=0x7f4df800b330 comp rx=0 tx=0).stop 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 -- 172.21.15.60:0/1311389368 shutdown_connections 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 --2- 172.21.15.60:0/1311389368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e0010dd00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 --2- 172.21.15.60:0/1311389368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 0x7f4e00107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 --2- 172.21.15.60:0/1311389368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 0x7f4e00068750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 -- 172.21.15.60:0/1311389368 >> 172.21.15.60:0/1311389368 conn(0x7f4e00076b70 msgr2=0x7f4e00076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 -- 172.21.15.60:0/1311389368 shutdown_connections 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.734+0000 7f4e05273700 1 -- 172.21.15.60:0/1311389368 wait complete. 2023-10-05T15:20:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 Processor -- start 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 -- start start 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 0x7f4e00197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e001975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 0x7f4e0019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0019c250 con 0x7f4e00106f60 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0019c3c0 con 0x7f4e00068c90 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4e05273700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0019c580 con 0x7f4e000682d0 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4dfe7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e001975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 0x7f4e0019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4dfe7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e001975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54010/0 (socket says 172.21.15.60:54010) 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4dfe7fc700 1 -- 172.21.15.60:0/3477039000 learned_addr learned my addr 172.21.15.60:0/3477039000 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.735+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 0x7f4e00197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfeffd700 1 -- 172.21.15.60:0/3477039000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 msgr2=0x7f4e001975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e001975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfeffd700 1 -- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 msgr2=0x7f4e0019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 0x7f4e0019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfeffd700 1 -- 172.21.15.60:0/3477039000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009c40 con 0x7f4e000682d0 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e001975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 0x7f4e0019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:20:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 0x7f4e00197060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4df000e9c0 tx=0x7f4df000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4de7fff700 1 -- 172.21.15.60:0/3477039000 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000c9c0 con 0x7f4e000682d0 2023-10-05T15:20:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4de7fff700 1 -- 172.21.15.60:0/3477039000 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4df0010430 con 0x7f4e000682d0 2023-10-05T15:20:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0019c860 con 0x7f4e000682d0 2023-10-05T15:20:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4de7fff700 1 -- 172.21.15.60:0/3477039000 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0018680 con 0x7f4e000682d0 2023-10-05T15:20:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.736+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e001a40a0 con 0x7f4e000682d0 2023-10-05T15:20:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.739+0000 7f4de7fff700 1 -- 172.21.15.60:0/3477039000 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4df0010860 con 0x7f4e000682d0 2023-10-05T15:20:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4de7fff700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4de80a15f0 0x7f4de80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4de80a15f0 0x7f4de80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4de7fff700 1 -- 172.21.15.60:0/3477039000 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4df0014070 con 0x7f4e000682d0 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 Processor -- start 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 -- start start 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 0x5578395fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fb520 0x557839605e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578396063d0 0x5578396087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557839564400 con 0x5578395fac00 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557839555bc0 con 0x5578396063d0 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4e1145db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578395534e0 con 0x5578395fb520 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4de80a15f0 0x7f4de80a3ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e00198880 tx=0x7f4df4009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dfeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 0x5578395fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dfeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 0x5578395fafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40594/0 (socket says 172.21.15.60:40594) 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dfeffd700 1 -- 172.21.15.60:0/3354152886 learned_addr learned my addr 172.21.15.60:0/3354152886 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578396063d0 0x5578396087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.740+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fb520 0x557839605e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dff7fe700 1 -- 172.21.15.60:0/3354152886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fb520 msgr2=0x557839605e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fb520 0x557839605e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dff7fe700 1 -- 172.21.15.60:0/3354152886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 msgr2=0x5578395fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 0x5578395fafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dff7fe700 1 -- 172.21.15.60:0/3354152886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557839379d80 con 0x5578396063d0 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 0x5578395fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578396063d0 0x5578396087c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b6c0 tx=0x7f4df8009440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35b4f93922146e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4de57fa700 1 -- 172.21.15.60:0/3354152886 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800e040 con 0x5578396063d0 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4de57fa700 1 -- 172.21.15.60:0/3354152886 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4df8007cd0 con 0x5578396063d0 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.741+0000 7f4de57fa700 1 -- 172.21.15.60:0/3354152886 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df801c6a0 con 0x5578396063d0 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 -- 172.21.15.60:0/3354152886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578396063d0 msgr2=0x5578396087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578396063d0 0x5578396087c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b6c0 tx=0x7f4df8009440 comp rx=0 tx=0).stop 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 -- 172.21.15.60:0/3354152886 shutdown_connections 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578396063d0 0x5578396087c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fac00 0x5578395fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 --2- 172.21.15.60:0/3354152886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fb520 0x557839605e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 -- 172.21.15.60:0/3354152886 >> 172.21.15.60:0/3354152886 conn(0x557839570200 msgr2=0x5578395f7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 -- 172.21.15.60:0/3354152886 shutdown_connections 2023-10-05T15:20:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.742+0000 7f4e1145db80 1 -- 172.21.15.60:0/3354152886 wait complete. 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 -- start start 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 Processor -- start 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 0x557839605de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fb520 0x557839603060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578396063d0 0x557839603700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783954edd0 con 0x5578395fb520 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578394eb6b0 con 0x5578395fac00 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578394eb350 con 0x5578396063d0 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4e1145db80 10 client.0 _ll_register_callbacks cb 0x5578393487a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4dfeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 0x557839605de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4dfeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 0x557839605de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54022/0 (socket says 172.21.15.60:54022) 2023-10-05T15:20:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.743+0000 7f4dfeffd700 1 -- 172.21.15.60:0/107732147 learned_addr learned my addr 172.21.15.60:0/107732147 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578396063d0 0x557839603700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fb520 0x557839603060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfeffd700 1 -- 172.21.15.60:0/107732147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578396063d0 msgr2=0x557839603700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578396063d0 0x557839603700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfeffd700 1 -- 172.21.15.60:0/107732147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fb520 msgr2=0x557839603060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fb520 0x557839603060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfeffd700 1 -- 172.21.15.60:0/107732147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e001a40a0 con 0x5578395fac00 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 0x557839605de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4df00965d0 tx=0x7f4df0099f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de410692052c10ab server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4de2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4de2ff5700 1 -- 172.21.15.60:0/107732147 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df009a0d0 con 0x5578395fac00 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4de2ff5700 1 -- 172.21.15.60:0/107732147 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4df009e220 con 0x5578395fac00 2023-10-05T15:20:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.744+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578395eed50 con 0x5578395fac00 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4de2ff5700 1 -- 172.21.15.60:0/107732147 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df00a2460 con 0x5578395fac00 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 10 client.26159 fetch_fsmap learned FSMap version 32 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f4e0010e5c0 con 0x5578395fac00 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4de2ff5700 1 -- 172.21.15.60:0/107732147 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5578395eed50 con 0x5578395fac00 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4de2ff5700 1 -- 172.21.15.60:0/107732147 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4df00996a0 con 0x5578395fac00 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 10 client.26159 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 10 client.26159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 20 client.26159 populate_metadata read hostname 'smithi060' 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557839615ee0 0x557839618300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 4 client.26159 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:20:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557839547db0 con 0x557839615ee0 2023-10-05T15:20:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.745+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557839615ee0 0x557839618300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.746+0000 7f4de2ff5700 10 client.26159 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.746+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557839615ee0 0x557839618300 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fc23cf2f391029 server_cookie=f6e0ae11560914ee in_seq=0 out_seq=0 2023-10-05T15:20:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.747+0000 7f4de2ff5700 1 -- 172.21.15.60:0/107732147 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557839547db0 con 0x557839615ee0 2023-10-05T15:20:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.747+0000 7f4de2ff5700 10 client.26159 handle_command_reply: tid=0 2023-10-05T15:20:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.747+0000 7f4e1145db80 1 client.26159 shutdown 2023-10-05T15:20:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.747+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 msgr2=0x557839605de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.747+0000 7f4e1145db80 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 0x557839605de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4df00965d0 tx=0x7f4df0099f10 comp rx=0 tx=0).stop 2023-10-05T15:20:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 shutdown_connections 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x557839615ee0 0x557839618300 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578396063d0 0x557839603700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fac00 0x557839605de0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 --2- 172.21.15.60:0/107732147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578395fb520 0x557839603060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 >> 172.21.15.60:0/107732147 conn(0x557839570200 msgr2=0x5578395f6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4de2ff5700 0 client.26159 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 shutdown_connections 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 1 -- 172.21.15.60:0/107732147 wait complete. 2023-10-05T15:20:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.748+0000 7f4e1145db80 20 client.26159 trim_cache size 0 max 16384 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 Processor -- start 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 -- start start 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x5578396120f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x557839611610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578393cf8c0 con 0x5578396063d0 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578396015c0 con 0x5578395fb520 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4e1145db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578395feeb0 con 0x5578395fac00 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x557839611610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x557839611610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40612/0 (socket says 172.21.15.60:40612) 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dff7fe700 1 -- 172.21.15.60:0/238511895 learned_addr learned my addr 172.21.15.60:0/238511895 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x5578396120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dff7fe700 1 -- 172.21.15.60:0/238511895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 msgr2=0x55783960cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.764+0000 7f4dff7fe700 1 -- 172.21.15.60:0/238511895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 msgr2=0x5578396120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.765+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x5578396120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.765+0000 7f4dff7fe700 1 -- 172.21.15.60:0/238511895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557839362c00 con 0x5578396063d0 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.765+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x557839611610 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4df800bce0 tx=0x7f4df800bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f4051b19290f8e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.765+0000 7f4de5ffb700 1 -- 172.21.15.60:0/238511895 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800e040 con 0x5578396063d0 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.765+0000 7f4de5ffb700 1 -- 172.21.15.60:0/238511895 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4df8029860 con 0x5578396063d0 2023-10-05T15:20:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.765+0000 7f4de5ffb700 1 -- 172.21.15.60:0/238511895 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df801c6a0 con 0x5578396063d0 2023-10-05T15:20:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 -- 172.21.15.60:0/238511895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 msgr2=0x557839611610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x557839611610 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4df800bce0 tx=0x7f4df800bd10 comp rx=0 tx=0).stop 2023-10-05T15:20:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 -- 172.21.15.60:0/238511895 shutdown_connections 2023-10-05T15:20:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x557839611610 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 --2- 172.21.15.60:0/238511895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x5578396120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 -- 172.21.15.60:0/238511895 >> 172.21.15.60:0/238511895 conn(0x557839570200 msgr2=0x55783961cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 -- 172.21.15.60:0/238511895 shutdown_connections 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.766+0000 7f4e1145db80 1 -- 172.21.15.60:0/238511895 wait complete. 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 -- start start 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 Processor -- start 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x55783960a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x55783960ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783960d3a0 con 0x5578396063d0 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557839668d40 con 0x5578395fb520 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557839668f00 con 0x5578395fac00 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4e1145db80 10 client.0 _ll_register_callbacks cb 0x7f4df0099cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4dfe7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x55783960a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4dfe7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x55783960a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54038/0 (socket says 172.21.15.60:54038) 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4dfe7fc700 1 -- 172.21.15.60:0/4154829188 learned_addr learned my addr 172.21.15.60:0/4154829188 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.767+0000 7f4dff7fe700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x55783960ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfe7fc700 1 -- 172.21.15.60:0/4154829188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 msgr2=0x55783960a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfe7fc700 1 -- 172.21.15.60:0/4154829188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 msgr2=0x55783960ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x55783960ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfe7fc700 1 -- 172.21.15.60:0/4154829188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557839379d80 con 0x5578395fb520 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4dfe7fc700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x55783960a850 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4df4013010 tx=0x7f4df4013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fa23d6faa60b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4de2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4de2ff5700 1 -- 172.21.15.60:0/4154829188 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4023040 con 0x5578395fb520 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4de2ff5700 1 -- 172.21.15.60:0/4154829188 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f4df402f070 con 0x5578395fb520 2023-10-05T15:20:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.768+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4df8007cd0 con 0x5578395fb520 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4de2ff5700 1 -- 172.21.15.60:0/4154829188 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df401e020 con 0x5578395fb520 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 10 client.26165 fetch_fsmap learned FSMap version 32 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5578393a01f0 con 0x5578395fb520 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4de2ff5700 1 -- 172.21.15.60:0/4154829188 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4df8007cd0 con 0x5578395fb520 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4de2ff5700 1 -- 172.21.15.60:0/4154829188 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4df4033780 con 0x5578395fb520 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 10 client.26165 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 10 client.26165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:20:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 20 client.26165 populate_metadata read hostname 'smithi060' 2023-10-05T15:20:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55783966a810 0x55783966cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 4 client.26165 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:20:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.769+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557839547ad0 con 0x55783966a810 2023-10-05T15:20:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.770+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55783966a810 0x55783966cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.770+0000 7f4dfeffd700 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55783966a810 0x55783966cc30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d896474f81f9ad4 server_cookie=c666caa4736c1d0d in_seq=0 out_seq=0 2023-10-05T15:20:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:08.770+0000 7f4de2ff5700 10 client.26165 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.203+0000 7f4de2ff5700 1 -- 172.21.15.60:0/4154829188 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557839547ad0 con 0x55783966a810 2023-10-05T15:20:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.203+0000 7f4de2ff5700 10 client.26165 handle_command_reply: tid=0 2023-10-05T15:20:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.204+0000 7f4e1145db80 1 client.26165 shutdown 2023-10-05T15:20:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.218+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 msgr2=0x55783960a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.218+0000 7f4e1145db80 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x55783960a850 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4df4013010 tx=0x7f4df4013040 comp rx=0 tx=0).stop 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 shutdown_connections 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55783966a810 0x55783966cc30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578396063d0 0x55783960ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578395fac00 0x55783960a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 --2- 172.21.15.60:0/4154829188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578395fb520 0x55783960a850 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 >> 172.21.15.60:0/4154829188 conn(0x557839570200 msgr2=0x5578396120f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4de2ff5700 0 client.26165 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 shutdown_connections 2023-10-05T15:20:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.223+0000 7f4e1145db80 1 -- 172.21.15.60:0/4154829188 wait complete. 2023-10-05T15:20:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.224+0000 7f4e1145db80 20 client.26165 trim_cache size 0 max 16384 2023-10-05T15:20:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:20:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:20:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:20:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:20:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.236+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4de80a15f0 msgr2=0x7f4de80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.236+0000 7f4e05273700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4de80a15f0 0x7f4de80a3ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e00198880 tx=0x7f4df4009260 comp rx=0 tx=0).stop 2023-10-05T15:20:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.236+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 msgr2=0x7f4e00197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.236+0000 7f4e05273700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 0x7f4e00197060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4df000e9c0 tx=0x7f4df000ecd0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.237+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 shutdown_connections 2023-10-05T15:20:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.237+0000 7f4e05273700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e00106f60 0x7f4e0019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.237+0000 7f4e05273700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000682d0 0x7f4e00197060 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.237+0000 7f4e05273700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4de80a15f0 0x7f4de80a3ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.237+0000 7f4e05273700 1 --2- 172.21.15.60:0/3477039000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e00068c90 0x7f4e001975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.237+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 >> 172.21.15.60:0/3477039000 conn(0x7f4e00076b70 msgr2=0x7f4e000fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.245+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 shutdown_connections 2023-10-05T15:20:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:09.245+0000 7f4e05273700 1 -- 172.21.15.60:0/3477039000 wait complete. 2023-10-05T15:20:09.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:09 smithi135 ceph-mon[103360]: pgmap v105: 129 pgs: 129 active+clean; 628 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 10 MiB/s wr, 903 op/s 2023-10-05T15:20:09.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:09 smithi060 ceph-mon[99238]: pgmap v105: 129 pgs: 129 active+clean; 628 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 10 MiB/s wr, 903 op/s 2023-10-05T15:20:09.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:09 smithi092 ceph-mon[102944]: pgmap v105: 129 pgs: 129 active+clean; 628 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 10 MiB/s wr, 903 op/s 2023-10-05T15:20:11.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:11 smithi135 ceph-mon[103360]: pgmap v106: 129 pgs: 129 active+clean; 628 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.6 MiB/s wr, 581 op/s 2023-10-05T15:20:11.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:11 smithi060 ceph-mon[99238]: pgmap v106: 129 pgs: 129 active+clean; 628 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.6 MiB/s wr, 581 op/s 2023-10-05T15:20:11.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:11 smithi092 ceph-mon[102944]: pgmap v106: 129 pgs: 129 active+clean; 628 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.6 MiB/s wr, 581 op/s 2023-10-05T15:20:13.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:13 smithi135 ceph-mon[103360]: pgmap v107: 129 pgs: 129 active+clean; 635 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 782 op/s 2023-10-05T15:20:13.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:13 smithi060 ceph-mon[99238]: pgmap v107: 129 pgs: 129 active+clean; 635 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 782 op/s 2023-10-05T15:20:13.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:13 smithi092 ceph-mon[102944]: pgmap v107: 129 pgs: 129 active+clean; 635 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 782 op/s 2023-10-05T15:20:15.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:15 smithi135 ceph-mon[103360]: pgmap v108: 129 pgs: 129 active+clean; 640 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 796 op/s 2023-10-05T15:20:15.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:15 smithi060 ceph-mon[99238]: pgmap v108: 129 pgs: 129 active+clean; 640 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 796 op/s 2023-10-05T15:20:15.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:15 smithi092 ceph-mon[102944]: pgmap v108: 129 pgs: 129 active+clean; 640 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 796 op/s 2023-10-05T15:20:17.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:17 smithi135 ceph-mon[103360]: pgmap v109: 129 pgs: 129 active+clean; 640 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.1 MiB/s wr, 714 op/s 2023-10-05T15:20:17.920 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:17 smithi060 ceph-mon[99238]: pgmap v109: 129 pgs: 129 active+clean; 640 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.1 MiB/s wr, 714 op/s 2023-10-05T15:20:17.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:17 smithi092 ceph-mon[102944]: pgmap v109: 129 pgs: 129 active+clean; 640 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.1 MiB/s wr, 714 op/s 2023-10-05T15:20:18.252 INFO:tasks.workunit.client.0.smithi060.stdout: 203 322893 2046 224635 1990 106701 1398 2023-10-05T15:20:18.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:18 smithi060 ceph-mon[99238]: pgmap v110: 129 pgs: 129 active+clean; 655 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-10-05T15:20:18.932 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:18 smithi092 ceph-mon[102944]: pgmap v110: 129 pgs: 129 active+clean; 655 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-10-05T15:20:19.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:18 smithi135 ceph-mon[103360]: pgmap v110: 129 pgs: 129 active+clean; 655 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-10-05T15:20:21.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:20 smithi135 ceph-mon[103360]: pgmap v111: 129 pgs: 129 active+clean; 655 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 371 op/s 2023-10-05T15:20:21.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:20 smithi060 ceph-mon[99238]: pgmap v111: 129 pgs: 129 active+clean; 655 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 371 op/s 2023-10-05T15:20:21.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:20 smithi092 ceph-mon[102944]: pgmap v111: 129 pgs: 129 active+clean; 655 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 371 op/s 2023-10-05T15:20:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 -- 172.21.15.60:0/4235209369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e501050f0 msgr2=0x7f2e5010cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 --2- 172.21.15.60:0/4235209369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e501050f0 0x7f2e5010cc70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009990 tx=0x7f2e40009ca0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 -- 172.21.15.60:0/4235209369 shutdown_connections 2023-10-05T15:20:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 --2- 172.21.15.60:0/4235209369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e501050f0 0x7f2e5010cc70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 --2- 172.21.15.60:0/4235209369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e500fffd0 0x7f2e501003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 --2- 172.21.15.60:0/4235209369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e50100980 0x7f2e501049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 -- 172.21.15.60:0/4235209369 >> 172.21.15.60:0/4235209369 conn(0x7f2e50076ea0 msgr2=0x7f2e500772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 -- 172.21.15.60:0/4235209369 shutdown_connections 2023-10-05T15:20:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.554+0000 7f2e577ad700 1 -- 172.21.15.60:0/4235209369 wait complete. 2023-10-05T15:20:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 Processor -- start 2023-10-05T15:20:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 -- start start 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e500fffd0 0x7f2e50199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e501050f0 0x7f2e501997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 0x7f2e5019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5019e890 con 0x7f2e500fffd0 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5019ea00 con 0x7f2e501050f0 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e577ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5019ebc0 con 0x7f2e5019de10 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e54d48700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e501050f0 0x7f2e501997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e55d4a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 0x7f2e5019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e55d4a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 0x7f2e5019e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54166/0 (socket says 172.21.15.60:54166) 2023-10-05T15:20:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1105975184 learned_addr learned my addr 172.21.15.60:0/1105975184 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e54d48700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e501050f0 0x7f2e501997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54056/0 (socket says 172.21.15.60:54056) 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.555+0000 7f2e55549700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e500fffd0 0x7f2e50199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1105975184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e501050f0 msgr2=0x7f2e501997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e501050f0 0x7f2e501997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e500fffd0 msgr2=0x7f2e50199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e500fffd0 0x7f2e50199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1105975184 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400095f0 con 0x7f2e5019de10 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 0x7f2e5019e290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e40004730 tx=0x7f2e40004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e467fc700 1 -- 172.21.15.60:0/1105975184 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4001d070 con 0x7f2e5019de10 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e467fc700 1 -- 172.21.15.60:0/1105975184 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e400047d0 con 0x7f2e5019de10 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e501a60c0 con 0x7f2e5019de10 2023-10-05T15:20:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e467fc700 1 -- 172.21.15.60:0/1105975184 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40005320 con 0x7f2e5019de10 2023-10-05T15:20:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.556+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e501a6540 con 0x7f2e5019de10 2023-10-05T15:20:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.561+0000 7f2e467fc700 1 -- 172.21.15.60:0/1105975184 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2e40005480 con 0x7f2e5019de10 2023-10-05T15:20:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.562+0000 7f2e467fc700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e3c0a1670 0x7f2e3c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.562+0000 7f2e467fc700 1 -- 172.21.15.60:0/1105975184 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e400ce2a0 con 0x7f2e5019de10 2023-10-05T15:20:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.562+0000 7f2e55549700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e3c0a1670 0x7f2e3c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 Processor -- start 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e55549700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e3c0a1670 0x7f2e3c0a3b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800f540 tx=0x7f2e4800b040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 -- start start 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355e66fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355dba400 con 0x560355e64be0 2023-10-05T15:20:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355dabbc0 con 0x560355e50c00 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e63997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355da94e0 con 0x560355e51520 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e55d4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355e66fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e55d4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355e66fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40644/0 (socket says 172.21.15.60:40644) 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.563+0000 7f2e55d4a700 1 -- 172.21.15.60:0/2410653608 learned_addr learned my addr 172.21.15.60:0/2410653608 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e55d4a700 1 -- 172.21.15.60:0/2410653608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 msgr2=0x560355e646a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e646a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e55d4a700 1 -- 172.21.15.60:0/2410653608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 msgr2=0x560355e50fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e55d4a700 1 -- 172.21.15.60:0/2410653608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560355bcfd80 con 0x560355e64be0 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355e66fd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2e4009af80 tx=0x7f2e4009ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e48471bbd5035f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e3b7fe700 1 -- 172.21.15.60:0/2410653608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4009aff0 con 0x560355e64be0 2023-10-05T15:20:22.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e3b7fe700 1 -- 172.21.15.60:0/2410653608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e4009f140 con 0x560355e64be0 2023-10-05T15:20:22.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.564+0000 7f2e3b7fe700 1 -- 172.21.15.60:0/2410653608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40004e20 con 0x560355e64be0 2023-10-05T15:20:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 -- 172.21.15.60:0/2410653608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 msgr2=0x560355e66fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355e66fd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2e4009af80 tx=0x7f2e4009ac40 comp rx=0 tx=0).stop 2023-10-05T15:20:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 -- 172.21.15.60:0/2410653608 shutdown_connections 2023-10-05T15:20:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355e66fd0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 --2- 172.21.15.60:0/2410653608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 -- 172.21.15.60:0/2410653608 >> 172.21.15.60:0/2410653608 conn(0x560355dc6200 msgr2=0x560355e4d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 -- 172.21.15.60:0/2410653608 shutdown_connections 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.565+0000 7f2e63997b80 1 -- 172.21.15.60:0/2410653608 wait complete. 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.566+0000 7f2e63997b80 1 -- start start 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.566+0000 7f2e63997b80 1 Processor -- start 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e5dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e51520 0x560355e5e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e64be0 0x560355e590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355da4dd0 con 0x560355e51520 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355d416b0 con 0x560355e50c00 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355d41350 con 0x560355e64be0 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e63997b80 10 client.0 _ll_register_callbacks cb 0x560355b9e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e5dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e5dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54068/0 (socket says 172.21.15.60:54068) 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 -- 172.21.15.60:0/3521502523 learned_addr learned my addr 172.21.15.60:0/3521502523 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e64be0 0x560355e590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e54d48700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e51520 0x560355e5e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 -- 172.21.15.60:0/3521502523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e64be0 msgr2=0x560355e590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e64be0 0x560355e590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 -- 172.21.15.60:0/3521502523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e51520 msgr2=0x560355e5e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e51520 0x560355e5e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.567+0000 7f2e55549700 1 -- 172.21.15.60:0/3521502523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e501a6540 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e64be0 0x560355e590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e55549700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e5dd30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e480045e0 tx=0x7f2e48004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b3b99f5bf20aa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e38ff9700 1 -- 172.21.15.60:0/3521502523 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800e040 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560355e44d50 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e38ff9700 1 -- 172.21.15.60:0/3521502523 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e48009230 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e38ff9700 1 -- 172.21.15.60:0/3521502523 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e480093f0 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e63997b80 10 client.26174 fetch_fsmap learned FSMap version 32 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x560355bb8c00 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.568+0000 7f2e38ff9700 1 -- 172.21.15.60:0/3521502523 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560355e44d50 con 0x560355e50c00 2023-10-05T15:20:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e38ff9700 1 -- 172.21.15.60:0/3521502523 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f2e48008c80 con 0x560355e50c00 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e63997b80 10 client.26174 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e63997b80 10 client.26174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e63997b80 20 client.26174 populate_metadata read hostname 'smithi060' 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e63997b80 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355e7cd30 0x560355e7f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e63997b80 4 client.26174 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560355d9ddb0 con 0x560355e7cd30 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e54d48700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355e7cd30 0x560355e7f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.569+0000 7f2e38ff9700 10 client.26174 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:22.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.570+0000 7f2e54d48700 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355e7cd30 0x560355e7f150 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50e67fc3d603943d server_cookie=c25ff687cae7f189 in_seq=0 out_seq=0 2023-10-05T15:20:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e38ff9700 1 -- 172.21.15.60:0/3521502523 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560355d9ddb0 con 0x560355e7cd30 2023-10-05T15:20:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e38ff9700 10 client.26174 handle_command_reply: tid=0 2023-10-05T15:20:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 client.26174 shutdown 2023-10-05T15:20:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 msgr2=0x560355e5dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e5dd30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e480045e0 tx=0x7f2e48004ad0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 shutdown_connections 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355e7cd30 0x560355e7f150 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e64be0 0x560355e590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e5dd30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 --2- 172.21.15.60:0/3521502523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e51520 0x560355e5e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 >> 172.21.15.60:0/3521502523 conn(0x560355dc6200 msgr2=0x560355e4cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e38ff9700 0 client.26174 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 shutdown_connections 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.571+0000 7f2e63997b80 1 -- 172.21.15.60:0/3521502523 wait complete. 2023-10-05T15:20:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.572+0000 7f2e63997b80 20 client.26174 trim_cache size 0 max 16384 2023-10-05T15:20:22.597 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.594+0000 7f2e63997b80 1 Processor -- start 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.594+0000 7f2e63997b80 1 -- start start 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e53ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e64be0 0x560355e4d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e63997b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355c258c0 con 0x560355e50c00 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e63997b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355e54f40 con 0x560355e64be0 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e63997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355e7f7b0 con 0x560355e51520 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e53ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e55549700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.600 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e53ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54186/0 (socket says 172.21.15.60:54186) 2023-10-05T15:20:22.600 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 -- 172.21.15.60:0/456984860 learned_addr learned my addr 172.21.15.60:0/456984860 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:22.600 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e55549700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40654/0 (socket says 172.21.15.60:40654) 2023-10-05T15:20:22.600 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 -- 172.21.15.60:0/456984860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e64be0 msgr2=0x560355e4d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e64be0 0x560355e4d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 -- 172.21.15.60:0/456984860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 msgr2=0x560355e50fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e54d48700 1 -- 172.21.15.60:0/456984860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560355bf61f0 con 0x560355e51520 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.595+0000 7f2e55549700 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.596+0000 7f2e54d48700 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e53ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e5019aa80 tx=0x7f2e4c004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753d2fb4b31b29d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.596+0000 7f2e3bfff700 1 -- 172.21.15.60:0/456984860 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c016040 con 0x560355e51520 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.596+0000 7f2e3bfff700 1 -- 172.21.15.60:0/456984860 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e4c01bdc0 con 0x560355e51520 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.596+0000 7f2e3bfff700 1 -- 172.21.15.60:0/456984860 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c004ab0 con 0x560355e51520 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 -- 172.21.15.60:0/456984860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 msgr2=0x560355e53ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e53ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e5019aa80 tx=0x7f2e4c004320 comp rx=0 tx=0).stop 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 -- 172.21.15.60:0/456984860 shutdown_connections 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e64be0 0x560355e4d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e50c00 0x560355e50fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 --2- 172.21.15.60:0/456984860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e53ba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 -- 172.21.15.60:0/456984860 >> 172.21.15.60:0/456984860 conn(0x560355dc6200 msgr2=0x560355e4cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 -- 172.21.15.60:0/456984860 shutdown_connections 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.597+0000 7f2e63997b80 1 -- 172.21.15.60:0/456984860 wait complete. 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 -- start start 2023-10-05T15:20:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 Processor -- start 2023-10-05T15:20:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e63290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355ec97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355ec9ea0 con 0x560355e64be0 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355eca010 con 0x560355e50c00 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560355eca1d0 con 0x560355e51520 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.598+0000 7f2e63997b80 10 client.0 _ll_register_callbacks cb 0x560355b9e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355ec97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355ec97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40664/0 (socket says 172.21.15.60:40664) 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1193320091 learned_addr learned my addr 172.21.15.60:0/1193320091 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55549700 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e63290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1193320091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 msgr2=0x560355e637d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e637d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 msgr2=0x560355e63290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e63290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.599+0000 7f2e55d4a700 1 -- 172.21.15.60:0/1193320091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560355bb8c00 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e55d4a700 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355ec97c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2e400974f0 tx=0x7f2e4009f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6bc809d488c4ec server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e38ff9700 1 -- 172.21.15.60:0/1193320091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400b2070 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e38ff9700 1 -- 172.21.15.60:0/1193320091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e400a32f0 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e4009f140 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e38ff9700 1 -- 172.21.15.60:0/1193320091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e400b5ea0 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e63997b80 10 client.16530 fetch_fsmap learned FSMap version 32 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f2e4c009d20 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e38ff9700 1 -- 172.21.15.60:0/1193320091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e4007d080 con 0x560355e64be0 2023-10-05T15:20:22.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e38ff9700 1 -- 172.21.15.60:0/1193320091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f2e4009b370 con 0x560355e64be0 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e63997b80 10 client.16530 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e63997b80 10 client.16530 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.600+0000 7f2e63997b80 20 client.16530 populate_metadata read hostname 'smithi060' 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.601+0000 7f2e63997b80 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355ee2810 0x560355ee4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.601+0000 7f2e63997b80 4 client.16530 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.601+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560355d9dad0 con 0x560355ee2810 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.601+0000 7f2e55549700 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355ee2810 0x560355ee4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.601+0000 7f2e38ff9700 10 client.16530 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:22.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:22.601+0000 7f2e55549700 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355ee2810 0x560355ee4c30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d7d8260a0016e12 server_cookie=b86c9d35e3daddf9 in_seq=0 out_seq=0 2023-10-05T15:20:23.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:23 smithi135 ceph-mon[103360]: pgmap v112: 129 pgs: 129 active+clean; 759 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 12 MiB/s wr, 790 op/s 2023-10-05T15:20:23.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:23 smithi060 ceph-mon[99238]: pgmap v112: 129 pgs: 129 active+clean; 759 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 12 MiB/s wr, 790 op/s 2023-10-05T15:20:23.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:23 smithi092 ceph-mon[102944]: pgmap v112: 129 pgs: 129 active+clean; 759 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 12 MiB/s wr, 790 op/s 2023-10-05T15:20:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.462+0000 7f2e38ff9700 1 -- 172.21.15.60:0/1193320091 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560355d9dad0 con 0x560355ee2810 2023-10-05T15:20:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.462+0000 7f2e38ff9700 10 client.16530 handle_command_reply: tid=0 2023-10-05T15:20:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.462+0000 7f2e63997b80 1 client.16530 shutdown 2023-10-05T15:20:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.472+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 msgr2=0x560355ec97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.472+0000 7f2e63997b80 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355ec97c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2e400974f0 tx=0x7f2e4009f2b0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.477+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 shutdown_connections 2023-10-05T15:20:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.477+0000 7f2e63997b80 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x560355ee2810 0x560355ee4c30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.477+0000 7f2e63997b80 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560355e64be0 0x560355ec97c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.477+0000 7f2e63997b80 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560355e50c00 0x560355e63290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.477+0000 7f2e63997b80 1 --2- 172.21.15.60:0/1193320091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560355e51520 0x560355e637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.477+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 >> 172.21.15.60:0/1193320091 conn(0x560355dc6200 msgr2=0x560355e52b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.478+0000 7f2e38ff9700 0 client.16530 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.478+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 shutdown_connections 2023-10-05T15:20:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.479+0000 7f2e63997b80 1 -- 172.21.15.60:0/1193320091 wait complete. 2023-10-05T15:20:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.479+0000 7f2e63997b80 20 client.16530 trim_cache size 0 max 16384 2023-10-05T15:20:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:20:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:20:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:20:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:20:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.809+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e3c0a1670 msgr2=0x7f2e3c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.809+0000 7f2e577ad700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e3c0a1670 0x7f2e3c0a3b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800f540 tx=0x7f2e4800b040 comp rx=0 tx=0).stop 2023-10-05T15:20:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.809+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 msgr2=0x7f2e5019e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.809+0000 7f2e577ad700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 0x7f2e5019e290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e40004730 tx=0x7f2e40004760 comp rx=0 tx=0).stop 2023-10-05T15:20:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.810+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 shutdown_connections 2023-10-05T15:20:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.810+0000 7f2e577ad700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e5019de10 0x7f2e5019e290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.810+0000 7f2e577ad700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e500fffd0 0x7f2e50199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.810+0000 7f2e577ad700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e3c0a1670 0x7f2e3c0a3b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.810+0000 7f2e577ad700 1 --2- 172.21.15.60:0/1105975184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e501050f0 0x7f2e501997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.810+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 >> 172.21.15.60:0/1105975184 conn(0x7f2e50076ea0 msgr2=0x7f2e500691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.811+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 shutdown_connections 2023-10-05T15:20:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:24.811+0000 7f2e577ad700 1 -- 172.21.15.60:0/1105975184 wait complete. 2023-10-05T15:20:25.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:25 smithi135 ceph-mon[103360]: pgmap v113: 129 pgs: 129 active+clean; 823 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 862 op/s 2023-10-05T15:20:25.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:25 smithi092 ceph-mon[102944]: pgmap v113: 129 pgs: 129 active+clean; 823 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 862 op/s 2023-10-05T15:20:25.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:25 smithi060 ceph-mon[99238]: pgmap v113: 129 pgs: 129 active+clean; 823 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 862 op/s 2023-10-05T15:20:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:27 smithi060 ceph-mon[99238]: pgmap v114: 129 pgs: 129 active+clean; 824 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 16 MiB/s wr, 794 op/s 2023-10-05T15:20:27.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:27 smithi092 ceph-mon[102944]: pgmap v114: 129 pgs: 129 active+clean; 824 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 16 MiB/s wr, 794 op/s 2023-10-05T15:20:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:27 smithi135 ceph-mon[103360]: pgmap v114: 129 pgs: 129 active+clean; 824 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 16 MiB/s wr, 794 op/s 2023-10-05T15:20:28.252 INFO:tasks.workunit.client.0.smithi060.stdout: 208 1460436 384 1010490 348 451402 373 2023-10-05T15:20:29.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:29 smithi060 ceph-mon[99238]: pgmap v115: 129 pgs: 129 active+clean; 816 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 1.17k op/s 2023-10-05T15:20:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:29 smithi092 ceph-mon[102944]: pgmap v115: 129 pgs: 129 active+clean; 816 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 1.17k op/s 2023-10-05T15:20:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:29 smithi135 ceph-mon[103360]: pgmap v115: 129 pgs: 129 active+clean; 816 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 1.17k op/s 2023-10-05T15:20:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:31 smithi092 ceph-mon[102944]: pgmap v116: 129 pgs: 129 active+clean; 816 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-10-05T15:20:31.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:31 smithi060 ceph-mon[99238]: pgmap v116: 129 pgs: 129 active+clean; 816 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-10-05T15:20:31.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:31 smithi135 ceph-mon[103360]: pgmap v116: 129 pgs: 129 active+clean; 816 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-10-05T15:20:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:33 smithi092 ceph-mon[102944]: pgmap v117: 129 pgs: 129 active+clean; 822 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 1.13k op/s 2023-10-05T15:20:33.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:33 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:33 smithi135 ceph-mon[103360]: pgmap v117: 129 pgs: 129 active+clean; 822 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 1.13k op/s 2023-10-05T15:20:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:33 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:33.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:33 smithi060 ceph-mon[99238]: pgmap v117: 129 pgs: 129 active+clean; 822 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 1.13k op/s 2023-10-05T15:20:33.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:33 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:35.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:35 smithi135 ceph-mon[103360]: pgmap v118: 129 pgs: 129 active+clean; 826 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 730 op/s 2023-10-05T15:20:35.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:35 smithi092 ceph-mon[102944]: pgmap v118: 129 pgs: 129 active+clean; 826 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 730 op/s 2023-10-05T15:20:35.976 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:35 smithi060 ceph-mon[99238]: pgmap v118: 129 pgs: 129 active+clean; 826 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 730 op/s 2023-10-05T15:20:37.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:37 smithi135 ceph-mon[103360]: pgmap v119: 129 pgs: 129 active+clean; 826 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 460 op/s 2023-10-05T15:20:37.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:37 smithi092 ceph-mon[102944]: pgmap v119: 129 pgs: 129 active+clean; 826 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 460 op/s 2023-10-05T15:20:37.928 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:37 smithi060 ceph-mon[99238]: pgmap v119: 129 pgs: 129 active+clean; 826 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 460 op/s 2023-10-05T15:20:38.252 INFO:tasks.workunit.client.0.smithi060.stdout: 225 1899843 1145 1314498 910 614835 1529 2023-10-05T15:20:38.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:38 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:38.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:38 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:39.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:38 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 -- 172.21.15.60:0/991946498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb811a690 msgr2=0x7f0bb811ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/991946498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb811a690 0x7f0bb811ca80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009f90 tx=0x7f0bb000b330 comp rx=0 tx=0).stop 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 -- 172.21.15.60:0/991946498 shutdown_connections 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/991946498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb811a690 0x7f0bb811ca80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/991946498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bb810f620 0x7f0bb8107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/991946498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bb810fa90 0x7f0bb81083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:39.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.711+0000 7f0bbf14c700 1 -- 172.21.15.60:0/991946498 >> 172.21.15.60:0/991946498 conn(0x7f0bb806cfa0 msgr2=0x7f0bb806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.749+0000 7f0bbf14c700 1 -- 172.21.15.60:0/991946498 shutdown_connections 2023-10-05T15:20:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.771+0000 7f0bbf14c700 1 -- 172.21.15.60:0/991946498 wait complete. 2023-10-05T15:20:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.772+0000 7f0bbf14c700 1 Processor -- start 2023-10-05T15:20:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.790+0000 7f0bbf14c700 1 -- start start 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.790+0000 7f0bbf14c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 0x7f0bb81a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.790+0000 7f0bbf14c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bb811a690 0x7f0bb81a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.791+0000 7f0bbf14c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bb81aaa40 0x7f0bb81aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.791+0000 7f0bbf14c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb81ab4c0 con 0x7f0bb81aaa40 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.791+0000 7f0bbf14c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb81ab600 con 0x7f0bb810f620 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.791+0000 7f0bbf14c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb81ab770 con 0x7f0bb811a690 2023-10-05T15:20:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.821+0000 7f0bb7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bb811a690 0x7f0bb81a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.830+0000 7f0bbcee8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 0x7f0bb81a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.830+0000 7f0bbcee8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 0x7f0bb81a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54100/0 (socket says 172.21.15.60:54100) 2023-10-05T15:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.830+0000 7f0bbcee8700 1 -- 172.21.15.60:0/904255944 learned_addr learned my addr 172.21.15.60:0/904255944 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.838+0000 7f0bbcee8700 1 -- 172.21.15.60:0/904255944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bb811a690 msgr2=0x7f0bb81a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.838+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bb811a690 0x7f0bb81a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.838+0000 7f0bbcee8700 1 -- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bb81aaa40 msgr2=0x7f0bb81aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.838+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bb81aaa40 0x7f0bb81aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.838+0000 7f0bbcee8700 1 -- 172.21.15.60:0/904255944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009c40 con 0x7f0bb810f620 2023-10-05T15:20:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:39.849+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 0x7f0bb81a5e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800e9c0 tx=0x7f0ba800ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:39.921 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:39 smithi060 ceph-mon[99238]: pgmap v120: 129 pgs: 129 active+clean; 837 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2023-10-05T15:20:39.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:39 smithi092 ceph-mon[102944]: pgmap v120: 129 pgs: 129 active+clean; 837 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2023-10-05T15:20:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.040+0000 7f0bb5ffb700 1 -- 172.21.15.60:0/904255944 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800cbd0 con 0x7f0bb810f620 2023-10-05T15:20:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.040+0000 7f0bb5ffb700 1 -- 172.21.15.60:0/904255944 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ba800cd30 con 0x7f0bb810f620 2023-10-05T15:20:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.040+0000 7f0bb5ffb700 1 -- 172.21.15.60:0/904255944 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8005580 con 0x7f0bb810f620 2023-10-05T15:20:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.040+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb810fe70 con 0x7f0bb810f620 2023-10-05T15:20:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.040+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb8110330 con 0x7f0bb810f620 2023-10-05T15:20:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.051+0000 7f0bcb336b80 1 Processor -- start 2023-10-05T15:20:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.052+0000 7f0bb5ffb700 1 -- 172.21.15.60:0/904255944 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0ba8004750 con 0x7f0bb810f620 2023-10-05T15:20:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.053+0000 7f0bb5ffb700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0ba00a1800 0x7f0ba00a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.053+0000 7f0bb5ffb700 1 -- 172.21.15.60:0/904255944 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0ba8014070 con 0x7f0bb810f620 2023-10-05T15:20:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.058+0000 7f0bcb336b80 1 -- start start 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.059+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dccc00 0x55a068dccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.059+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dcd520 0x55a068dd7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.059+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dda7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.059+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068d36400 con 0x55a068dd83d0 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.059+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068d27bc0 con 0x55a068dccc00 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.059+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068d254e0 con 0x55a068dcd520 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.061+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0ba00a1800 0x7f0ba00a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.061+0000 7f0bbd6e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dda7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.061+0000 7f0bbd6e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dda7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40684/0 (socket says 172.21.15.60:40684) 2023-10-05T15:20:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.061+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/2928729864 learned_addr learned my addr 172.21.15.60:0/2928729864 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.068+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/2928729864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dcd520 msgr2=0x55a068dd7e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:20:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.068+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dcd520 0x55a068dd7e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.068+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/2928729864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dccc00 msgr2=0x55a068dccfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:20:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.068+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dccc00 0x55a068dccfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.068+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/2928729864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a068b4bd80 con 0x55a068dd83d0 2023-10-05T15:20:40.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:39 smithi135 ceph-mon[103360]: pgmap v120: 129 pgs: 129 active+clean; 837 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2023-10-05T15:20:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.082+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dda7c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00074d0 tx=0x7f0bb0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6213a43666b6c674 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.082+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0ba00a1800 0x7f0ba00a3cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000cfb0 tx=0x7f0bb000ca00 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.260+0000 7f0b9effd700 1 -- 172.21.15.60:0/2928729864 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb000e070 con 0x55a068dd83d0 2023-10-05T15:20:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.260+0000 7f0b9effd700 1 -- 172.21.15.60:0/2928729864 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb0004c50 con 0x55a068dd83d0 2023-10-05T15:20:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.283+0000 7f0b9effd700 1 -- 172.21.15.60:0/2928729864 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0029440 con 0x55a068dd83d0 2023-10-05T15:20:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.284+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2928729864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 msgr2=0x55a068dda7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.284+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dda7c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00074d0 tx=0x7f0bb0022000 comp rx=0 tx=0).stop 2023-10-05T15:20:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.285+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2928729864 shutdown_connections 2023-10-05T15:20:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.285+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dda7c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.285+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dccc00 0x55a068dccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.288 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.285+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2928729864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dcd520 0x55a068dd7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.288 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.285+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2928729864 >> 172.21.15.60:0/2928729864 conn(0x55a068d42200 msgr2=0x55a068dc9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.296+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2928729864 shutdown_connections 2023-10-05T15:20:40.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.296+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2928729864 wait complete. 2023-10-05T15:20:40.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.297+0000 7f0bcb336b80 1 -- start start 2023-10-05T15:20:40.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.297+0000 7f0bcb336b80 1 Processor -- start 2023-10-05T15:20:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068dd7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068dd57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068d20dd0 con 0x55a068dccc00 2023-10-05T15:20:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068cbd6b0 con 0x55a068dcd520 2023-10-05T15:20:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068cbd350 con 0x55a068dd83d0 2023-10-05T15:20:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.298+0000 7f0bcb336b80 10 client.0 _ll_register_callbacks cb 0x55a068b1a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:20:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.299+0000 7f0bbcee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068dd7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.299+0000 7f0bbcee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068dd7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40690/0 (socket says 172.21.15.60:40690) 2023-10-05T15:20:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.299+0000 7f0bbcee8700 1 -- 172.21.15.60:0/2573280910 learned_addr learned my addr 172.21.15.60:0/2573280910 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.304+0000 7f0bb7fff700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.304+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068dd57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.314 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.312+0000 7f0bbcee8700 1 -- 172.21.15.60:0/2573280910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 msgr2=0x55a068dd57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:40.314 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.312+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068dd57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.314 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.312+0000 7f0bbcee8700 1 -- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 msgr2=0x55a068dd50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:40.314 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.312+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.314 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.312+0000 7f0bbcee8700 1 -- 172.21.15.60:0/2573280910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb0025070 con 0x55a068dccc00 2023-10-05T15:20:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.319+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068dd7e50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8096cf0 tx=0x7f0ba809aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1167e77333b3cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.521+0000 7f0b97fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:20:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.521+0000 7f0b97fff700 1 -- 172.21.15.60:0/2573280910 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80cd430 con 0x55a068dccc00 2023-10-05T15:20:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.521+0000 7f0b97fff700 1 -- 172.21.15.60:0/2573280910 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0ba80a2610 con 0x55a068dccc00 2023-10-05T15:20:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.521+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a068dc0d50 con 0x55a068dccc00 2023-10-05T15:20:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.526+0000 7f0b97fff700 1 -- 172.21.15.60:0/2573280910 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ba809a4e0 con 0x55a068dccc00 2023-10-05T15:20:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.526+0000 7f0bcb336b80 10 client.16539 fetch_fsmap learned FSMap version 34 2023-10-05T15:20:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.526+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a068b34c00 con 0x55a068dccc00 2023-10-05T15:20:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.532+0000 7f0b97fff700 1 -- 172.21.15.60:0/2573280910 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a068dc0d50 con 0x55a068dccc00 2023-10-05T15:20:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.532+0000 7f0b97fff700 1 -- 172.21.15.60:0/2573280910 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 34) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0ba80b82b0 con 0x55a068dccc00 2023-10-05T15:20:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bcb336b80 10 client.16539 fetch_fsmap finished waiting for FSMap version 34 2023-10-05T15:20:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bcb336b80 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:20:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bcb336b80 20 client.16539 populate_metadata read hostname 'smithi060' 2023-10-05T15:20:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068de7fc0 0x55a068dea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bcb336b80 4 client.16539 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:20:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a068d19db0 con 0x55a068de7fc0 2023-10-05T15:20:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.533+0000 7f0bb7fff700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068de7fc0 0x55a068dea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.619+0000 7f0bb7fff700 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068de7fc0 0x55a068dea3e0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5099b816f5a454ec server_cookie=bd845864817fca23 in_seq=0 out_seq=0 2023-10-05T15:20:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.619+0000 7f0b97fff700 10 client.16539 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.651+0000 7f0b97fff700 1 -- 172.21.15.60:0/2573280910 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a068d19db0 con 0x55a068de7fc0 2023-10-05T15:20:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.651+0000 7f0b97fff700 10 client.16539 handle_command_reply: tid=0 2023-10-05T15:20:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.651+0000 7f0bcb336b80 1 client.16539 shutdown 2023-10-05T15:20:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.651+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 msgr2=0x55a068dd7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.651+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068dd7e50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8096cf0 tx=0x7f0ba809aa70 comp rx=0 tx=0).stop 2023-10-05T15:20:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.658+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 shutdown_connections 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.658+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068de7fc0 0x55a068dea3e0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.658+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068dd57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.658+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068dd7e50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.658+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/2573280910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.658+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 >> 172.21.15.60:0/2573280910 conn(0x55a068d42200 msgr2=0x55a068dc8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.659+0000 7f0b97fff700 0 client.16539 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.659+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 shutdown_connections 2023-10-05T15:20:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.659+0000 7f0bcb336b80 1 -- 172.21.15.60:0/2573280910 wait complete. 2023-10-05T15:20:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.659+0000 7f0bcb336b80 20 client.16539 trim_cache size 0 max 16384 2023-10-05T15:20:40.893 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.892+0000 7f0bcb336b80 1 Processor -- start 2023-10-05T15:20:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 -- start start 2023-10-05T15:20:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dccc00 0x55a068dda7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dd4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068ba18c0 con 0x55a068dd83d0 2023-10-05T15:20:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068dc9e60 con 0x55a068dcd520 2023-10-05T15:20:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.901+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068dd0fc0 con 0x55a068dccc00 2023-10-05T15:20:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.909+0000 7f0bb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.909+0000 7f0bb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54122/0 (socket says 172.21.15.60:54122) 2023-10-05T15:20:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.909+0000 7f0bb7fff700 1 -- 172.21.15.60:0/1262006695 learned_addr learned my addr 172.21.15.60:0/1262006695 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.909+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dccc00 0x55a068dda7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.915 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.913+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dd4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.915+0000 7f0bb7fff700 1 -- 172.21.15.60:0/1262006695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dccc00 msgr2=0x55a068dda7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:40.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.915+0000 7f0bb7fff700 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dccc00 0x55a068dda7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.915+0000 7f0bb7fff700 1 -- 172.21.15.60:0/1262006695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 msgr2=0x55a068dd4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.915+0000 7f0bb7fff700 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dd4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.915+0000 7f0bb7fff700 1 -- 172.21.15.60:0/1262006695 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a068b721f0 con 0x55a068dcd520 2023-10-05T15:20:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.915+0000 7f0bb7fff700 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd7980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bb81a76b0 tx=0x7f0bac005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff76f44e376aa25f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:40.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.920+0000 7f0b9f7fe700 1 -- 172.21.15.60:0/1262006695 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017040 con 0x55a068dcd520 2023-10-05T15:20:40.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.920+0000 7f0b9f7fe700 1 -- 172.21.15.60:0/1262006695 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bac01e020 con 0x55a068dcd520 2023-10-05T15:20:40.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.920+0000 7f0b9f7fe700 1 -- 172.21.15.60:0/1262006695 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac011440 con 0x55a068dcd520 2023-10-05T15:20:40.923 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.921+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1262006695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 msgr2=0x55a068dd7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:40.923 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.921+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd7980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bb81a76b0 tx=0x7f0bac005bb0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1262006695 shutdown_connections 2023-10-05T15:20:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dd83d0 0x55a068dd4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dccc00 0x55a068dda7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1262006695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068dd7980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1262006695 >> 172.21.15.60:0/1262006695 conn(0x55a068d42200 msgr2=0x55a068de3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1262006695 shutdown_connections 2023-10-05T15:20:40.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:40 smithi092 ceph-mon[102944]: pgmap v121: 129 pgs: 129 active+clean; 837 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 156 op/s 2023-10-05T15:20:40.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.923+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1262006695 wait complete. 2023-10-05T15:20:40.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.924+0000 7f0bcb336b80 1 -- start start 2023-10-05T15:20:40.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.924+0000 7f0bcb336b80 1 Processor -- start 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068ddaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068ddb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068e3ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068ddbd40 con 0x55a068dccc00 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068e3b2e0 con 0x55a068dcd520 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a068e3b420 con 0x55a068dd83d0 2023-10-05T15:20:40.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.925+0000 7f0bcb336b80 10 client.0 _ll_register_callbacks cb 0x7f0ba8099e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:20:40.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068ddb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068ddb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54128/0 (socket says 172.21.15.60:54128) 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bb7fff700 1 -- 172.21.15.60:0/1737936010 learned_addr learned my addr 172.21.15.60:0/1737936010 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068e3ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068ddaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 msgr2=0x55a068ddb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068ddb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/1737936010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 msgr2=0x55a068ddaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:20:40.935 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068ddaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:40.935 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.932+0000 7f0bbd6e9700 1 -- 172.21.15.60:0/1737936010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac009a50 con 0x55a068dd83d0 2023-10-05T15:20:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:40.938+0000 7f0bbd6e9700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068e3ada0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00079e0 tx=0x7f0bb0003f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4621daa398e4d8a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:20:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.006+0000 7f0b97fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:20:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.006+0000 7f0b97fff700 1 -- 172.21.15.60:0/1737936010 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb000e070 con 0x55a068dd83d0 2023-10-05T15:20:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.006+0000 7f0b97fff700 1 -- 172.21.15.60:0/1737936010 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0bb000b680 con 0x55a068dd83d0 2023-10-05T15:20:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.007+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bb0004c50 con 0x55a068dd83d0 2023-10-05T15:20:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.017+0000 7f0b97fff700 1 -- 172.21.15.60:0/1737936010 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bb0005460 con 0x55a068dd83d0 2023-10-05T15:20:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.017+0000 7f0bcb336b80 10 client.26074 fetch_fsmap learned FSMap version 34 2023-10-05T15:20:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.017+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a068b4a250 con 0x55a068dd83d0 2023-10-05T15:20:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.027+0000 7f0b97fff700 1 -- 172.21.15.60:0/1737936010 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb0004c50 con 0x55a068dd83d0 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.027+0000 7f0b97fff700 1 -- 172.21.15.60:0/1737936010 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0bb001fa40 con 0x55a068dd83d0 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.029+0000 7f0bcb336b80 10 client.26074 fetch_fsmap finished waiting for FSMap version 34 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.029+0000 7f0bcb336b80 10 client.26074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.029+0000 7f0bcb336b80 20 client.26074 populate_metadata read hostname 'smithi060' 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.029+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068e3c910 0x55a068e3ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.029+0000 7f0bcb336b80 4 client.26074 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:20:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.029+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a068d19ad0 con 0x55a068e3c910 2023-10-05T15:20:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.038+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068e3c910 0x55a068e3ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:20:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.048+0000 7f0bbcee8700 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068e3c910 0x55a068e3ed30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca373018b193d07e server_cookie=c27bdbff19646cb1 in_seq=0 out_seq=0 2023-10-05T15:20:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:41.048+0000 7f0b97fff700 10 client.26074 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:41.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:40 smithi135 ceph-mon[103360]: pgmap v121: 129 pgs: 129 active+clean; 837 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 156 op/s 2023-10-05T15:20:41.191 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:40 smithi060 ceph-mon[99238]: pgmap v121: 129 pgs: 129 active+clean; 837 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 156 op/s 2023-10-05T15:20:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.770+0000 7f0b97fff700 1 -- 172.21.15.60:0/1737936010 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a068d19ad0 con 0x55a068e3c910 2023-10-05T15:20:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.770+0000 7f0b97fff700 10 client.26074 handle_command_reply: tid=0 2023-10-05T15:20:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.770+0000 7f0bcb336b80 1 client.26074 shutdown 2023-10-05T15:20:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 msgr2=0x55a068e3ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068e3ada0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00079e0 tx=0x7f0bb0003f50 comp rx=0 tx=0).stop 2023-10-05T15:20:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 shutdown_connections 2023-10-05T15:20:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a068e3c910 0x55a068e3ed30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a068dd83d0 0x55a068e3ada0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a068dccc00 0x55a068ddaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 --2- 172.21.15.60:0/1737936010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a068dcd520 0x55a068ddb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 >> 172.21.15.60:0/1737936010 conn(0x55a068d42200 msgr2=0x55a068dd0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.773+0000 7f0b97fff700 0 client.26074 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:20:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.776+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 shutdown_connections 2023-10-05T15:20:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.777+0000 7f0bcb336b80 1 -- 172.21.15.60:0/1737936010 wait complete. 2023-10-05T15:20:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.777+0000 7f0bcb336b80 20 client.26074 trim_cache size 0 max 16384 2023-10-05T15:20:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:20:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:20:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:20:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:20:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.800+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0ba00a1800 msgr2=0x7f0ba00a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.800+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0ba00a1800 0x7f0ba00a3cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000cfb0 tx=0x7f0bb000ca00 comp rx=0 tx=0).stop 2023-10-05T15:20:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.800+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 msgr2=0x7f0bb81a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:20:43.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.800+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 0x7f0bb81a5e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800e9c0 tx=0x7f0ba800ed80 comp rx=0 tx=0).stop 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 shutdown_connections 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bb81aaa40 0x7f0bb81aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0ba00a1800 0x7f0ba00a3cc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb810f620 0x7f0bb81a5e90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 --2- 172.21.15.60:0/904255944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bb811a690 0x7f0bb81a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 >> 172.21.15.60:0/904255944 conn(0x7f0bb806cfa0 msgr2=0x7f0bb810d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:20:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.817+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 shutdown_connections 2023-10-05T15:20:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:20:43.818+0000 7f0bbf14c700 1 -- 172.21.15.60:0/904255944 wait complete. 2023-10-05T15:20:43.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:43 smithi135 ceph-mon[103360]: pgmap v122: 129 pgs: 129 active+clean; 841 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 232 op/s 2023-10-05T15:20:43.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:43 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:43.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:43 smithi060 ceph-mon[99238]: pgmap v122: 129 pgs: 129 active+clean; 841 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 232 op/s 2023-10-05T15:20:43.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:43 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:43.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:43 smithi092 ceph-mon[102944]: pgmap v122: 129 pgs: 129 active+clean; 841 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 232 op/s 2023-10-05T15:20:43.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:43 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:20:45.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:45 smithi135 ceph-mon[103360]: pgmap v123: 129 pgs: 129 active+clean; 843 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 307 op/s 2023-10-05T15:20:45.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:45 smithi092 ceph-mon[102944]: pgmap v123: 129 pgs: 129 active+clean; 843 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 307 op/s 2023-10-05T15:20:45.930 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:45 smithi060 ceph-mon[99238]: pgmap v123: 129 pgs: 129 active+clean; 843 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 307 op/s 2023-10-05T15:20:47.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:47 smithi135 ceph-mon[103360]: pgmap v124: 129 pgs: 129 active+clean; 848 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 334 op/s 2023-10-05T15:20:47.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:47 smithi060 ceph-mon[99238]: pgmap v124: 129 pgs: 129 active+clean; 848 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 334 op/s 2023-10-05T15:20:47.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:47 smithi092 ceph-mon[102944]: pgmap v124: 129 pgs: 129 active+clean; 848 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 334 op/s 2023-10-05T15:20:48.252 INFO:tasks.workunit.client.0.smithi060.stdout: 235 1478170 419 1008712 478 472569 648 2023-10-05T15:20:49.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:49 smithi135 ceph-mon[103360]: pgmap v125: 129 pgs: 129 active+clean; 922 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.0 MiB/s wr, 944 op/s 2023-10-05T15:20:49.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:49 smithi092 ceph-mon[102944]: pgmap v125: 129 pgs: 129 active+clean; 922 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.0 MiB/s wr, 944 op/s 2023-10-05T15:20:49.930 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:49 smithi060 ceph-mon[99238]: pgmap v125: 129 pgs: 129 active+clean; 922 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.0 MiB/s wr, 944 op/s 2023-10-05T15:20:51.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:51 smithi135 ceph-mon[103360]: pgmap v126: 129 pgs: 129 active+clean; 940 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.5 MiB/s wr, 938 op/s 2023-10-05T15:20:51.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:51 smithi092 ceph-mon[102944]: pgmap v126: 129 pgs: 129 active+clean; 940 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.5 MiB/s wr, 938 op/s 2023-10-05T15:20:51.953 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:51 smithi060 ceph-mon[99238]: pgmap v126: 129 pgs: 129 active+clean; 940 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.5 MiB/s wr, 938 op/s 2023-10-05T15:20:53.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:53 smithi135 ceph-mon[103360]: pgmap v127: 129 pgs: 129 active+clean; 950 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.00k op/s 2023-10-05T15:20:53.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:53 smithi092 ceph-mon[102944]: pgmap v127: 129 pgs: 129 active+clean; 950 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.00k op/s 2023-10-05T15:20:53.944 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:53 smithi060 ceph-mon[99238]: pgmap v127: 129 pgs: 129 active+clean; 950 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.00k op/s 2023-10-05T15:20:55.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:55 smithi060 ceph-mon[99238]: pgmap v128: 129 pgs: 129 active+clean; 953 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 952 op/s 2023-10-05T15:20:55.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:55 smithi092 ceph-mon[102944]: pgmap v128: 129 pgs: 129 active+clean; 953 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 952 op/s 2023-10-05T15:20:56.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:55 smithi135 ceph-mon[103360]: pgmap v128: 129 pgs: 129 active+clean; 953 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 952 op/s 2023-10-05T15:20:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:57 smithi092 ceph-mon[102944]: pgmap v129: 129 pgs: 129 active+clean; 953 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-10-05T15:20:58.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:57 smithi135 ceph-mon[103360]: pgmap v129: 129 pgs: 129 active+clean; 953 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-10-05T15:20:58.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:57 smithi060 ceph-mon[99238]: pgmap v129: 129 pgs: 129 active+clean; 953 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-10-05T15:20:58.330 INFO:tasks.workunit.client.0.smithi060.stdout: 246 2176701 660 1502820 669 686507 484 2023-10-05T15:20:59.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:58 smithi135 ceph-mon[103360]: pgmap v130: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 857 op/s 2023-10-05T15:20:59.171 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:58 smithi060 ceph-mon[99238]: pgmap v130: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 857 op/s 2023-10-05T15:20:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:58 smithi092 ceph-mon[102944]: pgmap v130: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 857 op/s 2023-10-05T15:21:00.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:20:59 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:21:00.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:20:59 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:21:00.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:20:59 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:21:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.246+0000 7f604dbc2700 1 -- 172.21.15.60:0/1666167893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604811a690 msgr2=0x7f604811ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.246+0000 7f604dbc2700 1 --2- 172.21.15.60:0/1666167893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604811a690 0x7f604811ca80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6040009f90 tx=0x7f604000b330 comp rx=0 tx=0).stop 2023-10-05T15:21:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.252+0000 7f604dbc2700 1 -- 172.21.15.60:0/1666167893 shutdown_connections 2023-10-05T15:21:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.252+0000 7f604dbc2700 1 --2- 172.21.15.60:0/1666167893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604811a690 0x7f604811ca80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.252+0000 7f604dbc2700 1 --2- 172.21.15.60:0/1666167893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604810f620 0x7f6048107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.252+0000 7f604dbc2700 1 --2- 172.21.15.60:0/1666167893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f604810fa90 0x7f60481083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.252+0000 7f604dbc2700 1 -- 172.21.15.60:0/1666167893 >> 172.21.15.60:0/1666167893 conn(0x7f604806cfa0 msgr2=0x7f604806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.263+0000 7f604dbc2700 1 -- 172.21.15.60:0/1666167893 shutdown_connections 2023-10-05T15:21:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.263+0000 7f604dbc2700 1 -- 172.21.15.60:0/1666167893 wait complete. 2023-10-05T15:21:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.264+0000 7f604dbc2700 1 Processor -- start 2023-10-05T15:21:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.264+0000 7f604dbc2700 1 -- start start 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.265+0000 7f604dbc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604810f620 0x7f6048119a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.265+0000 7f604dbc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f604810fa90 0x7f6048119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.265+0000 7f604dbc2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 0x7f6048113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.265+0000 7f604dbc2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048113ff0 con 0x7f604810f620 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.265+0000 7f604dbc2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048114160 con 0x7f604811a690 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.265+0000 7f604dbc2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048114320 con 0x7f604810fa90 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 0x7f6048113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 0x7f6048113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54142/0 (socket says 172.21.15.60:54142) 2023-10-05T15:21:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 -- 172.21.15.60:0/664917006 learned_addr learned my addr 172.21.15.60:0/664917006 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 -- 172.21.15.60:0/664917006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f604810fa90 msgr2=0x7f6048119f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:21:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f604810fa90 0x7f6048119f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 -- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604810f620 msgr2=0x7f6048119a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604810f620 0x7f6048119a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.266+0000 7f6047fff700 1 -- 172.21.15.60:0/664917006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009c40 con 0x7f604811a690 2023-10-05T15:21:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.277+0000 7f6047fff700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 0x7f6048113820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6040004c60 tx=0x7f6040004c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.402+0000 7f6044ff9700 1 -- 172.21.15.60:0/664917006 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000e040 con 0x7f604811a690 2023-10-05T15:21:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.402+0000 7f6044ff9700 1 -- 172.21.15.60:0/664917006 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6040007910 con 0x7f604811a690 2023-10-05T15:21:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.402+0000 7f6044ff9700 1 -- 172.21.15.60:0/664917006 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604001b7c0 con 0x7f604811a690 2023-10-05T15:21:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.407+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60481145a0 con 0x7f604811a690 2023-10-05T15:21:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.407+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60481bb470 con 0x7f604811a690 2023-10-05T15:21:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.413+0000 7f6059dacb80 1 Processor -- start 2023-10-05T15:21:00.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.413+0000 7f6059dacb80 1 -- start start 2023-10-05T15:21:00.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca93cc00 0x55efca93cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca947e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca9483d0 0x55efca94a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6059dacb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca8a6400 con 0x55efca93cc00 2023-10-05T15:21:00.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6059dacb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca897bc0 con 0x55efca9483d0 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6059dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca8954e0 con 0x55efca93d520 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.414+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca9483d0 0x55efca94a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca9483d0 0x55efca94a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54148/0 (socket says 172.21.15.60:54148) 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f6046ffd700 1 -- 172.21.15.60:0/3513818921 learned_addr learned my addr 172.21.15.60:0/3513818921 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f60477fe700 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca947e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f60477fe700 1 -- 172.21.15.60:0/3513818921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca9483d0 msgr2=0x55efca94a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f60477fe700 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca9483d0 0x55efca94a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f60477fe700 1 -- 172.21.15.60:0/3513818921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca93cc00 msgr2=0x55efca93cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f60477fe700 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca93cc00 0x55efca93cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.415+0000 7f60477fe700 1 -- 172.21.15.60:0/3513818921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efca6bbd80 con 0x55efca93d520 2023-10-05T15:21:00.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.417+0000 7f6044ff9700 1 -- 172.21.15.60:0/664917006 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f604001da30 con 0x7f604811a690 2023-10-05T15:21:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.418+0000 7f6044ff9700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60300a1800 0x7f60300a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.418+0000 7f6044ff9700 1 -- 172.21.15.60:0/664917006 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f60400cde60 con 0x7f604811a690 2023-10-05T15:21:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.419+0000 7f60477fe700 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca947e90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f603800baa0 tx=0x7f603800bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d855d380f40d94af server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.419+0000 7f6046ffd700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60300a1800 0x7f60300a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.420+0000 7f6035ffb700 1 -- 172.21.15.60:0/3513818921 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038004220 con 0x55efca93d520 2023-10-05T15:21:00.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.420+0000 7f6035ffb700 1 -- 172.21.15.60:0/3513818921 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603800b580 con 0x55efca93d520 2023-10-05T15:21:00.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.420+0000 7f6035ffb700 1 -- 172.21.15.60:0/3513818921 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800dd90 con 0x55efca93d520 2023-10-05T15:21:00.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.422+0000 7f6059dacb80 1 -- 172.21.15.60:0/3513818921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 msgr2=0x55efca947e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:00.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.422+0000 7f6059dacb80 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca947e90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f603800baa0 tx=0x7f603800bdb0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.426+0000 7f6059dacb80 1 -- 172.21.15.60:0/3513818921 shutdown_connections 2023-10-05T15:21:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.426+0000 7f6059dacb80 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca9483d0 0x55efca94a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.426+0000 7f6059dacb80 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca93cc00 0x55efca93cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.426+0000 7f6059dacb80 1 --2- 172.21.15.60:0/3513818921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca947e90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.426+0000 7f6059dacb80 1 -- 172.21.15.60:0/3513818921 >> 172.21.15.60:0/3513818921 conn(0x55efca8b2200 msgr2=0x55efca939080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.436+0000 7f6046ffd700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60300a1800 0x7f60300a3cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f603c00cb10 tx=0x7f603c00c3d0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.436+0000 7f6059dacb80 1 -- 172.21.15.60:0/3513818921 shutdown_connections 2023-10-05T15:21:00.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.436+0000 7f6059dacb80 1 -- 172.21.15.60:0/3513818921 wait complete. 2023-10-05T15:21:00.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.437+0000 7f6059dacb80 1 -- start start 2023-10-05T15:21:00.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.437+0000 7f6059dacb80 1 Processor -- start 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93cc00 0x55efca945260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca9457a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca945ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca890dd0 con 0x55efca9483d0 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca82d6b0 con 0x55efca93cc00 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca82d350 con 0x55efca93d520 2023-10-05T15:21:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.438+0000 7f6059dacb80 10 client.0 _ll_register_callbacks cb 0x55efca68a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.449+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca9457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.449+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca9457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54266/0 (socket says 172.21.15.60:54266) 2023-10-05T15:21:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.449+0000 7f6046ffd700 1 -- 172.21.15.60:0/1439658091 learned_addr learned my addr 172.21.15.60:0/1439658091 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.449+0000 7f6047fff700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca945ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.449+0000 7f60477fe700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93cc00 0x55efca945260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.459+0000 7f6047fff700 1 -- 172.21.15.60:0/1439658091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 msgr2=0x55efca9457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.459+0000 7f6047fff700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca9457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.459+0000 7f6047fff700 1 -- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93cc00 msgr2=0x55efca945260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.459+0000 7f6047fff700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93cc00 0x55efca945260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.459+0000 7f6047fff700 1 -- 172.21.15.60:0/1439658091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603800b700 con 0x55efca9483d0 2023-10-05T15:21:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.466+0000 7f6047fff700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca945ce0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f60400cb230 tx=0x7f604009b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94c886559ee7b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.481+0000 7f602affd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:21:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.481+0000 7f602affd700 1 -- 172.21.15.60:0/1439658091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400a2e50 con 0x55efca9483d0 2023-10-05T15:21:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.481+0000 7f602affd700 1 -- 172.21.15.60:0/1439658091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f604009a040 con 0x55efca9483d0 2023-10-05T15:21:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.481+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efca889db0 con 0x55efca9483d0 2023-10-05T15:21:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.494+0000 7f602affd700 1 -- 172.21.15.60:0/1439658091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f604009a200 con 0x55efca9483d0 2023-10-05T15:21:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.494+0000 7f6059dacb80 10 client.16551 fetch_fsmap learned FSMap version 35 2023-10-05T15:21:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.494+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55efca6a4c00 con 0x55efca9483d0 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.501+0000 7f602affd700 1 -- 172.21.15.60:0/1439658091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55efca889db0 con 0x55efca9483d0 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.501+0000 7f602affd700 1 -- 172.21.15.60:0/1439658091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f6040099ab0 con 0x55efca9483d0 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.502+0000 7f6059dacb80 10 client.16551 fetch_fsmap finished waiting for FSMap version 35 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.502+0000 7f6059dacb80 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.502+0000 7f6059dacb80 20 client.16551 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.502+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca957e40 0x55efca95a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.502+0000 7f6059dacb80 4 client.16551 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:21:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.502+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efca889ad0 con 0x55efca957e40 2023-10-05T15:21:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.503+0000 7f60477fe700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca957e40 0x55efca95a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.542+0000 7f60477fe700 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca957e40 0x55efca95a260 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e31f220b156f3349 server_cookie=eca028155ad25b92 in_seq=0 out_seq=0 2023-10-05T15:21:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.553+0000 7f602affd700 10 client.16551 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.564+0000 7f602affd700 1 -- 172.21.15.60:0/1439658091 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55efca889ad0 con 0x55efca957e40 2023-10-05T15:21:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.564+0000 7f602affd700 10 client.16551 handle_command_reply: tid=0 2023-10-05T15:21:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.575+0000 7f6059dacb80 1 client.16551 shutdown 2023-10-05T15:21:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.576+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 msgr2=0x55efca945ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.576+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca945ce0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f60400cb230 tx=0x7f604009b340 comp rx=0 tx=0).stop 2023-10-05T15:21:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 shutdown_connections 2023-10-05T15:21:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca957e40 0x55efca95a260 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca945ce0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93cc00 0x55efca945260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1439658091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93d520 0x55efca9457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 >> 172.21.15.60:0/1439658091 conn(0x55efca8b2200 msgr2=0x55efca938c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f602affd700 0 client.16551 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 shutdown_connections 2023-10-05T15:21:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 1 -- 172.21.15.60:0/1439658091 wait complete. 2023-10-05T15:21:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.577+0000 7f6059dacb80 20 client.16551 trim_cache size 0 max 16384 2023-10-05T15:21:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.758+0000 7f6059dacb80 1 Processor -- start 2023-10-05T15:21:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 -- start start 2023-10-05T15:21:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca94ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 0x55efca959e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca7118c0 con 0x55efca9483d0 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca930890 con 0x55efca93d520 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.759+0000 7f6059dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca939df0 con 0x55efca93cc00 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 0x55efca959e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 0x55efca959e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54164/0 (socket says 172.21.15.60:54164) 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 -- 172.21.15.60:0/407014352 learned_addr learned my addr 172.21.15.60:0/407014352 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f60477fe700 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca94ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 -- 172.21.15.60:0/407014352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 msgr2=0x55efca94ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca94ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 -- 172.21.15.60:0/407014352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 msgr2=0x55efca9404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.760+0000 7f6046ffd700 1 -- 172.21.15.60:0/407014352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efca6e21f0 con 0x55efca93d520 2023-10-05T15:21:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.761+0000 7f6046ffd700 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 0x55efca959e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f603c010c30 tx=0x7f603c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=102133ca2719a896 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.838+0000 7f60367fc700 1 -- 172.21.15.60:0/407014352 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0128e0 con 0x55efca93d520 2023-10-05T15:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.838+0000 7f60367fc700 1 -- 172.21.15.60:0/407014352 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603c029470 con 0x55efca93d520 2023-10-05T15:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.838+0000 7f60367fc700 1 -- 172.21.15.60:0/407014352 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c020690 con 0x55efca93d520 2023-10-05T15:21:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.839+0000 7f6059dacb80 1 -- 172.21.15.60:0/407014352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 msgr2=0x55efca959e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.839+0000 7f6059dacb80 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 0x55efca959e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f603c010c30 tx=0x7f603c013000 comp rx=0 tx=0).stop 2023-10-05T15:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.840+0000 7f6059dacb80 1 -- 172.21.15.60:0/407014352 shutdown_connections 2023-10-05T15:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.840+0000 7f6059dacb80 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.840+0000 7f6059dacb80 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca94ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.840+0000 7f6059dacb80 1 --2- 172.21.15.60:0/407014352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca93d520 0x55efca959e50 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f603c010c30 tx=0x7f603c013000 comp rx=0 tx=0).stop 2023-10-05T15:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.840+0000 7f6059dacb80 1 -- 172.21.15.60:0/407014352 >> 172.21.15.60:0/407014352 conn(0x55efca8b2200 msgr2=0x55efca945a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.862+0000 7f6059dacb80 1 -- 172.21.15.60:0/407014352 shutdown_connections 2023-10-05T15:21:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.862+0000 7f6059dacb80 1 -- 172.21.15.60:0/407014352 wait complete. 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.863+0000 7f6059dacb80 1 -- start start 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.863+0000 7f6059dacb80 1 Processor -- start 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca9a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca99fc00 0x55efca9a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca9a05c0 con 0x55efca9483d0 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca9a0730 con 0x55efca99fc00 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efca9a08a0 con 0x55efca93cc00 2023-10-05T15:21:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.864+0000 7f6059dacb80 10 client.0 _ll_register_callbacks cb 0x7f604009a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.867+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.867+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40748/0 (socket says 172.21.15.60:40748) 2023-10-05T15:21:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.867+0000 7f6046ffd700 1 -- 172.21.15.60:0/1627993358 learned_addr learned my addr 172.21.15.60:0/1627993358 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.871+0000 7f6047fff700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca99fc00 0x55efca9a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.871+0000 7f60477fe700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca9a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.872+0000 7f6047fff700 1 -- 172.21.15.60:0/1627993358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 msgr2=0x55efca9a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.872+0000 7f6047fff700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca9a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.872+0000 7f6047fff700 1 -- 172.21.15.60:0/1627993358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 msgr2=0x55efca9a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.872+0000 7f6047fff700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.872+0000 7f6047fff700 1 -- 172.21.15.60:0/1627993358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c0108e0 con 0x55efca99fc00 2023-10-05T15:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:00.878+0000 7f6047fff700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca99fc00 0x55efca9a0080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6040098ea0 tx=0x7f604009ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6845c49dd7f01bd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:01.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:00 smithi135 ceph-mon[103360]: pgmap v131: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 249 op/s 2023-10-05T15:21:01.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:00 smithi060 ceph-mon[99238]: pgmap v131: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 249 op/s 2023-10-05T15:21:01.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:00 smithi092 ceph-mon[102944]: pgmap v131: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 249 op/s 2023-10-05T15:21:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.294+0000 7f602affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:21:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.294+0000 7f602affd700 1 -- 172.21.15.60:0/1627993358 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040004e60 con 0x55efca99fc00 2023-10-05T15:21:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.294+0000 7f602affd700 1 -- 172.21.15.60:0/1627993358 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f604009b250 con 0x55efca99fc00 2023-10-05T15:21:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.294+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efca930d50 con 0x55efca99fc00 2023-10-05T15:21:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.313+0000 7f602affd700 1 -- 172.21.15.60:0/1627993358 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60400a2e50 con 0x55efca99fc00 2023-10-05T15:21:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.315+0000 7f6059dacb80 10 client.26210 fetch_fsmap learned FSMap version 35 2023-10-05T15:21:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.315+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55efca6ba250 con 0x55efca99fc00 2023-10-05T15:21:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.322+0000 7f602affd700 1 -- 172.21.15.60:0/1627993358 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55efca930d50 con 0x55efca99fc00 2023-10-05T15:21:01.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.323+0000 7f602affd700 1 -- 172.21.15.60:0/1627993358 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f604001d470 con 0x55efca99fc00 2023-10-05T15:21:01.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f6059dacb80 10 client.26210 fetch_fsmap finished waiting for FSMap version 35 2023-10-05T15:21:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f6059dacb80 10 client.26210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f6059dacb80 20 client.26210 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca9cef60 0x55efca9d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f6059dacb80 4 client.26210 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:21:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55efca6dcf10 con 0x55efca9cef60 2023-10-05T15:21:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.324+0000 7f60477fe700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca9cef60 0x55efca9d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.325+0000 7f60477fe700 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca9cef60 0x55efca9d1350 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c48ac40fd27be83 server_cookie=accccd7540590142 in_seq=0 out_seq=0 2023-10-05T15:21:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:01.374+0000 7f602affd700 10 client.26210 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:03.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:03 smithi135 ceph-mon[103360]: pgmap v132: 129 pgs: 129 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 193 op/s 2023-10-05T15:21:03.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:03 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:21:03.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:03 smithi060 ceph-mon[99238]: pgmap v132: 129 pgs: 129 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 193 op/s 2023-10-05T15:21:03.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:03 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:21:03.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:03 smithi092 ceph-mon[102944]: pgmap v132: 129 pgs: 129 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 193 op/s 2023-10-05T15:21:03.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:03 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:21:05.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:05 smithi135 ceph-mon[103360]: pgmap v133: 129 pgs: 129 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 211 op/s 2023-10-05T15:21:05.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:05 smithi092 ceph-mon[102944]: pgmap v133: 129 pgs: 129 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 211 op/s 2023-10-05T15:21:05.956 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:05 smithi060 ceph-mon[99238]: pgmap v133: 129 pgs: 129 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 211 op/s 2023-10-05T15:21:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:07 smithi135 ceph-mon[103360]: pgmap v134: 129 pgs: 129 active+clean; 965 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2023-10-05T15:21:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:07 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:21:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:07 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:21:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:07 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:21:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:07 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:21:07.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:07 smithi060 ceph-mon[99238]: pgmap v134: 129 pgs: 129 active+clean; 965 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2023-10-05T15:21:07.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:07 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:21:07.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:07 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:21:07.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:07 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:21:07.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:07 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:21:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:07 smithi092 ceph-mon[102944]: pgmap v134: 129 pgs: 129 active+clean; 965 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2023-10-05T15:21:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:07 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:21:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:07 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:21:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:07 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:21:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:07 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:21:08.330 INFO:tasks.workunit.client.0.smithi060.stdout: 257 1804818 394 1248047 582 568006 526 2023-10-05T15:21:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:21:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:21:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:21:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:21:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.498+0000 7f602affd700 1 -- 172.21.15.60:0/1627993358 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55efca6dcf10 con 0x55efca9cef60 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.498+0000 7f602affd700 10 client.26210 handle_command_reply: tid=0 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.498+0000 7f6059dacb80 1 client.26210 shutdown 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca99fc00 msgr2=0x55efca9a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca99fc00 0x55efca9a0080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6040098ea0 tx=0x7f604009ac00 comp rx=0 tx=0).stop 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 shutdown_connections 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55efca9cef60 0x55efca9d1350 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55efca99fc00 0x55efca9a0080 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efca93cc00 0x55efca9a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 --2- 172.21.15.60:0/1627993358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55efca9483d0 0x55efca9a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 >> 172.21.15.60:0/1627993358 conn(0x55efca8b2200 msgr2=0x55efca945a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.499+0000 7f602affd700 0 client.26210 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.500+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 shutdown_connections 2023-10-05T15:21:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.500+0000 7f6059dacb80 1 -- 172.21.15.60:0/1627993358 wait complete. 2023-10-05T15:21:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.500+0000 7f6059dacb80 20 client.26210 trim_cache size 0 max 16384 2023-10-05T15:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.513+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60300a1800 msgr2=0x7f60300a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.513+0000 7f604dbc2700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60300a1800 0x7f60300a3cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f603c00cb10 tx=0x7f603c00c3d0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.513+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 msgr2=0x7f6048113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.513+0000 7f604dbc2700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 0x7f6048113820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6040004c60 tx=0x7f6040004c90 comp rx=0 tx=0).stop 2023-10-05T15:21:08.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.519+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 shutdown_connections 2023-10-05T15:21:08.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.519+0000 7f604dbc2700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60300a1800 0x7f60300a3cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.519+0000 7f604dbc2700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f604811a690 0x7f6048113820 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.519+0000 7f604dbc2700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f604810f620 0x7f6048119a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.519+0000 7f604dbc2700 1 --2- 172.21.15.60:0/664917006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f604810fa90 0x7f6048119f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.519+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 >> 172.21.15.60:0/664917006 conn(0x7f604806cfa0 msgr2=0x7f60480718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.529+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 shutdown_connections 2023-10-05T15:21:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:08.529+0000 7f604dbc2700 1 -- 172.21.15.60:0/664917006 wait complete. 2023-10-05T15:21:09.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:09 smithi060 ceph-mon[99238]: pgmap v135: 129 pgs: 129 active+clean; 1009 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.1 MiB/s wr, 653 op/s 2023-10-05T15:21:09.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:09 smithi092 ceph-mon[102944]: pgmap v135: 129 pgs: 129 active+clean; 1009 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.1 MiB/s wr, 653 op/s 2023-10-05T15:21:10.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:09 smithi135 ceph-mon[103360]: pgmap v135: 129 pgs: 129 active+clean; 1009 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.1 MiB/s wr, 653 op/s 2023-10-05T15:21:10.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:10 smithi060 ceph-mon[99238]: pgmap v136: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.6 MiB/s wr, 693 op/s 2023-10-05T15:21:10.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:10 smithi092 ceph-mon[102944]: pgmap v136: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.6 MiB/s wr, 693 op/s 2023-10-05T15:21:11.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:10 smithi135 ceph-mon[103360]: pgmap v136: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.6 MiB/s wr, 693 op/s 2023-10-05T15:21:12.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:12 smithi135 ceph-mon[103360]: pgmap v137: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 748 op/s 2023-10-05T15:21:12.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:12 smithi060 ceph-mon[99238]: pgmap v137: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 748 op/s 2023-10-05T15:21:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:12 smithi092 ceph-mon[102944]: pgmap v137: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 748 op/s 2023-10-05T15:21:14.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:13 smithi092 ceph-mon[102944]: pgmap v138: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 786 op/s 2023-10-05T15:21:14.176 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:13 smithi060 ceph-mon[99238]: pgmap v138: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 786 op/s 2023-10-05T15:21:14.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:13 smithi135 ceph-mon[103360]: pgmap v138: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 786 op/s 2023-10-05T15:21:16.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:15 smithi060 ceph-mon[99238]: pgmap v139: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.0 MiB/s wr, 729 op/s 2023-10-05T15:21:16.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:15 smithi092 ceph-mon[102944]: pgmap v139: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.0 MiB/s wr, 729 op/s 2023-10-05T15:21:16.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:15 smithi135 ceph-mon[103360]: pgmap v139: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.0 MiB/s wr, 729 op/s 2023-10-05T15:21:18.173 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:17 smithi060 ceph-mon[99238]: pgmap v140: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.3 MiB/s wr, 713 op/s 2023-10-05T15:21:18.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:17 smithi092 ceph-mon[102944]: pgmap v140: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.3 MiB/s wr, 713 op/s 2023-10-05T15:21:18.330 INFO:tasks.workunit.client.0.smithi060.stdout: 266 2199016 735 1521677 590 713643 953 2023-10-05T15:21:18.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:17 smithi135 ceph-mon[103360]: pgmap v140: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.3 MiB/s wr, 713 op/s 2023-10-05T15:21:20.175 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:19 smithi060 ceph-mon[99238]: pgmap v141: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 351 op/s 2023-10-05T15:21:20.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:19 smithi092 ceph-mon[102944]: pgmap v141: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 351 op/s 2023-10-05T15:21:20.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:19 smithi135 ceph-mon[103360]: pgmap v141: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 351 op/s 2023-10-05T15:21:22.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:22 smithi135 ceph-mon[103360]: pgmap v142: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 298 op/s 2023-10-05T15:21:22.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:22 smithi060 ceph-mon[99238]: pgmap v142: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 298 op/s 2023-10-05T15:21:22.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:22 smithi092 ceph-mon[102944]: pgmap v142: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 298 op/s 2023-10-05T15:21:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.061+0000 7ffb1c038700 1 -- 172.21.15.60:0/2969424204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1411a690 msgr2=0x7ffb1411ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.061+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2969424204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1411a690 0x7ffb1411ca80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b0a0 tx=0x7ffb0c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.062+0000 7ffb1c038700 1 -- 172.21.15.60:0/2969424204 shutdown_connections 2023-10-05T15:21:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.062+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2969424204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1411a690 0x7ffb1411ca80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.062+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2969424204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.062+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2969424204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1410fa90 0x7ffb141083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.062+0000 7ffb1c038700 1 -- 172.21.15.60:0/2969424204 >> 172.21.15.60:0/2969424204 conn(0x7ffb1406cfa0 msgr2=0x7ffb1406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:23.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.074+0000 7ffb1c038700 1 -- 172.21.15.60:0/2969424204 shutdown_connections 2023-10-05T15:21:23.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.074+0000 7ffb1c038700 1 -- 172.21.15.60:0/2969424204 wait complete. 2023-10-05T15:21:23.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 Processor -- start 2023-10-05T15:21:23.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 -- start start 2023-10-05T15:21:23.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14118ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1410fa90 0x7ffb14119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1411a690 0x7ffb14111a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb141121d0 con 0x7ffb1410f620 2023-10-05T15:21:23.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14112340 con 0x7ffb1410fa90 2023-10-05T15:21:23.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.076+0000 7ffb1c038700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14112500 con 0x7ffb1411a690 2023-10-05T15:21:23.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.077+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14118ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.077+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14118ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40760/0 (socket says 172.21.15.60:40760) 2023-10-05T15:21:23.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.077+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2331075318 learned_addr learned my addr 172.21.15.60:0/2331075318 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:23.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.077+0000 7ffb1a5d5700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1411a690 0x7ffb14111a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.077+0000 7ffb195d3700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1410fa90 0x7ffb14119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.081+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2331075318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1411a690 msgr2=0x7ffb14111a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.081+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1411a690 0x7ffb14111a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.081+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2331075318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1410fa90 msgr2=0x7ffb14119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.081+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1410fa90 0x7ffb14119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.081+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2331075318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009d00 con 0x7ffb1410f620 2023-10-05T15:21:23.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.084+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14118ad0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e9a0 tx=0x7ffb1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.211+0000 7ffb0affd700 1 -- 172.21.15.60:0/2331075318 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10009790 con 0x7ffb1410f620 2023-10-05T15:21:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.211+0000 7ffb0affd700 1 -- 172.21.15.60:0/2331075318 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb10010430 con 0x7ffb1410f620 2023-10-05T15:21:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.211+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb14116660 con 0x7ffb1410f620 2023-10-05T15:21:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.211+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14116b70 con 0x7ffb1410f620 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.221+0000 7ffb0affd700 1 -- 172.21.15.60:0/2331075318 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10018680 con 0x7ffb1410f620 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.221+0000 7ffb0affd700 1 -- 172.21.15.60:0/2331075318 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ffb100188a0 con 0x7ffb1410f620 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.223+0000 7ffb28222b80 1 Processor -- start 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.232+0000 7ffb28222b80 1 -- start start 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.232+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde28c00 0x561efde28fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.233+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde33e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.233+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde343d0 0x561efde367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.233+0000 7ffb28222b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdd92400 con 0x561efde343d0 2023-10-05T15:21:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.233+0000 7ffb28222b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdd83bc0 con 0x561efde29520 2023-10-05T15:21:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.233+0000 7ffb28222b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdd814e0 con 0x561efde28c00 2023-10-05T15:21:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.234+0000 7ffb195d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde343d0 0x561efde367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.234+0000 7ffb1a5d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde28c00 0x561efde28fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.234+0000 7ffb195d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde343d0 0x561efde367c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40766/0 (socket says 172.21.15.60:40766) 2023-10-05T15:21:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.234+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde33e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.234+0000 7ffb195d3700 1 -- 172.21.15.60:0/2241155305 learned_addr learned my addr 172.21.15.60:0/2241155305 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.240+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2241155305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde28c00 msgr2=0x561efde28fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.240+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde28c00 0x561efde28fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.240+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2241155305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde343d0 msgr2=0x561efde367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.240+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde343d0 0x561efde367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.240+0000 7ffb19dd4700 1 -- 172.21.15.60:0/2241155305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561efdba7d80 con 0x561efde29520 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.242+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde33e90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb100cb9d0 tx=0x7ffb10014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60be4acd577baff server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.243+0000 7ffb0affd700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ffb000a1880 0x7ffb000a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.243+0000 7ffb0affd700 1 -- 172.21.15.60:0/2331075318 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ffb10014070 con 0x7ffb1410f620 2023-10-05T15:21:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.246+0000 7ffb1a5d5700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ffb000a1880 0x7ffb000a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.275+0000 7ffafffff700 1 -- 172.21.15.60:0/2241155305 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000ce80 con 0x561efde29520 2023-10-05T15:21:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.275+0000 7ffafffff700 1 -- 172.21.15.60:0/2241155305 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb100975a0 con 0x561efde29520 2023-10-05T15:21:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.275+0000 7ffafffff700 1 -- 172.21.15.60:0/2241155305 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1009b260 con 0x561efde29520 2023-10-05T15:21:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.276+0000 7ffb28222b80 1 -- 172.21.15.60:0/2241155305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 msgr2=0x561efde33e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.276+0000 7ffb28222b80 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde33e90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb100cb9d0 tx=0x7ffb10014000 comp rx=0 tx=0).stop 2023-10-05T15:21:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.281+0000 7ffb1a5d5700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ffb000a1880 0x7ffb000a3d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009fd0 tx=0x7ffb0c00b740 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.287+0000 7ffb28222b80 1 -- 172.21.15.60:0/2241155305 shutdown_connections 2023-10-05T15:21:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.287+0000 7ffb28222b80 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde343d0 0x561efde367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.287+0000 7ffb28222b80 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde28c00 0x561efde28fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.287+0000 7ffb28222b80 1 --2- 172.21.15.60:0/2241155305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde33e90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.287+0000 7ffb28222b80 1 -- 172.21.15.60:0/2241155305 >> 172.21.15.60:0/2241155305 conn(0x561efdd9e200 msgr2=0x561efde25080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.291+0000 7ffb28222b80 1 -- 172.21.15.60:0/2241155305 shutdown_connections 2023-10-05T15:21:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.296+0000 7ffb28222b80 1 -- 172.21.15.60:0/2241155305 wait complete. 2023-10-05T15:21:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.297+0000 7ffb28222b80 1 -- start start 2023-10-05T15:21:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.297+0000 7ffb28222b80 1 Processor -- start 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde33e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde29520 0x561efde31090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde343d0 0x561efde317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdd7cdd0 con 0x561efde28c00 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdd196b0 con 0x561efde343d0 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdd19350 con 0x561efde29520 2023-10-05T15:21:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.299+0000 7ffb28222b80 10 client.0 _ll_register_callbacks cb 0x561efdb767a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.302+0000 7ffb195d3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde29520 0x561efde31090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.302+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde33e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.302+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde33e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40776/0 (socket says 172.21.15.60:40776) 2023-10-05T15:21:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.302+0000 7ffb19dd4700 1 -- 172.21.15.60:0/3708933738 learned_addr learned my addr 172.21.15.60:0/3708933738 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.303+0000 7ffb19dd4700 1 -- 172.21.15.60:0/3708933738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde29520 msgr2=0x561efde31090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.303+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde29520 0x561efde31090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.303+0000 7ffb19dd4700 1 -- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde343d0 msgr2=0x561efde317d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:21:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.303+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde343d0 0x561efde317d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.303+0000 7ffb19dd4700 1 -- 172.21.15.60:0/3708933738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14116b70 con 0x561efde28c00 2023-10-05T15:21:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.315+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde33e10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffb100a30c0 tx=0x7ffb10011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9006bd0b180aed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.397+0000 7ffafd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:21:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.397+0000 7ffafd7fa700 1 -- 172.21.15.60:0/3708933738 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1009abc0 con 0x561efde28c00 2023-10-05T15:21:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.397+0000 7ffafd7fa700 1 -- 172.21.15.60:0/3708933738 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ffb1009b960 con 0x561efde28c00 2023-10-05T15:21:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.397+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561efde1cd50 con 0x561efde28c00 2023-10-05T15:21:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.410+0000 7ffafd7fa700 1 -- 172.21.15.60:0/3708933738 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb1009f3b0 con 0x561efde28c00 2023-10-05T15:21:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.415+0000 7ffb28222b80 10 client.16566 fetch_fsmap learned FSMap version 37 2023-10-05T15:21:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.415+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x561efdb90c00 con 0x561efde28c00 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.430+0000 7ffafd7fa700 1 -- 172.21.15.60:0/3708933738 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561efde1cd50 con 0x561efde28c00 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffafd7fa700 1 -- 172.21.15.60:0/3708933738 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7ffb100b3d20 con 0x561efde28c00 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb28222b80 10 client.16566 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb28222b80 10 client.16566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb28222b80 20 client.16566 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde43c40 0x561efde46060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb28222b80 4 client.16566 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:21:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561efdd75db0 con 0x561efde43c40 2023-10-05T15:21:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.431+0000 7ffb195d3700 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde43c40 0x561efde46060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.432+0000 7ffb195d3700 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde43c40 0x561efde46060 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147a953a25cc276c server_cookie=fb1ac1b646e035f6 in_seq=0 out_seq=0 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.434+0000 7ffafd7fa700 10 client.16566 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.434+0000 7ffafd7fa700 1 -- 172.21.15.60:0/3708933738 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561efdd75db0 con 0x561efde43c40 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.434+0000 7ffafd7fa700 10 client.16566 handle_command_reply: tid=0 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.434+0000 7ffb28222b80 1 client.16566 shutdown 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.434+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 msgr2=0x561efde33e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.434+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde33e10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffb100a30c0 tx=0x7ffb10011f90 comp rx=0 tx=0).stop 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 shutdown_connections 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde43c40 0x561efde46060 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde343d0 0x561efde317d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde33e10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3708933738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde29520 0x561efde31090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 >> 172.21.15.60:0/3708933738 conn(0x561efdd9e200 msgr2=0x561efde24c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.435+0000 7ffafd7fa700 0 client.16566 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.436+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 shutdown_connections 2023-10-05T15:21:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.436+0000 7ffb28222b80 1 -- 172.21.15.60:0/3708933738 wait complete. 2023-10-05T15:21:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.436+0000 7ffb28222b80 20 client.16566 trim_cache size 0 max 16384 2023-10-05T15:21:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.734+0000 7ffb28222b80 1 Processor -- start 2023-10-05T15:21:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 -- start start 2023-10-05T15:21:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde3af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde3f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efde36c80 con 0x561efde28c00 2023-10-05T15:21:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efdbfd8c0 con 0x561efde29520 2023-10-05T15:21:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.769+0000 7ffb28222b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efde21860 con 0x561efde343d0 2023-10-05T15:21:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.771+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde3af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.771+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde3af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40782/0 (socket says 172.21.15.60:40782) 2023-10-05T15:21:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.771+0000 7ffb19dd4700 1 -- 172.21.15.60:0/3939994662 learned_addr learned my addr 172.21.15.60:0/3939994662 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.782+0000 7ffb1a5d5700 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.783+0000 7ffb195d3700 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde3f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.787+0000 7ffb195d3700 1 -- 172.21.15.60:0/3939994662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 msgr2=0x561efde339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.787+0000 7ffb195d3700 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.787+0000 7ffb195d3700 1 -- 172.21.15.60:0/3939994662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 msgr2=0x561efde3af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.787+0000 7ffb195d3700 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde3af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.787+0000 7ffb195d3700 1 -- 172.21.15.60:0/3939994662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561efdbce1f0 con 0x561efde29520 2023-10-05T15:21:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.798+0000 7ffb195d3700 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde3f6a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x561efde46900 tx=0x7ffb0403e900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531a9fb4256ca1df server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.961+0000 7ffb08ff9700 1 -- 172.21.15.60:0/3939994662 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04043070 con 0x561efde29520 2023-10-05T15:21:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.961+0000 7ffb08ff9700 1 -- 172.21.15.60:0/3939994662 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb040044e0 con 0x561efde29520 2023-10-05T15:21:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.961+0000 7ffb08ff9700 1 -- 172.21.15.60:0/3939994662 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04039040 con 0x561efde29520 2023-10-05T15:21:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.962+0000 7ffb28222b80 1 -- 172.21.15.60:0/3939994662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 msgr2=0x561efde3f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.962+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde3f6a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x561efde46900 tx=0x7ffb0403e900 comp rx=0 tx=0).stop 2023-10-05T15:21:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.968+0000 7ffb28222b80 1 -- 172.21.15.60:0/3939994662 shutdown_connections 2023-10-05T15:21:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.968+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.968+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde28c00 0x561efde3af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.968+0000 7ffb28222b80 1 --2- 172.21.15.60:0/3939994662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde29520 0x561efde3f6a0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x561efde46900 tx=0x7ffb0403e900 comp rx=0 tx=0).stop 2023-10-05T15:21:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.968+0000 7ffb28222b80 1 -- 172.21.15.60:0/3939994662 >> 172.21.15.60:0/3939994662 conn(0x561efdd9e200 msgr2=0x561efde4a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.970+0000 7ffb28222b80 1 -- 172.21.15.60:0/3939994662 shutdown_connections 2023-10-05T15:21:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.970+0000 7ffb28222b80 1 -- 172.21.15.60:0/3939994662 wait complete. 2023-10-05T15:21:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.971+0000 7ffb28222b80 1 -- start start 2023-10-05T15:21:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.971+0000 7ffb28222b80 1 Processor -- start 2023-10-05T15:21:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 0x561efde2e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde2ee90 0x561efde2d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efde2da50 con 0x561efde2ee90 2023-10-05T15:21:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efde2dbc0 con 0x561efde28c00 2023-10-05T15:21:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561efde2dd80 con 0x561efde343d0 2023-10-05T15:21:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.973+0000 7ffb28222b80 10 client.0 _ll_register_callbacks cb 0x7ffb10005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.975+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 0x561efde2e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.975+0000 7ffb19dd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 0x561efde2e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54210/0 (socket says 172.21.15.60:54210) 2023-10-05T15:21:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.975+0000 7ffb19dd4700 1 -- 172.21.15.60:0/1632957462 learned_addr learned my addr 172.21.15.60:0/1632957462 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.975+0000 7ffb195d3700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.976+0000 7ffb1a5d5700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde2ee90 0x561efde2d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.988+0000 7ffb19dd4700 1 -- 172.21.15.60:0/1632957462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 msgr2=0x561efde2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.988+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde2e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.988+0000 7ffb19dd4700 1 -- 172.21.15.60:0/1632957462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde2ee90 msgr2=0x561efde2d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.988+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde2ee90 0x561efde2d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.988+0000 7ffb19dd4700 1 -- 172.21.15.60:0/1632957462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0400a940 con 0x561efde28c00 2023-10-05T15:21:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.989+0000 7ffb19dd4700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 0x561efde2e3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb10010750 tx=0x7ffb100cbf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185ce5e71480046a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:24.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:23.989+0000 7ffafd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:21:24.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.003+0000 7ffafd7fa700 1 -- 172.21.15.60:0/1632957462 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100d1cb0 con 0x561efde28c00 2023-10-05T15:21:24.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.003+0000 7ffafd7fa700 1 -- 172.21.15.60:0/1632957462 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ffb1009b960 con 0x561efde28c00 2023-10-05T15:21:24.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.004+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb100975a0 con 0x561efde28c00 2023-10-05T15:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.027+0000 7ffafd7fa700 1 -- 172.21.15.60:0/1632957462 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb1009abc0 con 0x561efde28c00 2023-10-05T15:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.027+0000 7ffb28222b80 10 client.26225 fetch_fsmap learned FSMap version 37 2023-10-05T15:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.027+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x561efdba6250 con 0x561efde28c00 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.029+0000 7ffafd7fa700 1 -- 172.21.15.60:0/1632957462 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb100975a0 con 0x561efde28c00 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.029+0000 7ffafd7fa700 1 -- 172.21.15.60:0/1632957462 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7ffb100b3d20 con 0x561efde28c00 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.031+0000 7ffb28222b80 10 client.26225 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.031+0000 7ffb28222b80 10 client.26225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.031+0000 7ffb28222b80 20 client.26225 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.031+0000 7ffb28222b80 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde986d0 0x561efde9aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.031+0000 7ffb28222b80 4 client.26225 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.031+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561efdd75ad0 con 0x561efde986d0 2023-10-05T15:21:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.040+0000 7ffb195d3700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde986d0 0x561efde9aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:24.049 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.046+0000 7ffb195d3700 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde986d0 0x561efde9aac0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec4e15064392a3c server_cookie=ef8ed00b53c14a7 in_seq=0 out_seq=0 2023-10-05T15:21:24.050 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:24.046+0000 7ffafd7fa700 10 client.26225 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:24.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:23 smithi060 ceph-mon[99238]: pgmap v143: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 268 op/s 2023-10-05T15:21:24.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:23 smithi092 ceph-mon[102944]: pgmap v143: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 268 op/s 2023-10-05T15:21:24.335 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:23 smithi135 ceph-mon[103360]: pgmap v143: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 268 op/s 2023-10-05T15:21:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.762+0000 7ffafd7fa700 1 -- 172.21.15.60:0/1632957462 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561efdd75ad0 con 0x561efde986d0 2023-10-05T15:21:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.762+0000 7ffafd7fa700 10 client.26225 handle_command_reply: tid=0 2023-10-05T15:21:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.764+0000 7ffb28222b80 1 client.26225 shutdown 2023-10-05T15:21:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 msgr2=0x561efde2e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 0x561efde2e3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb10010750 tx=0x7ffb100cbf60 comp rx=0 tx=0).stop 2023-10-05T15:21:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 shutdown_connections 2023-10-05T15:21:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x561efde986d0 0x561efde9aac0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efde2ee90 0x561efde2d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efde28c00 0x561efde2e3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 --2- 172.21.15.60:0/1632957462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561efde343d0 0x561efde2e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 >> 172.21.15.60:0/1632957462 conn(0x561efdd9e200 msgr2=0x561efde3f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffafd7fa700 0 client.26225 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.765+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 shutdown_connections 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.766+0000 7ffb28222b80 1 -- 172.21.15.60:0/1632957462 wait complete. 2023-10-05T15:21:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.766+0000 7ffb28222b80 20 client.26225 trim_cache size 0 max 16384 2023-10-05T15:21:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:21:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:21:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:21:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:21:25.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.835+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ffb000a1880 msgr2=0x7ffb000a3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:25.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.835+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ffb000a1880 0x7ffb000a3d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009fd0 tx=0x7ffb0c00b740 comp rx=0 tx=0).stop 2023-10-05T15:21:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.835+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 msgr2=0x7ffb14118ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.835+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14118ad0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e9a0 tx=0x7ffb1000ecb0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.843+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 shutdown_connections 2023-10-05T15:21:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.843+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb1411a690 0x7ffb14111a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.843+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1410f620 0x7ffb14118ad0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.843+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7ffb000a1880 0x7ffb000a3d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.843+0000 7ffb1c038700 1 --2- 172.21.15.60:0/2331075318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1410fa90 0x7ffb14119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.843+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 >> 172.21.15.60:0/2331075318 conn(0x7ffb1406cfa0 msgr2=0x7ffb1406f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.856+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 shutdown_connections 2023-10-05T15:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:25.859+0000 7ffb1c038700 1 -- 172.21.15.60:0/2331075318 wait complete. 2023-10-05T15:21:26.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:25 smithi060 ceph-mon[99238]: pgmap v144: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 236 op/s 2023-10-05T15:21:26.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:25 smithi092 ceph-mon[102944]: pgmap v144: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 236 op/s 2023-10-05T15:21:26.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:25 smithi135 ceph-mon[103360]: pgmap v144: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 236 op/s 2023-10-05T15:21:28.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:27 smithi092 ceph-mon[102944]: pgmap v145: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 409 op/s 2023-10-05T15:21:28.177 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:27 smithi060 ceph-mon[99238]: pgmap v145: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 409 op/s 2023-10-05T15:21:28.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:27 smithi135 ceph-mon[103360]: pgmap v145: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 409 op/s 2023-10-05T15:21:28.340 INFO:tasks.workunit.client.0.smithi060.stdout: 274 2251673 463 1574983 420 752850 752 2023-10-05T15:21:30.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:29 smithi060 ceph-mon[99238]: pgmap v146: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 403 op/s 2023-10-05T15:21:30.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:29 smithi092 ceph-mon[102944]: pgmap v146: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 403 op/s 2023-10-05T15:21:30.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:29 smithi135 ceph-mon[103360]: pgmap v146: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 403 op/s 2023-10-05T15:21:32.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:32 smithi060 ceph-mon[99238]: pgmap v147: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 481 op/s 2023-10-05T15:21:32.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:32 smithi092 ceph-mon[102944]: pgmap v147: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 481 op/s 2023-10-05T15:21:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:32 smithi135 ceph-mon[103360]: pgmap v147: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 481 op/s 2023-10-05T15:21:34.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:33 smithi135 ceph-mon[103360]: pgmap v148: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2023-10-05T15:21:34.419 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:33 smithi060 ceph-mon[99238]: pgmap v148: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2023-10-05T15:21:34.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:33 smithi092 ceph-mon[102944]: pgmap v148: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 512 op/s 2023-10-05T15:21:36.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:35 smithi135 ceph-mon[103360]: pgmap v149: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.9 MiB/s wr, 519 op/s 2023-10-05T15:21:36.419 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:35 smithi060 ceph-mon[99238]: pgmap v149: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.9 MiB/s wr, 519 op/s 2023-10-05T15:21:36.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:35 smithi092 ceph-mon[102944]: pgmap v149: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.9 MiB/s wr, 519 op/s 2023-10-05T15:21:38.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:37 smithi135 ceph-mon[103360]: pgmap v150: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.0 MiB/s wr, 682 op/s 2023-10-05T15:21:38.341 INFO:tasks.workunit.client.0.smithi060.stdout: 282 1823054 502 1278803 392 616609 525 2023-10-05T15:21:38.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:37 smithi060 ceph-mon[99238]: pgmap v150: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.0 MiB/s wr, 682 op/s 2023-10-05T15:21:38.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:37 smithi092 ceph-mon[102944]: pgmap v150: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.0 MiB/s wr, 682 op/s 2023-10-05T15:21:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.047+0000 7fbab6f07700 1 -- 172.21.15.60:0/3951595325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab010f620 msgr2=0x7fbab0107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.047+0000 7fbab6f07700 1 --2- 172.21.15.60:0/3951595325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab010f620 0x7fbab0107eb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800b0a0 tx=0x7fbaa800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.048+0000 7fbab6f07700 1 -- 172.21.15.60:0/3951595325 shutdown_connections 2023-10-05T15:21:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.048+0000 7fbab6f07700 1 --2- 172.21.15.60:0/3951595325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab011a690 0x7fbab011ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.048+0000 7fbab6f07700 1 --2- 172.21.15.60:0/3951595325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab010f620 0x7fbab0107eb0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800b0a0 tx=0x7fbaa800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.048+0000 7fbab6f07700 1 --2- 172.21.15.60:0/3951595325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab010fa90 0x7fbab01083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.048+0000 7fbab6f07700 1 -- 172.21.15.60:0/3951595325 >> 172.21.15.60:0/3951595325 conn(0x7fbab006cfa0 msgr2=0x7fbab006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.054+0000 7fbab6f07700 1 -- 172.21.15.60:0/3951595325 shutdown_connections 2023-10-05T15:21:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.054+0000 7fbab6f07700 1 -- 172.21.15.60:0/3951595325 wait complete. 2023-10-05T15:21:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 Processor -- start 2023-10-05T15:21:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 -- start start 2023-10-05T15:21:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab010fa90 0x7fbab0119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 0x7fbab0113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab0114290 0x7fbab0114740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab01bb440 con 0x7fbab010fa90 2023-10-05T15:21:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab01bb5b0 con 0x7fbab011a690 2023-10-05T15:21:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.055+0000 7fbab6f07700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab01bb770 con 0x7fbab0114290 2023-10-05T15:21:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.061+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 0x7fbab0113d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.061+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 0x7fbab0113d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54224/0 (socket says 172.21.15.60:54224) 2023-10-05T15:21:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.061+0000 7fbaaffff700 1 -- 172.21.15.60:0/996853479 learned_addr learned my addr 172.21.15.60:0/996853479 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.061+0000 7fbab54a4700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab0114290 0x7fbab0114740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.061+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab010fa90 0x7fbab0119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.064+0000 7fbaaffff700 1 -- 172.21.15.60:0/996853479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab0114290 msgr2=0x7fbab0114740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.064+0000 7fbaaffff700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab0114290 0x7fbab0114740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.064+0000 7fbaaffff700 1 -- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab010fa90 msgr2=0x7fbab0119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.064+0000 7fbaaffff700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab010fa90 0x7fbab0119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.064+0000 7fbaaffff700 1 -- 172.21.15.60:0/996853479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa8009d00 con 0x7fbab011a690 2023-10-05T15:21:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.080+0000 7fbaaffff700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 0x7fbab0113d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400d950 tx=0x7fbaa400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.150+0000 7fbaadffb700 1 -- 172.21.15.60:0/996853479 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4009940 con 0x7fbab011a690 2023-10-05T15:21:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.150+0000 7fbaadffb700 1 -- 172.21.15.60:0/996853479 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa4010460 con 0x7fbab011a690 2023-10-05T15:21:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.150+0000 7fbaadffb700 1 -- 172.21.15.60:0/996853479 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400f620 con 0x7fbab011a690 2023-10-05T15:21:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.166+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab01bba50 con 0x7fbab011a690 2023-10-05T15:21:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.166+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab01bbee0 con 0x7fbab011a690 2023-10-05T15:21:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 Processor -- start 2023-10-05T15:21:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 -- start start 2023-10-05T15:21:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b121c00 0x556a9b121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b12ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b12d3d0 0x556a9b12f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b08b400 con 0x556a9b12d3d0 2023-10-05T15:21:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b07cbc0 con 0x556a9b121c00 2023-10-05T15:21:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.173+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b07a4e0 con 0x556a9b122520 2023-10-05T15:21:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.176+0000 7fbab54a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b121c00 0x556a9b121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.176+0000 7fbab54a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b121c00 0x556a9b121fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54232/0 (socket says 172.21.15.60:54232) 2023-10-05T15:21:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.176+0000 7fbab54a4700 1 -- 172.21.15.60:0/828107664 learned_addr learned my addr 172.21.15.60:0/828107664 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.176+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b12ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.177+0000 7fbab4ca3700 1 -- 172.21.15.60:0/828107664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b121c00 msgr2=0x556a9b121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.177+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b121c00 0x556a9b121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.177+0000 7fbab4ca3700 1 -- 172.21.15.60:0/828107664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b12d3d0 msgr2=0x556a9b12f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.177+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b12d3d0 0x556a9b12f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.177+0000 7fbab4ca3700 1 -- 172.21.15.60:0/828107664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9aea0d80 con 0x556a9b122520 2023-10-05T15:21:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.177+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b12ce90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8008000 tx=0x7fbaa8007da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1746aed0e5e3d4f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.184+0000 7fbaadffb700 1 -- 172.21.15.60:0/996853479 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbaa40108d0 con 0x7fbab011a690 2023-10-05T15:21:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.185+0000 7fbaadffb700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba980a1800 0x7fba980a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.185+0000 7fbaadffb700 1 -- 172.21.15.60:0/996853479 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fbaa40cd370 con 0x7fbab011a690 2023-10-05T15:21:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.188+0000 7fbab54a4700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba980a1800 0x7fba980a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.194+0000 7fbab54a4700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba980a1800 0x7fba980a3cc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009ba0 tx=0x7fbaa0009110 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.287+0000 7fba96ffd700 1 -- 172.21.15.60:0/828107664 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800e040 con 0x556a9b122520 2023-10-05T15:21:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.287+0000 7fba96ffd700 1 -- 172.21.15.60:0/828107664 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa80092d0 con 0x556a9b122520 2023-10-05T15:21:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.287+0000 7fba96ffd700 1 -- 172.21.15.60:0/828107664 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa801c4a0 con 0x556a9b122520 2023-10-05T15:21:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.288+0000 7fbac30f1b80 1 -- 172.21.15.60:0/828107664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 msgr2=0x556a9b12ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.288+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b12ce90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8008000 tx=0x7fbaa8007da0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 -- 172.21.15.60:0/828107664 shutdown_connections 2023-10-05T15:21:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b12d3d0 0x556a9b12f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b121c00 0x556a9b121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/828107664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b12ce90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 -- 172.21.15.60:0/828107664 >> 172.21.15.60:0/828107664 conn(0x556a9b097200 msgr2=0x556a9b11e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 -- 172.21.15.60:0/828107664 shutdown_connections 2023-10-05T15:21:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.289+0000 7fbac30f1b80 1 -- 172.21.15.60:0/828107664 wait complete. 2023-10-05T15:21:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 -- start start 2023-10-05T15:21:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 Processor -- start 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b121c00 0x556a9b12a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b122520 0x556a9b12a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b12ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b075dd0 con 0x556a9b122520 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b0126b0 con 0x556a9b12d3d0 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b012350 con 0x556a9b121c00 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.290+0000 7fbac30f1b80 10 client.0 _ll_register_callbacks cb 0x556a9ae6f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.291+0000 7fbab4ca3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b121c00 0x556a9b12a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.291+0000 7fbab54a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b12ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.291+0000 7fbab54a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b12ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54242/0 (socket says 172.21.15.60:54242) 2023-10-05T15:21:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.291+0000 7fbab54a4700 1 -- 172.21.15.60:0/1482669543 learned_addr learned my addr 172.21.15.60:0/1482669543 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.292+0000 7fbaaffff700 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b122520 0x556a9b12a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.302+0000 7fbaaffff700 1 -- 172.21.15.60:0/1482669543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b121c00 msgr2=0x556a9b12a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.302+0000 7fbaaffff700 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b121c00 0x556a9b12a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.302+0000 7fbaaffff700 1 -- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 msgr2=0x556a9b12ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.302+0000 7fbaaffff700 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b12ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.302+0000 7fbaaffff700 1 -- 172.21.15.60:0/1482669543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab011d3b0 con 0x556a9b122520 2023-10-05T15:21:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.308+0000 7fbaaffff700 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b122520 0x556a9b12a6e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ca740 tx=0x7fbaa40999b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fd34186adb4c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:40.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:39 smithi135 ceph-mon[103360]: pgmap v151: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.4 MiB/s wr, 548 op/s 2023-10-05T15:21:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.332+0000 7fba947f8700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:21:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.332+0000 7fba947f8700 1 -- 172.21.15.60:0/1482669543 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40cabc0 con 0x556a9b122520 2023-10-05T15:21:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.332+0000 7fba947f8700 1 -- 172.21.15.60:0/1482669543 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fbaa409e120 con 0x556a9b122520 2023-10-05T15:21:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.340+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a9b115d50 con 0x556a9b122520 2023-10-05T15:21:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.352+0000 7fba947f8700 1 -- 172.21.15.60:0/1482669543 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaa40a2360 con 0x556a9b122520 2023-10-05T15:21:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.352+0000 7fbac30f1b80 10 client.16578 fetch_fsmap learned FSMap version 37 2023-10-05T15:21:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.352+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x556a9ae89c00 con 0x556a9b122520 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.354+0000 7fba947f8700 1 -- 172.21.15.60:0/1482669543 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556a9b115d50 con 0x556a9b122520 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.354+0000 7fba947f8700 1 -- 172.21.15.60:0/1482669543 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fbaa40994c0 con 0x556a9b122520 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.356+0000 7fbac30f1b80 10 client.16578 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.356+0000 7fbac30f1b80 10 client.16578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.356+0000 7fbac30f1b80 20 client.16578 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.356+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b13cf70 0x556a9b13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.356+0000 7fbac30f1b80 4 client.16578 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:21:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.356+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a9b06edb0 con 0x556a9b13cf70 2023-10-05T15:21:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.360+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b13cf70 0x556a9b13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.395+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b13cf70 0x556a9b13f390 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2818b001b934515c server_cookie=c744bfae47f8cf2f in_seq=0 out_seq=0 2023-10-05T15:21:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.395+0000 7fba947f8700 10 client.16578 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.402+0000 7fba947f8700 1 -- 172.21.15.60:0/1482669543 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556a9b06edb0 con 0x556a9b13cf70 2023-10-05T15:21:40.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.403+0000 7fba947f8700 10 client.16578 handle_command_reply: tid=0 2023-10-05T15:21:40.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.403+0000 7fbac30f1b80 1 client.16578 shutdown 2023-10-05T15:21:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.414+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b122520 msgr2=0x556a9b12a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.414+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b122520 0x556a9b12a6e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ca740 tx=0x7fbaa40999b0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:39 smithi060 ceph-mon[99238]: pgmap v151: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.4 MiB/s wr, 548 op/s 2023-10-05T15:21:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 shutdown_connections 2023-10-05T15:21:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b13cf70 0x556a9b13f390 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b12ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b121c00 0x556a9b12a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/1482669543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b122520 0x556a9b12a6e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 >> 172.21.15.60:0/1482669543 conn(0x556a9b097200 msgr2=0x556a9b11dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.417+0000 7fba947f8700 0 client.16578 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:40.425 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:39 smithi092 ceph-mon[102944]: pgmap v151: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.4 MiB/s wr, 548 op/s 2023-10-05T15:21:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.425+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 shutdown_connections 2023-10-05T15:21:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.425+0000 7fbac30f1b80 1 -- 172.21.15.60:0/1482669543 wait complete. 2023-10-05T15:21:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.425+0000 7fbac30f1b80 20 client.16578 trim_cache size 0 max 16384 2023-10-05T15:21:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.536+0000 7fbac30f1b80 1 Processor -- start 2023-10-05T15:21:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.536+0000 7fbac30f1b80 1 -- start start 2023-10-05T15:21:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.537+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b121c00 0x556a9b124aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.537+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.537+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b129960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.537+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9aef68c0 con 0x556a9b121c00 2023-10-05T15:21:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.537+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b122e20 con 0x556a9b12d3d0 2023-10-05T15:21:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.537+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b12b780 con 0x556a9b122520 2023-10-05T15:21:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.542+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.542+0000 7fbab54a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b129960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.542+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b133eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54358/0 (socket says 172.21.15.60:54358) 2023-10-05T15:21:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.542+0000 7fbaaffff700 1 -- 172.21.15.60:0/2907132303 learned_addr learned my addr 172.21.15.60:0/2907132303 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.542+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b121c00 0x556a9b124aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.551+0000 7fbab4ca3700 1 -- 172.21.15.60:0/2907132303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 msgr2=0x556a9b133eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.551+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b133eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.551+0000 7fbab4ca3700 1 -- 172.21.15.60:0/2907132303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 msgr2=0x556a9b129960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.551+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b129960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.551+0000 7fbab4ca3700 1 -- 172.21.15.60:0/2907132303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9aec71f0 con 0x556a9b121c00 2023-10-05T15:21:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.565+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b121c00 0x556a9b124aa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800d010 tx=0x7fbaa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8022f1eeec1d99c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.571+0000 7fba977fe700 1 -- 172.21.15.60:0/2907132303 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800e040 con 0x556a9b121c00 2023-10-05T15:21:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.571+0000 7fba977fe700 1 -- 172.21.15.60:0/2907132303 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa802d390 con 0x556a9b121c00 2023-10-05T15:21:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.571+0000 7fba977fe700 1 -- 172.21.15.60:0/2907132303 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80079b0 con 0x556a9b121c00 2023-10-05T15:21:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.585+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2907132303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b121c00 msgr2=0x556a9b124aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.585+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b121c00 0x556a9b124aa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800d010 tx=0x7fbaa800b040 comp rx=0 tx=0).stop 2023-10-05T15:21:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.586+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2907132303 shutdown_connections 2023-10-05T15:21:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.586+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b12d3d0 0x556a9b129960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.586+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b121c00 0x556a9b124aa0 secure :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800d010 tx=0x7fbaa800b040 comp rx=0 tx=0).stop 2023-10-05T15:21:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.586+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2907132303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b122520 0x556a9b133eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.586+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2907132303 >> 172.21.15.60:0/2907132303 conn(0x556a9b097200 msgr2=0x556a9b1254d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.592+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2907132303 shutdown_connections 2023-10-05T15:21:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.592+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2907132303 wait complete. 2023-10-05T15:21:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 -- start start 2023-10-05T15:21:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 Processor -- start 2023-10-05T15:21:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b122520 0x556a9b131500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b12d3d0 0x556a9b131a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b131f80 0x556a9b18fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b134470 con 0x556a9b131f80 2023-10-05T15:21:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b1902e0 con 0x556a9b122520 2023-10-05T15:21:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9b1904a0 con 0x556a9b12d3d0 2023-10-05T15:21:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.593+0000 7fbac30f1b80 10 client.0 _ll_register_callbacks cb 0x7fbaa4099e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.604+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b12d3d0 0x556a9b131a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.604+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b12d3d0 0x556a9b131a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54364/0 (socket says 172.21.15.60:54364) 2023-10-05T15:21:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.604+0000 7fbaaffff700 1 -- 172.21.15.60:0/2491608065 learned_addr learned my addr 172.21.15.60:0/2491608065 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.604+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b122520 0x556a9b131500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.607+0000 7fbab54a4700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b131f80 0x556a9b18fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.615+0000 7fbab4ca3700 1 -- 172.21.15.60:0/2491608065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b12d3d0 msgr2=0x556a9b131a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.615+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b12d3d0 0x556a9b131a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.615+0000 7fbab4ca3700 1 -- 172.21.15.60:0/2491608065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b131f80 msgr2=0x556a9b18fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.615+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b131f80 0x556a9b18fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.615+0000 7fbab4ca3700 1 -- 172.21.15.60:0/2491608065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a9aea0d80 con 0x556a9b122520 2023-10-05T15:21:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.621+0000 7fbab4ca3700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b122520 0x556a9b131500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x556a9b118630 tx=0x7fbaa8009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947cac61b8425e2f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.621+0000 7fba947f8700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.634+0000 7fba947f8700 1 -- 172.21.15.60:0/2491608065 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800e040 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.634+0000 7fba947f8700 1 -- 172.21.15.60:0/2491608065 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fbaa8003e10 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.634+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbaa80092d0 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.635+0000 7fba947f8700 1 -- 172.21.15.60:0/2491608065 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaa80074a0 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.635+0000 7fbac30f1b80 10 client.26243 fetch_fsmap learned FSMap version 37 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.635+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x556a9ae9f250 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.635+0000 7fba947f8700 1 -- 172.21.15.60:0/2491608065 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa803a070 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fba947f8700 1 -- 172.21.15.60:0/2491608065 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fbaa8034070 con 0x556a9b122520 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbac30f1b80 10 client.26243 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:21:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbac30f1b80 10 client.26243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbac30f1b80 20 client.26243 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b191710 0x556a9b193b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbac30f1b80 4 client.26243 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:21:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556a9b06ead0 con 0x556a9b191710 2023-10-05T15:21:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.637+0000 7fbaaffff700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b191710 0x556a9b193b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.670+0000 7fbaaffff700 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b191710 0x556a9b193b00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c82e881bad52e5 server_cookie=bd5f39b87812e845 in_seq=0 out_seq=0 2023-10-05T15:21:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:40.670+0000 7fba947f8700 10 client.26243 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:42.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:42 smithi092 ceph-mon[102944]: pgmap v152: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.0 MiB/s wr, 551 op/s 2023-10-05T15:21:42.716 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:42 smithi060 ceph-mon[99238]: pgmap v152: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.0 MiB/s wr, 551 op/s 2023-10-05T15:21:42.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:42 smithi135 ceph-mon[103360]: pgmap v152: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.0 MiB/s wr, 551 op/s 2023-10-05T15:21:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.131+0000 7fba947f8700 1 -- 172.21.15.60:0/2491608065 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556a9b06ead0 con 0x556a9b191710 2023-10-05T15:21:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.131+0000 7fba947f8700 10 client.26243 handle_command_reply: tid=0 2023-10-05T15:21:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.131+0000 7fbac30f1b80 1 client.26243 shutdown 2023-10-05T15:21:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.131+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b122520 msgr2=0x556a9b131500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.131+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b122520 0x556a9b131500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x556a9b118630 tx=0x7fbaa8009c10 comp rx=0 tx=0).stop 2023-10-05T15:21:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 shutdown_connections 2023-10-05T15:21:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x556a9b191710 0x556a9b193b00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a9b131f80 0x556a9b18fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a9b122520 0x556a9b131500 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 --2- 172.21.15.60:0/2491608065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a9b12d3d0 0x556a9b131a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 >> 172.21.15.60:0/2491608065 conn(0x556a9b097200 msgr2=0x556a9b12bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fba947f8700 0 client.26243 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 shutdown_connections 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.132+0000 7fbac30f1b80 1 -- 172.21.15.60:0/2491608065 wait complete. 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.133+0000 7fbac30f1b80 20 client.26243 trim_cache size 0 max 16384 2023-10-05T15:21:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:21:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:21:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:21:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:21:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba980a1800 msgr2=0x7fba980a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba980a1800 0x7fba980a3cc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009ba0 tx=0x7fbaa0009110 comp rx=0 tx=0).stop 2023-10-05T15:21:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 msgr2=0x7fbab0113d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 0x7fbab0113d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400d950 tx=0x7fbaa400dc60 comp rx=0 tx=0).stop 2023-10-05T15:21:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 shutdown_connections 2023-10-05T15:21:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab0114290 0x7fbab0114740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab010fa90 0x7fbab0119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fba980a1800 0x7fba980a3cc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 --2- 172.21.15.60:0/996853479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab011a690 0x7fbab0113d50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.279+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 >> 172.21.15.60:0/996853479 conn(0x7fbab006cfa0 msgr2=0x7fbab00718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.280+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 shutdown_connections 2023-10-05T15:21:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:43.280+0000 7fbab6f07700 1 -- 172.21.15.60:0/996853479 wait complete. 2023-10-05T15:21:44.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:43 smithi135 ceph-mon[103360]: pgmap v153: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 532 op/s 2023-10-05T15:21:44.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:43 smithi060 ceph-mon[99238]: pgmap v153: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 532 op/s 2023-10-05T15:21:44.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:43 smithi092 ceph-mon[102944]: pgmap v153: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 532 op/s 2023-10-05T15:21:46.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:45 smithi135 ceph-mon[103360]: pgmap v154: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.6 MiB/s wr, 522 op/s 2023-10-05T15:21:46.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:45 smithi060 ceph-mon[99238]: pgmap v154: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.6 MiB/s wr, 522 op/s 2023-10-05T15:21:46.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:45 smithi092 ceph-mon[102944]: pgmap v154: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.6 MiB/s wr, 522 op/s 2023-10-05T15:21:48.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:48 smithi135 ceph-mon[103360]: pgmap v155: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 603 op/s 2023-10-05T15:21:48.341 INFO:tasks.workunit.client.0.smithi060.stdout: 290 2273093 514 1588542 449 767504 448 2023-10-05T15:21:48.419 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:48 smithi060 ceph-mon[99238]: pgmap v155: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 603 op/s 2023-10-05T15:21:48.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:48 smithi092 ceph-mon[102944]: pgmap v155: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 603 op/s 2023-10-05T15:21:50.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:50 smithi135 ceph-mon[103360]: pgmap v156: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 414 op/s 2023-10-05T15:21:50.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:50 smithi060 ceph-mon[99238]: pgmap v156: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 414 op/s 2023-10-05T15:21:50.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:50 smithi092 ceph-mon[102944]: pgmap v156: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 414 op/s 2023-10-05T15:21:52.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:52 smithi060 ceph-mon[99238]: pgmap v157: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 401 op/s 2023-10-05T15:21:52.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:52 smithi092 ceph-mon[102944]: pgmap v157: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 401 op/s 2023-10-05T15:21:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:52 smithi135 ceph-mon[103360]: pgmap v157: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 401 op/s 2023-10-05T15:21:55.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:54 smithi135 ceph-mon[103360]: pgmap v158: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 342 op/s 2023-10-05T15:21:55.425 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:54 smithi060 ceph-mon[99238]: pgmap v158: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 342 op/s 2023-10-05T15:21:55.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:54 smithi092 ceph-mon[102944]: pgmap v158: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 342 op/s 2023-10-05T15:21:56.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:56 smithi060 ceph-mon[99238]: pgmap v159: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 275 op/s 2023-10-05T15:21:56.431 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:56 smithi092 ceph-mon[102944]: pgmap v159: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 275 op/s 2023-10-05T15:21:56.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:56 smithi135 ceph-mon[103360]: pgmap v159: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 275 op/s 2023-10-05T15:21:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 -- 172.21.15.60:0/3923933975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 msgr2=0x7f0960107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 --2- 172.21.15.60:0/3923933975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 0x7f0960107eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f095c009990 tx=0x7f095c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 -- 172.21.15.60:0/3923933975 shutdown_connections 2023-10-05T15:21:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 --2- 172.21.15.60:0/3923933975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096011a690 0x7f096011ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 --2- 172.21.15.60:0/3923933975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 0x7f0960107eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 --2- 172.21.15.60:0/3923933975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096010fa90 0x7f09601083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.881+0000 7f0967bea700 1 -- 172.21.15.60:0/3923933975 >> 172.21.15.60:0/3923933975 conn(0x7f096006cfa0 msgr2=0x7f096006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.899+0000 7f0967bea700 1 -- 172.21.15.60:0/3923933975 shutdown_connections 2023-10-05T15:21:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.899+0000 7f0967bea700 1 -- 172.21.15.60:0/3923933975 wait complete. 2023-10-05T15:21:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 Processor -- start 2023-10-05T15:21:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 -- start start 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 0x7f09601189d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096010fa90 0x7f0960118f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096011a690 0x7f0960111810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960111fe0 con 0x7f096010fa90 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960112150 con 0x7f096010f620 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.900+0000 7f0967bea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960112310 con 0x7f096011a690 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.901+0000 7f0966187700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096011a690 0x7f0960111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.901+0000 7f0966187700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096011a690 0x7f0960111810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54378/0 (socket says 172.21.15.60:54378) 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.901+0000 7f0966187700 1 -- 172.21.15.60:0/3558366073 learned_addr learned my addr 172.21.15.60:0/3558366073 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.901+0000 7f0965986700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 0x7f09601189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.909+0000 7f0965185700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096010fa90 0x7f0960118f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.923+0000 7f0965185700 1 -- 172.21.15.60:0/3558366073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096011a690 msgr2=0x7f0960111810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.923+0000 7f0965185700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096011a690 0x7f0960111810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.923+0000 7f0965185700 1 -- 172.21.15.60:0/3558366073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 msgr2=0x7f09601189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.923+0000 7f0965185700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 0x7f09601189d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.923+0000 7f0965185700 1 -- 172.21.15.60:0/3558366073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c0095f0 con 0x7f096010fa90 2023-10-05T15:21:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.935+0000 7f0965185700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096010fa90 0x7f0960118f50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f095000e9f0 tx=0x7f095000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.946+0000 7f0956ffd700 1 -- 172.21.15.60:0/3558366073 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000c9c0 con 0x7f096010fa90 2023-10-05T15:21:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.946+0000 7f0956ffd700 1 -- 172.21.15.60:0/3558366073 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0950010430 con 0x7f096010fa90 2023-10-05T15:21:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.946+0000 7f0956ffd700 1 -- 172.21.15.60:0/3558366073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950018680 con 0x7f096010fa90 2023-10-05T15:21:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.948+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09601125f0 con 0x7f096010fa90 2023-10-05T15:21:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.948+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0960116800 con 0x7f096010fa90 2023-10-05T15:21:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.954+0000 7f0973dd4b80 1 Processor -- start 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.954+0000 7f0973dd4b80 1 -- start start 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe469fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe474e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe4777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe3d3400 con 0x5653fe469c00 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe3c4bc0 con 0x5653fe46a520 2023-10-05T15:21:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe3c24e0 con 0x5653fe4753d0 2023-10-05T15:21:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0965986700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe474e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0965986700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe474e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54276/0 (socket says 172.21.15.60:54276) 2023-10-05T15:21:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.955+0000 7f0965986700 1 -- 172.21.15.60:0/3347225329 learned_addr learned my addr 172.21.15.60:0/3347225329 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.956+0000 7f0965185700 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe4777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.962+0000 7f0966187700 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe469fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.962+0000 7f0965986700 1 -- 172.21.15.60:0/3347225329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 msgr2=0x5653fe4777c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.962+0000 7f0965986700 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe4777c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.962+0000 7f0965986700 1 -- 172.21.15.60:0/3347225329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 msgr2=0x5653fe469fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.962+0000 7f0965986700 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe469fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.962+0000 7f0965986700 1 -- 172.21.15.60:0/3347225329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653fe1e8d80 con 0x5653fe46a520 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.964+0000 7f0956ffd700 1 -- 172.21.15.60:0/3558366073 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0950010860 con 0x7f096010fa90 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.965+0000 7f0956ffd700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f094c0a1800 0x7f094c0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.966+0000 7f0956ffd700 1 -- 172.21.15.60:0/3558366073 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f0950014070 con 0x7f096010fa90 2023-10-05T15:21:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.970+0000 7f0965986700 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe474e90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f095c009590 tx=0x7f095c00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df43ed0f4bf4ea7c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.971+0000 7f0966187700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f094c0a1800 0x7f094c0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.981+0000 7f0966187700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f094c0a1800 0x7f094c0a3cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0958009fd0 tx=0x7f095800b040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.992+0000 7f094bfff700 1 -- 172.21.15.60:0/3347225329 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c01d070 con 0x5653fe46a520 2023-10-05T15:21:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.992+0000 7f094bfff700 1 -- 172.21.15.60:0/3347225329 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f095c01e040 con 0x5653fe46a520 2023-10-05T15:21:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.992+0000 7f094bfff700 1 -- 172.21.15.60:0/3347225329 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c004900 con 0x5653fe46a520 2023-10-05T15:21:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.993+0000 7f0973dd4b80 1 -- 172.21.15.60:0/3347225329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 msgr2=0x5653fe474e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:56.993+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe474e90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f095c009590 tx=0x7f095c00b610 comp rx=0 tx=0).stop 2023-10-05T15:21:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 -- 172.21.15.60:0/3347225329 shutdown_connections 2023-10-05T15:21:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe4777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe469fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/3347225329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe474e90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 -- 172.21.15.60:0/3347225329 >> 172.21.15.60:0/3347225329 conn(0x5653fe3df200 msgr2=0x5653fe466080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 -- 172.21.15.60:0/3347225329 shutdown_connections 2023-10-05T15:21:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.004+0000 7f0973dd4b80 1 -- 172.21.15.60:0/3347225329 wait complete. 2023-10-05T15:21:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.005+0000 7f0973dd4b80 1 -- start start 2023-10-05T15:21:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.005+0000 7f0973dd4b80 1 Processor -- start 2023-10-05T15:21:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe472150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe472bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe3bddd0 con 0x5653fe4753d0 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe35a6b0 con 0x5653fe46a520 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe35a350 con 0x5653fe469c00 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0973dd4b80 10 client.0 _ll_register_callbacks cb 0x5653fe1b77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0965986700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe472150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0965986700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe472150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54392/0 (socket says 172.21.15.60:54392) 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.006+0000 7f0965986700 1 -- 172.21.15.60:0/238708346 learned_addr learned my addr 172.21.15.60:0/238708346 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.007+0000 7f0965185700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.010+0000 7f0966187700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe472bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.010+0000 7f0965185700 1 -- 172.21.15.60:0/238708346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 msgr2=0x5653fe472150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.010+0000 7f0965185700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe472150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.010+0000 7f0965185700 1 -- 172.21.15.60:0/238708346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 msgr2=0x5653fe472bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.010+0000 7f0965185700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe472bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.010+0000 7f0965185700 1 -- 172.21.15.60:0/238708346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096011d3b0 con 0x5653fe46a520 2023-10-05T15:21:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.011+0000 7f0965185700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09500d00a0 tx=0x7f09500107d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8991fd24f8bf745a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:57.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.102+0000 7f09497fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:21:57.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.102+0000 7f09497fa700 1 -- 172.21.15.60:0/238708346 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095009fd90 con 0x5653fe46a520 2023-10-05T15:21:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.102+0000 7f09497fa700 1 -- 172.21.15.60:0/238708346 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f09500a0030 con 0x5653fe46a520 2023-10-05T15:21:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.103+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653fe45dd50 con 0x5653fe46a520 2023-10-05T15:21:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.118+0000 7f09497fa700 1 -- 172.21.15.60:0/238708346 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09500b8220 con 0x5653fe46a520 2023-10-05T15:21:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.118+0000 7f0973dd4b80 10 client.26255 fetch_fsmap learned FSMap version 37 2023-10-05T15:21:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.118+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5653fe1d1c00 con 0x5653fe46a520 2023-10-05T15:21:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.129+0000 7f09497fa700 1 -- 172.21.15.60:0/238708346 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653fe45dd50 con 0x5653fe46a520 2023-10-05T15:21:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.129+0000 7f09497fa700 1 -- 172.21.15.60:0/238708346 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f095009ee20 con 0x5653fe46a520 2023-10-05T15:21:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.130+0000 7f0973dd4b80 10 client.26255 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:21:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.130+0000 7f0973dd4b80 10 client.26255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.130+0000 7f0973dd4b80 20 client.26255 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.130+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe484fe0 0x5653fe487400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.130+0000 7f0973dd4b80 4 client.26255 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:21:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.130+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653fe3b6db0 con 0x5653fe484fe0 2023-10-05T15:21:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.153+0000 7f0965986700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe484fe0 0x5653fe487400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.187+0000 7f0965986700 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe484fe0 0x5653fe487400 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f073de15cc273d24 server_cookie=c099b5d2547c5ac0 in_seq=0 out_seq=0 2023-10-05T15:21:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.187+0000 7f09497fa700 10 client.26255 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.196+0000 7f09497fa700 1 -- 172.21.15.60:0/238708346 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5653fe3b6db0 con 0x5653fe484fe0 2023-10-05T15:21:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.196+0000 7f09497fa700 10 client.26255 handle_command_reply: tid=0 2023-10-05T15:21:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.196+0000 7f0973dd4b80 1 client.26255 shutdown 2023-10-05T15:21:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.200+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 msgr2=0x5653fe472690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.200+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09500d00a0 tx=0x7f09500107d0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 shutdown_connections 2023-10-05T15:21:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe484fe0 0x5653fe487400 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe472bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe472150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/238708346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 >> 172.21.15.60:0/238708346 conn(0x5653fe3df200 msgr2=0x5653fe465c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.214+0000 7f09497fa700 0 client.26255 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.237+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 shutdown_connections 2023-10-05T15:21:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.237+0000 7f0973dd4b80 1 -- 172.21.15.60:0/238708346 wait complete. 2023-10-05T15:21:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.238+0000 7f0973dd4b80 20 client.26255 trim_cache size 0 max 16384 2023-10-05T15:21:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.274+0000 7f0973dd4b80 1 Processor -- start 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.274+0000 7f0973dd4b80 1 -- start start 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.274+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe47beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.274+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.274+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe46f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.274+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe23e8c0 con 0x5653fe4753d0 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.275+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe47c4b0 con 0x5653fe46a520 2023-10-05T15:21:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.275+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe46e060 con 0x5653fe469c00 2023-10-05T15:21:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.282+0000 7f0966187700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe46f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.282+0000 7f0966187700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe46f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40872/0 (socket says 172.21.15.60:40872) 2023-10-05T15:21:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.282+0000 7f0966187700 1 -- 172.21.15.60:0/1862092277 learned_addr learned my addr 172.21.15.60:0/1862092277 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.284+0000 7f0965185700 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.284+0000 7f0965986700 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe47beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.295+0000 7f0965986700 1 -- 172.21.15.60:0/1862092277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 msgr2=0x5653fe472a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.295+0000 7f0965986700 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.295+0000 7f0965986700 1 -- 172.21.15.60:0/1862092277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 msgr2=0x5653fe46f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:21:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.295+0000 7f0965986700 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe46f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.295+0000 7f0965986700 1 -- 172.21.15.60:0/1862092277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653fe20f1f0 con 0x5653fe469c00 2023-10-05T15:21:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.296+0000 7f0965986700 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe47beb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f095c005d10 tx=0x7f095c01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f49af20dfeaaef16 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.303+0000 7f0954d82700 1 -- 172.21.15.60:0/1862092277 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c01d040 con 0x5653fe469c00 2023-10-05T15:21:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.304+0000 7f0954d82700 1 -- 172.21.15.60:0/1862092277 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f095c0092b0 con 0x5653fe469c00 2023-10-05T15:21:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.304+0000 7f0954d82700 1 -- 172.21.15.60:0/1862092277 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c031510 con 0x5653fe469c00 2023-10-05T15:21:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.306+0000 7f0973dd4b80 1 -- 172.21.15.60:0/1862092277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 msgr2=0x5653fe47beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:21:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.306+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe47beb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f095c005d10 tx=0x7f095c01a040 comp rx=0 tx=0).stop 2023-10-05T15:21:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.307+0000 7f0973dd4b80 1 -- 172.21.15.60:0/1862092277 shutdown_connections 2023-10-05T15:21:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.307+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe4753d0 0x5653fe46f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.307+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe469c00 0x5653fe47beb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.307+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/1862092277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe472a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.307+0000 7f0973dd4b80 1 -- 172.21.15.60:0/1862092277 >> 172.21.15.60:0/1862092277 conn(0x5653fe3df200 msgr2=0x5653fe46d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:21:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.314+0000 7f0973dd4b80 1 -- 172.21.15.60:0/1862092277 shutdown_connections 2023-10-05T15:21:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.315+0000 7f0973dd4b80 1 -- 172.21.15.60:0/1862092277 wait complete. 2023-10-05T15:21:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.315+0000 7f0973dd4b80 1 -- start start 2023-10-05T15:21:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.315+0000 7f0973dd4b80 1 Processor -- start 2023-10-05T15:21:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe479730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe479c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe47a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe4d7ff0 con 0x5653fe469c00 2023-10-05T15:21:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe4d8160 con 0x5653fe46a520 2023-10-05T15:21:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fe4d8320 con 0x5653fe4753d0 2023-10-05T15:21:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.316+0000 7f0973dd4b80 10 client.0 _ll_register_callbacks cb 0x5653fe1b77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:21:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.318+0000 7f0965986700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe479730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.318+0000 7f0965986700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe479730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40876/0 (socket says 172.21.15.60:40876) 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.318+0000 7f0965986700 1 -- 172.21.15.60:0/2927911072 learned_addr learned my addr 172.21.15.60:0/2927911072 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.319+0000 7f0965986700 1 -- 172.21.15.60:0/2927911072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 msgr2=0x5653fe47a1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.319+0000 7f0965986700 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe47a1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.319+0000 7f0965986700 1 -- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 msgr2=0x5653fe479c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.319+0000 7f0965986700 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe479c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.319+0000 7f0965986700 1 -- 172.21.15.60:0/2927911072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653fe1e8d80 con 0x5653fe469c00 2023-10-05T15:21:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.319+0000 7f0965986700 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe479730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f095c005a70 tx=0x7f095c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62be29c9da5bde46 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:21:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.328+0000 7f09497fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:21:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.328+0000 7f09497fa700 1 -- 172.21.15.60:0/2927911072 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c01d070 con 0x5653fe469c00 2023-10-05T15:21:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.328+0000 7f09497fa700 1 -- 172.21.15.60:0/2927911072 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f095c000e40 con 0x5653fe469c00 2023-10-05T15:21:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.334+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f095c01e040 con 0x5653fe469c00 2023-10-05T15:21:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.347+0000 7f09497fa700 1 -- 172.21.15.60:0/2927911072 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f095c0311b0 con 0x5653fe469c00 2023-10-05T15:21:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.355+0000 7f0973dd4b80 10 client.16602 fetch_fsmap learned FSMap version 37 2023-10-05T15:21:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.355+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5653fe1e7250 con 0x5653fe469c00 2023-10-05T15:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f09497fa700 1 -- 172.21.15.60:0/2927911072 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f095c01e040 con 0x5653fe469c00 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f09497fa700 1 -- 172.21.15.60:0/2927911072 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f095c038020 con 0x5653fe469c00 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0973dd4b80 10 client.16602 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0973dd4b80 10 client.16602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0973dd4b80 20 client.16602 populate_metadata read hostname 'smithi060' 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe4d9630 0x5653fe4dba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0973dd4b80 4 client.16602 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653fe3b6ad0 con 0x5653fe4d9630 2023-10-05T15:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.380+0000 7f0965185700 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe4d9630 0x5653fe4dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:21:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.384+0000 7f0965185700 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe4d9630 0x5653fe4dba50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae5c8337bdfef48 server_cookie=f6b03f70ff6cf8d7 in_seq=0 out_seq=0 2023-10-05T15:21:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:21:57.391+0000 7f09497fa700 10 client.16602 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:21:58.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:21:58 smithi135 ceph-mon[103360]: pgmap v160: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 337 op/s 2023-10-05T15:21:58.343 INFO:tasks.workunit.client.0.smithi060.stdout: 298 2066355 472 1439255 479 694892 670 2023-10-05T15:21:58.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:21:58 smithi060 ceph-mon[99238]: pgmap v160: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 337 op/s 2023-10-05T15:21:58.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:21:58 smithi092 ceph-mon[102944]: pgmap v160: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 337 op/s 2023-10-05T15:22:00.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:00 smithi135 ceph-mon[103360]: pgmap v161: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 258 op/s 2023-10-05T15:22:00.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:00 smithi060 ceph-mon[99238]: pgmap v161: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 258 op/s 2023-10-05T15:22:00.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:00 smithi092 ceph-mon[102944]: pgmap v161: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 258 op/s 2023-10-05T15:22:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.017+0000 7f09497fa700 1 -- 172.21.15.60:0/2927911072 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653fe3b6ad0 con 0x5653fe4d9630 2023-10-05T15:22:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.017+0000 7f09497fa700 10 client.16602 handle_command_reply: tid=0 2023-10-05T15:22:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.024+0000 7f0973dd4b80 1 client.16602 shutdown 2023-10-05T15:22:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.025+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 msgr2=0x5653fe479730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.025+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe479730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f095c005a70 tx=0x7f095c0056e0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 shutdown_connections 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5653fe4d9630 0x5653fe4dba50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653fe4753d0 0x5653fe47a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5653fe469c00 0x5653fe479730 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 --2- 172.21.15.60:0/2927911072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5653fe46a520 0x5653fe479c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 >> 172.21.15.60:0/2927911072 conn(0x5653fe3df200 msgr2=0x5653fe4726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f09497fa700 0 client.16602 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 shutdown_connections 2023-10-05T15:22:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.031+0000 7f0973dd4b80 1 -- 172.21.15.60:0/2927911072 wait complete. 2023-10-05T15:22:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.032+0000 7f0973dd4b80 20 client.16602 trim_cache size 0 max 16384 2023-10-05T15:22:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:22:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:22:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:22:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:22:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.034+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f094c0a1800 msgr2=0x7f094c0a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.034+0000 7f0967bea700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f094c0a1800 0x7f094c0a3cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0958009fd0 tx=0x7f095800b040 comp rx=0 tx=0).stop 2023-10-05T15:22:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.034+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096010fa90 msgr2=0x7f0960118f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.034+0000 7f0967bea700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096010fa90 0x7f0960118f50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f095000e9f0 tx=0x7f095000ed00 comp rx=0 tx=0).stop 2023-10-05T15:22:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 shutdown_connections 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f096011a690 0x7f0960111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f094c0a1800 0x7f094c0a3cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096010f620 0x7f09601189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 --2- 172.21.15.60:0/3558366073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096010fa90 0x7f0960118f50 secure :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f095000e9f0 tx=0x7f095000ed00 comp rx=0 tx=0).stop 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 >> 172.21.15.60:0/3558366073 conn(0x7f096006cfa0 msgr2=0x7f096006f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 shutdown_connections 2023-10-05T15:22:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:02.035+0000 7f0967bea700 1 -- 172.21.15.60:0/3558366073 wait complete. 2023-10-05T15:22:02.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:02 smithi060 ceph-mon[99238]: pgmap v162: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 635 op/s 2023-10-05T15:22:02.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:02 smithi092 ceph-mon[102944]: pgmap v162: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 635 op/s 2023-10-05T15:22:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:02 smithi135 ceph-mon[103360]: pgmap v162: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 635 op/s 2023-10-05T15:22:05.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:04 smithi135 ceph-mon[103360]: pgmap v163: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.7 MiB/s wr, 633 op/s 2023-10-05T15:22:05.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:04 smithi060 ceph-mon[99238]: pgmap v163: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.7 MiB/s wr, 633 op/s 2023-10-05T15:22:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:04 smithi092 ceph-mon[102944]: pgmap v163: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.7 MiB/s wr, 633 op/s 2023-10-05T15:22:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:06 smithi135 ceph-mon[103360]: pgmap v164: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 682 op/s 2023-10-05T15:22:06.423 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:06 smithi060 ceph-mon[99238]: pgmap v164: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 682 op/s 2023-10-05T15:22:06.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:06 smithi092 ceph-mon[102944]: pgmap v164: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 682 op/s 2023-10-05T15:22:07.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:07 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:22:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:07 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:22:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:07 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:22:08.353 INFO:tasks.workunit.client.0.smithi060.stdout: 303 2075678 488 1450874 323 689315 588 2023-10-05T15:22:08.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:08 smithi060 ceph-mon[99238]: pgmap v165: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 737 op/s 2023-10-05T15:22:08.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:08 smithi092 ceph-mon[102944]: pgmap v165: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 737 op/s 2023-10-05T15:22:08.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:08 smithi135 ceph-mon[103360]: pgmap v165: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 737 op/s 2023-10-05T15:22:10.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:09 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:22:10.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:09 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:22:10.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:09 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:22:10.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:09 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:22:10.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:09 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:22:10.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:09 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:22:10.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:09 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:22:10.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:09 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:22:10.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:09 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:22:11.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:10 smithi135 ceph-mon[103360]: pgmap v166: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.6 MiB/s wr, 613 op/s 2023-10-05T15:22:11.419 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:10 smithi060 ceph-mon[99238]: pgmap v166: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.6 MiB/s wr, 613 op/s 2023-10-05T15:22:11.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:10 smithi092 ceph-mon[102944]: pgmap v166: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.6 MiB/s wr, 613 op/s 2023-10-05T15:22:12.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:12 smithi060 ceph-mon[99238]: pgmap v167: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.9 MiB/s wr, 612 op/s 2023-10-05T15:22:12.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:12 smithi092 ceph-mon[102944]: pgmap v167: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.9 MiB/s wr, 612 op/s 2023-10-05T15:22:12.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:12 smithi135 ceph-mon[103360]: pgmap v167: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.9 MiB/s wr, 612 op/s 2023-10-05T15:22:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/3848535375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38101410 msgr2=0x7fdd38104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/3848535375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38101410 0x7fdd38104a20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd280099c0 tx=0x7fdd28009cd0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/3848535375 shutdown_connections 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/3848535375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 0x7fdd3810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/3848535375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd38100a60 0x7fdd38100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/3848535375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38101410 0x7fdd38104a20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/3848535375 >> 172.21.15.60:0/3848535375 conn(0x7fdd380762e0 msgr2=0x7fdd380766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/3848535375 shutdown_connections 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.242+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/3848535375 wait complete. 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 Processor -- start 2023-10-05T15:22:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 -- start start 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 0x7fdd381980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 0x7fdd38198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd381a0f60 0x7fdd381a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd381a3920 con 0x7fdd38105150 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd381a3a60 con 0x7fdd381a0f60 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3f3c1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd381a3c20 con 0x7fdd38100a60 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 0x7fdd381980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3d95e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd381a0f60 0x7fdd381a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 0x7fdd381980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54418/0 (socket says 172.21.15.60:54418) 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.243+0000 7fdd3d15d700 1 -- 172.21.15.60:0/920303812 learned_addr learned my addr 172.21.15.60:0/920303812 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 0x7fdd38198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3d15d700 1 -- 172.21.15.60:0/920303812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd381a0f60 msgr2=0x7fdd381a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd381a0f60 0x7fdd381a3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3d15d700 1 -- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 msgr2=0x7fdd38198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 0x7fdd38198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3d15d700 1 -- 172.21.15.60:0/920303812 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280095f0 con 0x7fdd38100a60 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 0x7fdd38198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:22:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.244+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd381a0f60 0x7fdd381a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:22:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.247+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 0x7fdd381980d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b530 tx=0x7fdd3400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.247+0000 7fdd2e7fc700 1 -- 172.21.15.60:0/920303812 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011830 con 0x7fdd38100a60 2023-10-05T15:22:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.247+0000 7fdd2e7fc700 1 -- 172.21.15.60:0/920303812 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd34011e50 con 0x7fdd38100a60 2023-10-05T15:22:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.247+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd381a3f00 con 0x7fdd38100a60 2023-10-05T15:22:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.247+0000 7fdd2e7fc700 1 -- 172.21.15.60:0/920303812 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400f2e0 con 0x7fdd38100a60 2023-10-05T15:22:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.247+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd381a43d0 con 0x7fdd38100a60 2023-10-05T15:22:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.250+0000 7fdd2e7fc700 1 -- 172.21.15.60:0/920303812 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdd34010380 con 0x7fdd38100a60 2023-10-05T15:22:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.250+0000 7fdd2e7fc700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdd240a16f0 0x7fdd240a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.250+0000 7fdd2e7fc700 1 -- 172.21.15.60:0/920303812 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fdd340cce50 con 0x7fdd38100a60 2023-10-05T15:22:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.251+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdd240a16f0 0x7fdd240a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.251+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdd240a16f0 0x7fdd240a3bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd280098e0 tx=0x7fdd28019040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 Processor -- start 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 -- start start 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e70efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e719e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e71c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e678400 con 0x55ea3e71a3d0 2023-10-05T15:22:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e669bc0 con 0x55ea3e70f520 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.254+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e6674e0 con 0x55ea3e70ec00 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e71c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e71c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40900/0 (socket says 172.21.15.60:40900) 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 -- 172.21.15.60:0/791867216 learned_addr learned my addr 172.21.15.60:0/791867216 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 -- 172.21.15.60:0/791867216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 msgr2=0x55ea3e70efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e70efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 -- 172.21.15.60:0/791867216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 msgr2=0x55ea3e719e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e719e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 -- 172.21.15.60:0/791867216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea3e48dd80 con 0x55ea3e71a3d0 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e71c7c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdd30003e40 tx=0x7fdd30009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c813b7b5ecbc317 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd237fe700 1 -- 172.21.15.60:0/791867216 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd300092d0 con 0x55ea3e71a3d0 2023-10-05T15:22:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd237fe700 1 -- 172.21.15.60:0/791867216 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd3000f040 con 0x55ea3e71a3d0 2023-10-05T15:22:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.255+0000 7fdd237fe700 1 -- 172.21.15.60:0/791867216 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000e870 con 0x55ea3e71a3d0 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.256+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/791867216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 msgr2=0x55ea3e71c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.256+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e71c7c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdd30003e40 tx=0x7fdd30009920 comp rx=0 tx=0).stop 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/791867216 shutdown_connections 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e71c7c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e70efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/791867216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e719e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/791867216 >> 172.21.15.60:0/791867216 conn(0x55ea3e684200 msgr2=0x55ea3e70b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/791867216 shutdown_connections 2023-10-05T15:22:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/791867216 wait complete. 2023-10-05T15:22:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 -- start start 2023-10-05T15:22:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.257+0000 7fdd4b5abb80 1 Processor -- start 2023-10-05T15:22:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e7176e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e717c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e662dd0 con 0x55ea3e71a3d0 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e5ff6b0 con 0x55ea3e70ec00 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e5ff350 con 0x55ea3e70f520 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd4b5abb80 10 client.0 _ll_register_callbacks cb 0x55ea3e45c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3c95c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e7176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7171a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54324/0 (socket says 172.21.15.60:54324) 2023-10-05T15:22:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 -- 172.21.15.60:0/2894232527 learned_addr learned my addr 172.21.15.60:0/2894232527 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e717c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 -- 172.21.15.60:0/2894232527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 msgr2=0x55ea3e7176e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e7176e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 -- 172.21.15.60:0/2894232527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 msgr2=0x55ea3e717c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e717c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d15d700 1 -- 172.21.15.60:0/2894232527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd30003b20 con 0x55ea3e70ec00 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.258+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e717c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:22:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7171a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd340998c0 tx=0x7fdd3409a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4e45aa6a4682e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd20ff9700 1 -- 172.21.15.60:0/2894232527 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3409a020 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea3e702d50 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd20ff9700 1 -- 172.21.15.60:0/2894232527 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fdd3409dd10 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd20ff9700 1 -- 172.21.15.60:0/2894232527 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd340a1f50 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd4b5abb80 10 client.26264 fetch_fsmap learned FSMap version 37 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ea3e476c00 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd20ff9700 1 -- 172.21.15.60:0/2894232527 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ea3e702d50 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd20ff9700 1 -- 172.21.15.60:0/2894232527 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fdd340959b0 con 0x55ea3e70ec00 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd4b5abb80 10 client.26264 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:22:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd4b5abb80 10 client.26264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.259+0000 7fdd4b5abb80 20 client.26264 populate_metadata read hostname 'smithi060' 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.260+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e72a070 0x55ea3e72c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.260+0000 7fdd4b5abb80 4 client.26264 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.260+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea3e65bdb0 con 0x55ea3e72a070 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.260+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e72a070 0x55ea3e72c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.260+0000 7fdd20ff9700 10 client.26264 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.260+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e72a070 0x55ea3e72c490 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26064806b4accfae server_cookie=a5f9e282d926f8a9 in_seq=0 out_seq=0 2023-10-05T15:22:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd20ff9700 1 -- 172.21.15.60:0/2894232527 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ea3e65bdb0 con 0x55ea3e72a070 2023-10-05T15:22:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd20ff9700 10 client.26264 handle_command_reply: tid=0 2023-10-05T15:22:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 client.26264 shutdown 2023-10-05T15:22:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 msgr2=0x55ea3e7171a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7171a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd340998c0 tx=0x7fdd3409a2c0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 shutdown_connections 2023-10-05T15:22:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e72a070 0x55ea3e72c490 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e717c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7171a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd20ff9700 0 client.26264 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/2894232527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e7176e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 >> 172.21.15.60:0/2894232527 conn(0x55ea3e684200 msgr2=0x55ea3e70ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 shutdown_connections 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/2894232527 wait complete. 2023-10-05T15:22:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.266+0000 7fdd4b5abb80 20 client.26264 trim_cache size 0 max 16384 2023-10-05T15:22:15.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.287+0000 7fdd4b5abb80 1 Processor -- start 2023-10-05T15:22:15.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 -- start start 2023-10-05T15:22:15.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e712a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e70abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e4e38c0 con 0x55ea3e71a3d0 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e70c680 con 0x55ea3e70ec00 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e7106c0 con 0x55ea3e70f520 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7124f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54332/0 (socket says 172.21.15.60:54332) 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 -- 172.21.15.60:0/4255228226 learned_addr learned my addr 172.21.15.60:0/4255228226 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e70abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 -- 172.21.15.60:0/4255228226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 msgr2=0x55ea3e712a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e712a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 -- 172.21.15.60:0/4255228226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 msgr2=0x55ea3e70abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e70abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.288+0000 7fdd3d15d700 1 -- 172.21.15.60:0/4255228226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea3e4b41f0 con 0x55ea3e70ec00 2023-10-05T15:22:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.292+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7124f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400bc40 tx=0x7fdd34010870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b536a9e7dac19c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.292+0000 7fdd23fff700 1 -- 172.21.15.60:0/4255228226 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3409dd10 con 0x55ea3e70ec00 2023-10-05T15:22:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.292+0000 7fdd23fff700 1 -- 172.21.15.60:0/4255228226 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd340b20f0 con 0x55ea3e70ec00 2023-10-05T15:22:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.292+0000 7fdd23fff700 1 -- 172.21.15.60:0/4255228226 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340990b0 con 0x55ea3e70ec00 2023-10-05T15:22:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/4255228226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 msgr2=0x55ea3e7124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7124f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400bc40 tx=0x7fdd34010870 comp rx=0 tx=0).stop 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/4255228226 shutdown_connections 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e70abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70ec00 0x55ea3e7124f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/4255228226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70f520 0x55ea3e712a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/4255228226 >> 172.21.15.60:0/4255228226 conn(0x55ea3e684200 msgr2=0x55ea3e7256a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/4255228226 shutdown_connections 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/4255228226 wait complete. 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.293+0000 7fdd4b5abb80 1 -- start start 2023-10-05T15:22:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 Processor -- start 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e71ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e71f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e778e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e71f8b0 con 0x55ea3e71a3d0 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e779380 con 0x55ea3e70f520 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3e779540 con 0x55ea3e70ec00 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd4b5abb80 10 client.0 _ll_register_callbacks cb 0x55ea3e45c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e71ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd3d15d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e71ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54446/0 (socket says 172.21.15.60:54446) 2023-10-05T15:22:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.294+0000 7fdd3d15d700 1 -- 172.21.15.60:0/3549502277 learned_addr learned my addr 172.21.15.60:0/3549502277 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e71f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3d95e700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e778e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 -- 172.21.15.60:0/3549502277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 msgr2=0x55ea3e71ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e71ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 -- 172.21.15.60:0/3549502277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 msgr2=0x55ea3e778e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e778e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 -- 172.21.15.60:0/3549502277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea3e476c00 con 0x55ea3e70f520 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd3c95c700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e71f150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd381001a0 tx=0x7fdd28009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bf11e06d647b36 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd20ff9700 1 -- 172.21.15.60:0/3549502277 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2801c040 con 0x55ea3e70f520 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd20ff9700 1 -- 172.21.15.60:0/3549502277 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7fdd2800fdd0 con 0x55ea3e70f520 2023-10-05T15:22:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.295+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd3000f040 con 0x55ea3e70f520 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd20ff9700 1 -- 172.21.15.60:0/3549502277 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd280335d0 con 0x55ea3e70f520 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 10 client.26270 fetch_fsmap learned FSMap version 37 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ea3e48c250 con 0x55ea3e70f520 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd20ff9700 1 -- 172.21.15.60:0/3549502277 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd3000f040 con 0x55ea3e70f520 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd20ff9700 1 -- 172.21.15.60:0/3549502277 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fdd28005020 con 0x55ea3e70f520 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 10 client.26270 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 10 client.26270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 20 client.26270 populate_metadata read hostname 'smithi060' 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e78fd30 0x55ea3e792150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 4 client.26270 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea3e65bad0 con 0x55ea3e78fd30 2023-10-05T15:22:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.296+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e78fd30 0x55ea3e792150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.297+0000 7fdd20ff9700 10 client.26270 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:15.297+0000 7fdd3d15d700 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e78fd30 0x55ea3e792150 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d29d61d16a8fe396 server_cookie=97fee5bcdf408716 in_seq=0 out_seq=0 2023-10-05T15:22:15.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:15 smithi135 ceph-mon[103360]: pgmap v168: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 223 op/s 2023-10-05T15:22:15.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:15 smithi060 ceph-mon[99238]: pgmap v168: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 223 op/s 2023-10-05T15:22:15.828 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:15 smithi092 ceph-mon[102944]: pgmap v168: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 223 op/s 2023-10-05T15:22:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.910+0000 7fdd20ff9700 1 -- 172.21.15.60:0/3549502277 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea3e65bad0 con 0x55ea3e78fd30 2023-10-05T15:22:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.910+0000 7fdd20ff9700 10 client.26270 handle_command_reply: tid=0 2023-10-05T15:22:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.910+0000 7fdd4b5abb80 1 client.26270 shutdown 2023-10-05T15:22:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.922+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 msgr2=0x55ea3e71f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.922+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e71f150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd381001a0 tx=0x7fdd28009310 comp rx=0 tx=0).stop 2023-10-05T15:22:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 shutdown_connections 2023-10-05T15:22:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55ea3e78fd30 0x55ea3e792150 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ea3e71a3d0 0x55ea3e778e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea3e70ec00 0x55ea3e71ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 --2- 172.21.15.60:0/3549502277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea3e70f520 0x55ea3e71f150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 >> 172.21.15.60:0/3549502277 conn(0x55ea3e684200 msgr2=0x55ea3e7124f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd20ff9700 0 client.26270 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 shutdown_connections 2023-10-05T15:22:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.944+0000 7fdd4b5abb80 1 -- 172.21.15.60:0/3549502277 wait complete. 2023-10-05T15:22:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:16.948+0000 7fdd4b5abb80 20 client.26270 trim_cache size 0 max 16384 2023-10-05T15:22:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:22:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:22:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:22:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:22:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:17 smithi135 ceph-mon[103360]: pgmap v169: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 186 op/s 2023-10-05T15:22:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.337+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdd240a16f0 msgr2=0x7fdd240a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.337+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdd240a16f0 0x7fdd240a3bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd280098e0 tx=0x7fdd28019040 comp rx=0 tx=0).stop 2023-10-05T15:22:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.337+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 msgr2=0x7fdd381980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.337+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 0x7fdd381980d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b530 tx=0x7fdd3400b840 comp rx=0 tx=0).stop 2023-10-05T15:22:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.351+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 shutdown_connections 2023-10-05T15:22:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.351+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdd240a16f0 0x7fdd240a3bb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.351+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd381a0f60 0x7fdd381a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.351+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd38100a60 0x7fdd381980d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.351+0000 7fdd3f3c1700 1 --2- 172.21.15.60:0/920303812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd38105150 0x7fdd38198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.351+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 >> 172.21.15.60:0/920303812 conn(0x7fdd380762e0 msgr2=0x7fdd380fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.359+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 shutdown_connections 2023-10-05T15:22:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:17.359+0000 7fdd3f3c1700 1 -- 172.21.15.60:0/920303812 wait complete. 2023-10-05T15:22:17.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:17 smithi060 ceph-mon[99238]: pgmap v169: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 186 op/s 2023-10-05T15:22:17.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:17 smithi092 ceph-mon[102944]: pgmap v169: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 186 op/s 2023-10-05T15:22:18.347 INFO:tasks.workunit.client.0.smithi060.stdout: 329 1514664 1382 1057478 1331 516946 1316 2023-10-05T15:22:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:18 smithi060 ceph-mon[99238]: pgmap v170: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 359 op/s 2023-10-05T15:22:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:18 smithi092 ceph-mon[102944]: pgmap v170: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 359 op/s 2023-10-05T15:22:18.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:18 smithi135 ceph-mon[103360]: pgmap v170: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 359 op/s 2023-10-05T15:22:21.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:21 smithi135 ceph-mon[103360]: pgmap v171: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 341 op/s 2023-10-05T15:22:21.424 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:21 smithi060 ceph-mon[99238]: pgmap v171: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 341 op/s 2023-10-05T15:22:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:21 smithi092 ceph-mon[102944]: pgmap v171: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 341 op/s 2023-10-05T15:22:22.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:22 smithi092 ceph-mon[102944]: pgmap v172: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 426 op/s 2023-10-05T15:22:22.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:22 smithi135 ceph-mon[103360]: pgmap v172: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 426 op/s 2023-10-05T15:22:22.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:22 smithi060 ceph-mon[99238]: pgmap v172: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 426 op/s 2023-10-05T15:22:25.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:25 smithi092 ceph-mon[102944]: pgmap v173: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 535 op/s 2023-10-05T15:22:25.457 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:25 smithi060 ceph-mon[99238]: pgmap v173: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 535 op/s 2023-10-05T15:22:25.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:25 smithi135 ceph-mon[103360]: pgmap v173: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 535 op/s 2023-10-05T15:22:26.589 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:26 smithi135 ceph-mon[103360]: pgmap v174: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 599 op/s 2023-10-05T15:22:26.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:26 smithi060 ceph-mon[99238]: pgmap v174: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 599 op/s 2023-10-05T15:22:26.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:26 smithi092 ceph-mon[102944]: pgmap v174: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 599 op/s 2023-10-05T15:22:28.366 INFO:tasks.workunit.client.0.smithi060.stdout: 333 1577401 491 1102559 246 531309 639 2023-10-05T15:22:28.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:28 smithi135 ceph-mon[103360]: pgmap v175: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 880 op/s 2023-10-05T15:22:28.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:28 smithi060 ceph-mon[99238]: pgmap v175: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 880 op/s 2023-10-05T15:22:28.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:28 smithi092 ceph-mon[102944]: pgmap v175: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 880 op/s 2023-10-05T15:22:31.426 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:31 smithi060 ceph-mon[99238]: pgmap v176: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 743 op/s 2023-10-05T15:22:31.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:31 smithi092 ceph-mon[102944]: pgmap v176: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 743 op/s 2023-10-05T15:22:31.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:31 smithi135 ceph-mon[103360]: pgmap v176: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 743 op/s 2023-10-05T15:22:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:32 smithi135 ceph-mon[103360]: pgmap v177: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 784 op/s 2023-10-05T15:22:32.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:32 smithi060 ceph-mon[99238]: pgmap v177: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 784 op/s 2023-10-05T15:22:32.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:32 smithi092 ceph-mon[102944]: pgmap v177: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 784 op/s 2023-10-05T15:22:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.514+0000 7f1755484700 1 -- 172.21.15.60:0/1473771853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175010d9e0 msgr2=0x7f175010e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.514+0000 7f1755484700 1 --2- 172.21.15.60:0/1473771853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175010d9e0 0x7f175010e370 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f17440098f0 tx=0x7f1744009c00 comp rx=0 tx=0).stop 2023-10-05T15:22:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.515+0000 7f1755484700 1 -- 172.21.15.60:0/1473771853 shutdown_connections 2023-10-05T15:22:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.515+0000 7f1755484700 1 --2- 172.21.15.60:0/1473771853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175010d9e0 0x7f175010e370 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.515+0000 7f1755484700 1 --2- 172.21.15.60:0/1473771853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.515+0000 7f1755484700 1 --2- 172.21.15.60:0/1473771853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17501088b0 0x7f175010d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.515+0000 7f1755484700 1 -- 172.21.15.60:0/1473771853 >> 172.21.15.60:0/1473771853 conn(0x7f175006cf90 msgr2=0x7f175006d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.516+0000 7f1755484700 1 -- 172.21.15.60:0/1473771853 shutdown_connections 2023-10-05T15:22:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.516+0000 7f1755484700 1 -- 172.21.15.60:0/1473771853 wait complete. 2023-10-05T15:22:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.517+0000 7f1755484700 1 Processor -- start 2023-10-05T15:22:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.517+0000 7f1755484700 1 -- start start 2023-10-05T15:22:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f1755484700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501167e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f1755484700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f175010d9e0 0x7f1750116d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f1755484700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175011a170 0x7f175011a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f1755484700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175011abc0 con 0x7f175011a170 2023-10-05T15:22:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f1755484700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175011ad30 con 0x7f175010d9e0 2023-10-05T15:22:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f1755484700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175011aef0 con 0x7f1750107f00 2023-10-05T15:22:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f174effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f174effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501167e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54458/0 (socket says 172.21.15.60:54458) 2023-10-05T15:22:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.518+0000 7f174effd700 1 -- 172.21.15.60:0/2731562533 learned_addr learned my addr 172.21.15.60:0/2731562533 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.519+0000 7f174effd700 1 -- 172.21.15.60:0/2731562533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f175010d9e0 msgr2=0x7f1750116d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:22:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.519+0000 7f174effd700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f175010d9e0 0x7f1750116d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.519+0000 7f174effd700 1 -- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175011a170 msgr2=0x7f175011a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.519+0000 7f174effd700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175011a170 0x7f175011a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.519+0000 7f174effd700 1 -- 172.21.15.60:0/2731562533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009520 con 0x7f1750107f00 2023-10-05T15:22:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.519+0000 7f174effd700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501167e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f174800c0c0 tx=0x7f174800c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.640+0000 7f1737fff700 1 -- 172.21.15.60:0/2731562533 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748018070 con 0x7f1750107f00 2023-10-05T15:22:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.640+0000 7f1737fff700 1 -- 172.21.15.60:0/2731562533 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f174800f040 con 0x7f1750107f00 2023-10-05T15:22:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.640+0000 7f1737fff700 1 -- 172.21.15.60:0/2731562533 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800e020 con 0x7f1750107f00 2023-10-05T15:22:34.648 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.641+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175011b1a0 con 0x7f1750107f00 2023-10-05T15:22:34.648 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.641+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175011b660 con 0x7f1750107f00 2023-10-05T15:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 Processor -- start 2023-10-05T15:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 -- start start 2023-10-05T15:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x5629590fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959106e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562959065400 con 0x5629590fbc00 2023-10-05T15:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562959056bc0 con 0x5629591073d0 2023-10-05T15:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.654+0000 7f176166eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629590544e0 con 0x5629590fc520 2023-10-05T15:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.657+0000 7f174e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.657+0000 7f174e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591097c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54358/0 (socket says 172.21.15.60:54358) 2023-10-05T15:22:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.657+0000 7f174e7fc700 1 -- 172.21.15.60:0/2846889381 learned_addr learned my addr 172.21.15.60:0/2846889381 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.657+0000 7f174effd700 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.658+0000 7f1737fff700 1 -- 172.21.15.60:0/2731562533 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1748014480 con 0x7f1750107f00 2023-10-05T15:22:34.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.659+0000 7f1737fff700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f17380a1800 0x7f17380a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.659+0000 7f1737fff700 1 -- 172.21.15.60:0/2731562533 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f17480ce0e0 con 0x7f1750107f00 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.660+0000 7f174f7fe700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f17380a1800 0x7f17380a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.661+0000 7f174f7fe700 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x5629590fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.661+0000 7f174effd700 1 -- 172.21.15.60:0/2846889381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 msgr2=0x5629591097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.661+0000 7f174effd700 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.661+0000 7f174effd700 1 -- 172.21.15.60:0/2846889381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 msgr2=0x5629590fbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.661+0000 7f174effd700 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x5629590fbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.661+0000 7f174effd700 1 -- 172.21.15.60:0/2846889381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562958e7ad80 con 0x5629590fc520 2023-10-05T15:22:34.670 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.669+0000 7f174effd700 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959106e90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17480cb4b0 tx=0x7f1748009000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba7af35cd21a5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.689+0000 7f174f7fe700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f17380a1800 0x7f17380a3cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1744009fd0 tx=0x7f174401b040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.824+0000 7f17357fa700 1 -- 172.21.15.60:0/2846889381 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174809a880 con 0x5629590fc520 2023-10-05T15:22:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.824+0000 7f17357fa700 1 -- 172.21.15.60:0/2846889381 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f174809a6a0 con 0x5629590fc520 2023-10-05T15:22:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.824+0000 7f17357fa700 1 -- 172.21.15.60:0/2846889381 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480a30d0 con 0x5629590fc520 2023-10-05T15:22:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.826+0000 7f176166eb80 1 -- 172.21.15.60:0/2846889381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 msgr2=0x562959106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.826+0000 7f176166eb80 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959106e90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17480cb4b0 tx=0x7f1748009000 comp rx=0 tx=0).stop 2023-10-05T15:22:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.832+0000 7f176166eb80 1 -- 172.21.15.60:0/2846889381 shutdown_connections 2023-10-05T15:22:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.832+0000 7f176166eb80 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591097c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.832+0000 7f176166eb80 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x5629590fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.832+0000 7f176166eb80 1 --2- 172.21.15.60:0/2846889381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959106e90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.832+0000 7f176166eb80 1 -- 172.21.15.60:0/2846889381 >> 172.21.15.60:0/2846889381 conn(0x562959071200 msgr2=0x5629590f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.832+0000 7f176166eb80 1 -- 172.21.15.60:0/2846889381 shutdown_connections 2023-10-05T15:22:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.833+0000 7f176166eb80 1 -- 172.21.15.60:0/2846889381 wait complete. 2023-10-05T15:22:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.833+0000 7f176166eb80 1 -- start start 2023-10-05T15:22:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.833+0000 7f176166eb80 1 Processor -- start 2023-10-05T15:22:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959106e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959104080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56295904fdd0 con 0x5629590fbc00 2023-10-05T15:22:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562958fec6b0 con 0x5629591073d0 2023-10-05T15:22:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562958fec350 con 0x5629590fc520 2023-10-05T15:22:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.834+0000 7f176166eb80 10 client.0 _ll_register_callbacks cb 0x562958e497a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:22:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959104080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54472/0 (socket says 172.21.15.60:54472) 2023-10-05T15:22:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 -- 172.21.15.60:0/3639740938 learned_addr learned my addr 172.21.15.60:0/3639740938 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174f7fe700 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 -- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 msgr2=0x5629591047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 -- 172.21.15.60:0/3639740938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 msgr2=0x562959106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.835+0000 7f174e7fc700 1 -- 172.21.15.60:0/3639740938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175011b660 con 0x5629590fc520 2023-10-05T15:22:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.839+0000 7f174e7fc700 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959104080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f174000e450 tx=0x7f174000e810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae2685400d884e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.895+0000 7f1732ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:22:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.895+0000 7f1732ff5700 1 -- 172.21.15.60:0/3639740938 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740009550 con 0x5629590fc520 2023-10-05T15:22:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.895+0000 7f1732ff5700 1 -- 172.21.15.60:0/3639740938 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f1740013470 con 0x5629590fc520 2023-10-05T15:22:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.895+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629590efd50 con 0x5629590fc520 2023-10-05T15:22:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.897+0000 7f1732ff5700 1 -- 172.21.15.60:0/3639740938 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1740013670 con 0x5629590fc520 2023-10-05T15:22:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.897+0000 7f176166eb80 10 client.26158 fetch_fsmap learned FSMap version 37 2023-10-05T15:22:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.897+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562958e63c00 con 0x5629590fc520 2023-10-05T15:22:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f1732ff5700 1 -- 172.21.15.60:0/3639740938 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5629590efd50 con 0x5629590fc520 2023-10-05T15:22:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f1732ff5700 1 -- 172.21.15.60:0/3639740938 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f1740011070 con 0x5629590fc520 2023-10-05T15:22:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f176166eb80 10 client.26158 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:22:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f176166eb80 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:22:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f176166eb80 20 client.26158 populate_metadata read hostname 'smithi060' 2023-10-05T15:22:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f176166eb80 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562959117080 0x5629591194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f176166eb80 4 client.26158 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:22:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.926+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562959048db0 con 0x562959117080 2023-10-05T15:22:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.928+0000 7f174effd700 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562959117080 0x5629591194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.954+0000 7f174effd700 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562959117080 0x5629591194a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb715a95b057576 server_cookie=38e2de290943f080 in_seq=0 out_seq=0 2023-10-05T15:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.954+0000 7f1732ff5700 10 client.26158 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f1732ff5700 1 -- 172.21.15.60:0/3639740938 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562959048db0 con 0x562959117080 2023-10-05T15:22:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f1732ff5700 10 client.26158 handle_command_reply: tid=0 2023-10-05T15:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f176166eb80 1 client.26158 shutdown 2023-10-05T15:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 msgr2=0x562959104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f176166eb80 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959104080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f174000e450 tx=0x7f174000e810 comp rx=0 tx=0).stop 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 shutdown_connections 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.959+0000 7f176166eb80 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562959117080 0x5629591194a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x5629591047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 1 --2- 172.21.15.60:0/3639740938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fc520 0x562959104080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 >> 172.21.15.60:0/3639740938 conn(0x562959071200 msgr2=0x5629590f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f1732ff5700 0 client.26158 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 shutdown_connections 2023-10-05T15:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 1 -- 172.21.15.60:0/3639740938 wait complete. 2023-10-05T15:22:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:34.960+0000 7f176166eb80 20 client.26158 trim_cache size 0 max 16384 2023-10-05T15:22:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.189+0000 7f176166eb80 1 Processor -- start 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 -- start start 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fbc00 0x562959109760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fc520 0x56295910deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x562959112610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562958ed08c0 con 0x5629590fc520 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629590f8dc0 con 0x5629591073d0 2023-10-05T15:22:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.202+0000 7f176166eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56295910e3f0 con 0x5629590fbc00 2023-10-05T15:22:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.203+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x562959112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.203+0000 7f174effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fbc00 0x562959109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.203+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x562959112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54374/0 (socket says 172.21.15.60:54374) 2023-10-05T15:22:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.203+0000 7f174f7fe700 1 -- 172.21.15.60:0/1926564479 learned_addr learned my addr 172.21.15.60:0/1926564479 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.206+0000 7f174e7fc700 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fc520 0x56295910deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.215+0000 7f174effd700 1 -- 172.21.15.60:0/1926564479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 msgr2=0x562959112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.215+0000 7f174effd700 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x562959112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.215+0000 7f174effd700 1 -- 172.21.15.60:0/1926564479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fc520 msgr2=0x56295910deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.215+0000 7f174effd700 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fc520 0x56295910deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.215+0000 7f174effd700 1 -- 172.21.15.60:0/1926564479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562958ea11f0 con 0x5629590fbc00 2023-10-05T15:22:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.217+0000 7f174effd700 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fbc00 0x562959109760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1748099090 tx=0x7f17480971b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83627734dd78a4fc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.228+0000 7f1735ffb700 1 -- 172.21.15.60:0/1926564479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174809b4c0 con 0x5629590fbc00 2023-10-05T15:22:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.228+0000 7f1735ffb700 1 -- 172.21.15.60:0/1926564479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17480a30d0 con 0x5629590fbc00 2023-10-05T15:22:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.228+0000 7f1735ffb700 1 -- 172.21.15.60:0/1926564479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174809a880 con 0x5629590fbc00 2023-10-05T15:22:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.229+0000 7f176166eb80 1 -- 172.21.15.60:0/1926564479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fbc00 msgr2=0x562959109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.229+0000 7f176166eb80 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fbc00 0x562959109760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1748099090 tx=0x7f17480971b0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.296+0000 7f176166eb80 1 -- 172.21.15.60:0/1926564479 shutdown_connections 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.296+0000 7f176166eb80 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629591073d0 0x562959112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.296+0000 7f176166eb80 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629590fbc00 0x562959109760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.296+0000 7f176166eb80 1 --2- 172.21.15.60:0/1926564479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fc520 0x56295910deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.296+0000 7f176166eb80 1 -- 172.21.15.60:0/1926564479 >> 172.21.15.60:0/1926564479 conn(0x562959071200 msgr2=0x562959106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.297+0000 7f176166eb80 1 -- 172.21.15.60:0/1926564479 shutdown_connections 2023-10-05T15:22:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.297+0000 7f176166eb80 1 -- 172.21.15.60:0/1926564479 wait complete. 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.297+0000 7f176166eb80 1 -- start start 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 Processor -- start 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959100320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629590fc520 0x562959100860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629591073d0 0x562959100da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629591013c0 con 0x5629590fbc00 2023-10-05T15:22:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562959101500 con 0x5629590fc520 2023-10-05T15:22:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629591016c0 con 0x5629591073d0 2023-10-05T15:22:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.298+0000 7f176166eb80 10 client.0 _ll_register_callbacks cb 0x7f1740009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:22:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.299+0000 7f174effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959100320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.299+0000 7f174effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959100320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40954/0 (socket says 172.21.15.60:40954) 2023-10-05T15:22:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.299+0000 7f174effd700 1 -- 172.21.15.60:0/1229741020 learned_addr learned my addr 172.21.15.60:0/1229741020 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.307+0000 7f174effd700 1 -- 172.21.15.60:0/1229741020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629591073d0 msgr2=0x562959100da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:22:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.307+0000 7f174effd700 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629591073d0 0x562959100da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.307+0000 7f174effd700 1 -- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629590fc520 msgr2=0x562959100860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:22:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.307+0000 7f174effd700 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629590fc520 0x562959100860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.307+0000 7f174effd700 1 -- 172.21.15.60:0/1229741020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562958e7ad80 con 0x5629590fbc00 2023-10-05T15:22:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.315+0000 7f174effd700 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959100320 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1748009040 tx=0x7f174809ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02c8210136e7a1d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.325+0000 7f1732ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:22:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.325+0000 7f1732ff5700 1 -- 172.21.15.60:0/1229741020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480cb930 con 0x5629590fbc00 2023-10-05T15:22:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.325+0000 7f1732ff5700 1 -- 172.21.15.60:0/1229741020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f174809a230 con 0x5629590fbc00 2023-10-05T15:22:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.325+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f174809a6a0 con 0x5629590fbc00 2023-10-05T15:22:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.336+0000 7f1732ff5700 1 -- 172.21.15.60:0/1229741020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f174809a430 con 0x5629590fbc00 2023-10-05T15:22:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.336+0000 7f176166eb80 10 client.16629 fetch_fsmap learned FSMap version 37 2023-10-05T15:22:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.336+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562958e79250 con 0x5629590fbc00 2023-10-05T15:22:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.342+0000 7f1732ff5700 1 -- 172.21.15.60:0/1229741020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f174809a6a0 con 0x5629590fbc00 2023-10-05T15:22:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.342+0000 7f1732ff5700 1 -- 172.21.15.60:0/1229741020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f1748096b30 con 0x5629590fbc00 2023-10-05T15:22:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.343+0000 7f176166eb80 10 client.16629 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:22:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.343+0000 7f176166eb80 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:22:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.343+0000 7f176166eb80 20 client.16629 populate_metadata read hostname 'smithi060' 2023-10-05T15:22:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.343+0000 7f176166eb80 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56295916b4b0 0x56295916d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.343+0000 7f176166eb80 4 client.16629 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:22:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.343+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562959048ad0 con 0x56295916b4b0 2023-10-05T15:22:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.347+0000 7f174e7fc700 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56295916b4b0 0x56295916d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.373+0000 7f174e7fc700 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56295916b4b0 0x56295916d8a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f22f57443ef53a server_cookie=60945161d08615fe in_seq=0 out_seq=0 2023-10-05T15:22:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:35.373+0000 7f1732ff5700 10 client.16629 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:35.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:35 smithi060 ceph-mon[99238]: pgmap v178: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 773 op/s 2023-10-05T15:22:35.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:35 smithi092 ceph-mon[102944]: pgmap v178: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 773 op/s 2023-10-05T15:22:35.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:35 smithi135 ceph-mon[103360]: pgmap v178: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 773 op/s 2023-10-05T15:22:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.872+0000 7f1732ff5700 1 -- 172.21.15.60:0/1229741020 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562959048ad0 con 0x56295916b4b0 2023-10-05T15:22:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.872+0000 7f1732ff5700 10 client.16629 handle_command_reply: tid=0 2023-10-05T15:22:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.872+0000 7f176166eb80 1 client.16629 shutdown 2023-10-05T15:22:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 msgr2=0x562959100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959100320 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1748009040 tx=0x7f174809ad40 comp rx=0 tx=0).stop 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 shutdown_connections 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56295916b4b0 0x56295916d8a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629591073d0 0x562959100da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5629590fbc00 0x562959100320 secure :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1748009040 tx=0x7f174809ad40 comp rx=0 tx=0).stop 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 --2- 172.21.15.60:0/1229741020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629590fc520 0x562959100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.925+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 >> 172.21.15.60:0/1229741020 conn(0x562959071200 msgr2=0x5629590ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.931+0000 7f1732ff5700 0 client.16629 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.943+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 shutdown_connections 2023-10-05T15:22:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.943+0000 7f176166eb80 1 -- 172.21.15.60:0/1229741020 wait complete. 2023-10-05T15:22:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:36.943+0000 7f176166eb80 20 client.16629 trim_cache size 0 max 16384 2023-10-05T15:22:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:22:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:22:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:22:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:22:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.403+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f17380a1800 msgr2=0x7f17380a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.404+0000 7f1755484700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f17380a1800 0x7f17380a3cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1744009fd0 tx=0x7f174401b040 comp rx=0 tx=0).stop 2023-10-05T15:22:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.404+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 msgr2=0x7f17501167e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.404+0000 7f1755484700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501167e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f174800c0c0 tx=0x7f174800c480 comp rx=0 tx=0).stop 2023-10-05T15:22:37.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.416+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 shutdown_connections 2023-10-05T15:22:37.418 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.416+0000 7f1755484700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f175011a170 0x7f175011a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.416+0000 7f1755484700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750107f00 0x7f17501167e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.416+0000 7f1755484700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f17380a1800 0x7f17380a3cc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.416+0000 7f1755484700 1 --2- 172.21.15.60:0/2731562533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f175010d9e0 0x7f1750116d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.416+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 >> 172.21.15.60:0/2731562533 conn(0x7f175006cf90 msgr2=0x7f175010b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:37.419 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:37 smithi060 ceph-mon[99238]: pgmap v179: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 655 op/s 2023-10-05T15:22:37.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:37 smithi092 ceph-mon[102944]: pgmap v179: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 655 op/s 2023-10-05T15:22:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.419+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 shutdown_connections 2023-10-05T15:22:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:37.419+0000 7f1755484700 1 -- 172.21.15.60:0/2731562533 wait complete. 2023-10-05T15:22:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:37 smithi135 ceph-mon[103360]: pgmap v179: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 655 op/s 2023-10-05T15:22:38.367 INFO:tasks.workunit.client.0.smithi060.stdout: 344 2007811 482 1405388 617 673308 696 2023-10-05T15:22:38.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:38 smithi135 ceph-mon[103360]: pgmap v180: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 783 op/s 2023-10-05T15:22:38.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:38 smithi060 ceph-mon[99238]: pgmap v180: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 783 op/s 2023-10-05T15:22:38.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:38 smithi092 ceph-mon[102944]: pgmap v180: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 783 op/s 2023-10-05T15:22:41.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:41 smithi060 ceph-mon[99238]: pgmap v181: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 549 op/s 2023-10-05T15:22:41.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:41 smithi092 ceph-mon[102944]: pgmap v181: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 549 op/s 2023-10-05T15:22:41.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:41 smithi135 ceph-mon[103360]: pgmap v181: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 549 op/s 2023-10-05T15:22:42.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:42 smithi135 ceph-mon[103360]: pgmap v182: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 484 op/s 2023-10-05T15:22:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:42 smithi092 ceph-mon[102944]: pgmap v182: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 484 op/s 2023-10-05T15:22:42.953 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:42 smithi060 ceph-mon[99238]: pgmap v182: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 484 op/s 2023-10-05T15:22:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:45 smithi092 ceph-mon[102944]: pgmap v183: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 482 op/s 2023-10-05T15:22:45.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:45 smithi135 ceph-mon[103360]: pgmap v183: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 482 op/s 2023-10-05T15:22:45.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:45 smithi060 ceph-mon[99238]: pgmap v183: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 482 op/s 2023-10-05T15:22:46.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:46 smithi060 ceph-mon[99238]: pgmap v184: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 434 op/s 2023-10-05T15:22:46.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:46 smithi092 ceph-mon[102944]: pgmap v184: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 434 op/s 2023-10-05T15:22:46.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:46 smithi135 ceph-mon[103360]: pgmap v184: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 434 op/s 2023-10-05T15:22:48.370 INFO:tasks.workunit.client.0.smithi060.stdout: 351 2028239 288 1415213 481 695539 952 2023-10-05T15:22:48.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:48 smithi135 ceph-mon[103360]: pgmap v185: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 567 op/s 2023-10-05T15:22:48.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:48 smithi092 ceph-mon[102944]: pgmap v185: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 567 op/s 2023-10-05T15:22:48.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:48 smithi060 ceph-mon[99238]: pgmap v185: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 567 op/s 2023-10-05T15:22:51.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:51 smithi092 ceph-mon[102944]: pgmap v186: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 403 op/s 2023-10-05T15:22:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:51 smithi135 ceph-mon[103360]: pgmap v186: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 403 op/s 2023-10-05T15:22:51.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:51 smithi060 ceph-mon[99238]: pgmap v186: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 403 op/s 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.490+0000 7f187e9d6700 1 -- 172.21.15.60:0/2603184815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187810fa90 msgr2=0x7f18781083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.490+0000 7f187e9d6700 1 --2- 172.21.15.60:0/2603184815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187810fa90 0x7f18781083f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f186c0098f0 tx=0x7f186c009c00 comp rx=0 tx=0).stop 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.491+0000 7f187e9d6700 1 -- 172.21.15.60:0/2603184815 shutdown_connections 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.491+0000 7f187e9d6700 1 --2- 172.21.15.60:0/2603184815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f187811a690 0x7f187811ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.491+0000 7f187e9d6700 1 --2- 172.21.15.60:0/2603184815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 0x7f1878107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.491+0000 7f187e9d6700 1 --2- 172.21.15.60:0/2603184815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187810fa90 0x7f18781083f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.491+0000 7f187e9d6700 1 -- 172.21.15.60:0/2603184815 >> 172.21.15.60:0/2603184815 conn(0x7f187806cfa0 msgr2=0x7f187806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.491+0000 7f187e9d6700 1 -- 172.21.15.60:0/2603184815 shutdown_connections 2023-10-05T15:22:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.492+0000 7f187e9d6700 1 -- 172.21.15.60:0/2603184815 wait complete. 2023-10-05T15:22:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 Processor -- start 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 -- start start 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 0x7f18781a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f187810fa90 0x7f18781a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187811a690 0x7f18781aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781ab020 con 0x7f187810fa90 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781ab190 con 0x7f187810f620 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.493+0000 7f187e9d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781ab350 con 0x7f187811a690 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187811a690 0x7f18781aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187811a690 0x7f18781aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54500/0 (socket says 172.21.15.60:54500) 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f187cf73700 1 -- 172.21.15.60:0/1298104472 learned_addr learned my addr 172.21.15.60:0/1298104472 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f18777fe700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f187810fa90 0x7f18781a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f1877fff700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 0x7f18781a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f1877fff700 1 -- 172.21.15.60:0/1298104472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187811a690 msgr2=0x7f18781aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f1877fff700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187811a690 0x7f18781aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f1877fff700 1 -- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f187810fa90 msgr2=0x7f18781a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f1877fff700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f187810fa90 0x7f18781a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.494+0000 7f1877fff700 1 -- 172.21.15.60:0/1298104472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009520 con 0x7f187810f620 2023-10-05T15:22:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.497+0000 7f1877fff700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 0x7f18781a5e30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f186800e9f0 tx=0x7f186800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.685+0000 7f18757fa700 1 -- 172.21.15.60:0/1298104472 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680096d0 con 0x7f187810f620 2023-10-05T15:22:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.685+0000 7f18757fa700 1 -- 172.21.15.60:0/1298104472 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f186800cbd0 con 0x7f187810f620 2023-10-05T15:22:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.685+0000 7f18757fa700 1 -- 172.21.15.60:0/1298104472 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868018680 con 0x7f187810f620 2023-10-05T15:22:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.685+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18781ab630 con 0x7f187810f620 2023-10-05T15:22:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.708+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878110050 con 0x7f187810f620 2023-10-05T15:22:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.719+0000 7f18757fa700 1 -- 172.21.15.60:0/1298104472 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f186800cd40 con 0x7f187810f620 2023-10-05T15:22:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.720+0000 7f18757fa700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f18600a1800 0x7f18600a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.720+0000 7f18757fa700 1 -- 172.21.15.60:0/1298104472 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f1868014070 con 0x7f187810f620 2023-10-05T15:22:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.725+0000 7f18777fe700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f18600a1800 0x7f18600a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.737+0000 7f188abc0b80 1 Processor -- start 2023-10-05T15:22:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.737+0000 7f188abc0b80 1 -- start start 2023-10-05T15:22:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.738+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec55fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.738+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec60e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.738+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.738+0000 7f188abc0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ebbf400 con 0x55d86ec56520 2023-10-05T15:22:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.738+0000 7f188abc0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ebb0bc0 con 0x55d86ec55c00 2023-10-05T15:22:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.738+0000 7f188abc0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ebae4e0 con 0x55d86ec613d0 2023-10-05T15:22:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.742+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.742+0000 7f1877fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec55fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.744+0000 7f18777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec60e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.744+0000 7f18777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec60e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40978/0 (socket says 172.21.15.60:40978) 2023-10-05T15:22:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.744+0000 7f18777fe700 1 -- 172.21.15.60:0/32902486 learned_addr learned my addr 172.21.15.60:0/32902486 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.755+0000 7f1877fff700 1 -- 172.21.15.60:0/32902486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 msgr2=0x55d86ec637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.755+0000 7f1877fff700 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.755+0000 7f1877fff700 1 -- 172.21.15.60:0/32902486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 msgr2=0x55d86ec60e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.755+0000 7f1877fff700 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec60e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.755+0000 7f1877fff700 1 -- 172.21.15.60:0/32902486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d86e9d4d80 con 0x55d86ec55c00 2023-10-05T15:22:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.755+0000 7f1877fff700 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec55fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f18680cb170 tx=0x7f186809b100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab950ed6dfb39ce server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.758+0000 7f18777fe700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f18600a1800 0x7f18600a3cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f186c009fd0 tx=0x7f186c00f800 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:52 smithi135 ceph-mon[103360]: pgmap v187: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2023-10-05T15:22:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.886+0000 7f185e7fc700 1 -- 172.21.15.60:0/32902486 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680a2d90 con 0x55d86ec55c00 2023-10-05T15:22:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.887+0000 7f185e7fc700 1 -- 172.21.15.60:0/32902486 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1868020340 con 0x55d86ec55c00 2023-10-05T15:22:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.887+0000 7f185e7fc700 1 -- 172.21.15.60:0/32902486 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186809a150 con 0x55d86ec55c00 2023-10-05T15:22:52.920 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:52 smithi060 ceph-mon[99238]: pgmap v187: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2023-10-05T15:22:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 -- 172.21.15.60:0/32902486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 msgr2=0x55d86ec55fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec55fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f18680cb170 tx=0x7f186809b100 comp rx=0 tx=0).stop 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 -- 172.21.15.60:0/32902486 shutdown_connections 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec55fe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 --2- 172.21.15.60:0/32902486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec60e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.917+0000 7f188abc0b80 1 -- 172.21.15.60:0/32902486 >> 172.21.15.60:0/32902486 conn(0x55d86ebcb200 msgr2=0x55d86ec52080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.918+0000 7f188abc0b80 1 -- 172.21.15.60:0/32902486 shutdown_connections 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.918+0000 7f188abc0b80 1 -- 172.21.15.60:0/32902486 wait complete. 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.918+0000 7f188abc0b80 1 -- start start 2023-10-05T15:22:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 Processor -- start 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec60e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec5e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec5e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86eba9dd0 con 0x55d86ec56520 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86eb466b0 con 0x55d86ec55c00 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86eb46350 con 0x55d86ec613d0 2023-10-05T15:22:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.919+0000 7f188abc0b80 10 client.0 _ll_register_callbacks cb 0x55d86e9a37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:22:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.922+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec5e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.922+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec5e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54514/0 (socket says 172.21.15.60:54514) 2023-10-05T15:22:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.922+0000 7f187cf73700 1 -- 172.21.15.60:0/1625690144 learned_addr learned my addr 172.21.15.60:0/1625690144 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.922+0000 7f1877fff700 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec60e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:52 smithi092 ceph-mon[102944]: pgmap v187: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2023-10-05T15:22:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.930+0000 7f1877fff700 1 -- 172.21.15.60:0/1625690144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 msgr2=0x55d86ec5e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.930+0000 7f1877fff700 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec5e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.930+0000 7f1877fff700 1 -- 172.21.15.60:0/1625690144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 msgr2=0x55d86ec5e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.930+0000 7f1877fff700 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec5e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.930+0000 7f1877fff700 1 -- 172.21.15.60:0/1625690144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878110050 con 0x55d86ec55c00 2023-10-05T15:22:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:52.942+0000 7f1877fff700 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec60e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f18680cb170 tx=0x7f186800efa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f9f02a30252dd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.246+0000 7f18577fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:22:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.246+0000 7f18577fe700 1 -- 172.21.15.60:0/1625690144 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680204b0 con 0x55d86ec55c00 2023-10-05T15:22:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.246+0000 7f18577fe700 1 -- 172.21.15.60:0/1625690144 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f18680a2d90 con 0x55d86ec55c00 2023-10-05T15:22:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.255+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d86ec49d50 con 0x55d86ec55c00 2023-10-05T15:22:53.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.347+0000 7f18577fe700 1 -- 172.21.15.60:0/1625690144 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f186809ae70 con 0x55d86ec55c00 2023-10-05T15:22:53.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.347+0000 7f188abc0b80 10 client.26291 fetch_fsmap learned FSMap version 37 2023-10-05T15:22:53.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.347+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d86e9bdc00 con 0x55d86ec55c00 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f18577fe700 1 -- 172.21.15.60:0/1625690144 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18680a6080 con 0x55d86ec55c00 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f18577fe700 1 -- 172.21.15.60:0/1625690144 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f1868099960 con 0x55d86ec55c00 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f188abc0b80 10 client.26291 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f188abc0b80 10 client.26291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f188abc0b80 20 client.26291 populate_metadata read hostname 'smithi060' 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ec70b50 0x55d86ec72f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f188abc0b80 4 client.26291 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:22:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d86eba2db0 con 0x55d86ec70b50 2023-10-05T15:22:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.352+0000 7f18777fe700 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ec70b50 0x55d86ec72f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.362+0000 7f18777fe700 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ec70b50 0x55d86ec72f70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f599c8feb065a07 server_cookie=bbde014168d3af54 in_seq=0 out_seq=0 2023-10-05T15:22:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.373+0000 7f18577fe700 10 client.26291 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.373+0000 7f18577fe700 1 -- 172.21.15.60:0/1625690144 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d86eba2db0 con 0x55d86ec70b50 2023-10-05T15:22:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.373+0000 7f18577fe700 10 client.26291 handle_command_reply: tid=0 2023-10-05T15:22:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.373+0000 7f188abc0b80 1 client.26291 shutdown 2023-10-05T15:22:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 msgr2=0x55d86ec60e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec60e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f18680cb170 tx=0x7f186800efa0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 shutdown_connections 2023-10-05T15:22:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ec70b50 0x55d86ec72f70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ec5e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec60e90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1625690144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec56520 0x55d86ec5e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.376+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 >> 172.21.15.60:0/1625690144 conn(0x55d86ebcb200 msgr2=0x55d86ec51c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.378+0000 7f18577fe700 0 client.26291 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.378+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 shutdown_connections 2023-10-05T15:22:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.378+0000 7f188abc0b80 1 -- 172.21.15.60:0/1625690144 wait complete. 2023-10-05T15:22:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.378+0000 7f188abc0b80 20 client.26291 trim_cache size 0 max 16384 2023-10-05T15:22:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.674+0000 7f188abc0b80 1 Processor -- start 2023-10-05T15:22:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.674+0000 7f188abc0b80 1 -- start start 2023-10-05T15:22:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.675+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec5d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.675+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec56520 0x55d86ec6c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.675+0000 7f1877fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec5d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.685+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec613d0 0x55d86ec60a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.685+0000 7f1877fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec5d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54412/0 (socket says 172.21.15.60:54412) 2023-10-05T15:22:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.685+0000 7f1877fff700 1 -- 172.21.15.60:0/1004883738 learned_addr learned my addr 172.21.15.60:0/1004883738 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.685+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ea2a8c0 con 0x55d86ec613d0 2023-10-05T15:22:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.685+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ec5f0a0 con 0x55d86ec55c00 2023-10-05T15:22:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.685+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ec5f6f0 con 0x55d86ec56520 2023-10-05T15:22:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.686+0000 7f187cf73700 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec613d0 0x55d86ec60a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.686+0000 7f18777fe700 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec56520 0x55d86ec6c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.687+0000 7f18777fe700 1 -- 172.21.15.60:0/1004883738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 msgr2=0x55d86ec5d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.687+0000 7f18777fe700 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec5d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.687+0000 7f18777fe700 1 -- 172.21.15.60:0/1004883738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec613d0 msgr2=0x55d86ec60a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.687+0000 7f18777fe700 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec613d0 0x55d86ec60a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.687+0000 7f18777fe700 1 -- 172.21.15.60:0/1004883738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d86e9fb1f0 con 0x55d86ec56520 2023-10-05T15:22:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.687+0000 7f18777fe700 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec56520 0x55d86ec6c5b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55d86ec498f0 tx=0x7f186c024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a35b76b9096ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.733+0000 7f185effd700 1 -- 172.21.15.60:0/1004883738 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c02fd40 con 0x55d86ec56520 2023-10-05T15:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.733+0000 7f185effd700 1 -- 172.21.15.60:0/1004883738 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f186c033070 con 0x55d86ec56520 2023-10-05T15:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.733+0000 7f185effd700 1 -- 172.21.15.60:0/1004883738 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0052a0 con 0x55d86ec56520 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec56520 msgr2=0x55d86ec6c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec56520 0x55d86ec6c5b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55d86ec498f0 tx=0x7f186c024000 comp rx=0 tx=0).stop 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 shutdown_connections 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec613d0 0x55d86ec60a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec55c00 0x55d86ec5d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 --2- 172.21.15.60:0/1004883738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec56520 0x55d86ec6c5b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.734+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 >> 172.21.15.60:0/1004883738 conn(0x55d86ebcb200 msgr2=0x55d86ec6d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.738+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 shutdown_connections 2023-10-05T15:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.738+0000 7f188abc0b80 1 -- 172.21.15.60:0/1004883738 wait complete. 2023-10-05T15:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.738+0000 7f188abc0b80 1 -- start start 2023-10-05T15:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 Processor -- start 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec55c00 0x55d86ec65e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec56520 0x55d86ec66380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ecc3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ec66b20 con 0x55d86ec55c00 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ec66c90 con 0x55d86ec56520 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ecc3ec0 con 0x55d86ec613d0 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.739+0000 7f188abc0b80 10 client.0 _ll_register_callbacks cb 0x7f18700098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.740+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ecc3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.740+0000 7f187cf73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ecc3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54528/0 (socket says 172.21.15.60:54528) 2023-10-05T15:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.740+0000 7f187cf73700 1 -- 172.21.15.60:0/2333042174 learned_addr learned my addr 172.21.15.60:0/2333042174 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.740+0000 7f18777fe700 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec56520 0x55d86ec66380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.746+0000 7f187cf73700 1 -- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec56520 msgr2=0x55d86ec66380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.746+0000 7f187cf73700 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec56520 0x55d86ec66380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.746+0000 7f187cf73700 1 -- 172.21.15.60:0/2333042174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec55c00 msgr2=0x55d86ec65e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:22:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.746+0000 7f187cf73700 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec55c00 0x55d86ec65e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.746+0000 7f187cf73700 1 -- 172.21.15.60:0/2333042174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c01f040 con 0x55d86ec613d0 2023-10-05T15:22:53.750 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.748+0000 7f187cf73700 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ecc3980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1870007f10 tx=0x7f1870007f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7d20e8d8031f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:22:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.759+0000 7f18577fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:22:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.759+0000 7f18577fe700 1 -- 172.21.15.60:0/2333042174 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870009c70 con 0x55d86ec613d0 2023-10-05T15:22:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.759+0000 7f18577fe700 1 -- 172.21.15.60:0/2333042174 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f1870018ca0 con 0x55d86ec613d0 2023-10-05T15:22:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.760+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1868020340 con 0x55d86ec613d0 2023-10-05T15:22:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.769+0000 7f18577fe700 1 -- 172.21.15.60:0/2333042174 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1870018e60 con 0x55d86ec613d0 2023-10-05T15:22:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.770+0000 7f188abc0b80 10 client.26179 fetch_fsmap learned FSMap version 37 2023-10-05T15:22:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.770+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d86e9d3250 con 0x55d86ec613d0 2023-10-05T15:22:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.780+0000 7f18577fe700 1 -- 172.21.15.60:0/2333042174 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1868020340 con 0x55d86ec613d0 2023-10-05T15:22:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.780+0000 7f18577fe700 1 -- 172.21.15.60:0/2333042174 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f18700217e0 con 0x55d86ec613d0 2023-10-05T15:22:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.782+0000 7f188abc0b80 10 client.26179 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:22:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.782+0000 7f188abc0b80 10 client.26179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:22:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.782+0000 7f188abc0b80 20 client.26179 populate_metadata read hostname 'smithi060' 2023-10-05T15:22:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.782+0000 7f188abc0b80 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ecc56a0 0x55d86ecc7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:22:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.782+0000 7f188abc0b80 4 client.26179 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:22:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.782+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d86eba2ad0 con 0x55d86ecc56a0 2023-10-05T15:22:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.793+0000 7f1877fff700 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ecc56a0 0x55d86ecc7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:22:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.813+0000 7f1877fff700 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ecc56a0 0x55d86ecc7ac0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3599d4e736a0d79 server_cookie=eeac5bee30e123c0 in_seq=0 out_seq=0 2023-10-05T15:22:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:53.813+0000 7f18577fe700 10 client.26179 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:55 smithi135 ceph-mon[103360]: pgmap v188: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.4 MiB/s wr, 433 op/s 2023-10-05T15:22:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:55 smithi092 ceph-mon[102944]: pgmap v188: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.4 MiB/s wr, 433 op/s 2023-10-05T15:22:55.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:55 smithi060 ceph-mon[99238]: pgmap v188: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.4 MiB/s wr, 433 op/s 2023-10-05T15:22:56.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:56 smithi135 ceph-mon[103360]: pgmap v189: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 395 op/s 2023-10-05T15:22:56.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:56 smithi060 ceph-mon[99238]: pgmap v189: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 395 op/s 2023-10-05T15:22:56.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:56 smithi092 ceph-mon[102944]: pgmap v189: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 395 op/s 2023-10-05T15:22:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.004+0000 7f18577fe700 1 -- 172.21.15.60:0/2333042174 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d86eba2ad0 con 0x55d86ecc56a0 2023-10-05T15:22:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.004+0000 7f18577fe700 10 client.26179 handle_command_reply: tid=0 2023-10-05T15:22:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.004+0000 7f188abc0b80 1 client.26179 shutdown 2023-10-05T15:22:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.011+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 msgr2=0x55d86ecc3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.011+0000 7f188abc0b80 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ecc3980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1870007f10 tx=0x7f1870007f40 comp rx=0 tx=0).stop 2023-10-05T15:22:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 shutdown_connections 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d86ecc56a0 0x55d86ecc7ac0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d86ec613d0 0x55d86ecc3980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d86ec55c00 0x55d86ec65e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 --2- 172.21.15.60:0/2333042174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d86ec56520 0x55d86ec66380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 >> 172.21.15.60:0/2333042174 conn(0x55d86ebcb200 msgr2=0x55d86ec6d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f18577fe700 0 client.26179 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 shutdown_connections 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.064+0000 7f188abc0b80 1 -- 172.21.15.60:0/2333042174 wait complete. 2023-10-05T15:22:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.065+0000 7f188abc0b80 20 client.26179 trim_cache size 0 max 16384 2023-10-05T15:22:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:22:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:22:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:22:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:22:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.404+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f18600a1800 msgr2=0x7f18600a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.404+0000 7f187e9d6700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f18600a1800 0x7f18600a3cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f186c009fd0 tx=0x7f186c00f800 comp rx=0 tx=0).stop 2023-10-05T15:22:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.404+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 msgr2=0x7f18781a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:22:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.404+0000 7f187e9d6700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 0x7f18781a5e30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f186800e9f0 tx=0x7f186800ed00 comp rx=0 tx=0).stop 2023-10-05T15:22:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 shutdown_connections 2023-10-05T15:22:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187811a690 0x7f18781aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f18600a1800 0x7f18600a3cc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f187810f620 0x7f18781a5e30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 --2- 172.21.15.60:0/1298104472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f187810fa90 0x7f18781a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:22:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 >> 172.21.15.60:0/1298104472 conn(0x7f187806cfa0 msgr2=0x7f1878118680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:22:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.415+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 shutdown_connections 2023-10-05T15:22:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:22:57.416+0000 7f187e9d6700 1 -- 172.21.15.60:0/1298104472 wait complete. 2023-10-05T15:22:58.381 INFO:tasks.workunit.client.0.smithi060.stdout: 358 2048537 532 1438790 377 723915 846 2023-10-05T15:22:58.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:22:58 smithi135 ceph-mon[103360]: pgmap v190: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.1 MiB/s wr, 671 op/s 2023-10-05T15:22:58.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:22:58 smithi060 ceph-mon[99238]: pgmap v190: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.1 MiB/s wr, 671 op/s 2023-10-05T15:22:58.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:22:58 smithi092 ceph-mon[102944]: pgmap v190: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.1 MiB/s wr, 671 op/s 2023-10-05T15:23:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:01 smithi135 ceph-mon[103360]: pgmap v191: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 535 op/s 2023-10-05T15:23:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:01 smithi092 ceph-mon[102944]: pgmap v191: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 535 op/s 2023-10-05T15:23:01.731 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:01 smithi060 ceph-mon[99238]: pgmap v191: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 535 op/s 2023-10-05T15:23:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:02 smithi135 ceph-mon[103360]: pgmap v192: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 547 op/s 2023-10-05T15:23:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:02 smithi092 ceph-mon[102944]: pgmap v192: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 547 op/s 2023-10-05T15:23:02.944 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:02 smithi060 ceph-mon[99238]: pgmap v192: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 547 op/s 2023-10-05T15:23:05.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:05 smithi060 ceph-mon[99238]: pgmap v193: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 585 op/s 2023-10-05T15:23:05.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:05 smithi092 ceph-mon[102944]: pgmap v193: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 585 op/s 2023-10-05T15:23:05.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:05 smithi135 ceph-mon[103360]: pgmap v193: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 585 op/s 2023-10-05T15:23:07.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:07 smithi060 ceph-mon[99238]: pgmap v194: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 504 op/s 2023-10-05T15:23:07.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:07 smithi092 ceph-mon[102944]: pgmap v194: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 504 op/s 2023-10-05T15:23:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:07 smithi135 ceph-mon[103360]: pgmap v194: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 504 op/s 2023-10-05T15:23:08.381 INFO:tasks.workunit.client.0.smithi060.stdout: 361 1209525 158 844644 176 430710 386 2023-10-05T15:23:09.414 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:09 smithi060 ceph-mon[99238]: pgmap v195: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2023-10-05T15:23:09.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:09 smithi092 ceph-mon[102944]: pgmap v195: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2023-10-05T15:23:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:09 smithi135 ceph-mon[103360]: pgmap v195: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2023-10-05T15:23:10.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:10 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:23:10.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:10 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:23:10.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:10 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:23:11.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 -- 172.21.15.60:0/651504561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e741050f0 msgr2=0x7f2e7410cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:11.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 --2- 172.21.15.60:0/651504561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e741050f0 0x7f2e7410cc70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00b0a0 tx=0x7f2e6c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 -- 172.21.15.60:0/651504561 shutdown_connections 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 --2- 172.21.15.60:0/651504561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e741050f0 0x7f2e7410cc70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 --2- 172.21.15.60:0/651504561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e740fffd0 0x7f2e741003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 --2- 172.21.15.60:0/651504561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e74100980 0x7f2e741049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 -- 172.21.15.60:0/651504561 >> 172.21.15.60:0/651504561 conn(0x7f2e740fb830 msgr2=0x7f2e740fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 -- 172.21.15.60:0/651504561 shutdown_connections 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.080+0000 7f2e799ab700 1 -- 172.21.15.60:0/651504561 wait complete. 2023-10-05T15:23:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 Processor -- start 2023-10-05T15:23:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 -- start start 2023-10-05T15:23:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 0x7f2e741970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e741050f0 0x7f2e74197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e7419bc70 0x7f2e7419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7419c6f0 con 0x7f2e740fffd0 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7419c860 con 0x7f2e7419bc70 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e799ab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7419ca20 con 0x7f2e741050f0 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 0x7f2e741970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 0x7f2e741970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41010/0 (socket says 172.21.15.60:41010) 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2083775027 learned_addr learned my addr 172.21.15.60:0/2083775027 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e741050f0 0x7f2e74197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.081+0000 7f2e737fe700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e7419bc70 0x7f2e7419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2083775027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e741050f0 msgr2=0x7f2e74197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e741050f0 0x7f2e74197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2083775027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e7419bc70 msgr2=0x7f2e7419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e7419bc70 0x7f2e7419c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2083775027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009d00 con 0x7f2e740fffd0 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 0x7f2e741970c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800d950 tx=0x7f2e6800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e789a9700 1 -- 172.21.15.60:0/2083775027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68009940 con 0x7f2e740fffd0 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e789a9700 1 -- 172.21.15.60:0/2083775027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e68010460 con 0x7f2e740fffd0 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e741a3f80 con 0x7f2e740fffd0 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e789a9700 1 -- 172.21.15.60:0/2083775027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800f620 con 0x7f2e740fffd0 2023-10-05T15:23:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.082+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e741a4400 con 0x7f2e740fffd0 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.084+0000 7f2e789a9700 1 -- 172.21.15.60:0/2083775027 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2e680108d0 con 0x7f2e740fffd0 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.085+0000 7f2e789a9700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e5c0a15f0 0x7f2e5c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.085+0000 7f2e789a9700 1 -- 172.21.15.60:0/2083775027 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e680cd2e0 con 0x7f2e740fffd0 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.085+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e5c0a15f0 0x7f2e5c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.085+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e5c0a15f0 0x7f2e5c0a3ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e741988e0 tx=0x7f2e64009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 Processor -- start 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 -- start start 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdb4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 0x55a51cdbfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdc03d0 0x55a51cdc27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cd1e400 con 0x55a51cdc03d0 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cd0fbc0 con 0x55a51cdb4c00 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cd0d4e0 con 0x55a51cdb5520 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdc03d0 0x55a51cdc27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 0x55a51cdbfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 0x55a51cdbfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54550/0 (socket says 172.21.15.60:54550) 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdc03d0 0x55a51cdc27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41022/0 (socket says 172.21.15.60:41022) 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e727fc700 1 -- 172.21.15.60:0/2592838800 learned_addr learned my addr 172.21.15.60:0/2592838800 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.086+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdb4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e727fc700 1 -- 172.21.15.60:0/2592838800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 msgr2=0x55a51cdb4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdb4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e727fc700 1 -- 172.21.15.60:0/2592838800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdc03d0 msgr2=0x55a51cdc27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdc03d0 0x55a51cdc27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e727fc700 1 -- 172.21.15.60:0/2592838800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a51cb33d80 con 0x55a51cdb5520 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 0x55a51cdbfe90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e64011d10 tx=0x7f2e64014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf879039bc01371 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e59ffb700 1 -- 172.21.15.60:0/2592838800 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64011d40 con 0x55a51cdb5520 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e59ffb700 1 -- 172.21.15.60:0/2592838800 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e64004020 con 0x55a51cdb5520 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.087+0000 7f2e59ffb700 1 -- 172.21.15.60:0/2592838800 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64003c70 con 0x55a51cdb5520 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2592838800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 msgr2=0x55a51cdbfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 0x55a51cdbfe90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e64011d10 tx=0x7f2e64014000 comp rx=0 tx=0).stop 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2592838800 shutdown_connections 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdc03d0 0x55a51cdc27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdb4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2592838800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb5520 0x55a51cdbfe90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2592838800 >> 172.21.15.60:0/2592838800 conn(0x55a51cd2a200 msgr2=0x55a51cdb1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2592838800 shutdown_connections 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2592838800 wait complete. 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 -- start start 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.088+0000 7f2e85b95b80 1 Processor -- start 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdbfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdbd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdbd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cd08dd0 con 0x55a51cdb5520 2023-10-05T15:23:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cca56b0 con 0x55a51cdc03d0 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cca5350 con 0x55a51cdb4c00 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 10 client.0 _ll_register_callbacks cb 0x55a51cb027a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdbd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdbd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41026/0 (socket says 172.21.15.60:41026) 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdbfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e727fc700 1 -- 172.21.15.60:0/2926102547 learned_addr learned my addr 172.21.15.60:0/2926102547 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e737fe700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdbd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 msgr2=0x55a51cdbd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdbd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2926102547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 msgr2=0x55a51cdbd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdbd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2926102547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e64017070 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdbd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdbfe10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e680ca6b0 tx=0x7f2e6809a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc70f1ecc4800ae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2926102547 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a22d0 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2926102547 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e6809a1a0 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.089+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a51cda8d50 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2926102547 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e6809a360 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 10 client.26191 fetch_fsmap learned FSMap version 37 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a51cb1cc00 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2926102547 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a51cda8d50 con 0x55a51cdb4c00 2023-10-05T15:23:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2926102547 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f2e680add20 con 0x55a51cdb4c00 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 10 client.26191 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 10 client.26191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 20 client.26191 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51cdcfe30 0x55a51cdd2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 4 client.26191 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a51cd01db0 con 0x55a51cdcfe30 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.090+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51cdcfe30 0x55a51cdd2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.091+0000 7f2e52ffd700 10 client.26191 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.091+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51cdcfe30 0x55a51cdd2250 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7d92b90863e409 server_cookie=dd49cd103b482bbf in_seq=0 out_seq=0 2023-10-05T15:23:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.091+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2926102547 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a51cd01db0 con 0x55a51cdcfe30 2023-10-05T15:23:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.091+0000 7f2e52ffd700 10 client.26191 handle_command_reply: tid=0 2023-10-05T15:23:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.091+0000 7f2e85b95b80 1 client.26191 shutdown 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 msgr2=0x55a51cdbfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdbfe10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e680ca6b0 tx=0x7f2e6809a780 comp rx=0 tx=0).stop 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 shutdown_connections 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51cdcfe30 0x55a51cdd2250 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdbd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdbfe10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2926102547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdbd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e52ffd700 0 client.26191 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 >> 172.21.15.60:0/2926102547 conn(0x55a51cd2a200 msgr2=0x55a51cdb0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 shutdown_connections 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2926102547 wait complete. 2023-10-05T15:23:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.092+0000 7f2e85b95b80 20 client.26191 trim_cache size 0 max 16384 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 Processor -- start 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 -- start start 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdd2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdc03d0 0x55a51cdb8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cb898c0 con 0x55a51cdb5520 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cdb8e90 con 0x55a51cdb4c00 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cdb5b60 con 0x55a51cdc03d0 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41034/0 (socket says 172.21.15.60:41034) 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 -- 172.21.15.60:0/1052232235 learned_addr learned my addr 172.21.15.60:0/1052232235 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdd2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e737fe700 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdc03d0 0x55a51cdb8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 -- 172.21.15.60:0/1052232235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdc03d0 msgr2=0x55a51cdb8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdc03d0 0x55a51cdb8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 -- 172.21.15.60:0/1052232235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 msgr2=0x55a51cdd2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdd2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 -- 172.21.15.60:0/1052232235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a51cb5a1f0 con 0x55a51cdb5520 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e737fe700 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdc03d0 0x55a51cdb8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.107+0000 7f2e727fc700 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6f20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009fd0 tx=0x7f2e640094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefb337ebffab765 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:11.111 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e5a7fc700 1 -- 172.21.15.60:0/1052232235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6402c040 con 0x55a51cdb5520 2023-10-05T15:23:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e5a7fc700 1 -- 172.21.15.60:0/1052232235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e64003680 con 0x55a51cdb5520 2023-10-05T15:23:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e5a7fc700 1 -- 172.21.15.60:0/1052232235 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64003c80 con 0x55a51cdb5520 2023-10-05T15:23:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 -- 172.21.15.60:0/1052232235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 msgr2=0x55a51cdc6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6f20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009fd0 tx=0x7f2e640094b0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 -- 172.21.15.60:0/1052232235 shutdown_connections 2023-10-05T15:23:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdc03d0 0x55a51cdb8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdb4c00 0x55a51cdd2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/1052232235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6f20 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 -- 172.21.15.60:0/1052232235 >> 172.21.15.60:0/1052232235 conn(0x55a51cd2a200 msgr2=0x55a51cdcb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 -- 172.21.15.60:0/1052232235 shutdown_connections 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.108+0000 7f2e85b95b80 1 -- 172.21.15.60:0/1052232235 wait complete. 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 -- start start 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 Processor -- start 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdc6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdc4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cdc5610 con 0x55a51cdb5520 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cdc5780 con 0x55a51cdc03d0 2023-10-05T15:23:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51cdc5940 con 0x55a51cdb4c00 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e85b95b80 10 client.0 _ll_register_callbacks cb 0x7f2e680998a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdc6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41038/0 (socket says 172.21.15.60:41038) 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdc6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54568/0 (socket says 172.21.15.60:54568) 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e727fc700 1 -- 172.21.15.60:0/2996001040 learned_addr learned my addr 172.21.15.60:0/2996001040 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.109+0000 7f2e737fe700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdc4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 msgr2=0x55a51cdc4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdc4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2996001040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 msgr2=0x55a51cdc6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e72ffd700 1 -- 172.21.15.60:0/2996001040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a51cb33d80 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e737fe700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdc4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e72ffd700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdc6660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e68099830 tx=0x7f2e6809a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5461710641025c88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2996001040 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68014040 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2996001040 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9315+0+0 (secure 0 0 0) 0x7f2e680a22d0 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e64004020 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2996001040 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e680a20d0 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e85b95b80 10 client.26194 fetch_fsmap learned FSMap version 37 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a51cb32250 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2996001040 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e64004020 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2996001040 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f2e680add20 con 0x55a51cdb4c00 2023-10-05T15:23:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e85b95b80 10 client.26194 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e85b95b80 10 client.26194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.110+0000 7f2e85b95b80 20 client.26194 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.111+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51ce28c10 0x55a51ce2b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.111+0000 7f2e85b95b80 4 client.26194 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.111+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a51cd01ad0 con 0x55a51ce28c10 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.111+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51ce28c10 0x55a51ce2b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.111+0000 7f2e52ffd700 10 client.26194 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:11.111+0000 7f2e727fc700 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51ce28c10 0x55a51ce2b000 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890eaf5da1fde1a8 server_cookie=faecad58a5227a40 in_seq=0 out_seq=0 2023-10-05T15:23:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:11 smithi135 ceph-mon[103360]: pgmap v196: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1013 KiB/s wr, 173 op/s 2023-10-05T15:23:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:11 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:23:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:11 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:23:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:11 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:23:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:11 smithi060 ceph-mon[99238]: pgmap v196: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1013 KiB/s wr, 173 op/s 2023-10-05T15:23:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:11 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:23:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:11 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:23:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:11 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:23:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:11 smithi092 ceph-mon[102944]: pgmap v196: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1013 KiB/s wr, 173 op/s 2023-10-05T15:23:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:11 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:23:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:11 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:23:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:11 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:23:12.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:12 smithi135 ceph-mon[103360]: pgmap v197: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 154 op/s 2023-10-05T15:23:12.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:12 smithi060 ceph-mon[99238]: pgmap v197: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 154 op/s 2023-10-05T15:23:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:12 smithi092 ceph-mon[102944]: pgmap v197: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 154 op/s 2023-10-05T15:23:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.576+0000 7f2e52ffd700 1 -- 172.21.15.60:0/2996001040 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a51cd01ad0 con 0x55a51ce28c10 2023-10-05T15:23:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.576+0000 7f2e52ffd700 10 client.26194 handle_command_reply: tid=0 2023-10-05T15:23:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.576+0000 7f2e85b95b80 1 client.26194 shutdown 2023-10-05T15:23:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 msgr2=0x55a51cdc6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdc6660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e68099830 tx=0x7f2e6809a6f0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 shutdown_connections 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a51ce28c10 0x55a51ce2b000 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a51cdc03d0 0x55a51cdc4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e52ffd700 0 client.26194 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a51cdb4c00 0x55a51cdc6660 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 --2- 172.21.15.60:0/2996001040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a51cdb5520 0x55a51cdc6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 >> 172.21.15.60:0/2996001040 conn(0x55a51cd2a200 msgr2=0x55a51cdb8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 shutdown_connections 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 1 -- 172.21.15.60:0/2996001040 wait complete. 2023-10-05T15:23:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.577+0000 7f2e85b95b80 20 client.26194 trim_cache size 0 max 16384 2023-10-05T15:23:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:23:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:23:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:23:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:23:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e5c0a15f0 msgr2=0x7f2e5c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e5c0a15f0 0x7f2e5c0a3ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e741988e0 tx=0x7f2e64009260 comp rx=0 tx=0).stop 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 msgr2=0x7f2e741970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 0x7f2e741970c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800d950 tx=0x7f2e6800dc60 comp rx=0 tx=0).stop 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 shutdown_connections 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f2e5c0a15f0 0x7f2e5c0a3ab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e7419bc70 0x7f2e7419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e740fffd0 0x7f2e741970c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 --2- 172.21.15.60:0/2083775027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e741050f0 0x7f2e74197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 >> 172.21.15.60:0/2083775027 conn(0x7f2e740fb830 msgr2=0x7f2e740692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 shutdown_connections 2023-10-05T15:23:14.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:14.578+0000 7f2e799ab700 1 -- 172.21.15.60:0/2083775027 wait complete. 2023-10-05T15:23:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:15 smithi135 ceph-mon[103360]: pgmap v198: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2023-10-05T15:23:15.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:15 smithi060 ceph-mon[99238]: pgmap v198: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2023-10-05T15:23:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:15 smithi092 ceph-mon[102944]: pgmap v198: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2023-10-05T15:23:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:17 smithi135 ceph-mon[103360]: pgmap v199: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-10-05T15:23:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:17 smithi060 ceph-mon[99238]: pgmap v199: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-10-05T15:23:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:17 smithi092 ceph-mon[102944]: pgmap v199: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-10-05T15:23:18.636 INFO:tasks.workunit.client.0.smithi060.stdout: 2023-10-05T15:23:18.636 INFO:tasks.workunit.client.0.smithi060.stdout:Final score for writes: 361 2023-10-05T15:23:18.636 INFO:tasks.workunit.client.0.smithi060.stdout:Final score for reads : 819297 2023-10-05T15:23:18.636 INFO:tasks.workunit.client.0.smithi060.stdout: 2023-10-05T15:23:18.637 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T15:23:18.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T15:23:19.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:19 smithi135 ceph-mon[103360]: pgmap v200: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 385 op/s 2023-10-05T15:23:19.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:19 smithi060 ceph-mon[99238]: pgmap v200: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 385 op/s 2023-10-05T15:23:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:19 smithi092 ceph-mon[102944]: pgmap v200: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 385 op/s 2023-10-05T15:23:21.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:21 smithi135 ceph-mon[103360]: pgmap v201: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 384 op/s 2023-10-05T15:23:21.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:21 smithi060 ceph-mon[99238]: pgmap v201: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 384 op/s 2023-10-05T15:23:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:21 smithi092 ceph-mon[102944]: pgmap v201: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 384 op/s 2023-10-05T15:23:22.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:22 smithi135 ceph-mon[103360]: pgmap v202: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.3 MiB/s wr, 402 op/s 2023-10-05T15:23:22.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:22 smithi060 ceph-mon[99238]: pgmap v202: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.3 MiB/s wr, 402 op/s 2023-10-05T15:23:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:22 smithi092 ceph-mon[102944]: pgmap v202: 129 pgs: 129 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.3 MiB/s wr, 402 op/s 2023-10-05T15:23:24.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:24 smithi135 ceph-mon[103360]: osdmap e95: 12 total, 12 up, 12 in 2023-10-05T15:23:24.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:24 smithi135 ceph-mon[103360]: pgmap v204: 129 pgs: 4 active+clean+snaptrim, 112 active+clean, 13 active+clean+snaptrim_wait; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 469 op/s 2023-10-05T15:23:24.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:24 smithi060 ceph-mon[99238]: osdmap e95: 12 total, 12 up, 12 in 2023-10-05T15:23:24.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:24 smithi060 ceph-mon[99238]: pgmap v204: 129 pgs: 4 active+clean+snaptrim, 112 active+clean, 13 active+clean+snaptrim_wait; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 469 op/s 2023-10-05T15:23:24.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:24 smithi092 ceph-mon[102944]: osdmap e95: 12 total, 12 up, 12 in 2023-10-05T15:23:24.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:24 smithi092 ceph-mon[102944]: pgmap v204: 129 pgs: 4 active+clean+snaptrim, 112 active+clean, 13 active+clean+snaptrim_wait; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 469 op/s 2023-10-05T15:23:27.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:27 smithi092 ceph-mon[102944]: pgmap v205: 129 pgs: 7 active+clean+snaptrim, 102 active+clean, 20 active+clean+snaptrim_wait; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.6 MiB/s wr, 454 op/s 2023-10-05T15:23:27.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:27 smithi135 ceph-mon[103360]: pgmap v205: 129 pgs: 7 active+clean+snaptrim, 102 active+clean, 20 active+clean+snaptrim_wait; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.6 MiB/s wr, 454 op/s 2023-10-05T15:23:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:27 smithi060 ceph-mon[99238]: pgmap v205: 129 pgs: 7 active+clean+snaptrim, 102 active+clean, 20 active+clean+snaptrim_wait; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.6 MiB/s wr, 454 op/s 2023-10-05T15:23:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.761+0000 7f5eab2e0700 1 -- 172.21.15.60:0/795663880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4100a60 msgr2=0x7f5ea4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.761+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/795663880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4100a60 0x7f5ea4100e40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00099c0 tx=0x7f5ea0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.764+0000 7f5eab2e0700 1 -- 172.21.15.60:0/795663880 shutdown_connections 2023-10-05T15:23:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.764+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/795663880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.764+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/795663880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4100a60 0x7f5ea4100e40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.764+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/795663880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea4101410 0x7f5ea4104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.764+0000 7f5eab2e0700 1 -- 172.21.15.60:0/795663880 >> 172.21.15.60:0/795663880 conn(0x7f5ea40762e0 msgr2=0x7f5ea40766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.767+0000 7f5eab2e0700 1 -- 172.21.15.60:0/795663880 shutdown_connections 2023-10-05T15:23:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.767+0000 7f5eab2e0700 1 -- 172.21.15.60:0/795663880 wait complete. 2023-10-05T15:23:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 Processor -- start 2023-10-05T15:23:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 -- start start 2023-10-05T15:23:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea4100a60 0x7f5ea419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4194e60 0x7f5ea41952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4195ac0 con 0x7f5ea4100a60 2023-10-05T15:23:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4195c30 con 0x7f5ea4105150 2023-10-05T15:23:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.768+0000 7f5eab2e0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4199b80 con 0x7f5ea4194e60 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea419c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54478/0 (socket says 172.21.15.60:54478) 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 -- 172.21.15.60:0/2398981907 learned_addr learned my addr 172.21.15.60:0/2398981907 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea987d700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4194e60 0x7f5ea41952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 -- 172.21.15.60:0/2398981907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4194e60 msgr2=0x7f5ea41952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4194e60 0x7f5ea41952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 -- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea4100a60 msgr2=0x7f5ea419bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea4100a60 0x7f5ea419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 -- 172.21.15.60:0/2398981907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00095f0 con 0x7f5ea4105150 2023-10-05T15:23:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.769+0000 7f5ea887b700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea419c540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b450 tx=0x7f5e9400b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.770+0000 7f5e9a7fc700 1 -- 172.21.15.60:0/2398981907 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94011830 con 0x7f5ea4105150 2023-10-05T15:23:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.770+0000 7f5e9a7fc700 1 -- 172.21.15.60:0/2398981907 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e94011e50 con 0x7f5ea4105150 2023-10-05T15:23:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.770+0000 7f5e9a7fc700 1 -- 172.21.15.60:0/2398981907 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94010de0 con 0x7f5ea4105150 2023-10-05T15:23:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.770+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea4199e00 con 0x7f5ea4105150 2023-10-05T15:23:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.770+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea419a2c0 con 0x7f5ea4105150 2023-10-05T15:23:27.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.774+0000 7f5e9a7fc700 1 -- 172.21.15.60:0/2398981907 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5e9401a400 con 0x7f5ea4105150 2023-10-05T15:23:27.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.775+0000 7f5e9a7fc700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e900a1770 0x7f5e900a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.775+0000 7f5e9a7fc700 1 -- 172.21.15.60:0/2398981907 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f5e940cd990 con 0x7f5ea4105150 2023-10-05T15:23:27.783 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 Processor -- start 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 -- start start 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d29fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d34e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5c93400 con 0x55bdb5d2a520 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5c84bc0 con 0x55bdb5d29c00 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5c824e0 con 0x55bdb5d353d0 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5ea907c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d29fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5ea907c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d29fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54484/0 (socket says 172.21.15.60:54484) 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5ea907c700 1 -- 172.21.15.60:0/2659127204 learned_addr learned my addr 172.21.15.60:0/2659127204 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:27.784 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5ea887b700 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d34e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.785 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.781+0000 7f5ea987d700 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.785 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.782+0000 7f5ea907c700 1 -- 172.21.15.60:0/2659127204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 msgr2=0x55bdb5d377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:27.785 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.782+0000 7f5ea907c700 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.785 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.782+0000 7f5ea907c700 1 -- 172.21.15.60:0/2659127204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 msgr2=0x55bdb5d34e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:27.785 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.782+0000 7f5ea907c700 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d34e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.785+0000 7f5ea907c700 1 -- 172.21.15.60:0/2659127204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdb5aa8d80 con 0x55bdb5d29c00 2023-10-05T15:23:27.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.785+0000 7f5ea907c700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e900a1770 0x7f5e900a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.788+0000 7f5ea907c700 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d29fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0006010 tx=0x7f5ea0009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=201a67d34ac3a038 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:27.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.788+0000 7f5ea907c700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e900a1770 0x7f5e900a3c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0023000 tx=0x7f5ea0025000 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:27.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.789+0000 7f5e8f7fe700 1 -- 172.21.15.60:0/2659127204 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000bcf0 con 0x55bdb5d29c00 2023-10-05T15:23:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.789+0000 7f5e8f7fe700 1 -- 172.21.15.60:0/2659127204 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ea0005170 con 0x55bdb5d29c00 2023-10-05T15:23:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.789+0000 7f5e8f7fe700 1 -- 172.21.15.60:0/2659127204 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0004700 con 0x55bdb5d29c00 2023-10-05T15:23:27.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 -- 172.21.15.60:0/2659127204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 msgr2=0x55bdb5d29fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:27.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d29fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0006010 tx=0x7f5ea0009f30 comp rx=0 tx=0).stop 2023-10-05T15:23:27.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 -- 172.21.15.60:0/2659127204 shutdown_connections 2023-10-05T15:23:27.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d29fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/2659127204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d34e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.794+0000 7f5eb74cab80 1 -- 172.21.15.60:0/2659127204 >> 172.21.15.60:0/2659127204 conn(0x55bdb5c9f200 msgr2=0x55bdb5d26080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.796+0000 7f5eb74cab80 1 -- 172.21.15.60:0/2659127204 shutdown_connections 2023-10-05T15:23:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.796+0000 7f5eb74cab80 1 -- 172.21.15.60:0/2659127204 wait complete. 2023-10-05T15:23:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.796+0000 7f5eb74cab80 1 -- start start 2023-10-05T15:23:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.797+0000 7f5eb74cab80 1 Processor -- start 2023-10-05T15:23:27.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d34e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 0x55bdb5d32090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d353d0 0x55bdb5d327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5c7ddd0 con 0x55bdb5d353d0 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5c1a6b0 con 0x55bdb5d29c00 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5c1a350 con 0x55bdb5d2a520 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.798+0000 7f5eb74cab80 10 client.0 _ll_register_callbacks cb 0x55bdb5a777a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 0x55bdb5d32090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea987d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d353d0 0x55bdb5d327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 0x55bdb5d32090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54600/0 (socket says 172.21.15.60:54600) 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea987d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d353d0 0x55bdb5d327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41072/0 (socket says 172.21.15.60:41072) 2023-10-05T15:23:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea907c700 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d34e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 -- 172.21.15.60:0/1436095304 learned_addr learned my addr 172.21.15.60:0/1436095304 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 -- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 msgr2=0x55bdb5d34e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d34e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 -- 172.21.15.60:0/1436095304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d353d0 msgr2=0x55bdb5d327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d353d0 0x55bdb5d327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 -- 172.21.15.60:0/1436095304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea410d4d0 con 0x55bdb5d2a520 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.799+0000 7f5ea887b700 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 0x55bdb5d32090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b420 tx=0x7f5e940963e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f093a52b1a6d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.800+0000 7f5e8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.800+0000 7f5e8cff9700 1 -- 172.21.15.60:0/1436095304 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94018510 con 0x55bdb5d2a520 2023-10-05T15:23:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.800+0000 7f5e8cff9700 1 -- 172.21.15.60:0/1436095304 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f5e940b2030 con 0x55bdb5d2a520 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.800+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdb5d1dd50 con 0x55bdb5d2a520 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5e8cff9700 1 -- 172.21.15.60:0/1436095304 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e9409e800 con 0x55bdb5d2a520 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 10 client.26206 fetch_fsmap learned FSMap version 37 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bdb5a91c00 con 0x55bdb5d2a520 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5e8cff9700 1 -- 172.21.15.60:0/1436095304 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e940a6020 con 0x55bdb5d2a520 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5e8cff9700 1 -- 172.21.15.60:0/1436095304 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f5e94099ba0 con 0x55bdb5d2a520 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 10 client.26206 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 10 client.26206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 20 client.26206 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d44ec0 0x55bdb5d472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 4 client.26206 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:23:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.801+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdb5c76db0 con 0x55bdb5d44ec0 2023-10-05T15:23:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.802+0000 7f5ea907c700 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d44ec0 0x55bdb5d472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.805+0000 7f5e8cff9700 10 client.26206 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.805+0000 7f5ea907c700 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d44ec0 0x55bdb5d472e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70b246b1cdf1778 server_cookie=5341865798b0f7ca in_seq=0 out_seq=0 2023-10-05T15:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5e8cff9700 1 -- 172.21.15.60:0/1436095304 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bdb5c76db0 con 0x55bdb5d44ec0 2023-10-05T15:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5e8cff9700 10 client.26206 handle_command_reply: tid=0 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 client.26206 shutdown 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 msgr2=0x55bdb5d32090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 0x55bdb5d32090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b420 tx=0x7f5e940963e0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 shutdown_connections 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d44ec0 0x55bdb5d472e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d353d0 0x55bdb5d327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d29c00 0x55bdb5d34e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/1436095304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d2a520 0x55bdb5d32090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.837+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 >> 172.21.15.60:0/1436095304 conn(0x55bdb5c9f200 msgr2=0x55bdb5d25c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.838+0000 7f5e8cff9700 0 client.26206 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.839+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 shutdown_connections 2023-10-05T15:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.839+0000 7f5eb74cab80 1 -- 172.21.15.60:0/1436095304 wait complete. 2023-10-05T15:23:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.845+0000 7f5eb74cab80 20 client.26206 trim_cache size 0 max 16384 2023-10-05T15:23:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.872+0000 7f5eb74cab80 1 Processor -- start 2023-10-05T15:23:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 -- start start 2023-10-05T15:23:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d29c00 0x55bdb5d377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d2a520 0x55bdb5d31850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d46ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5afe8c0 con 0x55bdb5d29c00 2023-10-05T15:23:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5d2dee0 con 0x55bdb5d2a520 2023-10-05T15:23:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.875+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5d31d90 con 0x55bdb5d353d0 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.878+0000 7f5ea987d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d46ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.880+0000 7f5ea987d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d46ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54606/0 (socket says 172.21.15.60:54606) 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.880+0000 7f5ea987d700 1 -- 172.21.15.60:0/674155262 learned_addr learned my addr 172.21.15.60:0/674155262 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.881+0000 7f5ea987d700 1 -- 172.21.15.60:0/674155262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d2a520 msgr2=0x55bdb5d31850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.881+0000 7f5ea987d700 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d2a520 0x55bdb5d31850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.881+0000 7f5ea987d700 1 -- 172.21.15.60:0/674155262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d29c00 msgr2=0x55bdb5d377c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.881+0000 7f5ea987d700 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d29c00 0x55bdb5d377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.881+0000 7f5ea987d700 1 -- 172.21.15.60:0/674155262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdb5acf1f0 con 0x55bdb5d353d0 2023-10-05T15:23:27.885 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.882+0000 7f5ea987d700 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d46ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009f90 tx=0x7f5e9c0073e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb4dfe0e8d8fa902 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:27.885 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.883+0000 7f5e8ffff700 1 -- 172.21.15.60:0/674155262 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c009b10 con 0x55bdb5d353d0 2023-10-05T15:23:27.885 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.883+0000 7f5e8ffff700 1 -- 172.21.15.60:0/674155262 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e9c00f040 con 0x55bdb5d353d0 2023-10-05T15:23:27.885 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.883+0000 7f5e8ffff700 1 -- 172.21.15.60:0/674155262 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c039840 con 0x55bdb5d353d0 2023-10-05T15:23:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.885+0000 7f5eb74cab80 1 -- 172.21.15.60:0/674155262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 msgr2=0x55bdb5d46ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.886+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d46ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009f90 tx=0x7f5e9c0073e0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.886+0000 7f5eb74cab80 1 -- 172.21.15.60:0/674155262 shutdown_connections 2023-10-05T15:23:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.886+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d353d0 0x55bdb5d46ed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.886+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d29c00 0x55bdb5d377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.886+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/674155262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d2a520 0x55bdb5d31850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.886+0000 7f5eb74cab80 1 -- 172.21.15.60:0/674155262 >> 172.21.15.60:0/674155262 conn(0x55bdb5c9f200 msgr2=0x55bdb5d4bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:27.892 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.887+0000 7f5eb74cab80 1 -- 172.21.15.60:0/674155262 shutdown_connections 2023-10-05T15:23:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.894+0000 7f5eb74cab80 1 -- 172.21.15.60:0/674155262 wait complete. 2023-10-05T15:23:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.894+0000 7f5eb74cab80 1 -- start start 2023-10-05T15:23:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.894+0000 7f5eb74cab80 1 Processor -- start 2023-10-05T15:23:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d29c00 0x55bdb5d37fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d38520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d353d0 0x55bdb5d3b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5d3ba20 con 0x55bdb5d2a520 2023-10-05T15:23:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5d3bb90 con 0x55bdb5d353d0 2023-10-05T15:23:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb5d3bd50 con 0x55bdb5d29c00 2023-10-05T15:23:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.900+0000 7f5eb74cab80 10 client.0 _ll_register_callbacks cb 0x7f5e9409a050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.901+0000 7f5ea887b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d38520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.901+0000 7f5ea887b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d38520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41082/0 (socket says 172.21.15.60:41082) 2023-10-05T15:23:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.901+0000 7f5ea887b700 1 -- 172.21.15.60:0/948707599 learned_addr learned my addr 172.21.15.60:0/948707599 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.902+0000 7f5ea987d700 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d353d0 0x55bdb5d3b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.903+0000 7f5ea887b700 1 -- 172.21.15.60:0/948707599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d29c00 msgr2=0x55bdb5d37fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:23:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.903+0000 7f5ea887b700 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d29c00 0x55bdb5d37fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.903+0000 7f5ea887b700 1 -- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d353d0 msgr2=0x55bdb5d3b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.903+0000 7f5ea887b700 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d353d0 0x55bdb5d3b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.903+0000 7f5ea887b700 1 -- 172.21.15.60:0/948707599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c009c70 con 0x55bdb5d2a520 2023-10-05T15:23:27.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.908+0000 7f5ea887b700 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d38520 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5e9409af60 tx=0x7f5e940ba040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22176e4fd83937bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.909+0000 7f5e8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:23:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.909+0000 7f5e8cff9700 1 -- 172.21.15.60:0/948707599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9409ab10 con 0x55bdb5d2a520 2023-10-05T15:23:27.911 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.909+0000 7f5e8cff9700 1 -- 172.21.15.60:0/948707599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f5e940b2050 con 0x55bdb5d2a520 2023-10-05T15:23:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ea0005170 con 0x55bdb5d2a520 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5e8cff9700 1 -- 172.21.15.60:0/948707599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e940092b0 con 0x55bdb5d2a520 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5eb74cab80 10 client.16668 fetch_fsmap learned FSMap version 37 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bdb5aa7250 con 0x55bdb5d2a520 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5e8cff9700 1 -- 172.21.15.60:0/948707599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e9407e020 con 0x55bdb5d2a520 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5e8cff9700 1 -- 172.21.15.60:0/948707599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 37) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f5e940a2600 con 0x55bdb5d2a520 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5eb74cab80 10 client.16668 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5eb74cab80 10 client.16668 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.918+0000 7f5eb74cab80 20 client.16668 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.919+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d99d00 0x55bdb5d9c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.919+0000 7f5eb74cab80 4 client.16668 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:23:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.919+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bdb5c76ad0 con 0x55bdb5d99d00 2023-10-05T15:23:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.919+0000 7f5ea907c700 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d99d00 0x55bdb5d9c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.921+0000 7f5ea907c700 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d99d00 0x55bdb5d9c120 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=846ee5bd87a0b4aa server_cookie=f1b220b5043ddd60 in_seq=0 out_seq=0 2023-10-05T15:23:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:27.921+0000 7f5e8cff9700 10 client.16668 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.342+0000 7f5e8cff9700 1 -- 172.21.15.60:0/948707599 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bdb5c76ad0 con 0x55bdb5d99d00 2023-10-05T15:23:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.342+0000 7f5e8cff9700 10 client.16668 handle_command_reply: tid=0 2023-10-05T15:23:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.342+0000 7f5eb74cab80 1 client.16668 shutdown 2023-10-05T15:23:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.344+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 msgr2=0x55bdb5d38520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.344+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d38520 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5e9409af60 tx=0x7f5e940ba040 comp rx=0 tx=0).stop 2023-10-05T15:23:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 shutdown_connections 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55bdb5d99d00 0x55bdb5d9c120 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdb5d353d0 0x55bdb5d3b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdb5d29c00 0x55bdb5d37fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 --2- 172.21.15.60:0/948707599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bdb5d2a520 0x55bdb5d38520 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 >> 172.21.15.60:0/948707599 conn(0x55bdb5c9f200 msgr2=0x55bdb5d46ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5e8cff9700 0 client.16668 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 shutdown_connections 2023-10-05T15:23:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 1 -- 172.21.15.60:0/948707599 wait complete. 2023-10-05T15:23:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.350+0000 7f5eb74cab80 20 client.16668 trim_cache size 0 max 16384 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.353+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e900a1770 msgr2=0x7f5e900a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.353+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e900a1770 0x7f5e900a3c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0023000 tx=0x7f5ea0025000 comp rx=0 tx=0).stop 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 msgr2=0x7f5ea419c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea419c540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b450 tx=0x7f5e9400b760 comp rx=0 tx=0).stop 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 shutdown_connections 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea4194e60 0x7f5ea41952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea4100a60 0x7f5ea419bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e900a1770 0x7f5e900a3c30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 --2- 172.21.15.60:0/2398981907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ea4105150 0x7f5ea419c540 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b450 tx=0x7f5e9400b760 comp rx=0 tx=0).stop 2023-10-05T15:23:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 >> 172.21.15.60:0/2398981907 conn(0x7f5ea40762e0 msgr2=0x7f5ea40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.354+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 shutdown_connections 2023-10-05T15:23:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:28.356+0000 7f5eab2e0700 1 -- 172.21.15.60:0/2398981907 wait complete. 2023-10-05T15:23:29.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:29 smithi135 ceph-mon[103360]: pgmap v206: 129 pgs: 18 active+clean+snaptrim, 62 active+clean, 49 active+clean+snaptrim_wait; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 282 op/s 2023-10-05T15:23:29.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:29 smithi060 ceph-mon[99238]: pgmap v206: 129 pgs: 18 active+clean+snaptrim, 62 active+clean, 49 active+clean+snaptrim_wait; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 282 op/s 2023-10-05T15:23:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:29 smithi092 ceph-mon[102944]: pgmap v206: 129 pgs: 18 active+clean+snaptrim, 62 active+clean, 49 active+clean+snaptrim_wait; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 282 op/s 2023-10-05T15:23:31.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:31 smithi135 ceph-mon[103360]: pgmap v207: 129 pgs: 18 active+clean+snaptrim, 71 active+clean, 40 active+clean+snaptrim_wait; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2023-10-05T15:23:31.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:31 smithi060 ceph-mon[99238]: pgmap v207: 129 pgs: 18 active+clean+snaptrim, 71 active+clean, 40 active+clean+snaptrim_wait; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2023-10-05T15:23:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:31 smithi092 ceph-mon[102944]: pgmap v207: 129 pgs: 18 active+clean+snaptrim, 71 active+clean, 40 active+clean+snaptrim_wait; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2023-10-05T15:23:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:32 smithi135 ceph-mon[103360]: pgmap v208: 129 pgs: 13 active+clean+snaptrim, 88 active+clean, 28 active+clean+snaptrim_wait; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 757 KiB/s wr, 353 op/s 2023-10-05T15:23:32.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:32 smithi060 ceph-mon[99238]: pgmap v208: 129 pgs: 13 active+clean+snaptrim, 88 active+clean, 28 active+clean+snaptrim_wait; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 757 KiB/s wr, 353 op/s 2023-10-05T15:23:32.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:32 smithi092 ceph-mon[102944]: pgmap v208: 129 pgs: 13 active+clean+snaptrim, 88 active+clean, 28 active+clean+snaptrim_wait; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 757 KiB/s wr, 353 op/s 2023-10-05T15:23:33.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:33 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:33.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:33 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:33.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:33 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:34.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:34 smithi135 ceph-mon[103360]: pgmap v209: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 423 op/s 2023-10-05T15:23:34.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:34 smithi060 ceph-mon[99238]: pgmap v209: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 423 op/s 2023-10-05T15:23:34.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:34 smithi092 ceph-mon[102944]: pgmap v209: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 423 op/s 2023-10-05T15:23:37.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:37 smithi092 ceph-mon[102944]: pgmap v210: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 370 op/s 2023-10-05T15:23:37.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:37 smithi092 ceph-mon[102944]: osdmap e96: 12 total, 12 up, 12 in 2023-10-05T15:23:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:37 smithi135 ceph-mon[103360]: pgmap v210: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 370 op/s 2023-10-05T15:23:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:37 smithi135 ceph-mon[103360]: osdmap e96: 12 total, 12 up, 12 in 2023-10-05T15:23:37.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:37 smithi060 ceph-mon[99238]: pgmap v210: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 370 op/s 2023-10-05T15:23:37.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:37 smithi060 ceph-mon[99238]: osdmap e96: 12 total, 12 up, 12 in 2023-10-05T15:23:39.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:39 smithi135 ceph-mon[103360]: pgmap v212: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 457 op/s 2023-10-05T15:23:39.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:39 smithi060 ceph-mon[99238]: pgmap v212: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 457 op/s 2023-10-05T15:23:39.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:39 smithi092 ceph-mon[102944]: pgmap v212: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 457 op/s 2023-10-05T15:23:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:40 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:40.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:40 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:40.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:40 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.514+0000 7f25e1c0e700 1 -- 172.21.15.60:0/2974714789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc100990 msgr2=0x7f25dc1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.514+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/2974714789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc100990 0x7f25dc1049d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009990 tx=0x7f25cc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 -- 172.21.15.60:0/2974714789 shutdown_connections 2023-10-05T15:23:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/2974714789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25dc105100 0x7f25dc10cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/2974714789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0fffe0 0x7f25dc1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/2974714789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc100990 0x7f25dc1049d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 -- 172.21.15.60:0/2974714789 >> 172.21.15.60:0/2974714789 conn(0x7f25dc076eb0 msgr2=0x7f25dc0772c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:41.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 -- 172.21.15.60:0/2974714789 shutdown_connections 2023-10-05T15:23:41.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.515+0000 7f25e1c0e700 1 -- 172.21.15.60:0/2974714789 wait complete. 2023-10-05T15:23:41.519 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 Processor -- start 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 -- start start 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25dc0fffe0 0x7f25dc1159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 0x7f25dc10f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc10fe60 0x7f25dc1b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc1105a0 con 0x7f25dc10fe60 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc1b2b50 con 0x7f25dc0fffe0 2023-10-05T15:23:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.516+0000 7f25e1c0e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc1b2c90 con 0x7f25dc105100 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 0x7f25dc10f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 0x7f25dc10f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54628/0 (socket says 172.21.15.60:54628) 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 -- 172.21.15.60:0/674007764 learned_addr learned my addr 172.21.15.60:0/674007764 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25db7fe700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25dc0fffe0 0x7f25dc1159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 -- 172.21.15.60:0/674007764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25dc0fffe0 msgr2=0x7f25dc1159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25dc0fffe0 0x7f25dc1159f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 -- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc10fe60 msgr2=0x7f25dc1b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc10fe60 0x7f25dc1b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 -- 172.21.15.60:0/674007764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0095f0 con 0x7f25dc105100 2023-10-05T15:23:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.517+0000 7f25daffd700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 0x7f25dc10f7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25cc005740 tx=0x7f25cc005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.518+0000 7f25d8ff9700 1 -- 172.21.15.60:0/674007764 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc01d070 con 0x7f25dc105100 2023-10-05T15:23:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.518+0000 7f25d8ff9700 1 -- 172.21.15.60:0/674007764 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25cc004010 con 0x7f25dc105100 2023-10-05T15:23:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.518+0000 7f25d8ff9700 1 -- 172.21.15.60:0/674007764 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc022db0 con 0x7f25dc105100 2023-10-05T15:23:41.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.519+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc1b2e90 con 0x7f25dc105100 2023-10-05T15:23:41.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.519+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc1b3200 con 0x7f25dc105100 2023-10-05T15:23:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.523+0000 7f25d8ff9700 1 -- 172.21.15.60:0/674007764 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f25cc022470 con 0x7f25dc105100 2023-10-05T15:23:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.524+0000 7f25d8ff9700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25c40a1730 0x7f25c40a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.524+0000 7f25d8ff9700 1 -- 172.21.15.60:0/674007764 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9359+0+0 (secure 0 0 0) 0x7f25cc0ce2f0 con 0x7f25dc105100 2023-10-05T15:23:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.525+0000 7f25eddf8b80 1 Processor -- start 2023-10-05T15:23:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 -- start start 2023-10-05T15:23:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 0x55b61fd43e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fca2400 con 0x55b61fd443d0 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fc93bc0 con 0x55b61fd39520 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fc914e0 con 0x55b61fd38c00 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 0x55b61fd43e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25dbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 0x55b61fd43e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54528/0 (socket says 172.21.15.60:54528) 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 -- 172.21.15.60:0/3182437535 learned_addr learned my addr 172.21.15.60:0/3182437535 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 -- 172.21.15.60:0/3182437535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd38c00 msgr2=0x55b61fd38fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 -- 172.21.15.60:0/3182437535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 msgr2=0x55b61fd467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.526+0000 7f25daffd700 1 -- 172.21.15.60:0/3182437535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b61fab7d80 con 0x55b61fd39520 2023-10-05T15:23:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.527+0000 7f25db7fe700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25c40a1730 0x7f25c40a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.527+0000 7f25daffd700 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 0x55b61fd43e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f25cc097520 tx=0x7f25cc09a980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86a9a4c43c5c4254 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.527+0000 7f25c1ffb700 1 -- 172.21.15.60:0/3182437535 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc09b020 con 0x55b61fd39520 2023-10-05T15:23:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.527+0000 7f25c1ffb700 1 -- 172.21.15.60:0/3182437535 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25cc09f170 con 0x55b61fd39520 2023-10-05T15:23:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.527+0000 7f25c1ffb700 1 -- 172.21.15.60:0/3182437535 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc09b4a0 con 0x55b61fd39520 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.527+0000 7f25db7fe700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25c40a1730 0x7f25c40a3bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25d400a620 tx=0x7f25d4009d50 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3182437535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 msgr2=0x55b61fd43e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 0x55b61fd43e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f25cc097520 tx=0x7f25cc09a980 comp rx=0 tx=0).stop 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3182437535 shutdown_connections 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3182437535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd39520 0x55b61fd43e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3182437535 >> 172.21.15.60:0/3182437535 conn(0x55b61fcae200 msgr2=0x55b61fd35080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3182437535 shutdown_connections 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.528+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3182437535 wait complete. 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.529+0000 7f25eddf8b80 1 -- start start 2023-10-05T15:23:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.529+0000 7f25eddf8b80 1 Processor -- start 2023-10-05T15:23:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 0x55b61fd447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd44cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd4f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fc8cdd0 con 0x55b61fd38c00 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fc296b0 con 0x55b61fd443d0 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fc29350 con 0x55b61fd39520 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25eddf8b80 10 client.0 _ll_register_callbacks cb 0x55b61fa867a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 0x55b61fd447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 0x55b61fd447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41110/0 (socket says 172.21.15.60:41110) 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 -- 172.21.15.60:0/1524724303 learned_addr learned my addr 172.21.15.60:0/1524724303 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 -- 172.21.15.60:0/1524724303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 msgr2=0x55b61fd44cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd44cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 -- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 msgr2=0x55b61fd4f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd4f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.530+0000 7f25db7fe700 1 -- 172.21.15.60:0/1524724303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc1b3200 con 0x55b61fd38c00 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25db7fe700 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 0x55b61fd447b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f25d4004b10 tx=0x7f25d4004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90751201aa38dd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25baffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25baffd700 1 -- 172.21.15.60:0/1524724303 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4018e80 con 0x55b61fd38c00 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25baffd700 1 -- 172.21.15.60:0/1524724303 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9359+0+0 (secure 0 0 0) 0x7f25d4006e40 con 0x55b61fd38c00 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b61fd2cd50 con 0x55b61fd38c00 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25baffd700 1 -- 172.21.15.60:0/1524724303 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d4016840 con 0x55b61fd38c00 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25eddf8b80 10 client.16674 fetch_fsmap learned FSMap version 39 2023-10-05T15:23:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.531+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55b61faa0c00 con 0x55b61fd38c00 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25baffd700 1 -- 172.21.15.60:0/1524724303 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b61fd2cd50 con 0x55b61fd38c00 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25baffd700 1 -- 172.21.15.60:0/1524724303 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f25d4017bf0 con 0x55b61fd38c00 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25eddf8b80 10 client.16674 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25eddf8b80 10 client.16674 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25eddf8b80 20 client.16674 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fd53d10 0x55b61fd56170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25eddf8b80 4 client.16674 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:23:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.532+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b61fc85db0 con 0x55b61fd53d10 2023-10-05T15:23:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.536+0000 7f25daffd700 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fd53d10 0x55b61fd56170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.539+0000 7f25daffd700 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fd53d10 0x55b61fd56170 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad7f132fad8f9962 server_cookie=19ecf7aec13e81d5 in_seq=0 out_seq=0 2023-10-05T15:23:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.539+0000 7f25baffd700 10 client.16674 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.541+0000 7f25baffd700 1 -- 172.21.15.60:0/1524724303 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b61fc85db0 con 0x55b61fd53d10 2023-10-05T15:23:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.541+0000 7f25baffd700 10 client.16674 handle_command_reply: tid=0 2023-10-05T15:23:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.541+0000 7f25eddf8b80 1 client.16674 shutdown 2023-10-05T15:23:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 msgr2=0x55b61fd447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 0x55b61fd447b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f25d4004b10 tx=0x7f25d4004be0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 shutdown_connections 2023-10-05T15:23:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fd53d10 0x55b61fd56170 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd4f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd38c00 0x55b61fd447b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25baffd700 0 client.16674 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.542+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/1524724303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd44cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.543+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 >> 172.21.15.60:0/1524724303 conn(0x55b61fcae200 msgr2=0x55b61fd34c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.545+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 shutdown_connections 2023-10-05T15:23:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.545+0000 7f25eddf8b80 1 -- 172.21.15.60:0/1524724303 wait complete. 2023-10-05T15:23:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.545+0000 7f25eddf8b80 20 client.16674 trim_cache size 0 max 16384 2023-10-05T15:23:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.572+0000 7f25eddf8b80 1 Processor -- start 2023-10-05T15:23:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.576+0000 7f25eddf8b80 1 -- start start 2023-10-05T15:23:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.576+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.576+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd3ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd3e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fb0d8c0 con 0x55b61fd443d0 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fd36520 con 0x55b61fd38c00 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fd3f3c0 con 0x55b61fd39520 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54540/0 (socket says 172.21.15.60:54540) 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 -- 172.21.15.60:0/3588142918 learned_addr learned my addr 172.21.15.60:0/3588142918 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25daffd700 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd3ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25dbfff700 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd3e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 -- 172.21.15.60:0/3588142918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 msgr2=0x55b61fd3ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd3ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 -- 172.21.15.60:0/3588142918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 msgr2=0x55b61fd3e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd3e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.577+0000 7f25db7fe700 1 -- 172.21.15.60:0/3588142918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b61fade1f0 con 0x55b61fd38c00 2023-10-05T15:23:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.578+0000 7f25db7fe700 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009d20 tx=0x7f25d4009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aab32033016db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:41.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:41 smithi135 ceph-mon[103360]: pgmap v213: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 440 op/s 2023-10-05T15:23:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.578+0000 7f25c27fc700 1 -- 172.21.15.60:0/3588142918 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40144d0 con 0x55b61fd38c00 2023-10-05T15:23:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.578+0000 7f25c27fc700 1 -- 172.21.15.60:0/3588142918 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25d4019e90 con 0x55b61fd38c00 2023-10-05T15:23:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.578+0000 7f25c27fc700 1 -- 172.21.15.60:0/3588142918 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4016b50 con 0x55b61fd38c00 2023-10-05T15:23:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3588142918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 msgr2=0x55b61fd38fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009d20 tx=0x7f25d4009740 comp rx=0 tx=0).stop 2023-10-05T15:23:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3588142918 shutdown_connections 2023-10-05T15:23:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd443d0 0x55b61fd3e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd38c00 0x55b61fd38fe0 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009d20 tx=0x7f25d4009740 comp rx=0 tx=0).stop 2023-10-05T15:23:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/3588142918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fd39520 0x55b61fd3ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.579+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3588142918 >> 172.21.15.60:0/3588142918 conn(0x55b61fcae200 msgr2=0x55b61fd42df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.585+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3588142918 shutdown_connections 2023-10-05T15:23:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.587+0000 7f25eddf8b80 1 -- 172.21.15.60:0/3588142918 wait complete. 2023-10-05T15:23:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 -- start start 2023-10-05T15:23:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 Processor -- start 2023-10-05T15:23:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd39520 0x55b61fd45940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd45e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fda4ba0 0x55b61fda6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fd465b0 con 0x55b61fd39520 2023-10-05T15:23:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fda74d0 con 0x55b61fd443d0 2023-10-05T15:23:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.588+0000 7f25eddf8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b61fda7660 con 0x55b61fda4ba0 2023-10-05T15:23:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25eddf8b80 10 client.0 _ll_register_callbacks cb 0x7f25d4018820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd45e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd45e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54546/0 (socket says 172.21.15.60:54546) 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 -- 172.21.15.60:0/2008973036 learned_addr learned my addr 172.21.15.60:0/2008973036 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25dbfff700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fda4ba0 0x55b61fda6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25db7fe700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd39520 0x55b61fd45940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 -- 172.21.15.60:0/2008973036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fda4ba0 msgr2=0x55b61fda6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fda4ba0 0x55b61fda6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 -- 172.21.15.60:0/2008973036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd39520 msgr2=0x55b61fd45940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd39520 0x55b61fd45940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.589+0000 7f25daffd700 1 -- 172.21.15.60:0/2008973036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b61faa0c00 con 0x55b61fd443d0 2023-10-05T15:23:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.590+0000 7f25db7fe700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd39520 0x55b61fd45940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:23:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.590+0000 7f25daffd700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd45e80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0cb7b0 tx=0x7f25cc097360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964e579189772a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.591+0000 7f25baffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:23:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.591+0000 7f25baffd700 1 -- 172.21.15.60:0/2008973036 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0a12b0 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.591+0000 7f25baffd700 1 -- 172.21.15.60:0/2008973036 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9359+0+0 (secure 0 0 0) 0x7f25cc0b9250 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25cc09f170 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25baffd700 1 -- 172.21.15.60:0/2008973036 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25cc09a510 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 10 client.26342 fetch_fsmap learned FSMap version 39 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55b61fab6250 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25baffd700 1 -- 172.21.15.60:0/2008973036 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25cc09f170 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25baffd700 1 -- 172.21.15.60:0/2008973036 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 39) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f25cc0a2e90 con 0x55b61fd443d0 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 10 client.26342 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 10 client.26342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 20 client.26342 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fda8b00 0x55b61fdaaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 4 client.26342 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:23:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.592+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b61fc85ad0 con 0x55b61fda8b00 2023-10-05T15:23:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.593+0000 7f25db7fe700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fda8b00 0x55b61fdaaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.593+0000 7f25baffd700 10 client.26342 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:41.593+0000 7f25db7fe700 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fda8b00 0x55b61fdaaf20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64cde53affd323b3 server_cookie=a2534b4e8b9fa3e3 in_seq=0 out_seq=0 2023-10-05T15:23:41.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:41 smithi060 ceph-mon[99238]: pgmap v213: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 440 op/s 2023-10-05T15:23:41.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:41 smithi092 ceph-mon[102944]: pgmap v213: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 440 op/s 2023-10-05T15:23:42.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:42 smithi135 ceph-mon[103360]: osdmap e97: 12 total, 12 up, 12 in 2023-10-05T15:23:42.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:42 smithi135 ceph-mon[103360]: pgmap v215: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 285 op/s 2023-10-05T15:23:42.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:42 smithi060 ceph-mon[99238]: osdmap e97: 12 total, 12 up, 12 in 2023-10-05T15:23:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:42 smithi060 ceph-mon[99238]: pgmap v215: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 285 op/s 2023-10-05T15:23:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:42 smithi092 ceph-mon[102944]: osdmap e97: 12 total, 12 up, 12 in 2023-10-05T15:23:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:42 smithi092 ceph-mon[102944]: pgmap v215: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 285 op/s 2023-10-05T15:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25baffd700 1 -- 172.21.15.60:0/2008973036 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b61fc85ad0 con 0x55b61fda8b00 2023-10-05T15:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25baffd700 10 client.26342 handle_command_reply: tid=0 2023-10-05T15:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 client.26342 shutdown 2023-10-05T15:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 msgr2=0x55b61fd45e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd45e80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0cb7b0 tx=0x7f25cc097360 comp rx=0 tx=0).stop 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 shutdown_connections 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b61fda8b00 0x55b61fdaaf20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b61fda4ba0 0x55b61fda6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b61fd39520 0x55b61fd45940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 --2- 172.21.15.60:0/2008973036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b61fd443d0 0x55b61fd45e80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 >> 172.21.15.60:0/2008973036 conn(0x55b61fcae200 msgr2=0x55b61fd3ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25baffd700 0 client.26342 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 shutdown_connections 2023-10-05T15:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.943+0000 7f25eddf8b80 1 -- 172.21.15.60:0/2008973036 wait complete. 2023-10-05T15:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.944+0000 7f25eddf8b80 20 client.26342 trim_cache size 0 max 16384 2023-10-05T15:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25c40a1730 msgr2=0x7f25c40a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25c40a1730 0x7f25c40a3bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25d400a620 tx=0x7f25d4009d50 comp rx=0 tx=0).stop 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 msgr2=0x7f25dc10f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 0x7f25dc10f7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25cc005740 tx=0x7f25cc005770 comp rx=0 tx=0).stop 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 shutdown_connections 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc10fe60 0x7f25dc1b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f25c40a1730 0x7f25c40a3bf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25dc0fffe0 0x7f25dc1159f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 --2- 172.21.15.60:0/674007764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25dc105100 0x7f25dc10f7c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 >> 172.21.15.60:0/674007764 conn(0x7f25dc076eb0 msgr2=0x7f25dc0ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 shutdown_connections 2023-10-05T15:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:42.945+0000 7f25e1c0e700 1 -- 172.21.15.60:0/674007764 wait complete. 2023-10-05T15:23:45.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:45 smithi092 ceph-mon[102944]: pgmap v216: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.1 MiB/s wr, 531 op/s 2023-10-05T15:23:45.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:45 smithi135 ceph-mon[103360]: pgmap v216: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.1 MiB/s wr, 531 op/s 2023-10-05T15:23:45.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:45 smithi060 ceph-mon[99238]: pgmap v216: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.1 MiB/s wr, 531 op/s 2023-10-05T15:23:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:47 smithi135 ceph-mon[103360]: pgmap v217: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.5 MiB/s wr, 503 op/s 2023-10-05T15:23:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:47 smithi060 ceph-mon[99238]: pgmap v217: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.5 MiB/s wr, 503 op/s 2023-10-05T15:23:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:47 smithi092 ceph-mon[102944]: pgmap v217: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.5 MiB/s wr, 503 op/s 2023-10-05T15:23:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:48 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:48.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:48 smithi135 ceph-mon[103360]: pgmap v218: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 526 op/s 2023-10-05T15:23:48.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:48 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:48.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:48 smithi060 ceph-mon[99238]: pgmap v218: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 526 op/s 2023-10-05T15:23:48.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:48 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:48.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:48 smithi092 ceph-mon[102944]: pgmap v218: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 526 op/s 2023-10-05T15:23:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:51 smithi135 ceph-mon[103360]: pgmap v219: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 557 op/s 2023-10-05T15:23:51.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:51 smithi060 ceph-mon[99238]: pgmap v219: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 557 op/s 2023-10-05T15:23:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:51 smithi092 ceph-mon[102944]: pgmap v219: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 557 op/s 2023-10-05T15:23:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:52 smithi135 ceph-mon[103360]: pgmap v220: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 551 op/s 2023-10-05T15:23:52.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:52 smithi060 ceph-mon[99238]: pgmap v220: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 551 op/s 2023-10-05T15:23:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:52 smithi092 ceph-mon[102944]: pgmap v220: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 551 op/s 2023-10-05T15:23:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:54 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:55.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:54 smithi135 ceph-mon[103360]: pgmap v221: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 599 op/s 2023-10-05T15:23:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:54 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:55.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:54 smithi060 ceph-mon[99238]: pgmap v221: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 599 op/s 2023-10-05T15:23:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:54 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:23:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:54 smithi092 ceph-mon[102944]: pgmap v221: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 599 op/s 2023-10-05T15:23:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 -- 172.21.15.60:0/467230066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc1061e0 msgr2=0x7f59bc10dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 --2- 172.21.15.60:0/467230066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc1061e0 0x7f59bc10dd60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009f90 tx=0x7f59b400b330 comp rx=0 tx=0).stop 2023-10-05T15:23:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 -- 172.21.15.60:0/467230066 shutdown_connections 2023-10-05T15:23:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 --2- 172.21.15.60:0/467230066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc1061e0 0x7f59bc10dd60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 --2- 172.21.15.60:0/467230066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc1010c0 0x7f59bc1014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 --2- 172.21.15.60:0/467230066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc101a70 0x7f59bc105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 -- 172.21.15.60:0/467230066 >> 172.21.15.60:0/467230066 conn(0x7f59bc0fc940 msgr2=0x7f59bc0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 -- 172.21.15.60:0/467230066 shutdown_connections 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.060+0000 7f59c18ec700 1 -- 172.21.15.60:0/467230066 wait complete. 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 Processor -- start 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 -- start start 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc1010c0 0x7f59bc197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc1061e0 0x7f59bc197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 0x7f59bc19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc19c700 con 0x7f59bc19bc80 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc19c870 con 0x7f59bc1010c0 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59c18ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc19ca30 con 0x7f59bc1061e0 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 0x7f59bc19c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 0x7f59bc19c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41142/0 (socket says 172.21.15.60:41142) 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc1061e0 0x7f59bc197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc1010c0 0x7f59bc197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.061+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3824904675 learned_addr learned my addr 172.21.15.60:0/3824904675 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3824904675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc1061e0 msgr2=0x7f59bc197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc1061e0 0x7f59bc197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3824904675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc1010c0 msgr2=0x7f59bc197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc1010c0 0x7f59bc197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3824904675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00095f0 con 0x7f59bc19bc80 2023-10-05T15:23:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 0x7f59bc19c100 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f59b4006070 tx=0x7f59b4004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59c08ea700 1 -- 172.21.15.60:0/3824904675 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400e040 con 0x7f59bc19bc80 2023-10-05T15:23:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59c08ea700 1 -- 172.21.15.60:0/3824904675 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59b4009320 con 0x7f59bc19bc80 2023-10-05T15:23:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b4009c40 con 0x7f59bc19bc80 2023-10-05T15:23:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59c08ea700 1 -- 172.21.15.60:0/3824904675 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4005040 con 0x7f59bc19bc80 2023-10-05T15:23:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.062+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc1a4270 con 0x7f59bc19bc80 2023-10-05T15:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.064+0000 7f59c08ea700 1 -- 172.21.15.60:0/3824904675 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f59b401d470 con 0x7f59bc19bc80 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.065+0000 7f59c08ea700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59a40a1670 0x7f59a40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.065+0000 7f59c08ea700 1 -- 172.21.15.60:0/3824904675 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9359+0+0 (secure 0 0 0) 0x7f59b40ce7d0 con 0x7f59bc19bc80 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.065+0000 7f59baffd700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59a40a1670 0x7f59a40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.065+0000 7f59baffd700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59a40a1670 0x7f59a40a3b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f59b0005fd0 tx=0x7f59b0009310 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 Processor -- start 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 -- start start 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f96f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f7520 0x55a0f9701e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 0x55a0f97047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f9660400 con 0x55a0f97023d0 2023-10-05T15:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f9651bc0 con 0x55a0f96f7520 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f964f4e0 con 0x55a0f96f6c00 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 0x55a0f97047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59baffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f96f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 0x55a0f97047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41150/0 (socket says 172.21.15.60:41150) 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3101638848 learned_addr learned my addr 172.21.15.60:0/3101638848 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f7520 0x55a0f9701e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3101638848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 msgr2=0x55a0f96f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f96f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3101638848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f7520 msgr2=0x55a0f9701e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f7520 0x55a0f9701e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59bb7fe700 1 -- 172.21.15.60:0/3101638848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0f9475d80 con 0x55a0f97023d0 2023-10-05T15:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59baffd700 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f96f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.066+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f7520 0x55a0f9701e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.067+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 0x55a0f97047c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f59b409b430 tx=0x7f59b409ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9421ae090dcd4d17 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.067+0000 7f59a1ffb700 1 -- 172.21.15.60:0/3101638848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b409b4a0 con 0x55a0f97023d0 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.067+0000 7f59a1ffb700 1 -- 172.21.15.60:0/3101638848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59b409f5f0 con 0x55a0f97023d0 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.067+0000 7f59a1ffb700 1 -- 172.21.15.60:0/3101638848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ce3d0 con 0x55a0f97023d0 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.067+0000 7f59cdad6b80 1 -- 172.21.15.60:0/3101638848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 msgr2=0x55a0f97047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.067+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 0x55a0f97047c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f59b409b430 tx=0x7f59b409ae00 comp rx=0 tx=0).stop 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- 172.21.15.60:0/3101638848 shutdown_connections 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f97023d0 0x55a0f97047c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f96f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/3101638848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f7520 0x55a0f9701e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- 172.21.15.60:0/3101638848 >> 172.21.15.60:0/3101638848 conn(0x55a0f966c200 msgr2=0x55a0f96f3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- 172.21.15.60:0/3101638848 shutdown_connections 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- 172.21.15.60:0/3101638848 wait complete. 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- start start 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 Processor -- start 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9701db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f96ff730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f964add0 con 0x55a0f96f7520 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f95e76b0 con 0x55a0f96f6c00 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.068+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f95e7350 con 0x55a0f97023d0 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59cdad6b80 10 client.0 _ll_register_callbacks cb 0x55a0f94447a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9701db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9701db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54574/0 (socket says 172.21.15.60:54574) 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96ff0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41154/0 (socket says 172.21.15.60:41154) 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 -- 172.21.15.60:0/212530067 learned_addr learned my addr 172.21.15.60:0/212530067 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 -- 172.21.15.60:0/212530067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 msgr2=0x55a0f96ff730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f96ff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 -- 172.21.15.60:0/212530067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 msgr2=0x55a0f96ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 -- 172.21.15.60:0/212530067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b0017070 con 0x55a0f96f6c00 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59baffd700 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9701db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59b000edf0 tx=0x7f59b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a855e7569e4d1ea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f599affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f599affd700 1 -- 172.21.15.60:0/212530067 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0022070 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0f96ead50 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f599affd700 1 -- 172.21.15.60:0/212530067 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9359+0+0 (secure 0 0 0) 0x7f59b001da30 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.069+0000 7f599affd700 1 -- 172.21.15.60:0/212530067 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59b001dc30 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 10 client.26354 fetch_fsmap learned FSMap version 41 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f59ac0098e0 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f599affd700 1 -- 172.21.15.60:0/212530067 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a0f96ead50 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f599affd700 1 -- 172.21.15.60:0/212530067 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 41) v1 ==== 7962+0+0 (secure 0 0 0) 0x7f59b001c400 con 0x55a0f96f6c00 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 10 client.26354 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 10 client.26354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 20 client.26354 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f9711e00 0x55a0f9714220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 4 client.26354 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0f9643db0 con 0x55a0f9711e00 2023-10-05T15:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f9711e00 0x55a0f9714220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f9711e00 0x55a0f9714220 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6523d1ef90c9edb8 server_cookie=91d72db144976af3 in_seq=0 out_seq=0 2023-10-05T15:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.070+0000 7f599affd700 10 client.26354 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.074+0000 7f599affd700 1 -- 172.21.15.60:0/212530067 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a0f9643db0 con 0x55a0f9711e00 2023-10-05T15:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.074+0000 7f599affd700 10 client.26354 handle_command_reply: tid=0 2023-10-05T15:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.074+0000 7f59cdad6b80 1 client.26354 shutdown 2023-10-05T15:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 msgr2=0x55a0f9701db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9701db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59b000edf0 tx=0x7f59b00047c0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 shutdown_connections 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f9711e00 0x55a0f9714220 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f96ff730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9701db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f599affd700 0 client.26354 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/212530067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 >> 172.21.15.60:0/212530067 conn(0x55a0f966c200 msgr2=0x55a0f96f2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 shutdown_connections 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 1 -- 172.21.15.60:0/212530067 wait complete. 2023-10-05T15:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.075+0000 7f59cdad6b80 20 client.26354 trim_cache size 0 max 16384 2023-10-05T15:23:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 Processor -- start 2023-10-05T15:23:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 -- start start 2023-10-05T15:23:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f97018e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f97023d0 0x55a0f96faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f94cb8c0 con 0x55a0f96f7520 2023-10-05T15:23:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f96f7be0 con 0x55a0f97023d0 2023-10-05T15:23:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f96f7230 con 0x55a0f96f6c00 2023-10-05T15:23:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96fa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41162/0 (socket says 172.21.15.60:41162) 2023-10-05T15:23:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 -- 172.21.15.60:0/420077389 learned_addr learned my addr 172.21.15.60:0/420077389 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59baffd700 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f97018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f97023d0 0x55a0f96faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 -- 172.21.15.60:0/420077389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 msgr2=0x55a0f97018e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f97018e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 -- 172.21.15.60:0/420077389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f97023d0 msgr2=0x55a0f96faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f97023d0 0x55a0f96faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.090+0000 7f59ba7fc700 1 -- 172.21.15.60:0/420077389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc1a4270 con 0x55a0f96f7520 2023-10-05T15:23:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96fa4d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f59bc1988f0 tx=0x7f59ac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be95598483fd7e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59a27fc700 1 -- 172.21.15.60:0/420077389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac016030 con 0x55a0f96f7520 2023-10-05T15:23:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59a27fc700 1 -- 172.21.15.60:0/420077389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59ac017040 con 0x55a0f96f7520 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59a27fc700 1 -- 172.21.15.60:0/420077389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac004c70 con 0x55a0f96f7520 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 -- 172.21.15.60:0/420077389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 msgr2=0x55a0f96fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96fa4d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f59bc1988f0 tx=0x7f59ac009260 comp rx=0 tx=0).stop 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 -- 172.21.15.60:0/420077389 shutdown_connections 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f97023d0 0x55a0f96faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f96f6c00 0x55a0f97018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/420077389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f96fa4d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 -- 172.21.15.60:0/420077389 >> 172.21.15.60:0/420077389 conn(0x55a0f966c200 msgr2=0x55a0f96f17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.091+0000 7f59cdad6b80 1 -- 172.21.15.60:0/420077389 shutdown_connections 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 -- 172.21.15.60:0/420077389 wait complete. 2023-10-05T15:23:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 -- start start 2023-10-05T15:23:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 Processor -- start 2023-10-05T15:23:56.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9706f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f97074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f9764c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f9707c70 con 0x55a0f96f7520 2023-10-05T15:23:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f9765170 con 0x55a0f96f6c00 2023-10-05T15:23:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f9765300 con 0x55a0f97023d0 2023-10-05T15:23:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59cdad6b80 10 client.0 _ll_register_callbacks cb 0x7f59b000e9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f97074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9706f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f97074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41168/0 (socket says 172.21.15.60:41168) 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.092+0000 7f59ba7fc700 1 -- 172.21.15.60:0/2901213181 learned_addr learned my addr 172.21.15.60:0/2901213181 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f9764c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 -- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 msgr2=0x55a0f9706f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9706f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 -- 172.21.15.60:0/2901213181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 msgr2=0x55a0f97074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:23:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f97074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 -- 172.21.15.60:0/2901213181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ac004040 con 0x55a0f97023d0 2023-10-05T15:23:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59baffd700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9706f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59ba7fc700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f97074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:23:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59bb7fe700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f9764c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f59b40a3960 tx=0x7f59b409b270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14751a43d678a16 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f599affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f599affd700 1 -- 172.21.15.60:0/2901213181 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a37a0 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59b409f5f0 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f599affd700 1 -- 172.21.15.60:0/2901213181 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9359+0+0 (secure 0 0 0) 0x7f59b409b4a0 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f599affd700 1 -- 172.21.15.60:0/2901213181 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59b40ce3d0 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59cdad6b80 10 client.26236 fetch_fsmap learned FSMap version 41 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55a0f945ec00 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.093+0000 7f599affd700 1 -- 172.21.15.60:0/2901213181 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59b409f5f0 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f599affd700 1 -- 172.21.15.60:0/2901213181 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7962+0+0 (secure 0 0 0) 0x7f59b409aa20 con 0x55a0f97023d0 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59cdad6b80 10 client.26236 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59cdad6b80 10 client.26236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:23:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59cdad6b80 20 client.26236 populate_metadata read hostname 'smithi060' 2023-10-05T15:23:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f97667b0 0x55a0f9768bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:23:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59cdad6b80 4 client.26236 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:23:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a0f9643ad0 con 0x55a0f97667b0 2023-10-05T15:23:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59baffd700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f97667b0 0x55a0f9768bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:23:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f599affd700 10 client.26236 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:56.094+0000 7f59baffd700 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f97667b0 0x55a0f9768bd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb2bbfd77dd387f9 server_cookie=acb10343ffd97bfc in_seq=0 out_seq=0 2023-10-05T15:23:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:57 smithi135 ceph-mon[103360]: pgmap v222: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 445 op/s 2023-10-05T15:23:57.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:57 smithi060 ceph-mon[99238]: pgmap v222: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 445 op/s 2023-10-05T15:23:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:57 smithi092 ceph-mon[102944]: pgmap v222: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 445 op/s 2023-10-05T15:23:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.831+0000 7f599affd700 1 -- 172.21.15.60:0/2901213181 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a0f9643ad0 con 0x55a0f97667b0 2023-10-05T15:23:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.831+0000 7f599affd700 10 client.26236 handle_command_reply: tid=0 2023-10-05T15:23:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.831+0000 7f59cdad6b80 1 client.26236 shutdown 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 msgr2=0x55a0f9764c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f9764c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f59b40a3960 tx=0x7f59b409b270 comp rx=0 tx=0).stop 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 shutdown_connections 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a0f97667b0 0x55a0f9768bd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a0f97023d0 0x55a0f9764c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0f96f6c00 0x55a0f9706f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 --2- 172.21.15.60:0/2901213181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0f96f7520 0x55a0f97074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 >> 172.21.15.60:0/2901213181 conn(0x55a0f966c200 msgr2=0x55a0f96fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.832+0000 7f599affd700 0 client.26236 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 shutdown_connections 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59cdad6b80 1 -- 172.21.15.60:0/2901213181 wait complete. 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59cdad6b80 20 client.26236 trim_cache size 0 max 16384 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:23:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:23:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59a40a1670 msgr2=0x7f59a40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59a40a1670 0x7f59a40a3b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f59b0005fd0 tx=0x7f59b0009310 comp rx=0 tx=0).stop 2023-10-05T15:23:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 msgr2=0x7f59bc19c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:23:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 0x7f59bc19c100 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f59b4006070 tx=0x7f59b4004d00 comp rx=0 tx=0).stop 2023-10-05T15:23:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 shutdown_connections 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc19bc80 0x7f59bc19c100 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.833+0000 7f59c18ec700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f59a40a1670 0x7f59a40a3b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.834+0000 7f59c18ec700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc1010c0 0x7f59bc197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.834+0000 7f59c18ec700 1 --2- 172.21.15.60:0/3824904675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc1061e0 0x7f59bc197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.834+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 >> 172.21.15.60:0/3824904675 conn(0x7f59bc0fc940 msgr2=0x7f59bc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.834+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 shutdown_connections 2023-10-05T15:23:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:23:57.834+0000 7f59c18ec700 1 -- 172.21.15.60:0/3824904675 wait complete. 2023-10-05T15:23:59.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:23:59 smithi135 ceph-mon[103360]: pgmap v223: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 733 op/s 2023-10-05T15:23:59.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:23:59 smithi060 ceph-mon[99238]: pgmap v223: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 733 op/s 2023-10-05T15:23:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:23:59 smithi092 ceph-mon[102944]: pgmap v223: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 733 op/s 2023-10-05T15:24:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:01 smithi135 ceph-mon[103360]: pgmap v224: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 734 op/s 2023-10-05T15:24:01.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:01 smithi060 ceph-mon[99238]: pgmap v224: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 734 op/s 2023-10-05T15:24:01.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:01 smithi092 ceph-mon[102944]: pgmap v224: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 734 op/s 2023-10-05T15:24:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:02 smithi135 ceph-mon[103360]: pgmap v225: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 773 op/s 2023-10-05T15:24:02.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:02 smithi060 ceph-mon[99238]: pgmap v225: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 773 op/s 2023-10-05T15:24:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:02 smithi092 ceph-mon[102944]: pgmap v225: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 773 op/s 2023-10-05T15:24:03.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:03 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:24:03.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:03 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:24:03.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:03 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:24:04.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:04 smithi135 ceph-mon[103360]: pgmap v226: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 951 op/s 2023-10-05T15:24:04.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:04 smithi060 ceph-mon[99238]: pgmap v226: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 951 op/s 2023-10-05T15:24:04.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:04 smithi092 ceph-mon[102944]: pgmap v226: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 951 op/s 2023-10-05T15:24:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:07 smithi135 ceph-mon[103360]: pgmap v227: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 859 op/s 2023-10-05T15:24:07.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:07 smithi060 ceph-mon[99238]: pgmap v227: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 859 op/s 2023-10-05T15:24:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:07 smithi092 ceph-mon[102944]: pgmap v227: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 859 op/s 2023-10-05T15:24:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:09 smithi135 ceph-mon[103360]: pgmap v228: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 930 op/s 2023-10-05T15:24:09.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:09 smithi135 ceph-mon[103360]: osdmap e98: 12 total, 12 up, 12 in 2023-10-05T15:24:09.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:09 smithi060 ceph-mon[99238]: pgmap v228: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 930 op/s 2023-10-05T15:24:09.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:09 smithi060 ceph-mon[99238]: osdmap e98: 12 total, 12 up, 12 in 2023-10-05T15:24:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:09 smithi092 ceph-mon[102944]: pgmap v228: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 930 op/s 2023-10-05T15:24:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:09 smithi092 ceph-mon[102944]: osdmap e98: 12 total, 12 up, 12 in 2023-10-05T15:24:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 -- 172.21.15.60:0/2470925768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac411a690 msgr2=0x7f8ac411ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/2470925768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac411a690 0x7f8ac411ca80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801a9a0 tx=0x7f8ab801acb0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 -- 172.21.15.60:0/2470925768 shutdown_connections 2023-10-05T15:24:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/2470925768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac411a690 0x7f8ac411ca80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/2470925768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410f620 0x7f8ac4107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.035 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/2470925768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ac410fa90 0x7f8ac41083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.035 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.032+0000 7f8ac97e6700 1 -- 172.21.15.60:0/2470925768 >> 172.21.15.60:0/2470925768 conn(0x7f8ac406cfa0 msgr2=0x7f8ac406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.050+0000 7f8ac97e6700 1 -- 172.21.15.60:0/2470925768 shutdown_connections 2023-10-05T15:24:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.052+0000 7f8ac97e6700 1 -- 172.21.15.60:0/2470925768 wait complete. 2023-10-05T15:24:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.052+0000 7f8ac97e6700 1 Processor -- start 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 -- start start 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410f620 0x7f8ac41158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 0x7f8ac4115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ac411a690 0x7f8ac41a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac41a3990 con 0x7f8ac410fa90 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac41a3b00 con 0x7f8ac411a690 2023-10-05T15:24:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.053+0000 7f8ac97e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac41a3cc0 con 0x7f8ac410f620 2023-10-05T15:24:11.056 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 0x7f8ac4115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.056 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ac411a690 0x7f8ac41a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 0x7f8ac4115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41182/0 (socket says 172.21.15.60:41182) 2023-10-05T15:24:11.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 -- 172.21.15.60:0/3828606773 learned_addr learned my addr 172.21.15.60:0/3828606773 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:11.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 -- 172.21.15.60:0/3828606773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410f620 msgr2=0x7f8ac41158c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:24:11.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410f620 0x7f8ac41158c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.057 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 -- 172.21.15.60:0/3828606773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ac411a690 msgr2=0x7f8ac41a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ac411a690 0x7f8ac41a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.055+0000 7f8ac27fc700 1 -- 172.21.15.60:0/3828606773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab801a600 con 0x7f8ac410fa90 2023-10-05T15:24:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.056+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 0x7f8ac4115e00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00ba50 tx=0x7f8abc00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.056+0000 7f8aabfff700 1 -- 172.21.15.60:0/3828606773 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc00c9b0 con 0x7f8ac410fa90 2023-10-05T15:24:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.056+0000 7f8aabfff700 1 -- 172.21.15.60:0/3828606773 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8abc014440 con 0x7f8ac410fa90 2023-10-05T15:24:11.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.056+0000 7f8aabfff700 1 -- 172.21.15.60:0/3828606773 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0075d0 con 0x7f8ac410fa90 2023-10-05T15:24:11.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.056+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac41a3fa0 con 0x7f8ac410fa90 2023-10-05T15:24:11.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.056+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac41aa620 con 0x7f8ac410fa90 2023-10-05T15:24:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.060+0000 7f8aabfff700 1 -- 172.21.15.60:0/3828606773 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8abc007730 con 0x7f8ac410fa90 2023-10-05T15:24:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.061+0000 7f8aabfff700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8aac0a1740 0x7f8aac0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.061+0000 7f8aabfff700 1 -- 172.21.15.60:0/3828606773 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f8abc006e40 con 0x7f8ac410fa90 2023-10-05T15:24:11.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.062+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8aac0a1740 0x7f8aac0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.063+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8aac0a1740 0x7f8aac0a3c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ba10 tx=0x7f8ab400b3f0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.063+0000 7f8ad59d0b80 1 Processor -- start 2023-10-05T15:24:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 -- start start 2023-10-05T15:24:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46635fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd46640e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 0x55fd466437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd4659f400 con 0x55fd466413d0 2023-10-05T15:24:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd46590bc0 con 0x55fd46635c00 2023-10-05T15:24:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd4658e4e0 con 0x55fd46636520 2023-10-05T15:24:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ac37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 0x55fd466437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ac37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 0x55fd466437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41190/0 (socket says 172.21.15.60:41190) 2023-10-05T15:24:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ac37fe700 1 -- 172.21.15.60:0/2181767352 learned_addr learned my addr 172.21.15.60:0/2181767352 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.064+0000 7f8ac27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd46640e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.065+0000 7f8ac37fe700 1 -- 172.21.15.60:0/2181767352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 msgr2=0x55fd46640e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.065+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd46640e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.065+0000 7f8ac37fe700 1 -- 172.21.15.60:0/2181767352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 msgr2=0x55fd46635fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.065+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46635fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.065+0000 7f8ac37fe700 1 -- 172.21.15.60:0/2181767352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd463b4d80 con 0x55fd466413d0 2023-10-05T15:24:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.066+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 0x55fd466437c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801a9a0 tx=0x7f8ab8005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eece006371c2ce5a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.068+0000 7f8aa97fa700 1 -- 172.21.15.60:0/2181767352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab801c9f0 con 0x55fd466413d0 2023-10-05T15:24:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.068+0000 7f8aa97fa700 1 -- 172.21.15.60:0/2181767352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab804f070 con 0x55fd466413d0 2023-10-05T15:24:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.068+0000 7f8aa97fa700 1 -- 172.21.15.60:0/2181767352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80048c0 con 0x55fd466413d0 2023-10-05T15:24:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.069+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/2181767352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 msgr2=0x55fd466437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.069+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 0x55fd466437c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801a9a0 tx=0x7f8ab8005960 comp rx=0 tx=0).stop 2023-10-05T15:24:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.084+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/2181767352 shutdown_connections 2023-10-05T15:24:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.084+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd466413d0 0x55fd466437c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.084+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46635fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.084+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/2181767352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd46640e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.084+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/2181767352 >> 172.21.15.60:0/2181767352 conn(0x55fd465ab200 msgr2=0x55fd46632080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.086+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/2181767352 shutdown_connections 2023-10-05T15:24:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.086+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/2181767352 wait complete. 2023-10-05T15:24:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.086+0000 7f8ad59d0b80 1 -- start start 2023-10-05T15:24:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.086+0000 7f8ad59d0b80 1 Processor -- start 2023-10-05T15:24:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 0x55fd4663e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd4663e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd466413d0 0x55fd4663ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd46589dd0 con 0x55fd46635c00 2023-10-05T15:24:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd465266b0 con 0x55fd466413d0 2023-10-05T15:24:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd46526350 con 0x55fd46636520 2023-10-05T15:24:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ad59d0b80 10 client.0 _ll_register_callbacks cb 0x55fd463837a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ac2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 0x55fd4663e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ac2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 0x55fd4663e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41194/0 (socket says 172.21.15.60:41194) 2023-10-05T15:24:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ac2ffd700 1 -- 172.21.15.60:0/183633557 learned_addr learned my addr 172.21.15.60:0/183633557 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.087+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd466413d0 0x55fd4663ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.088+0000 7f8ac2ffd700 1 -- 172.21.15.60:0/183633557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 msgr2=0x55fd4663e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.088+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd4663e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.088+0000 7f8ac2ffd700 1 -- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd466413d0 msgr2=0x55fd4663ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.088+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd466413d0 0x55fd4663ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.088+0000 7f8ac2ffd700 1 -- 172.21.15.60:0/183633557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac411d3b0 con 0x55fd46635c00 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.088+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 0x55fd4663e140 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400dcd0 tx=0x7f8ab4010460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab60cd1e12f461a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8aa6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/183633557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4010b90 con 0x55fd46635c00 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/183633557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f8ab4010cf0 con 0x55fd46635c00 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd46629d50 con 0x55fd46635c00 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/183633557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab401d440 con 0x55fd46635c00 2023-10-05T15:24:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8ad59d0b80 10 client.16710 fetch_fsmap learned FSMap version 42 2023-10-05T15:24:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55fd4639dc00 con 0x55fd46635c00 2023-10-05T15:24:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.089+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/183633557 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fd46629d50 con 0x55fd46635c00 2023-10-05T15:24:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/183633557 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 42) v1 ==== 7966+0+0 (secure 0 0 0) 0x7f8ab400f620 con 0x55fd46635c00 2023-10-05T15:24:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8ad59d0b80 10 client.16710 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:24:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8ad59d0b80 10 client.16710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8ad59d0b80 20 client.16710 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466510e0 0x55fd46653500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8ad59d0b80 4 client.16710 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:24:11.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.090+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd46582db0 con 0x55fd466510e0 2023-10-05T15:24:11.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.094+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466510e0 0x55fd46653500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.097+0000 7f8aa6ff5700 10 client.16710 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.097+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466510e0 0x55fd46653500 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ff34d95fd1f021 server_cookie=2b34b8c2f7c9e0fc in_seq=0 out_seq=0 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/183633557 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fd46582db0 con 0x55fd466510e0 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8aa6ff5700 10 client.16710 handle_command_reply: tid=0 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 client.16710 shutdown 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 msgr2=0x55fd4663e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 0x55fd4663e140 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400dcd0 tx=0x7f8ab4010460 comp rx=0 tx=0).stop 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 shutdown_connections 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466510e0 0x55fd46653500 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd466413d0 0x55fd4663ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46635c00 0x55fd4663e140 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/183633557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd46636520 0x55fd4663e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 >> 172.21.15.60:0/183633557 conn(0x55fd465ab200 msgr2=0x55fd46631c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:11.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.098+0000 7f8aa6ff5700 0 client.16710 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.106+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 shutdown_connections 2023-10-05T15:24:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.106+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/183633557 wait complete. 2023-10-05T15:24:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.107+0000 7f8ad59d0b80 20 client.16710 trim_cache size 0 max 16384 2023-10-05T15:24:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 Processor -- start 2023-10-05T15:24:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 -- start start 2023-10-05T15:24:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46647f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd4663d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd46639490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd4640a8c0 con 0x55fd46636520 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd4663c6c0 con 0x55fd46635c00 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd46639fd0 con 0x55fd466413d0 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ac2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46647f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ac2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46647f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54622/0 (socket says 172.21.15.60:54622) 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ac2ffd700 1 -- 172.21.15.60:0/911242799 learned_addr learned my addr 172.21.15.60:0/911242799 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.133+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd46639490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.134+0000 7f8ac37fe700 1 -- 172.21.15.60:0/911242799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 msgr2=0x55fd46647f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.134+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46647f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.134+0000 7f8ac37fe700 1 -- 172.21.15.60:0/911242799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 msgr2=0x55fd4663d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.134+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd4663d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.134+0000 7f8ac37fe700 1 -- 172.21.15.60:0/911242799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd463db1f0 con 0x55fd466413d0 2023-10-05T15:24:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.136+0000 7f8ac37fe700 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd46639490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801c5d0 tx=0x7f8ab801afa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b44d8075c740f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.141+0000 7f8aa9ffb700 1 -- 172.21.15.60:0/911242799 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8005050 con 0x55fd466413d0 2023-10-05T15:24:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.141+0000 7f8aa9ffb700 1 -- 172.21.15.60:0/911242799 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab801ceb0 con 0x55fd466413d0 2023-10-05T15:24:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.141+0000 7f8aa9ffb700 1 -- 172.21.15.60:0/911242799 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8004b20 con 0x55fd466413d0 2023-10-05T15:24:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/911242799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 msgr2=0x55fd46639490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd46639490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801c5d0 tx=0x7f8ab801afa0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/911242799 shutdown_connections 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd46639490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46647f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/911242799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd4663d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/911242799 >> 172.21.15.60:0/911242799 conn(0x55fd465ab200 msgr2=0x55fd4664d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/911242799 shutdown_connections 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.142+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/911242799 wait complete. 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 -- start start 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 Processor -- start 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46645720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd46645c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd466461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd466a40c0 con 0x55fd46636520 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd466a4230 con 0x55fd46635c00 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd466a43f0 con 0x55fd466413d0 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.143+0000 7f8ad59d0b80 10 client.0 _ll_register_callbacks cb 0x7f8ab400d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd46645c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd46645c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41206/0 (socket says 172.21.15.60:41206) 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 -- 172.21.15.60:0/378432310 learned_addr learned my addr 172.21.15.60:0/378432310 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 -- 172.21.15.60:0/378432310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 msgr2=0x55fd466461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd466461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 -- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 msgr2=0x55fd46645720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46645720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 -- 172.21.15.60:0/378432310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd463b4d80 con 0x55fd46636520 2023-10-05T15:24:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.144+0000 7f8ac27fc700 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd46645c60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8abc09a4f0 tx=0x7f8abc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ed898e3010c682 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.151+0000 7f8aa6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:24:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.151+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/378432310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0a2b80 con 0x55fd46636520 2023-10-05T15:24:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.151+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/378432310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f8abc0ba0b0 con 0x55fd46636520 2023-10-05T15:24:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.154+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ab804f070 con 0x55fd46636520 2023-10-05T15:24:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.155+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/378432310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8abc0cb0d0 con 0x55fd46636520 2023-10-05T15:24:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.155+0000 7f8ad59d0b80 10 client.16713 fetch_fsmap learned FSMap version 42 2023-10-05T15:24:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.155+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55fd463b3250 con 0x55fd46636520 2023-10-05T15:24:11.161 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.159+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/378432310 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab804f070 con 0x55fd46636520 2023-10-05T15:24:11.161 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.159+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/378432310 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 42) v1 ==== 7966+0+0 (secure 0 0 0) 0x7f8abc0b4020 con 0x55fd46636520 2023-10-05T15:24:11.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.160+0000 7f8ad59d0b80 10 client.16713 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:24:11.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.160+0000 7f8ad59d0b80 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:11.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.160+0000 7f8ad59d0b80 20 client.16713 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:11.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.160+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466a5bc0 0x55fd466a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:11.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.160+0000 7f8ad59d0b80 4 client.16713 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:24:11.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.160+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fd46582ad0 con 0x55fd466a5bc0 2023-10-05T15:24:11.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.161+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466a5bc0 0x55fd466a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.181+0000 7f8aa6ff5700 10 client.16713 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.181+0000 7f8ac2ffd700 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466a5bc0 0x55fd466a7fe0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09b76f8fad545db server_cookie=4095d86d59119f5a in_seq=0 out_seq=0 2023-10-05T15:24:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.344+0000 7f8aa6ff5700 1 -- 172.21.15.60:0/378432310 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fd46582ad0 con 0x55fd466a5bc0 2023-10-05T15:24:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.344+0000 7f8aa6ff5700 10 client.16713 handle_command_reply: tid=0 2023-10-05T15:24:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.348+0000 7f8ad59d0b80 1 client.16713 shutdown 2023-10-05T15:24:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.358+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 msgr2=0x55fd46645c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.358+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd46645c60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8abc09a4f0 tx=0x7f8abc004ad0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.358+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 shutdown_connections 2023-10-05T15:24:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.358+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55fd466a5bc0 0x55fd466a7fe0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.358+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd466413d0 0x55fd466461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.358+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd46635c00 0x55fd46645720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.359+0000 7f8ad59d0b80 1 --2- 172.21.15.60:0/378432310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fd46636520 0x55fd46645c60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.359+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 >> 172.21.15.60:0/378432310 conn(0x55fd465ab200 msgr2=0x55fd4663e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.364+0000 7f8aa6ff5700 0 client.16713 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.368+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 shutdown_connections 2023-10-05T15:24:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.368+0000 7f8ad59d0b80 1 -- 172.21.15.60:0/378432310 wait complete. 2023-10-05T15:24:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:24:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:24:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:24:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:24:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.374+0000 7f8ad59d0b80 20 client.16713 trim_cache size 0 max 16384 2023-10-05T15:24:11.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.380+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8aac0a1740 msgr2=0x7f8aac0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.383 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.380+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8aac0a1740 0x7f8aac0a3c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ba10 tx=0x7f8ab400b3f0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.383 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.380+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 msgr2=0x7f8ac4115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:11.383 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.380+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 0x7f8ac4115e00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00ba50 tx=0x7f8abc00bd60 comp rx=0 tx=0).stop 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 shutdown_connections 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f8aac0a1740 0x7f8aac0a3c00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ac411a690 0x7f8ac41a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410f620 0x7f8ac41158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 --2- 172.21.15.60:0/3828606773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac410fa90 0x7f8ac4115e00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 >> 172.21.15.60:0/3828606773 conn(0x7f8ac406cfa0 msgr2=0x7f8ac411bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 shutdown_connections 2023-10-05T15:24:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:11.385+0000 7f8ac97e6700 1 -- 172.21.15.60:0/3828606773 wait complete. 2023-10-05T15:24:11.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:11 smithi135 ceph-mon[103360]: pgmap v230: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 602 op/s 2023-10-05T15:24:11.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:11 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:24:11.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:11 smithi060 ceph-mon[99238]: pgmap v230: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 602 op/s 2023-10-05T15:24:11.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:11 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:24:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:11 smithi092 ceph-mon[102944]: pgmap v230: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 602 op/s 2023-10-05T15:24:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:11 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:24:12.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:12 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:24:12.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:12 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:24:12.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:12 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:24:12.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:12 smithi135 ceph-mon[103360]: pgmap v231: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 518 op/s 2023-10-05T15:24:12.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:12 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:24:12.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:12 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:24:12.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:12 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:24:12.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:12 smithi060 ceph-mon[99238]: pgmap v231: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 518 op/s 2023-10-05T15:24:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:12 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:24:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:12 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:24:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:12 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:24:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:12 smithi092 ceph-mon[102944]: pgmap v231: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 518 op/s 2023-10-05T15:24:13.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:13 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:24:13.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:13 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:24:13.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:13 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:24:14.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:14 smithi135 ceph-mon[103360]: pgmap v232: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 329 op/s 2023-10-05T15:24:14.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:14 smithi060 ceph-mon[99238]: pgmap v232: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 329 op/s 2023-10-05T15:24:14.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:14 smithi092 ceph-mon[102944]: pgmap v232: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 329 op/s 2023-10-05T15:24:17.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:17 smithi135 ceph-mon[103360]: pgmap v233: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 313 op/s 2023-10-05T15:24:17.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:17 smithi060 ceph-mon[99238]: pgmap v233: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 313 op/s 2023-10-05T15:24:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:17 smithi092 ceph-mon[102944]: pgmap v233: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 313 op/s 2023-10-05T15:24:19.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:19 smithi135 ceph-mon[103360]: pgmap v234: 129 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 93 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 258 op/s 2023-10-05T15:24:19.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:19 smithi060 ceph-mon[99238]: pgmap v234: 129 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 93 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 258 op/s 2023-10-05T15:24:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:19 smithi092 ceph-mon[102944]: pgmap v234: 129 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 93 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 258 op/s 2023-10-05T15:24:21.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:21 smithi135 ceph-mon[103360]: pgmap v235: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 242 op/s 2023-10-05T15:24:21.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:21 smithi060 ceph-mon[99238]: pgmap v235: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 242 op/s 2023-10-05T15:24:21.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:21 smithi092 ceph-mon[102944]: pgmap v235: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 242 op/s 2023-10-05T15:24:22.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:22 smithi135 ceph-mon[103360]: osdmap e99: 12 total, 12 up, 12 in 2023-10-05T15:24:22.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:22 smithi135 ceph-mon[103360]: pgmap v237: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 221 op/s 2023-10-05T15:24:22.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:22 smithi060 ceph-mon[99238]: osdmap e99: 12 total, 12 up, 12 in 2023-10-05T15:24:22.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:22 smithi060 ceph-mon[99238]: pgmap v237: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 221 op/s 2023-10-05T15:24:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:22 smithi092 ceph-mon[102944]: osdmap e99: 12 total, 12 up, 12 in 2023-10-05T15:24:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:22 smithi092 ceph-mon[102944]: pgmap v237: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 221 op/s 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 -- 172.21.15.60:0/1976641314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c1009b0 msgr2=0x7fdf3c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 --2- 172.21.15.60:0/1976641314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c1009b0 0x7fdf3c1049f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009990 tx=0x7fdf38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 -- 172.21.15.60:0/1976641314 shutdown_connections 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 --2- 172.21.15.60:0/1976641314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c105120 0x7fdf3c10cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 --2- 172.21.15.60:0/1976641314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf3c100000 0x7fdf3c1003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 --2- 172.21.15.60:0/1976641314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c1009b0 0x7fdf3c1049f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 -- 172.21.15.60:0/1976641314 >> 172.21.15.60:0/1976641314 conn(0x7fdf3c0fb860 msgr2=0x7fdf3c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 -- 172.21.15.60:0/1976641314 shutdown_connections 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 -- 172.21.15.60:0/1976641314 wait complete. 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.512+0000 7fdf443ae700 1 Processor -- start 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 -- start start 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 0x7fdf3c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf3c105120 0x7fdf3c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 0x7fdf3c19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c19e810 con 0x7fdf3c19dd90 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c19e980 con 0x7fdf3c100000 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf443ae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c19eb40 con 0x7fdf3c105120 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4294b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 0x7fdf3c19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 0x7fdf3c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 0x7fdf3c1991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54638/0 (socket says 172.21.15.60:54638) 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4294b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 0x7fdf3c19e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41220/0 (socket says 172.21.15.60:41220) 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 -- 172.21.15.60:0/849011763 learned_addr learned my addr 172.21.15.60:0/849011763 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf41949700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf3c105120 0x7fdf3c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 -- 172.21.15.60:0/849011763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf3c105120 msgr2=0x7fdf3c199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf3c105120 0x7fdf3c199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 -- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 msgr2=0x7fdf3c19e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 0x7fdf3c19e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 -- 172.21.15.60:0/849011763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf380095f0 con 0x7fdf3c100000 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4294b700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 0x7fdf3c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.513+0000 7fdf4214a700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 0x7fdf3c1991e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00e9a0 tx=0x7fdf2c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.514+0000 7fdf337fe700 1 -- 172.21.15.60:0/849011763 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c009790 con 0x7fdf3c100000 2023-10-05T15:24:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.514+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c1a60a0 con 0x7fdf3c100000 2023-10-05T15:24:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.514+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c1a65d0 con 0x7fdf3c100000 2023-10-05T15:24:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.514+0000 7fdf337fe700 1 -- 172.21.15.60:0/849011763 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf2c010430 con 0x7fdf3c100000 2023-10-05T15:24:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.514+0000 7fdf337fe700 1 -- 172.21.15.60:0/849011763 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c018680 con 0x7fdf3c100000 2023-10-05T15:24:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.516+0000 7fdf337fe700 1 -- 172.21.15.60:0/849011763 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdf2c0187e0 con 0x7fdf3c100000 2023-10-05T15:24:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.516+0000 7fdf337fe700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdf280a15f0 0x7fdf280a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.517+0000 7fdf337fe700 1 -- 172.21.15.60:0/849011763 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 9415+0+0 (secure 0 0 0) 0x7fdf2c014070 con 0x7fdf3c100000 2023-10-05T15:24:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.517+0000 7fdf41949700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdf280a15f0 0x7fdf280a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.517+0000 7fdf41949700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdf280a15f0 0x7fdf280a3ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800b2e0 tx=0x7fdf38005960 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.517+0000 7fdf50598b80 1 Processor -- start 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.517+0000 7fdf50598b80 1 -- start start 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a65fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a66520 0x55dad3a70e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a713d0 0x55dad3a737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf50598b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad39cf400 con 0x55dad3a65c00 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf50598b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad39c0bc0 con 0x55dad3a66520 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf50598b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad39be4e0 con 0x55dad3a713d0 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a65fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a65fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41224/0 (socket says 172.21.15.60:41224) 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 -- 172.21.15.60:0/1552195883 learned_addr learned my addr 172.21.15.60:0/1552195883 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf41949700 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a66520 0x55dad3a70e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4294b700 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a713d0 0x55dad3a737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 -- 172.21.15.60:0/1552195883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a713d0 msgr2=0x55dad3a737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a713d0 0x55dad3a737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 -- 172.21.15.60:0/1552195883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a66520 msgr2=0x55dad3a70e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a66520 0x55dad3a70e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 -- 172.21.15.60:0/1552195883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dad37e4d80 con 0x55dad3a65c00 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf4214a700 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a65fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0a30c0 tx=0x7fdf2c09aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb7ef0baa816161 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf30d82700 1 -- 172.21.15.60:0/1552195883 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0cd070 con 0x55dad3a65c00 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf30d82700 1 -- 172.21.15.60:0/1552195883 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf2c09f3b0 con 0x55dad3a65c00 2023-10-05T15:24:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.518+0000 7fdf30d82700 1 -- 172.21.15.60:0/1552195883 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c09b720 con 0x55dad3a65c00 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 -- 172.21.15.60:0/1552195883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 msgr2=0x55dad3a65fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a65fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0a30c0 tx=0x7fdf2c09aed0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 -- 172.21.15.60:0/1552195883 shutdown_connections 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a713d0 0x55dad3a737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a65fe0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1552195883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a66520 0x55dad3a70e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 -- 172.21.15.60:0/1552195883 >> 172.21.15.60:0/1552195883 conn(0x55dad39db200 msgr2=0x55dad3a62080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 -- 172.21.15.60:0/1552195883 shutdown_connections 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 -- 172.21.15.60:0/1552195883 wait complete. 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.519+0000 7fdf50598b80 1 -- start start 2023-10-05T15:24:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 Processor -- start 2023-10-05T15:24:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a65c00 0x55dad3a70dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a6e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 0x55dad3a6e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad39b9dd0 con 0x55dad3a713d0 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad39566b0 con 0x55dad3a65c00 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad3956350 con 0x55dad3a66520 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf50598b80 10 client.0 _ll_register_callbacks cb 0x55dad37b37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 0x55dad3a6e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf41949700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a6e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 0x55dad3a6e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41234/0 (socket says 172.21.15.60:41234) 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf41949700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a6e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54762/0 (socket says 172.21.15.60:54762) 2023-10-05T15:24:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 -- 172.21.15.60:0/2184427105 learned_addr learned my addr 172.21.15.60:0/2184427105 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4214a700 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a65c00 0x55dad3a70dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 -- 172.21.15.60:0/2184427105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 msgr2=0x55dad3a6e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a6e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 -- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a65c00 msgr2=0x55dad3a70dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a65c00 0x55dad3a70dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 -- 172.21.15.60:0/2184427105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c095e70 con 0x55dad3a713d0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf4294b700 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 0x55dad3a6e730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdf340046e0 tx=0x7fdf340049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0f1ef7a538ec9b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.520+0000 7fdf25ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf25ffb700 1 -- 172.21.15.60:0/2184427105 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400ea50 con 0x55dad3a713d0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf25ffb700 1 -- 172.21.15.60:0/2184427105 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9415+0+0 (secure 0 0 0) 0x7fdf3400ebb0 con 0x55dad3a713d0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dad3a59d50 con 0x55dad3a713d0 2023-10-05T15:24:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf25ffb700 1 -- 172.21.15.60:0/2184427105 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3400ed70 con 0x55dad3a713d0 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 10 client.16725 fetch_fsmap learned FSMap version 43 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dad37cdc00 con 0x55dad3a713d0 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf25ffb700 1 -- 172.21.15.60:0/2184427105 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dad3a59d50 con 0x55dad3a713d0 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf25ffb700 1 -- 172.21.15.60:0/2184427105 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fdf3401c020 con 0x55dad3a713d0 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 10 client.16725 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 20 client.16725 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3a83420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 4 client.16725 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dad39b2db0 con 0x55dad3a81000 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.521+0000 7fdf4214a700 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3a83420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.522+0000 7fdf25ffb700 10 client.16725 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.522+0000 7fdf4214a700 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3a83420 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ac8ac3c6e47791 server_cookie=b49519d77f558537 in_seq=0 out_seq=0 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.522+0000 7fdf25ffb700 1 -- 172.21.15.60:0/2184427105 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dad39b2db0 con 0x55dad3a81000 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.522+0000 7fdf25ffb700 10 client.16725 handle_command_reply: tid=0 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.522+0000 7fdf50598b80 1 client.16725 shutdown 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 msgr2=0x55dad3a6e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 0x55dad3a6e730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdf340046e0 tx=0x7fdf340049f0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 shutdown_connections 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3a83420 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a713d0 0x55dad3a6e730 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf25ffb700 0 client.16725 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a65c00 0x55dad3a70dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 --2- 172.21.15.60:0/2184427105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a6e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 >> 172.21.15.60:0/2184427105 conn(0x55dad39db200 msgr2=0x55dad3a61c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 shutdown_connections 2023-10-05T15:24:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 1 -- 172.21.15.60:0/2184427105 wait complete. 2023-10-05T15:24:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.523+0000 7fdf50598b80 20 client.16725 trim_cache size 0 max 16384 2023-10-05T15:24:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.537+0000 7fdf50598b80 1 Processor -- start 2023-10-05T15:24:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.537+0000 7fdf50598b80 1 -- start start 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a69390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf50598b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad383a8c0 con 0x55dad3a65c00 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf50598b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad3a6f400 con 0x55dad3a713d0 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf50598b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad3a62dc0 con 0x55dad3a66520 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a69390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a69390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41238/0 (socket says 172.21.15.60:41238) 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 -- 172.21.15.60:0/1946939109 learned_addr learned my addr 172.21.15.60:0/1946939109 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf41949700 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4294b700 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 -- 172.21.15.60:0/1946939109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 msgr2=0x55dad3a698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 -- 172.21.15.60:0/1946939109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 msgr2=0x55dad3a727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 -- 172.21.15.60:0/1946939109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dad380b1f0 con 0x55dad3a65c00 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf4214a700 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a69390 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00cfd0 tx=0x7fdf2c09b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e08918990f61d8a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.538+0000 7fdf31583700 1 -- 172.21.15.60:0/1946939109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0cd040 con 0x55dad3a65c00 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf31583700 1 -- 172.21.15.60:0/1946939109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf2c09f120 con 0x55dad3a65c00 2023-10-05T15:24:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf31583700 1 -- 172.21.15.60:0/1946939109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c09b720 con 0x55dad3a65c00 2023-10-05T15:24:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 -- 172.21.15.60:0/1946939109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 msgr2=0x55dad3a69390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a69390 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00cfd0 tx=0x7fdf2c09b160 comp rx=0 tx=0).stop 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 -- 172.21.15.60:0/1946939109 shutdown_connections 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a65c00 0x55dad3a69390 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 --2- 172.21.15.60:0/1946939109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a66520 0x55dad3a698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 -- 172.21.15.60:0/1946939109 >> 172.21.15.60:0/1946939109 conn(0x55dad39db200 msgr2=0x55dad3a7c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 -- 172.21.15.60:0/1946939109 shutdown_connections 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 -- 172.21.15.60:0/1946939109 wait complete. 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 -- start start 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.539+0000 7fdf50598b80 1 Processor -- start 2023-10-05T15:24:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a65c00 0x55dad3a77800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 0x55dad3a77d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a75c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad3a76200 con 0x55dad3a66520 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad3a76370 con 0x55dad3a713d0 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad3a76530 con 0x55dad3a65c00 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf50598b80 10 client.0 _ll_register_callbacks cb 0x7fdf34004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 0x55dad3a77d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 0x55dad3a77d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41246/0 (socket says 172.21.15.60:41246) 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 -- 172.21.15.60:0/941451201 learned_addr learned my addr 172.21.15.60:0/941451201 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf4214a700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a65c00 0x55dad3a77800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf4294b700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a75c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 -- 172.21.15.60:0/941451201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a65c00 msgr2=0x55dad3a77800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a65c00 0x55dad3a77800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 -- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 msgr2=0x55dad3a75c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a75c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 -- 172.21.15.60:0/941451201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0b3040 con 0x55dad3a66520 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf4214a700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a65c00 0x55dad3a77800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf4294b700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a75c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf41949700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 0x55dad3a77d40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009990 tx=0x7fdf38009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a51f6424cb6fc70 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.540+0000 7fdf25ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf25ffb700 1 -- 172.21.15.60:0/941451201 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38004be0 con 0x55dad3a66520 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf25ffb700 1 -- 172.21.15.60:0/941451201 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9415+0+0 (secure 0 0 0) 0x7fdf38004d40 con 0x55dad3a66520 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf2c09f3b0 con 0x55dad3a66520 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf25ffb700 1 -- 172.21.15.60:0/941451201 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3800f460 con 0x55dad3a66520 2023-10-05T15:24:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 10 client.16731 fetch_fsmap learned FSMap version 43 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dad37e3250 con 0x55dad3a66520 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf25ffb700 1 -- 172.21.15.60:0/941451201 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf2c09f3b0 con 0x55dad3a66520 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf25ffb700 1 -- 172.21.15.60:0/941451201 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fdf38033650 con 0x55dad3a66520 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 10 client.16731 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 10 client.16731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 20 client.16731 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3ad80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 4 client.16731 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dad39b2ad0 con 0x55dad3a81000 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.541+0000 7fdf4214a700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3ad80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.542+0000 7fdf25ffb700 10 client.16731 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.542+0000 7fdf4214a700 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3ad80a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c88f8be0ee15f041 server_cookie=40ede6c101dabffd in_seq=0 out_seq=0 2023-10-05T15:24:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.553+0000 7fdf25ffb700 1 -- 172.21.15.60:0/941451201 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dad39b2ad0 con 0x55dad3a81000 2023-10-05T15:24:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf25ffb700 10 client.16731 handle_command_reply: tid=0 2023-10-05T15:24:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 client.16731 shutdown 2023-10-05T15:24:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 msgr2=0x55dad3a77d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 0x55dad3a77d40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009990 tx=0x7fdf38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 shutdown_connections 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dad3a81000 0x55dad3ad80a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dad3a713d0 0x55dad3a75c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf25ffb700 0 client.16731 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dad3a65c00 0x55dad3a77800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 --2- 172.21.15.60:0/941451201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dad3a66520 0x55dad3a77d40 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 >> 172.21.15.60:0/941451201 conn(0x55dad39db200 msgr2=0x55dad3a69390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 shutdown_connections 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 1 -- 172.21.15.60:0/941451201 wait complete. 2023-10-05T15:24:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.554+0000 7fdf50598b80 20 client.16731 trim_cache size 0 max 16384 2023-10-05T15:24:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:24:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:24:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:24:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdf280a15f0 msgr2=0x7fdf280a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdf280a15f0 0x7fdf280a3ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800b2e0 tx=0x7fdf38005960 comp rx=0 tx=0).stop 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 msgr2=0x7fdf3c1991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 0x7fdf3c1991e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00e9a0 tx=0x7fdf2c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 shutdown_connections 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3c19dd90 0x7fdf3c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdf280a15f0 0x7fdf280a3ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf3c100000 0x7fdf3c1991e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 --2- 172.21.15.60:0/849011763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf3c105120 0x7fdf3c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 >> 172.21.15.60:0/849011763 conn(0x7fdf3c0fb860 msgr2=0x7fdf3c068e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 shutdown_connections 2023-10-05T15:24:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:24.555+0000 7fdf443ae700 1 -- 172.21.15.60:0/849011763 wait complete. 2023-10-05T15:24:25.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:25 smithi135 ceph-mon[103360]: pgmap v238: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 179 op/s 2023-10-05T15:24:25.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:25 smithi060 ceph-mon[99238]: pgmap v238: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 179 op/s 2023-10-05T15:24:25.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:25 smithi092 ceph-mon[102944]: pgmap v238: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 179 op/s 2023-10-05T15:24:27.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:27 smithi135 ceph-mon[103360]: pgmap v239: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 175 op/s 2023-10-05T15:24:27.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:27 smithi135 ceph-mon[103360]: osdmap e100: 12 total, 12 up, 12 in 2023-10-05T15:24:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:27 smithi060 ceph-mon[99238]: pgmap v239: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 175 op/s 2023-10-05T15:24:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:27 smithi060 ceph-mon[99238]: osdmap e100: 12 total, 12 up, 12 in 2023-10-05T15:24:27.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:27 smithi092 ceph-mon[102944]: pgmap v239: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 175 op/s 2023-10-05T15:24:27.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:27 smithi092 ceph-mon[102944]: osdmap e100: 12 total, 12 up, 12 in 2023-10-05T15:24:29.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:29 smithi135 ceph-mon[103360]: pgmap v241: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 9.1 MiB/s wr, 163 op/s 2023-10-05T15:24:29.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:29 smithi060 ceph-mon[99238]: pgmap v241: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 9.1 MiB/s wr, 163 op/s 2023-10-05T15:24:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:29 smithi092 ceph-mon[102944]: pgmap v241: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 9.1 MiB/s wr, 163 op/s 2023-10-05T15:24:31.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:31 smithi135 ceph-mon[103360]: pgmap v242: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 8.6 MiB/s wr, 172 op/s 2023-10-05T15:24:31.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:31 smithi060 ceph-mon[99238]: pgmap v242: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 8.6 MiB/s wr, 172 op/s 2023-10-05T15:24:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:31 smithi092 ceph-mon[102944]: pgmap v242: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 8.6 MiB/s wr, 172 op/s 2023-10-05T15:24:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:32 smithi135 ceph-mon[103360]: pgmap v243: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 7.9 MiB/s wr, 178 op/s 2023-10-05T15:24:32.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:32 smithi060 ceph-mon[99238]: pgmap v243: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 7.9 MiB/s wr, 178 op/s 2023-10-05T15:24:32.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:32 smithi092 ceph-mon[102944]: pgmap v243: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 7.9 MiB/s wr, 178 op/s 2023-10-05T15:24:35.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:35 smithi135 ceph-mon[103360]: pgmap v244: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 6.5 MiB/s wr, 302 op/s 2023-10-05T15:24:35.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:35 smithi060 ceph-mon[99238]: pgmap v244: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 6.5 MiB/s wr, 302 op/s 2023-10-05T15:24:35.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:35 smithi092 ceph-mon[102944]: pgmap v244: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 6.5 MiB/s wr, 302 op/s 2023-10-05T15:24:37.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:37 smithi135 ceph-mon[103360]: pgmap v245: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.3 MiB/s wr, 319 op/s 2023-10-05T15:24:37.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:37 smithi060 ceph-mon[99238]: pgmap v245: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.3 MiB/s wr, 319 op/s 2023-10-05T15:24:37.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:37 smithi092 ceph-mon[102944]: pgmap v245: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.3 MiB/s wr, 319 op/s 2023-10-05T15:24:37.733 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.732+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1317875461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141061e0 msgr2=0x7fb81410dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:37.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.732+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1317875461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141061e0 0x7fb81410dd60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb804009990 tx=0x7fb804009ca0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.737+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1317875461 shutdown_connections 2023-10-05T15:24:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.737+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1317875461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141061e0 0x7fb81410dd60 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.737+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1317875461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8141010c0 0x7fb8141014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.737+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1317875461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814101a70 0x7fb814105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.737+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1317875461 >> 172.21.15.60:0/1317875461 conn(0x7fb8140fc940 msgr2=0x7fb8140fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.738+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1317875461 shutdown_connections 2023-10-05T15:24:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.738+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1317875461 wait complete. 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 Processor -- start 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 -- start start 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 0x7fb8141151f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8141061e0 0x7fb814115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb814110080 0x7fb814110530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814110c40 con 0x7fb8141010c0 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814110db0 con 0x7fb814110080 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb81b6b4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81411cf80 con 0x7fb8141061e0 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb819450700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 0x7fb8141151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb819450700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 0x7fb8141151f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41260/0 (socket says 172.21.15.60:41260) 2023-10-05T15:24:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb819450700 1 -- 172.21.15.60:0/1596350086 learned_addr learned my addr 172.21.15.60:0/1596350086 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.739+0000 7fb819c51700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb814110080 0x7fb814110530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb819450700 1 -- 172.21.15.60:0/1596350086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8141061e0 msgr2=0x7fb814115750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb819450700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8141061e0 0x7fb814115750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb819450700 1 -- 172.21.15.60:0/1596350086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb814110080 msgr2=0x7fb814110530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb819450700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb814110080 0x7fb814110530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb819450700 1 -- 172.21.15.60:0/1596350086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040095f0 con 0x7fb8141010c0 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb819450700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 0x7fb8141151f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b530 tx=0x7fb80c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb80a7fc700 1 -- 172.21.15.60:0/1596350086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0118f0 con 0x7fb8141010c0 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb80a7fc700 1 -- 172.21.15.60:0/1596350086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb80c010380 con 0x7fb8141010c0 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb80a7fc700 1 -- 172.21.15.60:0/1596350086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00f540 con 0x7fb8141010c0 2023-10-05T15:24:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.740+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81411d260 con 0x7fb8141010c0 2023-10-05T15:24:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.741+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81411d720 con 0x7fb8141010c0 2023-10-05T15:24:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.746+0000 7fb82789eb80 1 Processor -- start 2023-10-05T15:24:37.754 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 -- start start 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dd2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26de07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26d3c400 con 0x558d26dd3520 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26d2dbc0 con 0x558d26dde3d0 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.751+0000 7fb82789eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26d2b4e0 con 0x558d26dd2c00 2023-10-05T15:24:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.753+0000 7fb80a7fc700 1 -- 172.21.15.60:0/1596350086 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb80c0104f0 con 0x7fb8141010c0 2023-10-05T15:24:37.756 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.753+0000 7fb819c51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dd2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26de07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb80a7fc700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8000a1800 0x7fb8000a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26de07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54688/0 (socket says 172.21.15.60:54688) 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 -- 172.21.15.60:0/3983141956 learned_addr learned my addr 172.21.15.60:0/3983141956 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb80a7fc700 1 -- 172.21.15.60:0/1596350086 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9387+0+0 (secure 0 0 0) 0x7fb80c0cc730 con 0x7fb8141010c0 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb819450700 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 -- 172.21.15.60:0/3983141956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 msgr2=0x558d26dd2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dd2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 -- 172.21.15.60:0/3983141956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 msgr2=0x558d26ddde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.754+0000 7fb818c4f700 1 -- 172.21.15.60:0/3983141956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d26b51d80 con 0x558d26dde3d0 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.755+0000 7fb818c4f700 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26de07c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d70 tx=0x7fb81000b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b564922565de3698 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.755+0000 7fb7ff7fe700 1 -- 172.21.15.60:0/3983141956 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810013410 con 0x558d26dde3d0 2023-10-05T15:24:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.755+0000 7fb7ff7fe700 1 -- 172.21.15.60:0/3983141956 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb810013a30 con 0x558d26dde3d0 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.755+0000 7fb7ff7fe700 1 -- 172.21.15.60:0/3983141956 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810012980 con 0x558d26dde3d0 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb819c51700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8000a1800 0x7fb8000a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 -- 172.21.15.60:0/3983141956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 msgr2=0x558d26de07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26de07c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d70 tx=0x7fb81000b720 comp rx=0 tx=0).stop 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 -- 172.21.15.60:0/3983141956 shutdown_connections 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26de07c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dd2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3983141956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.756+0000 7fb82789eb80 1 -- 172.21.15.60:0/3983141956 >> 172.21.15.60:0/3983141956 conn(0x558d26d48200 msgr2=0x558d26dcf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.757+0000 7fb82789eb80 1 -- 172.21.15.60:0/3983141956 shutdown_connections 2023-10-05T15:24:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.757+0000 7fb819c51700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8000a1800 0x7fb8000a3cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb80400b5c0 tx=0x7fb804005040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.760+0000 7fb82789eb80 1 -- 172.21.15.60:0/3983141956 wait complete. 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.760+0000 7fb82789eb80 1 -- start start 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.760+0000 7fb82789eb80 1 Processor -- start 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dddd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26ddb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26d26dd0 con 0x558d26dd3520 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26cc36b0 con 0x558d26dde3d0 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26cc3350 con 0x558d26dd2c00 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb82789eb80 10 client.0 _ll_register_callbacks cb 0x558d26b207a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb819c51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26ddb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb819c51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26ddb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54694/0 (socket says 172.21.15.60:54694) 2023-10-05T15:24:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb819c51700 1 -- 172.21.15.60:0/3699464950 learned_addr learned my addr 172.21.15.60:0/3699464950 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.761+0000 7fb819450700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.762+0000 7fb818c4f700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.765+0000 7fb819450700 1 -- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 msgr2=0x558d26ddb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.765+0000 7fb819450700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26ddb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.765+0000 7fb819450700 1 -- 172.21.15.60:0/3699464950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 msgr2=0x558d26ddb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.765+0000 7fb819450700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.765+0000 7fb819450700 1 -- 172.21.15.60:0/3699464950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100099a0 con 0x558d26dd2c00 2023-10-05T15:24:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.767+0000 7fb819450700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dddd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0c9bd0 tx=0x7fb80c010f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74fa33d9d9167ae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:37.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.767+0000 7fb7fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:24:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.773+0000 7fb7fcff9700 1 -- 172.21.15.60:0/3699464950 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c09d370 con 0x558d26dd2c00 2023-10-05T15:24:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.773+0000 7fb7fcff9700 1 -- 172.21.15.60:0/3699464950 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9387+0+0 (secure 0 0 0) 0x7fb80c09d5b0 con 0x558d26dd2c00 2023-10-05T15:24:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.773+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d26dc6d50 con 0x558d26dd2c00 2023-10-05T15:24:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.773+0000 7fb7fcff9700 1 -- 172.21.15.60:0/3699464950 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb80c0cc540 con 0x558d26dd2c00 2023-10-05T15:24:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.774+0000 7fb82789eb80 10 client.26263 fetch_fsmap learned FSMap version 43 2023-10-05T15:24:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.774+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558d26b3ac00 con 0x558d26dd2c00 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.785+0000 7fb7fcff9700 1 -- 172.21.15.60:0/3699464950 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb80c0a5020 con 0x558d26dd2c00 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb7fcff9700 1 -- 172.21.15.60:0/3699464950 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fb80c0cc050 con 0x558d26dd2c00 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb82789eb80 10 client.26263 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb82789eb80 10 client.26263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb82789eb80 20 client.26263 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26dedfa0 0x558d26df03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb82789eb80 4 client.26263 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:24:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d26d1fdb0 con 0x558d26dedfa0 2023-10-05T15:24:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.786+0000 7fb818c4f700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26dedfa0 0x558d26df03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.787+0000 7fb7fcff9700 10 client.26263 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.787+0000 7fb818c4f700 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26dedfa0 0x558d26df03c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ba3e217da3e5e2 server_cookie=a7283825e65e65a3 in_seq=0 out_seq=0 2023-10-05T15:24:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.788+0000 7fb7fcff9700 1 -- 172.21.15.60:0/3699464950 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d26d1fdb0 con 0x558d26dedfa0 2023-10-05T15:24:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.788+0000 7fb7fcff9700 10 client.26263 handle_command_reply: tid=0 2023-10-05T15:24:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.788+0000 7fb82789eb80 1 client.26263 shutdown 2023-10-05T15:24:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.789+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 msgr2=0x558d26dddd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.789+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dddd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0c9bd0 tx=0x7fb80c010f30 comp rx=0 tx=0).stop 2023-10-05T15:24:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.790+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 shutdown_connections 2023-10-05T15:24:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.790+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26dedfa0 0x558d26df03c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.790+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dde3d0 0x558d26ddb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.790+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd2c00 0x558d26dddd50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.790+0000 7fb82789eb80 1 --2- 172.21.15.60:0/3699464950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd3520 0x558d26ddb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.790+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 >> 172.21.15.60:0/3699464950 conn(0x558d26d48200 msgr2=0x558d26dcec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.793+0000 7fb7fcff9700 0 client.26263 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.794+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 shutdown_connections 2023-10-05T15:24:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.794+0000 7fb82789eb80 1 -- 172.21.15.60:0/3699464950 wait complete. 2023-10-05T15:24:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.795+0000 7fb82789eb80 20 client.26263 trim_cache size 0 max 16384 2023-10-05T15:24:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.822+0000 7fb82789eb80 1 Processor -- start 2023-10-05T15:24:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 -- start start 2023-10-05T15:24:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd2c00 0x558d26ddb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd3520 0x558d26de4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dde3d0 0x558d26dda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26ba78c0 con 0x558d26dd2c00 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26dcfdc0 con 0x558d26dd3520 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb82789eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26de54b0 con 0x558d26dde3d0 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb818c4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd3520 0x558d26de4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb818c4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd3520 0x558d26de4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54704/0 (socket says 172.21.15.60:54704) 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb818c4f700 1 -- 172.21.15.60:0/391537693 learned_addr learned my addr 172.21.15.60:0/391537693 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.823+0000 7fb819c51700 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dde3d0 0x558d26dda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.824+0000 7fb819450700 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd2c00 0x558d26ddb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.824+0000 7fb819450700 1 -- 172.21.15.60:0/391537693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dde3d0 msgr2=0x558d26dda800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.824+0000 7fb819450700 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dde3d0 0x558d26dda800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.824+0000 7fb819450700 1 -- 172.21.15.60:0/391537693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd3520 msgr2=0x558d26de4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.824+0000 7fb819450700 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd3520 0x558d26de4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.824+0000 7fb819450700 1 -- 172.21.15.60:0/391537693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d26b781f0 con 0x558d26dd2c00 2023-10-05T15:24:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.825+0000 7fb819450700 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd2c00 0x558d26ddb650 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00bc40 tx=0x7fb80c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1766920c409be4c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.828+0000 7fb7fffff700 1 -- 172.21.15.60:0/391537693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0cc540 con 0x558d26dd2c00 2023-10-05T15:24:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.828+0000 7fb7fffff700 1 -- 172.21.15.60:0/391537693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb80c0a5070 con 0x558d26dd2c00 2023-10-05T15:24:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.828+0000 7fb7fffff700 1 -- 172.21.15.60:0/391537693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c09d3d0 con 0x558d26dd2c00 2023-10-05T15:24:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 -- 172.21.15.60:0/391537693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd2c00 msgr2=0x558d26ddb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd2c00 0x558d26ddb650 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00bc40 tx=0x7fb80c00b480 comp rx=0 tx=0).stop 2023-10-05T15:24:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 -- 172.21.15.60:0/391537693 shutdown_connections 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dde3d0 0x558d26dda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dd2c00 0x558d26ddb650 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 --2- 172.21.15.60:0/391537693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd3520 0x558d26de4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 -- 172.21.15.60:0/391537693 >> 172.21.15.60:0/391537693 conn(0x558d26d48200 msgr2=0x558d26df4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 -- 172.21.15.60:0/391537693 shutdown_connections 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 -- 172.21.15.60:0/391537693 wait complete. 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.829+0000 7fb82789eb80 1 -- start start 2023-10-05T15:24:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 Processor -- start 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd2c00 0x558d26e3cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd3520 0x558d26e3d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 0x558d26e39d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26e3dc60 con 0x558d26dde3d0 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26de4fb0 con 0x558d26dd2c00 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d26de5170 con 0x558d26dd3520 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb82789eb80 10 client.0 _ll_register_callbacks cb 0x558d26b207a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb819c51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 0x558d26e39d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb819c51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 0x558d26e39d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41290/0 (socket says 172.21.15.60:41290) 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb819450700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd2c00 0x558d26e3cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.830+0000 7fb819c51700 1 -- 172.21.15.60:0/1917141111 learned_addr learned my addr 172.21.15.60:0/1917141111 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb818c4f700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd3520 0x558d26e3d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb819c51700 1 -- 172.21.15.60:0/1917141111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd3520 msgr2=0x558d26e3d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb819c51700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd3520 0x558d26e3d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb819c51700 1 -- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd2c00 msgr2=0x558d26e3cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb819c51700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd2c00 0x558d26e3cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb819c51700 1 -- 172.21.15.60:0/1917141111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d26b3ac00 con 0x558d26dde3d0 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb818c4f700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd3520 0x558d26e3d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb819c51700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 0x558d26e39d80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098e0 tx=0x7fb804009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90acd5b0c351b81c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb7fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb7fcff9700 1 -- 172.21.15.60:0/1917141111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80400f670 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb810013a30 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb7fcff9700 1 -- 172.21.15.60:0/1917141111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9387+0+0 (secure 0 0 0) 0x7fb80400f7d0 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb7fcff9700 1 -- 172.21.15.60:0/1917141111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb80400f990 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb82789eb80 10 client.16749 fetch_fsmap learned FSMap version 43 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.831+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558d26b50250 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb7fcff9700 1 -- 172.21.15.60:0/1917141111 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb810013a30 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb7fcff9700 1 -- 172.21.15.60:0/1917141111 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fb804031c50 con 0x558d26dde3d0 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb82789eb80 10 client.16749 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb82789eb80 10 client.16749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb82789eb80 20 client.16749 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb82789eb80 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26e53850 0x558d26e55c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb82789eb80 4 client.16749 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:24:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558d26d1fad0 con 0x558d26e53850 2023-10-05T15:24:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb819450700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26e53850 0x558d26e55c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb7fcff9700 10 client.16749 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:37.832+0000 7fb819450700 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26e53850 0x558d26e55c70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93ba7c6321c3023 server_cookie=9b27daef3e90426d in_seq=0 out_seq=0 2023-10-05T15:24:39.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:39 smithi135 ceph-mon[103360]: pgmap v246: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 390 op/s 2023-10-05T15:24:39.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:39 smithi060 ceph-mon[99238]: pgmap v246: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 390 op/s 2023-10-05T15:24:39.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:39 smithi092 ceph-mon[102944]: pgmap v246: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 390 op/s 2023-10-05T15:24:40.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:40 smithi135 ceph-mon[103360]: pgmap v247: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 495 op/s 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb7fcff9700 1 -- 172.21.15.60:0/1917141111 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558d26d1fad0 con 0x558d26e53850 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb7fcff9700 10 client.16749 handle_command_reply: tid=0 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 client.16749 shutdown 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 msgr2=0x558d26e39d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 0x558d26e39d80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098e0 tx=0x7fb804009ca0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 shutdown_connections 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x558d26e53850 0x558d26e55c70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558d26dde3d0 0x558d26e39d80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d26dd2c00 0x558d26e3cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 --2- 172.21.15.60:0/1917141111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d26dd3520 0x558d26e3d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 >> 172.21.15.60:0/1917141111 conn(0x558d26d48200 msgr2=0x558d26de96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.621+0000 7fb7fcff9700 0 client.16749 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 shutdown_connections 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb82789eb80 1 -- 172.21.15.60:0/1917141111 wait complete. 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb82789eb80 20 client.16749 trim_cache size 0 max 16384 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8000a1800 msgr2=0x7fb8000a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8000a1800 0x7fb8000a3cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb80400b5c0 tx=0x7fb804005040 comp rx=0 tx=0).stop 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 msgr2=0x7fb8141151f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 0x7fb8141151f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b530 tx=0x7fb80c00b840 comp rx=0 tx=0).stop 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 shutdown_connections 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8000a1800 0x7fb8000a3cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb814110080 0x7fb814110530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8141010c0 0x7fb8141151f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 --2- 172.21.15.60:0/1596350086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8141061e0 0x7fb814115750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.622+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 >> 172.21.15.60:0/1596350086 conn(0x7fb8140fc940 msgr2=0x7fb8140fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.623+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 shutdown_connections 2023-10-05T15:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:40.623+0000 7fb81b6b4700 1 -- 172.21.15.60:0/1596350086 wait complete. 2023-10-05T15:24:40.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:40 smithi060 ceph-mon[99238]: pgmap v247: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 495 op/s 2023-10-05T15:24:40.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:40 smithi092 ceph-mon[102944]: pgmap v247: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 495 op/s 2023-10-05T15:24:42.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:42 smithi135 ceph-mon[103360]: pgmap v248: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.4 MiB/s wr, 612 op/s 2023-10-05T15:24:42.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:42 smithi060 ceph-mon[99238]: pgmap v248: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.4 MiB/s wr, 612 op/s 2023-10-05T15:24:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:42 smithi092 ceph-mon[102944]: pgmap v248: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.4 MiB/s wr, 612 op/s 2023-10-05T15:24:45.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:45 smithi135 ceph-mon[103360]: pgmap v249: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 1.12k op/s 2023-10-05T15:24:45.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:45 smithi060 ceph-mon[99238]: pgmap v249: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 1.12k op/s 2023-10-05T15:24:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:45 smithi092 ceph-mon[102944]: pgmap v249: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 1.12k op/s 2023-10-05T15:24:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:47 smithi135 ceph-mon[103360]: pgmap v250: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.15k op/s 2023-10-05T15:24:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:47 smithi060 ceph-mon[99238]: pgmap v250: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.15k op/s 2023-10-05T15:24:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:47 smithi092 ceph-mon[102944]: pgmap v250: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.15k op/s 2023-10-05T15:24:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:49 smithi135 ceph-mon[103360]: pgmap v251: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 1.24k op/s 2023-10-05T15:24:49.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:49 smithi060 ceph-mon[99238]: pgmap v251: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 1.24k op/s 2023-10-05T15:24:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:49 smithi092 ceph-mon[102944]: pgmap v251: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 1.24k op/s 2023-10-05T15:24:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:51 smithi135 ceph-mon[103360]: pgmap v252: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.18k op/s 2023-10-05T15:24:51.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:51 smithi060 ceph-mon[99238]: pgmap v252: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.18k op/s 2023-10-05T15:24:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:51 smithi092 ceph-mon[102944]: pgmap v252: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.18k op/s 2023-10-05T15:24:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:52 smithi135 ceph-mon[103360]: pgmap v253: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2023-10-05T15:24:52.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:52 smithi060 ceph-mon[99238]: pgmap v253: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2023-10-05T15:24:52.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:52 smithi092 ceph-mon[102944]: pgmap v253: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e91402700 1 --2- 172.21.15.60:0/1657263796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e8c11a690 0x7f7e8c11ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 -- 172.21.15.60:0/1657263796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 msgr2=0x7f7e8c107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 --2- 172.21.15.60:0/1657263796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c107eb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009990 tx=0x7f7e7c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 -- 172.21.15.60:0/1657263796 shutdown_connections 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 --2- 172.21.15.60:0/1657263796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e8c11a690 0x7f7e8c11ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 --2- 172.21.15.60:0/1657263796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c107eb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 --2- 172.21.15.60:0/1657263796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e8c10fa90 0x7f7e8c1083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 -- 172.21.15.60:0/1657263796 >> 172.21.15.60:0/1657263796 conn(0x7f7e8c06cfa0 msgr2=0x7f7e8c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 -- 172.21.15.60:0/1657263796 shutdown_connections 2023-10-05T15:24:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.765+0000 7f7e92e65700 1 -- 172.21.15.60:0/1657263796 wait complete. 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.766+0000 7f7e92e65700 1 Processor -- start 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.766+0000 7f7e92e65700 1 -- start start 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e92e65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c118990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e92e65700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e8c10fa90 0x7f7e8c118f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e92e65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e8c11a690 0x7f7e8c111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e92e65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c111f60 con 0x7f7e8c10f620 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e92e65700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c1120d0 con 0x7f7e8c10fa90 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e92e65700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c112290 con 0x7f7e8c11a690 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e90c01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c118990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e90c01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c118990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41300/0 (socket says 172.21.15.60:41300) 2023-10-05T15:24:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.767+0000 7f7e90c01700 1 -- 172.21.15.60:0/2586996219 learned_addr learned my addr 172.21.15.60:0/2586996219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.768+0000 7f7e90c01700 1 -- 172.21.15.60:0/2586996219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e8c11a690 msgr2=0x7f7e8c111790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.768+0000 7f7e90c01700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e8c11a690 0x7f7e8c111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.768+0000 7f7e90c01700 1 -- 172.21.15.60:0/2586996219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e8c10fa90 msgr2=0x7f7e8c118f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.768+0000 7f7e90c01700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e8c10fa90 0x7f7e8c118f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.768+0000 7f7e90c01700 1 -- 172.21.15.60:0/2586996219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0095f0 con 0x7f7e8c10f620 2023-10-05T15:24:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.768+0000 7f7e90c01700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c118990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b2e0 tx=0x7f7e7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.769+0000 7f7e89ffb700 1 -- 172.21.15.60:0/2586996219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c01d070 con 0x7f7e8c10f620 2023-10-05T15:24:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.769+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c112510 con 0x7f7e8c10f620 2023-10-05T15:24:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.769+0000 7f7e89ffb700 1 -- 172.21.15.60:0/2586996219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e7c00fc40 con 0x7f7e8c10f620 2023-10-05T15:24:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.769+0000 7f7e89ffb700 1 -- 172.21.15.60:0/2586996219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c017650 con 0x7f7e8c10f620 2023-10-05T15:24:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.769+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c116750 con 0x7f7e8c10f620 2023-10-05T15:24:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.773+0000 7f7e89ffb700 1 -- 172.21.15.60:0/2586996219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7e7c021410 con 0x7f7e8c10f620 2023-10-05T15:24:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e89ffb700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e740a1670 0x7f7e740a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 Processor -- start 2023-10-05T15:24:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 -- start start 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e89ffb700 1 -- 172.21.15.60:0/2586996219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9387+0+0 (secure 0 0 0) 0x7f7e7c0ce8d0 con 0x7f7e8c10f620 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718677c00 0x55e718677fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718678520 0x55e718682e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e7186857c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7185e1400 con 0x55e718677c00 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7185d2bc0 con 0x55e718678520 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.774+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7185d04e0 con 0x55e7186833d0 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e91402700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e7186857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e91402700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e7186857c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54838/0 (socket says 172.21.15.60:54838) 2023-10-05T15:24:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e91402700 1 -- 172.21.15.60:0/396682704 learned_addr learned my addr 172.21.15.60:0/396682704 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718677c00 0x55e718677fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 -- 172.21.15.60:0/396682704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 msgr2=0x55e7186857c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e7186857c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 -- 172.21.15.60:0/396682704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718678520 msgr2=0x55e718682e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718678520 0x55e718682e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 -- 172.21.15.60:0/396682704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7183f6d80 con 0x55e718677c00 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.775+0000 7f7e90c01700 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718677c00 0x55e718677fe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0cbcc0 tx=0x7f7e7c09b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64399a7c72f314e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.776+0000 7f7e72ffd700 1 -- 172.21.15.60:0/396682704 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c09f730 con 0x55e718677c00 2023-10-05T15:24:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.776+0000 7f7e72ffd700 1 -- 172.21.15.60:0/396682704 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e7c0a38e0 con 0x55e718677c00 2023-10-05T15:24:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.776+0000 7f7e72ffd700 1 -- 172.21.15.60:0/396682704 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c09ad30 con 0x55e718677c00 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e8bfff700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e740a1670 0x7f7e740a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/396682704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718677c00 msgr2=0x55e718677fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718677c00 0x55e718677fe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0cbcc0 tx=0x7f7e7c09b230 comp rx=0 tx=0).stop 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/396682704 shutdown_connections 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e7186857c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718677c00 0x55e718677fe0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/396682704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718678520 0x55e718682e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.777+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/396682704 >> 172.21.15.60:0/396682704 conn(0x55e7185ed200 msgr2=0x55e718674080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.778+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/396682704 shutdown_connections 2023-10-05T15:24:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.778+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/396682704 wait complete. 2023-10-05T15:24:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.779+0000 7f7e8bfff700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e740a1670 0x7f7e740a3b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e800094f0 tx=0x7f7e80009440 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.779+0000 7f7e9f04fb80 1 -- start start 2023-10-05T15:24:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.779+0000 7f7e9f04fb80 1 Processor -- start 2023-10-05T15:24:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718677c00 0x55e7186837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 0x55e718683cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 0x55e71868e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7185cbdd0 con 0x55e718678520 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7185686b0 con 0x55e7186833d0 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e718568350 con 0x55e718677c00 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e9f04fb80 10 client.0 _ll_register_callbacks cb 0x55e7183c57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 0x55e71868e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 0x55e71868e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54736/0 (socket says 172.21.15.60:54736) 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 -- 172.21.15.60:0/3456400007 learned_addr learned my addr 172.21.15.60:0/3456400007 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e90c01700 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718677c00 0x55e7186837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 -- 172.21.15.60:0/3456400007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718677c00 msgr2=0x55e7186837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718677c00 0x55e7186837b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 -- 172.21.15.60:0/3456400007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 msgr2=0x55e718683cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 0x55e718683cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.780+0000 7f7e91402700 1 -- 172.21.15.60:0/3456400007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c116750 con 0x55e7186833d0 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e91402700 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 0x55e71868e830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e980 tx=0x7f7e8400ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0f5c92ced16fe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3456400007 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84019070 con 0x55e7186833d0 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3456400007 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9387+0+0 (secure 0 0 0) 0x7f7e84004bb0 con 0x55e7186833d0 2023-10-05T15:24:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e71866bd50 con 0x55e7186833d0 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3456400007 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e84007b10 con 0x55e7186833d0 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 10 client.26408 fetch_fsmap learned FSMap version 43 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e7183dfc00 con 0x55e7186833d0 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3456400007 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e71866bd50 con 0x55e7186833d0 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3456400007 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7e8401c020 con 0x55e7186833d0 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 10 client.26408 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:24:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 10 client.26408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 20 client.26408 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e718692da0 0x55e7186951c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.781+0000 7f7e9f04fb80 4 client.26408 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.782+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7185c4db0 con 0x55e718692da0 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.782+0000 7f7e90c01700 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e718692da0 0x55e7186951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.782+0000 7f7e6bfff700 10 client.26408 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.782+0000 7f7e90c01700 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e718692da0 0x55e7186951c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa86a84b531f01b server_cookie=a4d564acd83615a1 in_seq=0 out_seq=0 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3456400007 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7185c4db0 con 0x55e718692da0 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e6bfff700 10 client.26408 handle_command_reply: tid=0 2023-10-05T15:24:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 client.26408 shutdown 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 msgr2=0x55e71868e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 0x55e71868e830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e980 tx=0x7f7e8400ed40 comp rx=0 tx=0).stop 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 shutdown_connections 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e718692da0 0x55e7186951c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7186833d0 0x55e71868e830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e6bfff700 0 client.26408 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718677c00 0x55e7186837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3456400007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 0x55e718683cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.783+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 >> 172.21.15.60:0/3456400007 conn(0x55e7185ed200 msgr2=0x55e718673c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.784+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 shutdown_connections 2023-10-05T15:24:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.784+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3456400007 wait complete. 2023-10-05T15:24:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.785+0000 7f7e9f04fb80 20 client.26408 trim_cache size 0 max 16384 2023-10-05T15:24:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.807+0000 7f7e9f04fb80 1 Processor -- start 2023-10-05T15:24:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 -- start start 2023-10-05T15:24:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186887c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 0x55e718673250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e71867d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e71844c8c0 con 0x55e718678520 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e718682b80 con 0x55e718677c00 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e718688d00 con 0x55e7186833d0 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e90c01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186887c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e91402700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e71867d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e90c01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186887c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54746/0 (socket says 172.21.15.60:54746) 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e91402700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e71867d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54852/0 (socket says 172.21.15.60:54852) 2023-10-05T15:24:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.808+0000 7f7e90c01700 1 -- 172.21.15.60:0/1843946414 learned_addr learned my addr 172.21.15.60:0/1843946414 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e90c01700 1 -- 172.21.15.60:0/1843946414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 msgr2=0x55e71867d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e90c01700 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e71867d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e90c01700 1 -- 172.21.15.60:0/1843946414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 msgr2=0x55e718673250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e90c01700 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 0x55e718673250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e90c01700 1 -- 172.21.15.60:0/1843946414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e71841d1f0 con 0x55e718677c00 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e90c01700 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186887c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c09b7a0 tx=0x7f7e7c0bb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace1dd688d99383b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e737fe700 1 -- 172.21.15.60:0/1843946414 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c09aad0 con 0x55e718677c00 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e737fe700 1 -- 172.21.15.60:0/1843946414 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e7c09ac30 con 0x55e718677c00 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.809+0000 7f7e737fe700 1 -- 172.21.15.60:0/1843946414 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0a36b0 con 0x55e718677c00 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/1843946414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 msgr2=0x55e7186887c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186887c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c09b7a0 tx=0x7f7e7c0bb040 comp rx=0 tx=0).stop 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/1843946414 shutdown_connections 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7186833d0 0x55e71867d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186887c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/1843946414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e718678520 0x55e718673250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.810+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/1843946414 >> 172.21.15.60:0/1843946414 conn(0x55e7185ed200 msgr2=0x55e71867cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.813+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/1843946414 shutdown_connections 2023-10-05T15:24:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.813+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/1843946414 wait complete. 2023-10-05T15:24:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.814+0000 7f7e9f04fb80 1 -- start start 2023-10-05T15:24:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.814+0000 7f7e9f04fb80 1 Processor -- start 2023-10-05T15:24:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186848c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 0x55e718684e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7186833d0 0x55e7186dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7186e00d0 con 0x55e7186833d0 2023-10-05T15:24:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7186e0240 con 0x55e718677c00 2023-10-05T15:24:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7186e0400 con 0x55e718678520 2023-10-05T15:24:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e9f04fb80 10 client.0 _ll_register_callbacks cb 0x7f7e8400e1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:24:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 0x55e718684e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 0x55e718684e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54856/0 (socket says 172.21.15.60:54856) 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.815+0000 7f7e8bfff700 1 -- 172.21.15.60:0/3661014903 learned_addr learned my addr 172.21.15.60:0/3661014903 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e90c01700 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186848c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e8bfff700 1 -- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 msgr2=0x55e7186848c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e8bfff700 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186848c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e8bfff700 1 -- 172.21.15.60:0/3661014903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7186833d0 msgr2=0x55e7186dfb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e8bfff700 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7186833d0 0x55e7186dfb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e8bfff700 1 -- 172.21.15.60:0/3661014903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7183f6d80 con 0x55e718678520 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e8bfff700 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 0x55e718684e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000ebe0 tx=0x7f7e8000efa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=978422eb6a130189 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:24:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3661014903 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80010ad0 con 0x55e718678520 2023-10-05T15:24:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.816+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3661014903 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9387+0+0 (secure 0 0 0) 0x7f7e80010c30 con 0x55e718678520 2023-10-05T15:24:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.817+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e7c0a38e0 con 0x55e718678520 2023-10-05T15:24:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.817+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3661014903 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e80010df0 con 0x55e718678520 2023-10-05T15:24:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.817+0000 7f7e9f04fb80 10 client.26278 fetch_fsmap learned FSMap version 43 2023-10-05T15:24:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.817+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e7183f5250 con 0x55e718678520 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3661014903 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e7c0a38e0 con 0x55e718678520 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3661014903 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7e800256c0 con 0x55e718678520 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e9f04fb80 10 client.26278 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e9f04fb80 10 client.26278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e9f04fb80 20 client.26278 populate_metadata read hostname 'smithi060' 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e7186e7dd0 0x55e7186ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e9f04fb80 4 client.26278 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e7185c4ad0 con 0x55e7186e7dd0 2023-10-05T15:24:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.819+0000 7f7e90c01700 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e7186e7dd0 0x55e7186ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:24:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.820+0000 7f7e6bfff700 10 client.26278 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.820+0000 7f7e90c01700 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e7186e7dd0 0x55e7186ea1f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=876a9165ad374e49 server_cookie=7f4102ca0d3a38d0 in_seq=0 out_seq=0 2023-10-05T15:24:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e6bfff700 1 -- 172.21.15.60:0/3661014903 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e7185c4ad0 con 0x55e7186e7dd0 2023-10-05T15:24:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e6bfff700 10 client.26278 handle_command_reply: tid=0 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 client.26278 shutdown 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 msgr2=0x55e718684e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 0x55e718684e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000ebe0 tx=0x7f7e8000efa0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 shutdown_connections 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e7186e7dd0 0x55e7186ea1f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7186833d0 0x55e7186dfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e6bfff700 0 client.26278 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e718677c00 0x55e7186848c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 --2- 172.21.15.60:0/3661014903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e718678520 0x55e718684e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 >> 172.21.15.60:0/3661014903 conn(0x55e7185ed200 msgr2=0x55e718680cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 shutdown_connections 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 1 -- 172.21.15.60:0/3661014903 wait complete. 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.906+0000 7f7e9f04fb80 20 client.26278 trim_cache size 0 max 16384 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:24:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:24:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e740a1670 msgr2=0x7f7e740a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e740a1670 0x7f7e740a3b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e800094f0 tx=0x7f7e80009440 comp rx=0 tx=0).stop 2023-10-05T15:24:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 msgr2=0x7f7e8c118990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c118990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b2e0 tx=0x7f7e7c0057f0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 shutdown_connections 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e8c11a690 0x7f7e8c111790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e8c10f620 0x7f7e8c118990 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e740a1670 0x7f7e740a3b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 --2- 172.21.15.60:0/2586996219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e8c10fa90 0x7f7e8c118f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:24:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.911+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 >> 172.21.15.60:0/2586996219 conn(0x7f7e8c06cfa0 msgr2=0x7f7e8c06f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:24:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.912+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 shutdown_connections 2023-10-05T15:24:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:24:53.913+0000 7f7e92e65700 1 -- 172.21.15.60:0/2586996219 wait complete. 2023-10-05T15:24:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:55 smithi135 ceph-mon[103360]: pgmap v254: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 988 op/s 2023-10-05T15:24:55.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:55 smithi060 ceph-mon[99238]: pgmap v254: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 988 op/s 2023-10-05T15:24:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:55 smithi092 ceph-mon[102944]: pgmap v254: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 988 op/s 2023-10-05T15:24:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:57 smithi135 ceph-mon[103360]: pgmap v255: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 521 op/s 2023-10-05T15:24:57.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:57 smithi060 ceph-mon[99238]: pgmap v255: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 521 op/s 2023-10-05T15:24:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:57 smithi092 ceph-mon[102944]: pgmap v255: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 521 op/s 2023-10-05T15:24:59.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:24:59 smithi135 ceph-mon[103360]: pgmap v256: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 464 op/s 2023-10-05T15:24:59.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:24:59 smithi060 ceph-mon[99238]: pgmap v256: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 464 op/s 2023-10-05T15:24:59.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:24:59 smithi092 ceph-mon[102944]: pgmap v256: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 464 op/s 2023-10-05T15:25:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:01 smithi135 ceph-mon[103360]: pgmap v257: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 395 op/s 2023-10-05T15:25:01.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:01 smithi060 ceph-mon[99238]: pgmap v257: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 395 op/s 2023-10-05T15:25:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:01 smithi092 ceph-mon[102944]: pgmap v257: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 395 op/s 2023-10-05T15:25:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:02 smithi135 ceph-mon[103360]: pgmap v258: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 364 op/s 2023-10-05T15:25:02.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:02 smithi060 ceph-mon[99238]: pgmap v258: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 364 op/s 2023-10-05T15:25:02.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:02 smithi092 ceph-mon[102944]: pgmap v258: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 364 op/s 2023-10-05T15:25:04.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:04 smithi135 ceph-mon[103360]: osdmap e101: 12 total, 12 up, 12 in 2023-10-05T15:25:04.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:04 smithi135 ceph-mon[103360]: pgmap v260: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 380 op/s 2023-10-05T15:25:04.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:04 smithi060 ceph-mon[99238]: osdmap e101: 12 total, 12 up, 12 in 2023-10-05T15:25:04.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:04 smithi060 ceph-mon[99238]: pgmap v260: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 380 op/s 2023-10-05T15:25:04.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:04 smithi092 ceph-mon[102944]: osdmap e101: 12 total, 12 up, 12 in 2023-10-05T15:25:04.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:04 smithi092 ceph-mon[102944]: pgmap v260: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 380 op/s 2023-10-05T15:25:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.111+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1063463497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581010c0 msgr2=0x7f5e581014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.111+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1063463497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581010c0 0x7f5e581014a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009990 tx=0x7f5e48009ca0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.112+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1063463497 shutdown_connections 2023-10-05T15:25:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.112+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1063463497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e581061e0 0x7f5e5810dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.112+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1063463497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581010c0 0x7f5e581014a0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009990 tx=0x7f5e48009ca0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.112+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1063463497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e58101a70 0x7f5e58105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.112+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1063463497 >> 172.21.15.60:0/1063463497 conn(0x7f5e580fc940 msgr2=0x7f5e580fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.117+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1063463497 shutdown_connections 2023-10-05T15:25:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.122+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1063463497 wait complete. 2023-10-05T15:25:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.123+0000 7f5e5c8ec700 1 Processor -- start 2023-10-05T15:25:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 -- start start 2023-10-05T15:25:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e581061e0 0x7f5e58115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e581157c0 0x7f5e58110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 0x7f5e58110b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5811b000 con 0x7f5e581061e0 2023-10-05T15:25:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5811b170 con 0x7f5e581106a0 2023-10-05T15:25:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e5c8ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5811b2e0 con 0x7f5e581157c0 2023-10-05T15:25:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 0x7f5e58110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 0x7f5e58110b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54762/0 (socket says 172.21.15.60:54762) 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1631464414 learned_addr learned my addr 172.21.15.60:0/1631464414 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1631464414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e581157c0 msgr2=0x7f5e58110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.124+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e581157c0 0x7f5e58110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.125+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e581061e0 msgr2=0x7f5e58115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.125+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e581061e0 0x7f5e58115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.125+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1631464414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480095f0 con 0x7f5e581106a0 2023-10-05T15:25:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.131+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 0x7f5e58110b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e50007ee0 tx=0x7f5e5000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.136+0000 7f5e477fe700 1 -- 172.21.15.60:0/1631464414 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50028070 con 0x7f5e581106a0 2023-10-05T15:25:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.136+0000 7f5e477fe700 1 -- 172.21.15.60:0/1631464414 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e50009390 con 0x7f5e581106a0 2023-10-05T15:25:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.136+0000 7f5e477fe700 1 -- 172.21.15.60:0/1631464414 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50005900 con 0x7f5e581106a0 2023-10-05T15:25:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.137+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5811b5c0 con 0x7f5e581106a0 2023-10-05T15:25:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.138+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5811ba80 con 0x7f5e581106a0 2023-10-05T15:25:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.155+0000 7f5e68ad6b80 1 Processor -- start 2023-10-05T15:25:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.160+0000 7f5e477fe700 1 -- 172.21.15.60:0/1631464414 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5e5002d410 con 0x7f5e581106a0 2023-10-05T15:25:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.161+0000 7f5e477fe700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e400a1730 0x7f5e400a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.161+0000 7f5e477fe700 1 -- 172.21.15.60:0/1631464414 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f5e500de2d0 con 0x7f5e581106a0 2023-10-05T15:25:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.161+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e400a1730 0x7f5e400a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.162+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e400a1730 0x7f5e400a3bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005950 tx=0x7f5e4c0058e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 -- start start 2023-10-05T15:25:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87dc00 0x55996c87dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87e520 0x55996c888e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c7e7400 con 0x55996c8893d0 2023-10-05T15:25:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c7d8bc0 con 0x55996c87dc00 2023-10-05T15:25:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.164+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c7d64e0 con 0x55996c87e520 2023-10-05T15:25:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e5659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87dc00 0x55996c87dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e5659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87dc00 0x55996c87dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54768/0 (socket says 172.21.15.60:54768) 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e5659c700 1 -- 172.21.15.60:0/1868430730 learned_addr learned my addr 172.21.15.60:0/1868430730 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87e520 0x55996c888e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1868430730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87e520 msgr2=0x55996c888e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87e520 0x55996c888e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1868430730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87dc00 msgr2=0x55996c87dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87dc00 0x55996c87dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.168+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1868430730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55996c5fcd80 con 0x55996c8893d0 2023-10-05T15:25:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.169+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88b7c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5e500db5f0 tx=0x7f5e500aa9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5050b0638197403e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.169+0000 7f5e44ff9700 1 -- 172.21.15.60:0/1868430730 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500b3210 con 0x55996c8893d0 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.169+0000 7f5e44ff9700 1 -- 172.21.15.60:0/1868430730 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e500a9220 con 0x55996c8893d0 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.169+0000 7f5e44ff9700 1 -- 172.21.15.60:0/1868430730 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500aa5d0 con 0x55996c8893d0 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.170+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1868430730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 msgr2=0x55996c88b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.170+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88b7c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5e500db5f0 tx=0x7f5e500aa9c0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.174+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1868430730 shutdown_connections 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.174+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88b7c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.174+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87dc00 0x55996c87dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.174+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1868430730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87e520 0x55996c888e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.174+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1868430730 >> 172.21.15.60:0/1868430730 conn(0x55996c7f3200 msgr2=0x55996c87a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.177+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1868430730 shutdown_connections 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.179+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1868430730 wait complete. 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.179+0000 7f5e68ad6b80 1 -- start start 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.179+0000 7f5e68ad6b80 1 Processor -- start 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c8861d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87e520 0x55996c886710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c886c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c7d1dd0 con 0x55996c87dc00 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c76e6b0 con 0x55996c87e520 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c76e350 con 0x55996c8893d0 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e68ad6b80 10 client.0 _ll_register_callbacks cb 0x55996c5cb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e5659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c8861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e5659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c8861d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41354/0 (socket says 172.21.15.60:41354) 2023-10-05T15:25:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.180+0000 7f5e5659c700 1 -- 172.21.15.60:0/3117102326 learned_addr learned my addr 172.21.15.60:0/3117102326 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.184+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87e520 0x55996c886710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.185+0000 7f5e55d9b700 1 -- 172.21.15.60:0/3117102326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 msgr2=0x55996c886c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:25:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.185+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c886c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.185+0000 7f5e55d9b700 1 -- 172.21.15.60:0/3117102326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 msgr2=0x55996c8861d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.185+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c8861d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.185+0000 7f5e55d9b700 1 -- 172.21.15.60:0/3117102326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5811ba80 con 0x55996c87e520 2023-10-05T15:25:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.189+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87e520 0x55996c886710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0094f0 tx=0x7f5e4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e282235b11b983c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.189+0000 7f5e3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:25:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.190+0000 7f5e3dffb700 1 -- 172.21.15.60:0/3117102326 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c010dc0 con 0x55996c87e520 2023-10-05T15:25:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.190+0000 7f5e3dffb700 1 -- 172.21.15.60:0/3117102326 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f5e4c00ee50 con 0x55996c87e520 2023-10-05T15:25:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.190+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55996c871d50 con 0x55996c87e520 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.191+0000 7f5e3dffb700 1 -- 172.21.15.60:0/3117102326 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e4c026430 con 0x55996c87e520 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 10 client.26426 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55996c5e5c00 con 0x55996c87e520 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e3dffb700 1 -- 172.21.15.60:0/3117102326 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55996c871d50 con 0x55996c87e520 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e3dffb700 1 -- 172.21.15.60:0/3117102326 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f5e4c030660 con 0x55996c87e520 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 10 client.26426 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 10 client.26426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 20 client.26426 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c8bb1d0 0x55996c8bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 4 client.26426 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:25:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.193+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55996c7cadb0 con 0x55996c8bb1d0 2023-10-05T15:25:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.210+0000 7f5e5659c700 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c8bb1d0 0x55996c8bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.212+0000 7f5e5659c700 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c8bb1d0 0x55996c8bd5f0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ff74eac4abf65ce server_cookie=590cede7db7bdf01 in_seq=0 out_seq=0 2023-10-05T15:25:07.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.212+0000 7f5e3dffb700 10 client.26426 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:07.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.213+0000 7f5e3dffb700 1 -- 172.21.15.60:0/3117102326 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55996c7cadb0 con 0x55996c8bb1d0 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.213+0000 7f5e3dffb700 10 client.26426 handle_command_reply: tid=0 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.213+0000 7f5e68ad6b80 1 client.26426 shutdown 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.220+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87e520 msgr2=0x55996c886710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.220+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87e520 0x55996c886710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0094f0 tx=0x7f5e4c004750 comp rx=0 tx=0).stop 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 shutdown_connections 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c8bb1d0 0x55996c8bd5f0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c886c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c8861d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3117102326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c87e520 0x55996c886710 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0094f0 tx=0x7f5e4c004750 comp rx=0 tx=0).stop 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 >> 172.21.15.60:0/3117102326 conn(0x55996c7f3200 msgr2=0x55996c879c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:07.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e3dffb700 0 client.26426 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 shutdown_connections 2023-10-05T15:25:07.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.221+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3117102326 wait complete. 2023-10-05T15:25:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.233+0000 7f5e68ad6b80 20 client.26426 trim_cache size 0 max 16384 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 Processor -- start 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 -- start start 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c880c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c88ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 0x55996c885740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c6528c0 con 0x55996c87dc00 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c871c40 con 0x55996c881be0 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.259+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c87ee20 con 0x55996c8893d0 2023-10-05T15:25:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 0x55996c885740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 0x55996c885740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54784/0 (socket says 172.21.15.60:54784) 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 -- 172.21.15.60:0/3905168017 learned_addr learned my addr 172.21.15.60:0/3905168017 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e5659c700 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c880c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c88ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 -- 172.21.15.60:0/3905168017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 msgr2=0x55996c88ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c88ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 -- 172.21.15.60:0/3905168017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 msgr2=0x55996c880c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c880c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 -- 172.21.15.60:0/3905168017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55996c8bd9a0 con 0x55996c881be0 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 0x55996c885740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e500af190 tx=0x7f5e500a7220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a094035528802779 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.260+0000 7f5e457fa700 1 -- 172.21.15.60:0/3905168017 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500b3210 con 0x55996c881be0 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e457fa700 1 -- 172.21.15.60:0/3905168017 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e5002a2c0 con 0x55996c881be0 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e457fa700 1 -- 172.21.15.60:0/3905168017 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000de10 con 0x55996c881be0 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3905168017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 msgr2=0x55996c885740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 0x55996c885740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e500af190 tx=0x7f5e500a7220 comp rx=0 tx=0).stop 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3905168017 shutdown_connections 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c881be0 0x55996c885740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c87dc00 0x55996c880c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/3905168017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c8893d0 0x55996c88ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.261+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3905168017 >> 172.21.15.60:0/3905168017 conn(0x55996c7f3200 msgr2=0x55996c8814d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3905168017 shutdown_connections 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/3905168017 wait complete. 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 -- start start 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 Processor -- start 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87dc00 0x55996c88f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.262+0000 7f5e68ad6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 0x55996c88dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c88e4f0 con 0x55996c8893d0 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c88e630 con 0x55996c88db30 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e68ad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55996c88e7f0 con 0x55996c87dc00 2023-10-05T15:25:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e68ad6b80 10 client.0 _ll_register_callbacks cb 0x7f5e4c00ecb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 0x55996c88dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 0x55996c88dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54790/0 (socket says 172.21.15.60:54790) 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1478763057 learned_addr learned my addr 172.21.15.60:0/1478763057 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1478763057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87dc00 msgr2=0x55996c88f700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87dc00 0x55996c88f700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1478763057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 msgr2=0x55996c88fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e56d9d700 1 -- 172.21.15.60:0/1478763057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55996c5fcd80 con 0x55996c88db30 2023-10-05T15:25:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.263+0000 7f5e55d9b700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.264+0000 7f5e56d9d700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 0x55996c88dfb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e500a7380 tx=0x7f5e500dbbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18993ae5056e9014 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.267+0000 7f5e3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:25:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.267+0000 7f5e3dffb700 1 -- 172.21.15.60:0/1478763057 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500b3210 con 0x55996c88db30 2023-10-05T15:25:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.267+0000 7f5e3dffb700 1 -- 172.21.15.60:0/1478763057 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f5e500ab0e0 con 0x55996c88db30 2023-10-05T15:25:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.267+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e500a9220 con 0x55996c88db30 2023-10-05T15:25:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.268+0000 7f5e3dffb700 1 -- 172.21.15.60:0/1478763057 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e500ab2a0 con 0x55996c88db30 2023-10-05T15:25:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.268+0000 7f5e68ad6b80 10 client.26432 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.268+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55996c6231f0 con 0x55996c88db30 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.268+0000 7f5e3dffb700 1 -- 172.21.15.60:0/1478763057 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e500a9220 con 0x55996c88db30 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.268+0000 7f5e3dffb700 1 -- 172.21.15.60:0/1478763057 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f5e500b2d80 con 0x55996c88db30 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.269+0000 7f5e68ad6b80 10 client.26432 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.269+0000 7f5e68ad6b80 10 client.26432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.269+0000 7f5e68ad6b80 20 client.26432 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.269+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c9100e0 0x55996c9124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.269+0000 7f5e68ad6b80 4 client.26432 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:25:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.269+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55996c7caad0 con 0x55996c9100e0 2023-10-05T15:25:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.280+0000 7f5e5659c700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c9100e0 0x55996c9124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.282+0000 7f5e5659c700 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c9100e0 0x55996c9124d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea523f16d212827e server_cookie=415e5e842fa627ce in_seq=0 out_seq=0 2023-10-05T15:25:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.282+0000 7f5e3dffb700 10 client.26432 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.430+0000 7f5e3dffb700 1 -- 172.21.15.60:0/1478763057 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55996c7caad0 con 0x55996c9100e0 2023-10-05T15:25:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.430+0000 7f5e3dffb700 10 client.26432 handle_command_reply: tid=0 2023-10-05T15:25:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.430+0000 7f5e68ad6b80 1 client.26432 shutdown 2023-10-05T15:25:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 msgr2=0x55996c88dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 0x55996c88dfb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e500a7380 tx=0x7f5e500dbbb0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 shutdown_connections 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55996c9100e0 0x55996c9124d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55996c88db30 0x55996c88dfb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55996c87dc00 0x55996c88f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 --2- 172.21.15.60:0/1478763057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55996c8893d0 0x55996c88fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 >> 172.21.15.60:0/1478763057 conn(0x55996c7f3200 msgr2=0x55996c887a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.433+0000 7f5e3dffb700 0 client.26432 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:07.442 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.441+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 shutdown_connections 2023-10-05T15:25:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.445+0000 7f5e68ad6b80 1 -- 172.21.15.60:0/1478763057 wait complete. 2023-10-05T15:25:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.448+0000 7f5e68ad6b80 20 client.26432 trim_cache size 0 max 16384 2023-10-05T15:25:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:25:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:25:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:25:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:25:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.451+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e400a1730 msgr2=0x7f5e400a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.451+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e400a1730 0x7f5e400a3bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005950 tx=0x7f5e4c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.451+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 msgr2=0x7f5e58110b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.451+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 0x7f5e58110b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e50007ee0 tx=0x7f5e5000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.457+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 shutdown_connections 2023-10-05T15:25:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.457+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f5e400a1730 0x7f5e400a3bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.457+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e581106a0 0x7f5e58110b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.457+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e581061e0 0x7f5e58115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.457+0000 7f5e5c8ec700 1 --2- 172.21.15.60:0/1631464414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e581157c0 0x7f5e58110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.457+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 >> 172.21.15.60:0/1631464414 conn(0x7f5e580fc940 msgr2=0x7f5e580fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.470+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 shutdown_connections 2023-10-05T15:25:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:07.472+0000 7f5e5c8ec700 1 -- 172.21.15.60:0/1631464414 wait complete. 2023-10-05T15:25:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:07 smithi135 ceph-mon[103360]: pgmap v261: 129 pgs: 10 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 85 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 354 op/s 2023-10-05T15:25:07.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:07 smithi060 ceph-mon[99238]: pgmap v261: 129 pgs: 10 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 85 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 354 op/s 2023-10-05T15:25:07.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:07 smithi092 ceph-mon[102944]: pgmap v261: 129 pgs: 10 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 85 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 354 op/s 2023-10-05T15:25:09.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:09 smithi135 ceph-mon[103360]: pgmap v262: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 279 op/s 2023-10-05T15:25:09.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:09 smithi060 ceph-mon[99238]: pgmap v262: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 279 op/s 2023-10-05T15:25:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:09 smithi092 ceph-mon[102944]: pgmap v262: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 279 op/s 2023-10-05T15:25:11.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:11 smithi135 ceph-mon[103360]: pgmap v263: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2023-10-05T15:25:11.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:11 smithi060 ceph-mon[99238]: pgmap v263: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2023-10-05T15:25:11.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:11 smithi092 ceph-mon[102944]: pgmap v263: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2023-10-05T15:25:12.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:12 smithi135 ceph-mon[103360]: pgmap v264: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 219 op/s 2023-10-05T15:25:12.921 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:12 smithi060 ceph-mon[99238]: pgmap v264: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 219 op/s 2023-10-05T15:25:12.932 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:12 smithi092 ceph-mon[102944]: pgmap v264: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 219 op/s 2023-10-05T15:25:13.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:13 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:25:13.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:13 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:25:13.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:13 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:25:14.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:14 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:25:14.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:14 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:25:14.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:14 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:25:14.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:14 smithi135 ceph-mon[103360]: pgmap v265: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-10-05T15:25:14.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:14 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:25:14.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:14 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:25:14.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:14 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:25:14.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:14 smithi060 ceph-mon[99238]: pgmap v265: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-10-05T15:25:14.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:14 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:25:14.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:14 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:25:14.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:14 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:25:14.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:14 smithi092 ceph-mon[102944]: pgmap v265: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-10-05T15:25:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:17 smithi135 ceph-mon[103360]: pgmap v266: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 160 op/s 2023-10-05T15:25:17.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:17 smithi060 ceph-mon[99238]: pgmap v266: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 160 op/s 2023-10-05T15:25:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:17 smithi092 ceph-mon[102944]: pgmap v266: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 160 op/s 2023-10-05T15:25:19.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:19 smithi135 ceph-mon[103360]: pgmap v267: 129 pgs: 11 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 95 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 162 op/s 2023-10-05T15:25:19.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:19 smithi060 ceph-mon[99238]: pgmap v267: 129 pgs: 11 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 95 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 162 op/s 2023-10-05T15:25:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:19 smithi092 ceph-mon[102944]: pgmap v267: 129 pgs: 11 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 95 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 162 op/s 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 -- 172.21.15.60:0/4051435084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93740ff950 msgr2=0x7f93740ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 --2- 172.21.15.60:0/4051435084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93740ff950 0x7f93740ffd30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f93680099c0 tx=0x7f9368009cd0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 -- 172.21.15.60:0/4051435084 shutdown_connections 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 --2- 172.21.15.60:0/4051435084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93741048a0 0x7f937410c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 --2- 172.21.15.60:0/4051435084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93740ff950 0x7f93740ffd30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 --2- 172.21.15.60:0/4051435084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9374100300 0x7f9374104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 -- 172.21.15.60:0/4051435084 >> 172.21.15.60:0/4051435084 conn(0x7f93740762e0 msgr2=0x7f93740766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 -- 172.21.15.60:0/4051435084 shutdown_connections 2023-10-05T15:25:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.620+0000 7f937b229700 1 -- 172.21.15.60:0/4051435084 wait complete. 2023-10-05T15:25:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 Processor -- start 2023-10-05T15:25:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 -- start start 2023-10-05T15:25:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740ff950 0x7f937419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93741048a0 0x7f937419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 0x7f9374194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93741955c0 con 0x7f93740ff950 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.621+0000 7f937b229700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374195700 con 0x7f9374194b40 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f937b229700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93741958c0 con 0x7f93741048a0 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 0x7f9374194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740ff950 0x7f937419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 0x7f9374194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54806/0 (socket says 172.21.15.60:54806) 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 -- 172.21.15.60:0/2521657334 learned_addr learned my addr 172.21.15.60:0/2521657334 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f9373fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93741048a0 0x7f937419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 -- 172.21.15.60:0/2521657334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93741048a0 msgr2=0x7f937419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93741048a0 0x7f937419b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 -- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740ff950 msgr2=0x7f937419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740ff950 0x7f937419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 -- 172.21.15.60:0/2521657334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360009520 con 0x7f9374194b40 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740ff950 0x7f937419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f93797c6700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 0x7f9374194ff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f936c004960 tx=0x7f936c00e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.622+0000 7f9371ffb700 1 -- 172.21.15.60:0/2521657334 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c018070 con 0x7f9374194b40 2023-10-05T15:25:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.623+0000 7f9371ffb700 1 -- 172.21.15.60:0/2521657334 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f936c00ee30 con 0x7f9374194b40 2023-10-05T15:25:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.623+0000 7f9371ffb700 1 -- 172.21.15.60:0/2521657334 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c00f040 con 0x7f9374194b40 2023-10-05T15:25:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.623+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680095f0 con 0x7f9374194b40 2023-10-05T15:25:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.623+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93741a1e80 con 0x7f9374194b40 2023-10-05T15:25:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.625+0000 7f9371ffb700 1 -- 172.21.15.60:0/2521657334 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f936c00e970 con 0x7f9374194b40 2023-10-05T15:25:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.626+0000 7f9371ffb700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93640a1670 0x7f93640a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.626+0000 7f9371ffb700 1 -- 172.21.15.60:0/2521657334 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f936c0cd070 con 0x7f9374194b40 2023-10-05T15:25:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.626+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93640a1670 0x7f93640a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.627+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93640a1670 0x7f93640a3b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9368006010 tx=0x7f9368005040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.627+0000 7f9387413b80 1 Processor -- start 2023-10-05T15:25:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 -- start start 2023-10-05T15:25:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a5624b400 con 0x562a562e1c00 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a5623cbc0 con 0x562a562ed3d0 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9387413b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a5623a4e0 con 0x562a562e2520 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562e1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41388/0 (socket says 172.21.15.60:41388) 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 -- 172.21.15.60:0/1891374859 learned_addr learned my addr 172.21.15.60:0/1891374859 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9373fff700 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f93797c6700 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 -- 172.21.15.60:0/1891374859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 msgr2=0x562a562ece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ece90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 -- 172.21.15.60:0/1891374859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 msgr2=0x562a562ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.628+0000 7f9378fc5700 1 -- 172.21.15.60:0/1891374859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a56060d80 con 0x562a562e1c00 2023-10-05T15:25:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.629+0000 7f9378fc5700 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562e1fe0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f93680095c0 tx=0x7f936801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4410f08a57fd724e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.629+0000 7f935effd700 1 -- 172.21.15.60:0/1891374859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368005510 con 0x562a562e1c00 2023-10-05T15:25:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.629+0000 7f935effd700 1 -- 172.21.15.60:0/1891374859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9368005670 con 0x562a562e1c00 2023-10-05T15:25:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.629+0000 7f935effd700 1 -- 172.21.15.60:0/1891374859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368016460 con 0x562a562e1c00 2023-10-05T15:25:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 -- 172.21.15.60:0/1891374859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 msgr2=0x562a562e1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562e1fe0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f93680095c0 tx=0x7f936801f000 comp rx=0 tx=0).stop 2023-10-05T15:25:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 -- 172.21.15.60:0/1891374859 shutdown_connections 2023-10-05T15:25:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562e1fe0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 --2- 172.21.15.60:0/1891374859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 -- 172.21.15.60:0/1891374859 >> 172.21.15.60:0/1891374859 conn(0x562a56257200 msgr2=0x562a562de080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 -- 172.21.15.60:0/1891374859 shutdown_connections 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 -- 172.21.15.60:0/1891374859 wait complete. 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 -- start start 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.630+0000 7f9387413b80 1 Processor -- start 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562ece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a56235dd0 con 0x562a562e1c00 2023-10-05T15:25:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a561d26b0 con 0x562a562ed3d0 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a561d2350 con 0x562a562e2520 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9387413b80 10 client.0 _ll_register_callbacks cb 0x562a5602f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562ece30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41394/0 (socket says 172.21.15.60:41394) 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 -- 172.21.15.60:0/2513044040 learned_addr learned my addr 172.21.15.60:0/2513044040 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9373fff700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f93797c6700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 -- 172.21.15.60:0/2513044040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 msgr2=0x562a562ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ea0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 -- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 msgr2=0x562a562ea7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ea7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.631+0000 7f9378fc5700 1 -- 172.21.15.60:0/2513044040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937410cc50 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562ece30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9368018040 tx=0x7f936801faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c427f203246bf89 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9353fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9353fff700 1 -- 172.21.15.60:0/2513044040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368005510 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9353fff700 1 -- 172.21.15.60:0/2513044040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f9368027040 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a562d5d50 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9353fff700 1 -- 172.21.15.60:0/2513044040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9368016460 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9387413b80 10 client.16785 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x562a56049c00 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.632+0000 7f9353fff700 1 -- 172.21.15.60:0/2513044040 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562a562d5d50 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9353fff700 1 -- 172.21.15.60:0/2513044040 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f9368046050 con 0x562a562e1c00 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9387413b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9387413b80 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9387413b80 20 client.16785 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9387413b80 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a562fc970 0x562a562fed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9387413b80 4 client.16785 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a5622edb0 con 0x562a562fc970 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9373fff700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a562fc970 0x562a562fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9353fff700 10 client.16785 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.633+0000 7f9373fff700 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a562fc970 0x562a562fed90 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc467663faf63338 server_cookie=53aebba91a8b1649 in_seq=0 out_seq=0 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9353fff700 1 -- 172.21.15.60:0/2513044040 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a5622edb0 con 0x562a562fc970 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9353fff700 10 client.16785 handle_command_reply: tid=0 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 client.16785 shutdown 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 msgr2=0x562a562ece30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562ece30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9368018040 tx=0x7f936801faf0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 shutdown_connections 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a562fc970 0x562a562fed90 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e1c00 0x562a562ece30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 --2- 172.21.15.60:0/2513044040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e2520 0x562a562ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 >> 172.21.15.60:0/2513044040 conn(0x562a56257200 msgr2=0x562a562ddc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9353fff700 0 client.16785 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 shutdown_connections 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 1 -- 172.21.15.60:0/2513044040 wait complete. 2023-10-05T15:25:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.634+0000 7f9387413b80 20 client.16785 trim_cache size 0 max 16384 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 Processor -- start 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 -- start start 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 0x562a562e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562f8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a560b68c0 con 0x562a562e2520 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a562f4300 con 0x562a562ed3d0 2023-10-05T15:25:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.652+0000 7f9387413b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a56303a70 con 0x562a562e1c00 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f93797c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 0x562a562e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f93797c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54824/0 (socket says 172.21.15.60:54824) 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f93797c6700 1 -- 172.21.15.60:0/2101215576 learned_addr learned my addr 172.21.15.60:0/2101215576 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 0x562a562e3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41404/0 (socket says 172.21.15.60:41404) 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9378fc5700 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 -- 172.21.15.60:0/2101215576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 msgr2=0x562a562f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 -- 172.21.15.60:0/2101215576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 msgr2=0x562a562f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 -- 172.21.15.60:0/2101215576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a560871f0 con 0x562a562e2520 2023-10-05T15:25:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f9373fff700 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 0x562a562e3b60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x562a562ff630 tx=0x7f9360009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78a903bd5dfe356 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f935f7fe700 1 -- 172.21.15.60:0/2101215576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360017040 con 0x562a562e2520 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f935f7fe700 1 -- 172.21.15.60:0/2101215576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9360018040 con 0x562a562e2520 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.653+0000 7f935f7fe700 1 -- 172.21.15.60:0/2101215576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360012b50 con 0x562a562e2520 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 -- 172.21.15.60:0/2101215576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 msgr2=0x562a562e3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 0x562a562e3b60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x562a562ff630 tx=0x7f9360009260 comp rx=0 tx=0).stop 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 -- 172.21.15.60:0/2101215576 shutdown_connections 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562ed3d0 0x562a562f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 --2- 172.21.15.60:0/2101215576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562e2520 0x562a562e3b60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 -- 172.21.15.60:0/2101215576 >> 172.21.15.60:0/2101215576 conn(0x562a56257200 msgr2=0x562a562f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 -- 172.21.15.60:0/2101215576 shutdown_connections 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.654+0000 7f9387413b80 1 -- 172.21.15.60:0/2101215576 wait complete. 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 -- start start 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 Processor -- start 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 0x562a562f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 0x562a56353b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a563540b0 con 0x562a562ed3d0 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a563541f0 con 0x562a562e2520 2023-10-05T15:25:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a563543b0 con 0x562a562e1c00 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.655+0000 7f9387413b80 10 client.0 _ll_register_callbacks cb 0x7f936c095840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 0x562a562f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f93797c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 0x562a56353b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 0x562a562f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54832/0 (socket says 172.21.15.60:54832) 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9378fc5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54938/0 (socket says 172.21.15.60:54938) 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 -- 172.21.15.60:0/33211002 learned_addr learned my addr 172.21.15.60:0/33211002 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f93797c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 0x562a56353b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41412/0 (socket says 172.21.15.60:41412) 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 -- 172.21.15.60:0/33211002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 msgr2=0x562a562f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 -- 172.21.15.60:0/33211002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 msgr2=0x562a56353b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 0x562a56353b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 -- 172.21.15.60:0/33211002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9360009da0 con 0x562a562e2520 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f93797c6700 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 0x562a56353b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9373fff700 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 0x562a562f24d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f93600120d0 tx=0x7f9360012100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e1d25f75f01571 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9353fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9353fff700 1 -- 172.21.15.60:0/33211002 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360004050 con 0x562a562e2520 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9353fff700 1 -- 172.21.15.60:0/33211002 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f93600041b0 con 0x562a562e2520 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.656+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9368005670 con 0x562a562e2520 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9353fff700 1 -- 172.21.15.60:0/33211002 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9360004370 con 0x562a562e2520 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 10 client.26450 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x562a5605f250 con 0x562a562e2520 2023-10-05T15:25:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9353fff700 1 -- 172.21.15.60:0/33211002 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9368005670 con 0x562a562e2520 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9353fff700 1 -- 172.21.15.60:0/33211002 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f936002a4e0 con 0x562a562e2520 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 10 client.26450 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 10 client.26450 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 20 client.26450 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a56355b50 0x562a56357f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 4 client.26450 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a5622ead0 con 0x562a56355b50 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.657+0000 7f9378fc5700 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a56355b50 0x562a56357f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.658+0000 7f9353fff700 10 client.26450 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.658+0000 7f9378fc5700 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a56355b50 0x562a56357f70 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112b7b023683e7d7 server_cookie=77ce05470e429ea8 in_seq=0 out_seq=0 2023-10-05T15:25:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9353fff700 1 -- 172.21.15.60:0/33211002 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a5622ead0 con 0x562a56355b50 2023-10-05T15:25:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9353fff700 10 client.26450 handle_command_reply: tid=0 2023-10-05T15:25:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 client.26450 shutdown 2023-10-05T15:25:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 msgr2=0x562a562f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 0x562a562f24d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f93600120d0 tx=0x7f9360012100 comp rx=0 tx=0).stop 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 shutdown_connections 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562a56355b50 0x562a56357f70 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a562ed3d0 0x562a56353b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a562e1c00 0x562a562f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9353fff700 0 client.26450 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 --2- 172.21.15.60:0/33211002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a562e2520 0x562a562f24d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 >> 172.21.15.60:0/33211002 conn(0x562a56257200 msgr2=0x562a562f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 shutdown_connections 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 1 -- 172.21.15.60:0/33211002 wait complete. 2023-10-05T15:25:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.676+0000 7f9387413b80 20 client.26450 trim_cache size 0 max 16384 2023-10-05T15:25:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:25:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:25:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:25:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93640a1670 msgr2=0x7f93640a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93640a1670 0x7f93640a3b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9368006010 tx=0x7f9368005040 comp rx=0 tx=0).stop 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 msgr2=0x7f9374194ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 0x7f9374194ff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f936c004960 tx=0x7f936c00e410 comp rx=0 tx=0).stop 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 shutdown_connections 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93640a1670 0x7f93640a3b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9374194b40 0x7f9374194ff0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740ff950 0x7f937419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 --2- 172.21.15.60:0/2521657334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93741048a0 0x7f937419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 >> 172.21.15.60:0/2521657334 conn(0x7f93740762e0 msgr2=0x7f93740fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 shutdown_connections 2023-10-05T15:25:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:20.677+0000 7f937b229700 1 -- 172.21.15.60:0/2521657334 wait complete. 2023-10-05T15:25:21.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:21 smithi135 ceph-mon[103360]: pgmap v268: 129 pgs: 6 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 116 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 133 op/s 2023-10-05T15:25:21.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:21 smithi060 ceph-mon[99238]: pgmap v268: 129 pgs: 6 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 116 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 133 op/s 2023-10-05T15:25:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:21 smithi092 ceph-mon[102944]: pgmap v268: 129 pgs: 6 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 116 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 133 op/s 2023-10-05T15:25:22.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:22 smithi135 ceph-mon[103360]: pgmap v269: 129 pgs: 6 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 116 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 136 op/s 2023-10-05T15:25:22.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:22 smithi060 ceph-mon[99238]: pgmap v269: 129 pgs: 6 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 116 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 136 op/s 2023-10-05T15:25:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:22 smithi092 ceph-mon[102944]: pgmap v269: 129 pgs: 6 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 116 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 136 op/s 2023-10-05T15:25:25.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:25 smithi135 ceph-mon[103360]: pgmap v270: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 204 op/s 2023-10-05T15:25:25.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:25 smithi060 ceph-mon[99238]: pgmap v270: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 204 op/s 2023-10-05T15:25:25.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:25 smithi092 ceph-mon[102944]: pgmap v270: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 204 op/s 2023-10-05T15:25:27.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:27 smithi135 ceph-mon[103360]: pgmap v271: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 229 op/s 2023-10-05T15:25:27.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:27 smithi135 ceph-mon[103360]: osdmap e102: 12 total, 12 up, 12 in 2023-10-05T15:25:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:27 smithi060 ceph-mon[99238]: pgmap v271: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 229 op/s 2023-10-05T15:25:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:27 smithi060 ceph-mon[99238]: osdmap e102: 12 total, 12 up, 12 in 2023-10-05T15:25:27.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:27 smithi092 ceph-mon[102944]: pgmap v271: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 229 op/s 2023-10-05T15:25:27.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:27 smithi092 ceph-mon[102944]: osdmap e102: 12 total, 12 up, 12 in 2023-10-05T15:25:29.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:29 smithi135 ceph-mon[103360]: pgmap v273: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-10-05T15:25:29.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:29 smithi060 ceph-mon[99238]: pgmap v273: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-10-05T15:25:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:29 smithi092 ceph-mon[102944]: pgmap v273: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-10-05T15:25:31.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:31 smithi135 ceph-mon[103360]: pgmap v274: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-10-05T15:25:31.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:31 smithi060 ceph-mon[99238]: pgmap v274: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-10-05T15:25:31.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:31 smithi092 ceph-mon[102944]: pgmap v274: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-10-05T15:25:32.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:32 smithi135 ceph-mon[103360]: pgmap v275: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 329 op/s 2023-10-05T15:25:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:32 smithi060 ceph-mon[99238]: pgmap v275: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 329 op/s 2023-10-05T15:25:32.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:32 smithi092 ceph-mon[102944]: pgmap v275: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 329 op/s 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 -- 172.21.15.60:0/525692602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1010c0 msgr2=0x7fec7c1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 --2- 172.21.15.60:0/525692602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1010c0 0x7fec7c1014a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009990 tx=0x7fec6c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 -- 172.21.15.60:0/525692602 shutdown_connections 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 --2- 172.21.15.60:0/525692602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c1061e0 0x7fec7c10dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 --2- 172.21.15.60:0/525692602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1010c0 0x7fec7c1014a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 --2- 172.21.15.60:0/525692602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec7c101a70 0x7fec7c105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 -- 172.21.15.60:0/525692602 >> 172.21.15.60:0/525692602 conn(0x7fec7c0fc940 msgr2=0x7fec7c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 -- 172.21.15.60:0/525692602 shutdown_connections 2023-10-05T15:25:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.792+0000 7fec8418f700 1 -- 172.21.15.60:0/525692602 wait complete. 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 Processor -- start 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 -- start start 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c1010c0 0x7fec7c197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 0x7fec7c1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec7c19bc10 0x7fec7c19c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c19c690 con 0x7fec7c1061e0 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c19c800 con 0x7fec7c1010c0 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8418f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c19c9c0 con 0x7fec7c19bc10 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 0x7fec7c1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 0x7fec7c1975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41424/0 (socket says 172.21.15.60:41424) 2023-10-05T15:25:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 -- 172.21.15.60:0/1284403163 learned_addr learned my addr 172.21.15.60:0/1284403163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8272c700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec7c19bc10 0x7fec7c19c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c1010c0 0x7fec7c197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 -- 172.21.15.60:0/1284403163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec7c19bc10 msgr2=0x7fec7c19c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec7c19bc10 0x7fec7c19c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 -- 172.21.15.60:0/1284403163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c1010c0 msgr2=0x7fec7c197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c1010c0 0x7fec7c197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.793+0000 7fec8172a700 1 -- 172.21.15.60:0/1284403163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0095f0 con 0x7fec7c1061e0 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.794+0000 7fec8172a700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 0x7fec7c1975a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9f0 tx=0x7fec7800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.794+0000 7fec72ffd700 1 -- 172.21.15.60:0/1284403163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78009750 con 0x7fec7c1061e0 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.794+0000 7fec72ffd700 1 -- 172.21.15.60:0/1284403163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec7800c7c0 con 0x7fec7c1061e0 2023-10-05T15:25:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.794+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c1a3f20 con 0x7fec7c1061e0 2023-10-05T15:25:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.794+0000 7fec72ffd700 1 -- 172.21.15.60:0/1284403163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780054d0 con 0x7fec7c1061e0 2023-10-05T15:25:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.794+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c1a4350 con 0x7fec7c1061e0 2023-10-05T15:25:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.797+0000 7fec72ffd700 1 -- 172.21.15.60:0/1284403163 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fec7800c930 con 0x7fec7c1061e0 2023-10-05T15:25:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.797+0000 7fec72ffd700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fec680a15f0 0x7fec680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.797+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fec680a15f0 0x7fec680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.797+0000 7fec72ffd700 1 -- 172.21.15.60:0/1284403163 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7fec78014070 con 0x7fec7c1061e0 2023-10-05T15:25:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fec680a15f0 0x7fec680a3ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00b2e0 tx=0x7fec6c005fb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 Processor -- start 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 -- start start 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e73fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e7ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2ddd400 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2dcebc0 con 0x55d4c2e74520 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.798+0000 7fec90379b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2dcc4e0 con 0x55d4c2e73c00 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec8272c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e73fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e73fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:54960/0 (socket says 172.21.15.60:54960) 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec8272c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e817c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41434/0 (socket says 172.21.15.60:41434) 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 -- 172.21.15.60:0/1962992559 learned_addr learned my addr 172.21.15.60:0/1962992559 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec8172a700 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e7ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 -- 172.21.15.60:0/1962992559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 msgr2=0x55d4c2e7ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e7ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 -- 172.21.15.60:0/1962992559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 msgr2=0x55d4c2e817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e817c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 -- 172.21.15.60:0/1962992559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c2bf2d80 con 0x55d4c2e73c00 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e73fe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0095c0 tx=0x7fec6c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ab53e2fd76cf26 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec67fff700 1 -- 172.21.15.60:0/1962992559 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c004700 con 0x55d4c2e73c00 2023-10-05T15:25:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec67fff700 1 -- 172.21.15.60:0/1962992559 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec6c01e040 con 0x55d4c2e73c00 2023-10-05T15:25:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.799+0000 7fec67fff700 1 -- 172.21.15.60:0/1962992559 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00f8a0 con 0x55d4c2e73c00 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 -- 172.21.15.60:0/1962992559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 msgr2=0x55d4c2e73fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e73fe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0095c0 tx=0x7fec6c020000 comp rx=0 tx=0).stop 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 -- 172.21.15.60:0/1962992559 shutdown_connections 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e73fe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 --2- 172.21.15.60:0/1962992559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e7ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 -- 172.21.15.60:0/1962992559 >> 172.21.15.60:0/1962992559 conn(0x55d4c2de9200 msgr2=0x55d4c2e70080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 -- 172.21.15.60:0/1962992559 shutdown_connections 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.800+0000 7fec90379b80 1 -- 172.21.15.60:0/1962992559 wait complete. 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 -- start start 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 Processor -- start 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e73c00 0x55d4c2e7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e74520 0x55d4c2e7c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e7c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2dc7dd0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2d646b0 con 0x55d4c2e73c00 2023-10-05T15:25:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2d64350 con 0x55d4c2e74520 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec90379b80 10 client.0 _ll_register_callbacks cb 0x55d4c2bc17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e7c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e7c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41440/0 (socket says 172.21.15.60:41440) 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8172a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e74520 0x55d4c2e7c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 -- 172.21.15.60:0/1547069808 learned_addr learned my addr 172.21.15.60:0/1547069808 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e73c00 0x55d4c2e7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 -- 172.21.15.60:0/1547069808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e74520 msgr2=0x55d4c2e7c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e74520 0x55d4c2e7c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 -- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e73c00 msgr2=0x55d4c2e7ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e73c00 0x55d4c2e7ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.801+0000 7fec8272c700 1 -- 172.21.15.60:0/1547069808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c10e5d0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e73c00 0x55d4c2e7ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec8272c700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e7c820 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec74011f60 tx=0x7fec74014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e484cbe202bb939 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec657fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec657fa700 1 -- 172.21.15.60:0/1547069808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400e040 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec657fa700 1 -- 172.21.15.60:0/1547069808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7fec740090d0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4c2e67d50 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec657fa700 1 -- 172.21.15.60:0/1547069808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec740092b0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 10 client.16803 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d4c2bdbc00 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec657fa700 1 -- 172.21.15.60:0/1547069808 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4c2e67d50 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec657fa700 1 -- 172.21.15.60:0/1547069808 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fec7401c020 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 10 client.16803 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 20 client.16803 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2e8f010 0x55d4c2e91430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 4 client.16803 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.802+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4c2dc0db0 con 0x55d4c2e8f010 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.803+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2e8f010 0x55d4c2e91430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.803+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2e8f010 0x55d4c2e91430 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=161ded503517231c server_cookie=2b40cb97a8ea0ff5 in_seq=0 out_seq=0 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.803+0000 7fec657fa700 10 client.16803 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec657fa700 1 -- 172.21.15.60:0/1547069808 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4c2dc0db0 con 0x55d4c2e8f010 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec657fa700 10 client.16803 handle_command_reply: tid=0 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 client.16803 shutdown 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 msgr2=0x55d4c2e7c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e7c820 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec74011f60 tx=0x7fec74014600 comp rx=0 tx=0).stop 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 shutdown_connections 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2e8f010 0x55d4c2e91430 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e7c820 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e73c00 0x55d4c2e7ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 --2- 172.21.15.60:0/1547069808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e74520 0x55d4c2e7c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec657fa700 0 client.16803 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 >> 172.21.15.60:0/1547069808 conn(0x55d4c2de9200 msgr2=0x55d4c2e6fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 shutdown_connections 2023-10-05T15:25:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.804+0000 7fec90379b80 1 -- 172.21.15.60:0/1547069808 wait complete. 2023-10-05T15:25:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.805+0000 7fec90379b80 20 client.16803 trim_cache size 0 max 16384 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 Processor -- start 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 -- start start 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e8b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e8a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e77430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2c488c0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2e7ce30 con 0x55d4c2e74520 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec90379b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2e81a10 con 0x55d4c2e73c00 2023-10-05T15:25:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec8272c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e77430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec8272c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e77430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41448/0 (socket says 172.21.15.60:41448) 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec8272c700 1 -- 172.21.15.60:0/2207825512 learned_addr learned my addr 172.21.15.60:0/2207825512 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec81f2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e8b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.820+0000 7fec8172a700 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec8272c700 1 -- 172.21.15.60:0/2207825512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 msgr2=0x55d4c2e8b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec8272c700 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e8b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec8272c700 1 -- 172.21.15.60:0/2207825512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 msgr2=0x55d4c2e8a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec8272c700 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e8a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec8272c700 1 -- 172.21.15.60:0/2207825512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c2c191f0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec81f2b700 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e8b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec8272c700 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e77430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fec740061e0 tx=0x7fec74011290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6dc269c036d288 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec70ff9700 1 -- 172.21.15.60:0/2207825512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400e040 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec70ff9700 1 -- 172.21.15.60:0/2207825512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec7400f040 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.821+0000 7fec70ff9700 1 -- 172.21.15.60:0/2207825512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7402b430 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 -- 172.21.15.60:0/2207825512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 msgr2=0x55d4c2e77430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e77430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fec740061e0 tx=0x7fec74011290 comp rx=0 tx=0).stop 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 -- 172.21.15.60:0/2207825512 shutdown_connections 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e77430 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e8b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- 172.21.15.60:0/2207825512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e74520 0x55d4c2e8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 -- 172.21.15.60:0/2207825512 >> 172.21.15.60:0/2207825512 conn(0x55d4c2de9200 msgr2=0x55d4c2e95d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 -- 172.21.15.60:0/2207825512 shutdown_connections 2023-10-05T15:25:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 -- 172.21.15.60:0/2207825512 wait complete. 2023-10-05T15:25:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 -- start start 2023-10-05T15:25:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 Processor -- start 2023-10-05T15:25:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e83ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 0x55d4c2e843e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.822+0000 7fec90379b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e84920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2ee6360 con 0x55d4c2e74520 2023-10-05T15:25:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2ee64d0 con 0x55d4c2e7f3d0 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c2ee6690 con 0x55d4c2e73c00 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 10 client.0 _ll_register_callbacks cb 0x7fec740118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 0x55d4c2e843e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 0x55d4c2e843e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41452/0 (socket says 172.21.15.60:41452) 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 -- 172.21.15.60:0/1694624404 learned_addr learned my addr 172.21.15.60:0/1694624404 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e83ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8272c700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e84920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 -- 172.21.15.60:0/1694624404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 msgr2=0x55d4c2e83ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e83ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 -- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e7f3d0 msgr2=0x55d4c2e84920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e84920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 -- 172.21.15.60:0/1694624404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4c2bf2d80 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec8172a700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 0x55d4c2e843e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fec7809a1f0 tx=0x7fec7809a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1b2426cf5b866d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec657fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec657fa700 1 -- 172.21.15.60:0/1694624404 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78063020 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec657fa700 1 -- 172.21.15.60:0/1694624404 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7fec7809e120 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec6c01e040 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec657fa700 1 -- 172.21.15.60:0/1694624404 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec7800cc10 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 10 client.16809 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.823+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d4c2bdbc00 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec657fa700 1 -- 172.21.15.60:0/1694624404 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec6c01e040 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec657fa700 1 -- 172.21.15.60:0/1694624404 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fec7809a510 con 0x55d4c2e74520 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec90379b80 10 client.16809 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec90379b80 10 client.16809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec90379b80 20 client.16809 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec90379b80 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2ee7e60 0x55d4c2eea280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec90379b80 4 client.16809 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d4c2dc0ad0 con 0x55d4c2ee7e60 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2ee7e60 0x55d4c2eea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec657fa700 10 client.16809 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.824+0000 7fec81f2b700 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2ee7e60 0x55d4c2eea280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51501b9dff4b2fad server_cookie=8d6933fe36065e04 in_seq=0 out_seq=0 2023-10-05T15:25:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.838+0000 7fec657fa700 1 -- 172.21.15.60:0/1694624404 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d4c2dc0ad0 con 0x55d4c2ee7e60 2023-10-05T15:25:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.838+0000 7fec657fa700 10 client.16809 handle_command_reply: tid=0 2023-10-05T15:25:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 client.16809 shutdown 2023-10-05T15:25:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 msgr2=0x55d4c2e843e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 0x55d4c2e843e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fec7809a1f0 tx=0x7fec7809a380 comp rx=0 tx=0).stop 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 shutdown_connections 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d4c2ee7e60 0x55d4c2eea280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4c2e7f3d0 0x55d4c2e84920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4c2e73c00 0x55d4c2e83ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec657fa700 0 client.16809 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 --2- 172.21.15.60:0/1694624404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4c2e74520 0x55d4c2e843e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 >> 172.21.15.60:0/1694624404 conn(0x55d4c2de9200 msgr2=0x55d4c2e8a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 shutdown_connections 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 1 -- 172.21.15.60:0/1694624404 wait complete. 2023-10-05T15:25:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec90379b80 20 client.16809 trim_cache size 0 max 16384 2023-10-05T15:25:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:25:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:25:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:25:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.839+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fec680a15f0 msgr2=0x7fec680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fec680a15f0 0x7fec680a3ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00b2e0 tx=0x7fec6c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 msgr2=0x7fec7c1975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 0x7fec7c1975a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9f0 tx=0x7fec7800ed00 comp rx=0 tx=0).stop 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 shutdown_connections 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec7c19bc10 0x7fec7c19c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fec680a15f0 0x7fec680a3ab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c1010c0 0x7fec7c197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 --2- 172.21.15.60:0/1284403163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec7c1061e0 0x7fec7c1975a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 >> 172.21.15.60:0/1284403163 conn(0x7fec7c0fc940 msgr2=0x7fec7c104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 shutdown_connections 2023-10-05T15:25:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:33.840+0000 7fec8418f700 1 -- 172.21.15.60:0/1284403163 wait complete. 2023-10-05T15:25:35.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:35 smithi135 ceph-mon[103360]: pgmap v276: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 311 op/s 2023-10-05T15:25:35.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:35 smithi060 ceph-mon[99238]: pgmap v276: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 311 op/s 2023-10-05T15:25:35.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:35 smithi092 ceph-mon[102944]: pgmap v276: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 311 op/s 2023-10-05T15:25:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:37 smithi135 ceph-mon[103360]: pgmap v277: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 281 op/s 2023-10-05T15:25:37.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:37 smithi060 ceph-mon[99238]: pgmap v277: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 281 op/s 2023-10-05T15:25:37.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:37 smithi092 ceph-mon[102944]: pgmap v277: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 281 op/s 2023-10-05T15:25:39.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:39 smithi135 ceph-mon[103360]: pgmap v278: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 309 op/s 2023-10-05T15:25:39.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:39 smithi060 ceph-mon[99238]: pgmap v278: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 309 op/s 2023-10-05T15:25:39.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:39 smithi092 ceph-mon[102944]: pgmap v278: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 309 op/s 2023-10-05T15:25:41.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:41 smithi135 ceph-mon[103360]: pgmap v279: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 235 op/s 2023-10-05T15:25:41.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:41 smithi060 ceph-mon[99238]: pgmap v279: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 235 op/s 2023-10-05T15:25:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:41 smithi092 ceph-mon[102944]: pgmap v279: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 235 op/s 2023-10-05T15:25:42.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:42 smithi135 ceph-mon[103360]: pgmap v280: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 207 op/s 2023-10-05T15:25:42.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:42 smithi060 ceph-mon[99238]: pgmap v280: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 207 op/s 2023-10-05T15:25:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:42 smithi092 ceph-mon[102944]: pgmap v280: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 207 op/s 2023-10-05T15:25:45.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:45 smithi135 ceph-mon[103360]: pgmap v281: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2023-10-05T15:25:45.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:45 smithi060 ceph-mon[99238]: pgmap v281: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2023-10-05T15:25:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:45 smithi092 ceph-mon[102944]: pgmap v281: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2023-10-05T15:25:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 -- 172.21.15.60:0/4191743429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2281050f0 msgr2=0x7fc22810cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 --2- 172.21.15.60:0/4191743429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2281050f0 0x7fc22810cc70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc22000b0a0 tx=0x7fc22000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 -- 172.21.15.60:0/4191743429 shutdown_connections 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 --2- 172.21.15.60:0/4191743429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2281050f0 0x7fc22810cc70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 --2- 172.21.15.60:0/4191743429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2280fffd0 0x7fc2281003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 --2- 172.21.15.60:0/4191743429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc228100980 0x7fc2281049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 -- 172.21.15.60:0/4191743429 >> 172.21.15.60:0/4191743429 conn(0x7fc228076ea0 msgr2=0x7fc2280772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 -- 172.21.15.60:0/4191743429 shutdown_connections 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.962+0000 7fc22cb91700 1 -- 172.21.15.60:0/4191743429 wait complete. 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.963+0000 7fc22cb91700 1 Processor -- start 2023-10-05T15:25:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.963+0000 7fc22cb91700 1 -- start start 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22cb91700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 0x7fc228101c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22cb91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2281050f0 0x7fc228102180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22cb91700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2281a33e0 0x7fc2281a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22cb91700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2281a5d10 con 0x7fc2280fffd0 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22cb91700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2281a5e50 con 0x7fc2281050f0 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22cb91700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2281a5fc0 con 0x7fc2281a33e0 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 0x7fc228101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 0x7fc228101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41464/0 (socket says 172.21.15.60:41464) 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 -- 172.21.15.60:0/2329305717 learned_addr learned my addr 172.21.15.60:0/2329305717 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc21ffff700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2281050f0 0x7fc228102180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc226d9d700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2281a33e0 0x7fc2281a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 -- 172.21.15.60:0/2329305717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2281a33e0 msgr2=0x7fc2281a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2281a33e0 0x7fc2281a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 -- 172.21.15.60:0/2329305717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2281050f0 msgr2=0x7fc228102180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2281050f0 0x7fc228102180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 -- 172.21.15.60:0/2329305717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009d00 con 0x7fc2280fffd0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc22659c700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 0x7fc228101c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc21800e9a0 tx=0x7fc21800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc21f7fe700 1 -- 172.21.15.60:0/2329305717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218009790 con 0x7fc2280fffd0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.964+0000 7fc21f7fe700 1 -- 172.21.15.60:0/2329305717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc218010430 con 0x7fc2280fffd0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.965+0000 7fc21f7fe700 1 -- 172.21.15.60:0/2329305717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218018680 con 0x7fc2280fffd0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.965+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2281a62a0 con 0x7fc2280fffd0 2023-10-05T15:25:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.965+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2281a67b0 con 0x7fc2280fffd0 2023-10-05T15:25:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.968+0000 7fc21f7fe700 1 -- 172.21.15.60:0/2329305717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc2180105a0 con 0x7fc2280fffd0 2023-10-05T15:25:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.968+0000 7fc238d7bb80 1 Processor -- start 2023-10-05T15:25:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.968+0000 7fc238d7bb80 1 -- start start 2023-10-05T15:25:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc21f7fe700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc2140a1670 0x7fc2140a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5310400 con 0x555be53b23d0 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5301bc0 con 0x555be53a6c00 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be52ff4e0 con 0x555be53a7520 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc22659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41474/0 (socket says 172.21.15.60:41474) 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 -- 172.21.15.60:0/4076424751 learned_addr learned my addr 172.21.15.60:0/4076424751 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc21ffff700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc2140a1670 0x7fc2140a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc21f7fe700 1 -- 172.21.15.60:0/2329305717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7fc218014070 con 0x7fc2280fffd0 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 -- 172.21.15.60:0/4076424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 msgr2=0x555be53b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 -- 172.21.15.60:0/4076424751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 msgr2=0x555be53a6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 -- 172.21.15.60:0/4076424751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be5125d80 con 0x555be53b23d0 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc22659c700 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc226d9d700 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b47c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc220007f00 tx=0x7fc2200060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23674a8016ff47c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.969+0000 7fc21ffff700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc2140a1670 0x7fc2140a3b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc228103460 tx=0x7fc210009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.970+0000 7fc21cff9700 1 -- 172.21.15.60:0/4076424751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000e070 con 0x555be53b23d0 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.970+0000 7fc21cff9700 1 -- 172.21.15.60:0/4076424751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc22000bc50 con 0x555be53b23d0 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.970+0000 7fc21cff9700 1 -- 172.21.15.60:0/4076424751 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22001f440 con 0x555be53b23d0 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.970+0000 7fc238d7bb80 1 -- 172.21.15.60:0/4076424751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 msgr2=0x555be53b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.970+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b47c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc220007f00 tx=0x7fc2200060c0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 -- 172.21.15.60:0/4076424751 shutdown_connections 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b47c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/4076424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 -- 172.21.15.60:0/4076424751 >> 172.21.15.60:0/4076424751 conn(0x555be531c200 msgr2=0x555be53a3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 -- 172.21.15.60:0/4076424751 shutdown_connections 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 -- 172.21.15.60:0/4076424751 wait complete. 2023-10-05T15:25:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 -- start start 2023-10-05T15:25:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.971+0000 7fc238d7bb80 1 Processor -- start 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be52fadd0 con 0x555be53b23d0 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be52976b0 con 0x555be53a6c00 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5297350 con 0x555be53a7520 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc238d7bb80 10 client.0 _ll_register_callbacks cb 0x555be50f47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54900/0 (socket says 172.21.15.60:54900) 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc21ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 -- 172.21.15.60:0/774687136 learned_addr learned my addr 172.21.15.60:0/774687136 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc226d9d700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 -- 172.21.15.60:0/774687136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 msgr2=0x555be53af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 -- 172.21.15.60:0/774687136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 msgr2=0x555be53af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 -- 172.21.15.60:0/774687136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2281a67b0 con 0x555be53a6c00 2023-10-05T15:25:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc21ffff700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc22659c700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53b1e40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc218099f40 tx=0x7fc21801dc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44485454c011af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.972+0000 7fc20dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc20dffb700 1 -- 172.21.15.60:0/774687136 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180cd430 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc20dffb700 1 -- 172.21.15.60:0/774687136 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7fc21809a940 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555be539ad50 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc20dffb700 1 -- 172.21.15.60:0/774687136 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc218099ba0 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 10 client.26477 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fc22810d4e0 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc20dffb700 1 -- 172.21.15.60:0/774687136 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555be539ad50 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc20dffb700 1 -- 172.21.15.60:0/774687136 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fc2180a9970 con 0x555be53a6c00 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 10 client.26477 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 10 client.26477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 20 client.26477 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be53c1e80 0x555be53c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 4 client.26477 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.973+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555be52f3db0 con 0x555be53c1e80 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.974+0000 7fc21ffff700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be53c1e80 0x555be53c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.974+0000 7fc20dffb700 10 client.26477 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.974+0000 7fc21ffff700 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be53c1e80 0x555be53c42a0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66657de888c60ffc server_cookie=b50a699fa911ed7f in_seq=0 out_seq=0 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc20dffb700 1 -- 172.21.15.60:0/774687136 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555be52f3db0 con 0x555be53c1e80 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc20dffb700 10 client.26477 handle_command_reply: tid=0 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 client.26477 shutdown 2023-10-05T15:25:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 msgr2=0x555be53b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53b1e40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc218099f40 tx=0x7fc21801dc80 comp rx=0 tx=0).stop 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 shutdown_connections 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be53c1e80 0x555be53c42a0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc20dffb700 0 client.26477 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53b1e40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/774687136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 >> 172.21.15.60:0/774687136 conn(0x555be531c200 msgr2=0x555be53a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 shutdown_connections 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 1 -- 172.21.15.60:0/774687136 wait complete. 2023-10-05T15:25:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.975+0000 7fc238d7bb80 20 client.26477 trim_cache size 0 max 16384 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 Processor -- start 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 -- start start 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53aa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be517b8c0 con 0x555be53b23d0 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be539a8c0 con 0x555be53a6c00 2023-10-05T15:25:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be53a45e0 con 0x555be53a7520 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41490/0 (socket says 172.21.15.60:41490) 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc226d9d700 1 -- 172.21.15.60:0/3716889526 learned_addr learned my addr 172.21.15.60:0/3716889526 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc22659c700 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.990+0000 7fc21ffff700 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc226d9d700 1 -- 172.21.15.60:0/3716889526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 msgr2=0x555be53b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc226d9d700 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc226d9d700 1 -- 172.21.15.60:0/3716889526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 msgr2=0x555be53a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc226d9d700 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc226d9d700 1 -- 172.21.15.60:0/3716889526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be510ec00 con 0x555be53b23d0 2023-10-05T15:25:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc226d9d700 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53aa430 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc220009a20 tx=0x7fc220007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6d8cb0b0aab502 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc21d7fa700 1 -- 172.21.15.60:0/3716889526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000e040 con 0x555be53b23d0 2023-10-05T15:25:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc21d7fa700 1 -- 172.21.15.60:0/3716889526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc220023040 con 0x555be53b23d0 2023-10-05T15:25:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.991+0000 7fc21d7fa700 1 -- 172.21.15.60:0/3716889526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220005110 con 0x555be53b23d0 2023-10-05T15:25:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- 172.21.15.60:0/3716889526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 msgr2=0x555be53aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53aa430 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc220009a20 tx=0x7fc220007d60 comp rx=0 tx=0).stop 2023-10-05T15:25:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- 172.21.15.60:0/3716889526 shutdown_connections 2023-10-05T15:25:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53aa430 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a6c00 0x555be53a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/3716889526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a7520 0x555be53b8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- 172.21.15.60:0/3716889526 >> 172.21.15.60:0/3716889526 conn(0x555be531c200 msgr2=0x555be53bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- 172.21.15.60:0/3716889526 shutdown_connections 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- 172.21.15.60:0/3716889526 wait complete. 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- start start 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 Processor -- start 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 0x555be53b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 0x555be53b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5414e90 con 0x555be53b23d0 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5415000 con 0x555be53a7520 2023-10-05T15:25:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be54151c0 con 0x555be53a6c00 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc238d7bb80 10 client.0 _ll_register_callbacks cb 0x7fc218096580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.992+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc21ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 0x555be53b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc22659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 0x555be53b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41496/0 (socket says 172.21.15.60:41496) 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc21ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 0x555be53b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54916/0 (socket says 172.21.15.60:54916) 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc22659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 0x555be53b6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55022/0 (socket says 172.21.15.60:55022) 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 -- 172.21.15.60:0/645364174 learned_addr learned my addr 172.21.15.60:0/645364174 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 -- 172.21.15.60:0/645364174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 msgr2=0x555be53b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 0x555be53b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 -- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 msgr2=0x555be53b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:25:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 0x555be53b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 -- 172.21.15.60:0/645364174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555be5125d80 con 0x555be53b23d0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc22659c700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 0x555be53b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc21ffff700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 0x555be53b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc226d9d700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b78e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc220007dd0 tx=0x7fc220007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8e2cc7a00514e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc20dffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc20dffb700 1 -- 172.21.15.60:0/645364174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000e040 con 0x555be53b23d0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc20dffb700 1 -- 172.21.15.60:0/645364174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7fc22000bdc0 con 0x555be53b23d0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc22000bc50 con 0x555be53b23d0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc20dffb700 1 -- 172.21.15.60:0/645364174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc220005320 con 0x555be53b23d0 2023-10-05T15:25:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.993+0000 7fc238d7bb80 10 client.16827 fetch_fsmap learned FSMap version 43 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x555be514c1f0 con 0x555be53b23d0 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc20dffb700 1 -- 172.21.15.60:0/645364174 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc22000bc50 con 0x555be53b23d0 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc20dffb700 1 -- 172.21.15.60:0/645364174 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fc22002e050 con 0x555be53b23d0 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 10 client.16827 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 20 client.16827 populate_metadata read hostname 'smithi060' 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be5416520 0x555be5418940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 4 client.16827 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555be52f3ad0 con 0x555be5416520 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc22659c700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be5416520 0x555be5418940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:25:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc20dffb700 10 client.16827 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:46.994+0000 7fc22659c700 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be5416520 0x555be5418940 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aec61227e0a81ce server_cookie=d1797e28b8b09890 in_seq=0 out_seq=0 2023-10-05T15:25:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc20dffb700 1 -- 172.21.15.60:0/645364174 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555be52f3ad0 con 0x555be5416520 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc20dffb700 10 client.16827 handle_command_reply: tid=0 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 client.16827 shutdown 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 msgr2=0x555be53b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b78e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc220007dd0 tx=0x7fc220007750 comp rx=0 tx=0).stop 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 shutdown_connections 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x555be5416520 0x555be5418940 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555be53b23d0 0x555be53b78e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be53a6c00 0x555be53b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 --2- 172.21.15.60:0/645364174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555be53a7520 0x555be53b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 >> 172.21.15.60:0/645364174 conn(0x555be531c200 msgr2=0x555be53aa430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc20dffb700 0 client.16827 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 shutdown_connections 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.013+0000 7fc238d7bb80 1 -- 172.21.15.60:0/645364174 wait complete. 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc238d7bb80 20 client.16827 trim_cache size 0 max 16384 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:25:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:25:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc2140a1670 msgr2=0x7fc2140a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc2140a1670 0x7fc2140a3b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc228103460 tx=0x7fc210009260 comp rx=0 tx=0).stop 2023-10-05T15:25:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 msgr2=0x7fc228101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:25:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 0x7fc228101c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc21800e9a0 tx=0x7fc21800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 shutdown_connections 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2281a33e0 0x7fc2281a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2280fffd0 0x7fc228101c40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc2140a1670 0x7fc2140a3b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 --2- 172.21.15.60:0/2329305717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2281050f0 0x7fc228102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.014+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 >> 172.21.15.60:0/2329305717 conn(0x7fc228076ea0 msgr2=0x7fc2280692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.015+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 shutdown_connections 2023-10-05T15:25:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:25:47.015+0000 7fc22cb91700 1 -- 172.21.15.60:0/2329305717 wait complete. 2023-10-05T15:25:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:47 smithi135 ceph-mon[103360]: pgmap v282: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 225 op/s 2023-10-05T15:25:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:47 smithi060 ceph-mon[99238]: pgmap v282: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 225 op/s 2023-10-05T15:25:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:47 smithi092 ceph-mon[102944]: pgmap v282: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 225 op/s 2023-10-05T15:25:49.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:49 smithi135 ceph-mon[103360]: pgmap v283: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 220 op/s 2023-10-05T15:25:49.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:49 smithi060 ceph-mon[99238]: pgmap v283: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 220 op/s 2023-10-05T15:25:49.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:49 smithi092 ceph-mon[102944]: pgmap v283: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 220 op/s 2023-10-05T15:25:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:51 smithi135 ceph-mon[103360]: pgmap v284: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 167 op/s 2023-10-05T15:25:51.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:51 smithi060 ceph-mon[99238]: pgmap v284: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 167 op/s 2023-10-05T15:25:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:51 smithi092 ceph-mon[102944]: pgmap v284: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 167 op/s 2023-10-05T15:25:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:52 smithi135 ceph-mon[103360]: pgmap v285: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 161 op/s 2023-10-05T15:25:52.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:52 smithi060 ceph-mon[99238]: pgmap v285: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 161 op/s 2023-10-05T15:25:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:52 smithi092 ceph-mon[102944]: pgmap v285: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 161 op/s 2023-10-05T15:25:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:55 smithi135 ceph-mon[103360]: pgmap v286: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 222 op/s 2023-10-05T15:25:55.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:55 smithi060 ceph-mon[99238]: pgmap v286: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 222 op/s 2023-10-05T15:25:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:55 smithi092 ceph-mon[102944]: pgmap v286: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 222 op/s 2023-10-05T15:25:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:57 smithi135 ceph-mon[103360]: pgmap v287: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 201 op/s 2023-10-05T15:25:57.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:57 smithi060 ceph-mon[99238]: pgmap v287: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 201 op/s 2023-10-05T15:25:57.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:57 smithi092 ceph-mon[102944]: pgmap v287: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 201 op/s 2023-10-05T15:25:59.583 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:25:59 smithi135 ceph-mon[103360]: pgmap v288: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 264 op/s 2023-10-05T15:25:59.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:25:59 smithi060 ceph-mon[99238]: pgmap v288: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 264 op/s 2023-10-05T15:25:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:25:59 smithi092 ceph-mon[102944]: pgmap v288: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 264 op/s 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 -- 172.21.15.60:0/2549073842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 msgr2=0x7f4d301003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 --2- 172.21.15.60:0/2549073842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d301003f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009990 tx=0x7f4d20009ca0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 -- 172.21.15.60:0/2549073842 shutdown_connections 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 --2- 172.21.15.60:0/2549073842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d30100930 0x7f4d3010cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 --2- 172.21.15.60:0/2549073842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d30105ef0 0x7f4d301062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 --2- 172.21.15.60:0/2549073842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d301003f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 -- 172.21.15.60:0/2549073842 >> 172.21.15.60:0/2549073842 conn(0x7f4d30076b70 msgr2=0x7f4d30076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 -- 172.21.15.60:0/2549073842 shutdown_connections 2023-10-05T15:26:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.140+0000 7f4d37db2700 1 -- 172.21.15.60:0/2549073842 wait complete. 2023-10-05T15:26:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 Processor -- start 2023-10-05T15:26:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 -- start start 2023-10-05T15:26:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d30195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d30100930 0x7f4d30196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d30105ef0 0x7f4d3019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3019b0c0 con 0x7f4d300fff70 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3019b230 con 0x7f4d30105ef0 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d37db2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3019b3f0 con 0x7f4d30100930 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d30195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d30195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41506/0 (socket says 172.21.15.60:41506) 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d35b4e700 1 -- 172.21.15.60:0/273348912 learned_addr learned my addr 172.21.15.60:0/273348912 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d3534d700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d30100930 0x7f4d30196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.141+0000 7f4d3634f700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d30105ef0 0x7f4d3019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d35b4e700 1 -- 172.21.15.60:0/273348912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d30100930 msgr2=0x7f4d30196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d30100930 0x7f4d30196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d35b4e700 1 -- 172.21.15.60:0/273348912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d30105ef0 msgr2=0x7f4d3019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d30105ef0 0x7f4d3019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d35b4e700 1 -- 172.21.15.60:0/273348912 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200095f0 con 0x7f4d300fff70 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d30195ed0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00e9a0 tx=0x7f4d2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d26ffd700 1 -- 172.21.15.60:0/273348912 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c009790 con 0x7f4d300fff70 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d26ffd700 1 -- 172.21.15.60:0/273348912 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2c010430 con 0x7f4d300fff70 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3019b6d0 con 0x7f4d300fff70 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d26ffd700 1 -- 172.21.15.60:0/273348912 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c018680 con 0x7f4d300fff70 2023-10-05T15:26:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.142+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d301a2f10 con 0x7f4d300fff70 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.144+0000 7f4d26ffd700 1 -- 172.21.15.60:0/273348912 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4d2c0105a0 con 0x7f4d300fff70 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.145+0000 7f4d26ffd700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4d1c0a15f0 0x7f4d1c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.145+0000 7f4d26ffd700 1 -- 172.21.15.60:0/273348912 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7f4d2c014070 con 0x7f4d300fff70 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.145+0000 7f4d3534d700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4d1c0a15f0 0x7f4d1c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.145+0000 7f4d3534d700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4d1c0a15f0 0x7f4d1c0a3ab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d301976f0 tx=0x7f4d20005fb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 Processor -- start 2023-10-05T15:26:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 -- start start 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150e9afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150eaa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eacdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150e04400 con 0x565150eaa9d0 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150df5bc0 con 0x565150e9ac00 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150df34e0 con 0x565150e9b520 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eacdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150e9afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eacdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41518/0 (socket says 172.21.15.60:41518) 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150e9afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54936/0 (socket says 172.21.15.60:54936) 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 -- 172.21.15.60:0/1212839835 learned_addr learned my addr 172.21.15.60:0/1212839835 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3534d700 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150eaa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 -- 172.21.15.60:0/1212839835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 msgr2=0x565150eaa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150eaa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 -- 172.21.15.60:0/1212839835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 msgr2=0x565150e9afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150e9afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d3634f700 1 -- 172.21.15.60:0/1212839835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565150c19d80 con 0x565150eaa9d0 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.146+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150e9afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.147+0000 7f4d3634f700 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eacdc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4d28011670 tx=0x7f4d28009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35665d90d178f8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.147+0000 7f4d1bfff700 1 -- 172.21.15.60:0/1212839835 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800e040 con 0x565150eaa9d0 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.147+0000 7f4d1bfff700 1 -- 172.21.15.60:0/1212839835 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2800f040 con 0x565150eaa9d0 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.147+0000 7f4d1bfff700 1 -- 172.21.15.60:0/1212839835 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28004780 con 0x565150eaa9d0 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.147+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1212839835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 msgr2=0x565150eacdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.147+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eacdc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4d28011670 tx=0x7f4d28009920 comp rx=0 tx=0).stop 2023-10-05T15:26:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1212839835 shutdown_connections 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eacdc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150e9afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1212839835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150eaa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1212839835 >> 172.21.15.60:0/1212839835 conn(0x565150e10200 msgr2=0x565150e97080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1212839835 shutdown_connections 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1212839835 wait complete. 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 -- start start 2023-10-05T15:26:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.148+0000 7f4d43f9cb80 1 Processor -- start 2023-10-05T15:26:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eaa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150ea7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150deedd0 con 0x565150eaa9d0 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150d8b6b0 con 0x565150e9ac00 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150d8b350 con 0x565150e9b520 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 10 client.0 _ll_register_callbacks cb 0x565150be87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eaa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eaa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54942/0 (socket says 172.21.15.60:54942) 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 -- 172.21.15.60:0/3308285781 learned_addr learned my addr 172.21.15.60:0/3308285781 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d3634f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150ea7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d3534d700 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 -- 172.21.15.60:0/3308285781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 msgr2=0x565150ea7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 -- 172.21.15.60:0/3308285781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 msgr2=0x565150ea7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150ea7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 -- 172.21.15.60:0/3308285781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d301a2f10 con 0x565150e9ac00 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eaa410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0caa60 tx=0x7f4d2c09a9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afa643a4daaf3ad server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d197fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d197fa700 1 -- 172.21.15.60:0/3308285781 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c09a6a0 con 0x565150e9ac00 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565150e8ed50 con 0x565150e9ac00 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.149+0000 7f4d197fa700 1 -- 172.21.15.60:0/3308285781 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7f4d2c09e150 con 0x565150e9ac00 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d197fa700 1 -- 172.21.15.60:0/3308285781 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d2c09e390 con 0x565150e9ac00 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 10 client.26495 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f4d28011350 con 0x565150e9ac00 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d197fa700 1 -- 172.21.15.60:0/3308285781 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2c063020 con 0x565150e9ac00 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d197fa700 1 -- 172.21.15.60:0/3308285781 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f4d2c0a2140 con 0x565150e9ac00 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 10 client.26495 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 10 client.26495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 20 client.26495 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150eba370 0x565150ebc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 4 client.26495 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565150de7db0 con 0x565150eba370 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.150+0000 7f4d3534d700 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150eba370 0x565150ebc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.151+0000 7f4d197fa700 10 client.26495 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.151+0000 7f4d3534d700 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150eba370 0x565150ebc790 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca399c076f825097 server_cookie=d190bbbf23ec69a9 in_seq=0 out_seq=0 2023-10-05T15:26:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d197fa700 1 -- 172.21.15.60:0/3308285781 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565150de7db0 con 0x565150eba370 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d197fa700 10 client.26495 handle_command_reply: tid=0 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 client.26495 shutdown 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 msgr2=0x565150eaa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eaa410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0caa60 tx=0x7f4d2c09a9c0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 shutdown_connections 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150eba370 0x565150ebc790 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150ea7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eaa410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/3308285781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d197fa700 0 client.26495 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.152+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 >> 172.21.15.60:0/3308285781 conn(0x565150e10200 msgr2=0x565150e96c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.153+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 shutdown_connections 2023-10-05T15:26:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.153+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/3308285781 wait complete. 2023-10-05T15:26:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.153+0000 7f4d43f9cb80 20 client.26495 trim_cache size 0 max 16384 2023-10-05T15:26:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.167+0000 7f4d43f9cb80 1 Processor -- start 2023-10-05T15:26:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.167+0000 7f4d43f9cb80 1 -- start start 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eb07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eab870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150c6f8c0 con 0x565150eaa9d0 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150ea6c00 con 0x565150e9ac00 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150ea6d90 con 0x565150e9b520 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eb07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eb07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54950/0 (socket says 172.21.15.60:54950) 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d3634f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 -- 172.21.15.60:0/1106016267 learned_addr learned my addr 172.21.15.60:0/1106016267 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d3534d700 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 -- 172.21.15.60:0/1106016267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 msgr2=0x565150ea9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 -- 172.21.15.60:0/1106016267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 msgr2=0x565150eab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 -- 172.21.15.60:0/1106016267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565150c02c00 con 0x565150e9ac00 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d3534d700 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.168+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eb07e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c01e000 tx=0x7f4d2c010a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ebe7b1ebc1189af server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d24ff9700 1 -- 172.21.15.60:0/1106016267 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0992f0 con 0x565150e9ac00 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d24ff9700 1 -- 172.21.15.60:0/1106016267 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2c063030 con 0x565150e9ac00 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d24ff9700 1 -- 172.21.15.60:0/1106016267 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0b8520 con 0x565150e9ac00 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1106016267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 msgr2=0x565150eb07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eb07e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c01e000 tx=0x7f4d2c010a90 comp rx=0 tx=0).stop 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1106016267 shutdown_connections 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150eaa9d0 0x565150eab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150e9ac00 0x565150eb07e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/1106016267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9b520 0x565150ea9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1106016267 >> 172.21.15.60:0/1106016267 conn(0x565150e10200 msgr2=0x565150eaadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1106016267 shutdown_connections 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.169+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/1106016267 wait complete. 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 -- start start 2023-10-05T15:26:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 Processor -- start 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9ac00 0x565150eae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 0x565150eaed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150eaa9d0 0x565150f0d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150eaf4a0 con 0x565150e9b520 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150eaf610 con 0x565150eaa9d0 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x565150f0d6a0 con 0x565150e9ac00 2023-10-05T15:26:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d43f9cb80 10 client.0 _ll_register_callbacks cb 0x7f4d2c099d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d3534d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 0x565150eaed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d3534d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 0x565150eaed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41536/0 (socket says 172.21.15.60:41536) 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d3534d700 1 -- 172.21.15.60:0/2150611006 learned_addr learned my addr 172.21.15.60:0/2150611006 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.170+0000 7f4d3634f700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150eaa9d0 0x565150f0d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9ac00 0x565150eae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3534d700 1 -- 172.21.15.60:0/2150611006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9ac00 msgr2=0x565150eae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3534d700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9ac00 0x565150eae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3534d700 1 -- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150eaa9d0 msgr2=0x565150f0d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3534d700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150eaa9d0 0x565150f0d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3534d700 1 -- 172.21.15.60:0/2150611006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d28011350 con 0x565150e9b520 2023-10-05T15:26:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3634f700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150eaa9d0 0x565150f0d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d3534d700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 0x565150eaed10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4d20015000 tx=0x7f4d20009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4ad16d4ace6289 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d197fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d197fa700 1 -- 172.21.15.60:0/2150611006 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20034e10 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d197fa700 1 -- 172.21.15.60:0/2150611006 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9403+0+0 (secure 0 0 0) 0x7f4d20004990 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d2800f040 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d197fa700 1 -- 172.21.15.60:0/2150611006 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d20005700 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d43f9cb80 10 client.16845 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x565150c401f0 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.171+0000 7f4d197fa700 1 -- 172.21.15.60:0/2150611006 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2800f040 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d197fa700 1 -- 172.21.15.60:0/2150611006 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f4d2000f460 con 0x565150e9b520 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d43f9cb80 10 client.16845 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d43f9cb80 10 client.16845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d43f9cb80 20 client.16845 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150f0ee60 0x565150f11280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d43f9cb80 4 client.16845 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:26:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565150de7ad0 con 0x565150f0ee60 2023-10-05T15:26:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150f0ee60 0x565150f11280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d197fa700 10 client.16845 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.172+0000 7f4d35b4e700 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150f0ee60 0x565150f11280 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3baac0d6a00a83a7 server_cookie=b94c1ddd034b8424 in_seq=0 out_seq=0 2023-10-05T15:26:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.326+0000 7f4d197fa700 1 -- 172.21.15.60:0/2150611006 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565150de7ad0 con 0x565150f0ee60 2023-10-05T15:26:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.326+0000 7f4d197fa700 10 client.16845 handle_command_reply: tid=0 2023-10-05T15:26:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.326+0000 7f4d43f9cb80 1 client.16845 shutdown 2023-10-05T15:26:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.326+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 msgr2=0x565150eaed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.326+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 0x565150eaed10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4d20015000 tx=0x7f4d20009ca0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 shutdown_connections 2023-10-05T15:26:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x565150f0ee60 0x565150f11280 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565150eaa9d0 0x565150f0d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565150e9ac00 0x565150eae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 --2- 172.21.15.60:0/2150611006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565150e9b520 0x565150eaed10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d197fa700 0 client.16845 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 >> 172.21.15.60:0/2150611006 conn(0x565150e10200 msgr2=0x565150eab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 shutdown_connections 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 1 -- 172.21.15.60:0/2150611006 wait complete. 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d43f9cb80 20 client.16845 trim_cache size 0 max 16384 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:26:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:26:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:26:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4d1c0a15f0 msgr2=0x7f4d1c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d37db2700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4d1c0a15f0 0x7f4d1c0a3ab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d301976f0 tx=0x7f4d20005fb0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 msgr2=0x7f4d30195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.327+0000 7f4d37db2700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d30195ed0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00e9a0 tx=0x7f4d2c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 shutdown_connections 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f4d1c0a15f0 0x7f4d1c0a3ab0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d30105ef0 0x7f4d3019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300fff70 0x7f4d30195ed0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 --2- 172.21.15.60:0/273348912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d30100930 0x7f4d30196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 >> 172.21.15.60:0/273348912 conn(0x7f4d30076b70 msgr2=0x7f4d300febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 shutdown_connections 2023-10-05T15:26:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:00.328+0000 7f4d37db2700 1 -- 172.21.15.60:0/273348912 wait complete. 2023-10-05T15:26:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:01 smithi135 ceph-mon[103360]: pgmap v289: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 271 op/s 2023-10-05T15:26:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:01 smithi060 ceph-mon[99238]: pgmap v289: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 271 op/s 2023-10-05T15:26:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:01 smithi092 ceph-mon[102944]: pgmap v289: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 271 op/s 2023-10-05T15:26:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:02 smithi135 ceph-mon[103360]: pgmap v290: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 278 op/s 2023-10-05T15:26:02.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:02 smithi060 ceph-mon[99238]: pgmap v290: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 278 op/s 2023-10-05T15:26:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:02 smithi092 ceph-mon[102944]: pgmap v290: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 278 op/s 2023-10-05T15:26:04.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:04 smithi135 ceph-mon[103360]: osdmap e103: 12 total, 12 up, 12 in 2023-10-05T15:26:04.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:04 smithi135 ceph-mon[103360]: pgmap v292: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 333 op/s 2023-10-05T15:26:04.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:04 smithi060 ceph-mon[99238]: osdmap e103: 12 total, 12 up, 12 in 2023-10-05T15:26:04.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:04 smithi060 ceph-mon[99238]: pgmap v292: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 333 op/s 2023-10-05T15:26:04.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:04 smithi092 ceph-mon[102944]: osdmap e103: 12 total, 12 up, 12 in 2023-10-05T15:26:04.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:04 smithi092 ceph-mon[102944]: pgmap v292: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 333 op/s 2023-10-05T15:26:07.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:07 smithi135 ceph-mon[103360]: pgmap v293: 129 pgs: 12 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 81 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 348 op/s 2023-10-05T15:26:07.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:07 smithi060 ceph-mon[99238]: pgmap v293: 129 pgs: 12 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 81 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 348 op/s 2023-10-05T15:26:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:07 smithi092 ceph-mon[102944]: pgmap v293: 129 pgs: 12 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 81 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 348 op/s 2023-10-05T15:26:09.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:09 smithi135 ceph-mon[103360]: pgmap v294: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2023-10-05T15:26:09.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:09 smithi060 ceph-mon[99238]: pgmap v294: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2023-10-05T15:26:09.681 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:09 smithi092 ceph-mon[102944]: pgmap v294: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2023-10-05T15:26:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:11 smithi135 ceph-mon[103360]: pgmap v295: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 271 op/s 2023-10-05T15:26:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:11 smithi060 ceph-mon[99238]: pgmap v295: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 271 op/s 2023-10-05T15:26:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:11 smithi092 ceph-mon[102944]: pgmap v295: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 271 op/s 2023-10-05T15:26:12.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:12 smithi060 ceph-mon[99238]: pgmap v296: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 254 op/s 2023-10-05T15:26:12.933 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:12 smithi092 ceph-mon[102944]: pgmap v296: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 254 op/s 2023-10-05T15:26:13.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:12 smithi135 ceph-mon[103360]: pgmap v296: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 254 op/s 2023-10-05T15:26:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.536+0000 7f7e411de700 1 -- 172.21.15.60:0/2590622665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c11a690 msgr2=0x7f7e3c11ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.536+0000 7f7e411de700 1 --2- 172.21.15.60:0/2590622665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c11a690 0x7f7e3c11ca80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400b0a0 tx=0x7f7e3400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.542+0000 7f7e411de700 1 -- 172.21.15.60:0/2590622665 shutdown_connections 2023-10-05T15:26:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.542+0000 7f7e411de700 1 --2- 172.21.15.60:0/2590622665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c11a690 0x7f7e3c11ca80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.542+0000 7f7e411de700 1 --2- 172.21.15.60:0/2590622665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e3c10f620 0x7f7e3c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.542+0000 7f7e411de700 1 --2- 172.21.15.60:0/2590622665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e3c10fa90 0x7f7e3c1083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.542+0000 7f7e411de700 1 -- 172.21.15.60:0/2590622665 >> 172.21.15.60:0/2590622665 conn(0x7f7e3c06cfa0 msgr2=0x7f7e3c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.550+0000 7f7e411de700 1 -- 172.21.15.60:0/2590622665 shutdown_connections 2023-10-05T15:26:13.555 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.552+0000 7f7e411de700 1 -- 172.21.15.60:0/2590622665 wait complete. 2023-10-05T15:26:13.555 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.554+0000 7f7e411de700 1 Processor -- start 2023-10-05T15:26:13.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 -- start start 2023-10-05T15:26:13.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 0x7f7e3c118b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e3c10fa90 0x7f7e3c1190c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e3c11a690 0x7f7e3c111b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1122b0 con 0x7f7e3c10fa90 2023-10-05T15:26:13.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c112420 con 0x7f7e3c10f620 2023-10-05T15:26:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.565+0000 7f7e411de700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1125e0 con 0x7f7e3c11a690 2023-10-05T15:26:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 0x7f7e3c118b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 0x7f7e3c118b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:54970/0 (socket says 172.21.15.60:54970) 2023-10-05T15:26:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/442949990 learned_addr learned my addr 172.21.15.60:0/442949990 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e3c11a690 0x7f7e3c111b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/442949990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e3c11a690 msgr2=0x7f7e3c111b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e3c11a690 0x7f7e3c111b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e3c10fa90 msgr2=0x7f7e3c1190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e3c10fa90 0x7f7e3c1190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.571+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/442949990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34009d00 con 0x7f7e3c10f620 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.572+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 0x7f7e3c118b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b530 tx=0x7f7e3000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.572+0000 7f7e23fff700 1 -- 172.21.15.60:0/442949990 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300118f0 con 0x7f7e3c10f620 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.572+0000 7f7e23fff700 1 -- 172.21.15.60:0/442949990 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e30010380 con 0x7f7e3c10f620 2023-10-05T15:26:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.572+0000 7f7e23fff700 1 -- 172.21.15.60:0/442949990 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000f540 con 0x7f7e3c10f620 2023-10-05T15:26:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.577+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c1166d0 con 0x7f7e3c10f620 2023-10-05T15:26:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.577+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c116b90 con 0x7f7e3c10f620 2023-10-05T15:26:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.583+0000 7f7e4d3c8b80 1 Processor -- start 2023-10-05T15:26:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.583+0000 7f7e23fff700 1 -- 172.21.15.60:0/442949990 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7e300104f0 con 0x7f7e3c10f620 2023-10-05T15:26:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.584+0000 7f7e23fff700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e240a16f0 0x7f7e240a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.584+0000 7f7e23fff700 1 -- 172.21.15.60:0/442949990 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f7e300ccf30 con 0x7f7e3c10f620 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 -- start start 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 0x55603de7efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 0x55603de89e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de8a3d0 0x55603de8c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603dde8400 con 0x55603de7f520 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603ddd9bc0 con 0x55603de7ec00 2023-10-05T15:26:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.585+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603ddd74e0 con 0x55603de8a3d0 2023-10-05T15:26:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 0x55603de89e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 0x55603de89e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41560/0 (socket says 172.21.15.60:41560) 2023-10-05T15:26:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 -- 172.21.15.60:0/2857773306 learned_addr learned my addr 172.21.15.60:0/2857773306 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 -- 172.21.15.60:0/2857773306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de8a3d0 msgr2=0x55603de8c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de8a3d0 0x55603de8c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 -- 172.21.15.60:0/2857773306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 msgr2=0x55603de7efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 0x55603de7efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 -- 172.21.15.60:0/2857773306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55603dbfdd80 con 0x55603de7f520 2023-10-05T15:26:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.587+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 0x55603de89e90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00aa50 tx=0x7f7e2c00ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59794d056f7b7677 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.590+0000 7f7e217fa700 1 -- 172.21.15.60:0/2857773306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00cc10 con 0x55603de7f520 2023-10-05T15:26:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.590+0000 7f7e217fa700 1 -- 172.21.15.60:0/2857773306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e2c0044e0 con 0x55603de7f520 2023-10-05T15:26:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.590+0000 7f7e217fa700 1 -- 172.21.15.60:0/2857773306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00f450 con 0x55603de7f520 2023-10-05T15:26:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.591+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e240a16f0 0x7f7e240a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.591+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2857773306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 msgr2=0x55603de89e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.591+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e240a16f0 0x7f7e240a3bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e340062a0 tx=0x7f7e34009c00 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.591+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 0x55603de89e90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00aa50 tx=0x7f7e2c00ad60 comp rx=0 tx=0).stop 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.591+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2857773306 shutdown_connections 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.592+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de8a3d0 0x55603de8c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.592+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 0x55603de7efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.592+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2857773306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de7f520 0x55603de89e90 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.592+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2857773306 >> 172.21.15.60:0/2857773306 conn(0x55603ddf4200 msgr2=0x55603de7b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.592+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2857773306 shutdown_connections 2023-10-05T15:26:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.603+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2857773306 wait complete. 2023-10-05T15:26:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.603+0000 7f7e4d3c8b80 1 -- start start 2023-10-05T15:26:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.603+0000 7f7e4d3c8b80 1 Processor -- start 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de87290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de877d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de87d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603ddd2dd0 con 0x55603de8a3d0 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603dd6f6b0 con 0x55603de7f520 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603dd6f350 con 0x55603de7ec00 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e4d3c8b80 10 client.0 _ll_register_callbacks cb 0x55603dbcc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e3ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de87290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e3a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e3ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de87290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55092/0 (socket says 172.21.15.60:55092) 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.606+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/2949953882 learned_addr learned my addr 172.21.15.60:0/2949953882 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de87d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 msgr2=0x55603de877d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de877d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/2949953882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 msgr2=0x55603de87d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de87d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/2949953882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c00a680 con 0x55603de7ec00 2023-10-05T15:26:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.607+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de87290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b500 tx=0x7f7e30010f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f0f2f791fe3871 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.608+0000 7f7e1eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:26:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.608+0000 7f7e1eff5700 1 -- 172.21.15.60:0/2949953882 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30099bf0 con 0x55603de7ec00 2023-10-05T15:26:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.608+0000 7f7e1eff5700 1 -- 172.21.15.60:0/2949953882 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f7e3009dd40 con 0x55603de7ec00 2023-10-05T15:26:13.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.612+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55603de72d50 con 0x55603de7ec00 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.612+0000 7f7e1eff5700 1 -- 172.21.15.60:0/2949953882 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e300a1f80 con 0x55603de7ec00 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.612+0000 7f7e4d3c8b80 10 client.26365 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.612+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55603dbe6c00 con 0x55603de7ec00 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.612+0000 7f7e1eff5700 1 -- 172.21.15.60:0/2949953882 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e300b6070 con 0x55603de7ec00 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.612+0000 7f7e1eff5700 1 -- 172.21.15.60:0/2949953882 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7e300a1af0 con 0x55603de7ec00 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.613+0000 7f7e4d3c8b80 10 client.26365 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.613+0000 7f7e4d3c8b80 10 client.26365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.613+0000 7f7e4d3c8b80 20 client.26365 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.613+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603de99fa0 0x55603de9c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.613+0000 7f7e4d3c8b80 4 client.26365 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:26:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.613+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55603ddcbdb0 con 0x55603de99fa0 2023-10-05T15:26:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.614+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603de99fa0 0x55603de9c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.617+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603de99fa0 0x55603de9c3c0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6620e450da58e1c5 server_cookie=7d727b2a582022b5 in_seq=0 out_seq=0 2023-10-05T15:26:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.617+0000 7f7e1eff5700 10 client.26365 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.621+0000 7f7e1eff5700 1 -- 172.21.15.60:0/2949953882 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55603ddcbdb0 con 0x55603de99fa0 2023-10-05T15:26:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.621+0000 7f7e1eff5700 10 client.26365 handle_command_reply: tid=0 2023-10-05T15:26:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.621+0000 7f7e4d3c8b80 1 client.26365 shutdown 2023-10-05T15:26:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.630+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 msgr2=0x55603de87290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.630+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de87290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b500 tx=0x7f7e30010f50 comp rx=0 tx=0).stop 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 shutdown_connections 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603de99fa0 0x55603de9c3c0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de87d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de87290 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/2949953882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de877d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 >> 172.21.15.60:0/2949953882 conn(0x55603ddf4200 msgr2=0x55603de7ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.639+0000 7f7e1eff5700 0 client.26365 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.657+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 shutdown_connections 2023-10-05T15:26:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.660+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/2949953882 wait complete. 2023-10-05T15:26:13.667 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.663+0000 7f7e4d3c8b80 20 client.26365 trim_cache size 0 max 16384 2023-10-05T15:26:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.690+0000 7f7e4d3c8b80 1 Processor -- start 2023-10-05T15:26:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.693+0000 7f7e4d3c8b80 1 -- start start 2023-10-05T15:26:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 0x55603de90f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7f520 0x55603de81b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de82590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603dc538c0 con 0x55603de8a3d0 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603de77860 con 0x55603de7ec00 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603de7b5d0 con 0x55603de7f520 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de82590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de82590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41574/0 (socket says 172.21.15.60:41574) 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 -- 172.21.15.60:0/289951523 learned_addr learned my addr 172.21.15.60:0/289951523 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7f520 0x55603de81b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 -- 172.21.15.60:0/289951523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7f520 msgr2=0x55603de81b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7f520 0x55603de81b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 -- 172.21.15.60:0/289951523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 msgr2=0x55603de90f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 0x55603de90f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.694+0000 7f7e3b59e700 1 -- 172.21.15.60:0/289951523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55603dc241f0 con 0x55603de8a3d0 2023-10-05T15:26:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.695+0000 7f7e3b59e700 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de82590 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c06a250 tx=0x7f7e3401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60caf1435420b1e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.695+0000 7f7e21ffb700 1 -- 172.21.15.60:0/289951523 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400e040 con 0x55603de8a3d0 2023-10-05T15:26:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.695+0000 7f7e21ffb700 1 -- 172.21.15.60:0/289951523 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e34007820 con 0x55603de8a3d0 2023-10-05T15:26:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.695+0000 7f7e21ffb700 1 -- 172.21.15.60:0/289951523 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34005290 con 0x55603de8a3d0 2023-10-05T15:26:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.696+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/289951523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 msgr2=0x55603de82590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.696+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de82590 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c06a250 tx=0x7f7e3401c000 comp rx=0 tx=0).stop 2023-10-05T15:26:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.700+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/289951523 shutdown_connections 2023-10-05T15:26:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.700+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603de82590 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.700+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7ec00 0x55603de90f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.700+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/289951523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7f520 0x55603de81b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.700+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/289951523 >> 172.21.15.60:0/289951523 conn(0x55603ddf4200 msgr2=0x55603de9bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:13.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.700+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/289951523 shutdown_connections 2023-10-05T15:26:13.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.701+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/289951523 wait complete. 2023-10-05T15:26:13.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.701+0000 7f7e4d3c8b80 1 -- start start 2023-10-05T15:26:13.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.701+0000 7f7e4d3c8b80 1 Processor -- start 2023-10-05T15:26:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de8f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603deecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603deed310 con 0x55603de8a3d0 2023-10-05T15:26:13.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603deed480 con 0x55603de7f520 2023-10-05T15:26:13.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603deed640 con 0x55603de7ec00 2023-10-05T15:26:13.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.702+0000 7f7e4d3c8b80 10 client.0 _ll_register_callbacks cb 0x7f7e30099800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:13.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.706+0000 7f7e3a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de8f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de8f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55108/0 (socket says 172.21.15.60:55108) 2023-10-05T15:26:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/3057423273 learned_addr learned my addr 172.21.15.60:0/3057423273 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 msgr2=0x55603de8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de8f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/3057423273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 msgr2=0x55603deecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603deecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.711+0000 7f7e3ad9d700 1 -- 172.21.15.60:0/3057423273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c11d3b0 con 0x55603de7ec00 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.712+0000 7f7e3ad9d700 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de8f0f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e300960f0 tx=0x7f7e30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9975986788fd6d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.712+0000 7f7e1eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.712+0000 7f7e1eff5700 1 -- 172.21.15.60:0/3057423273 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3009dd40 con 0x55603de7ec00 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.712+0000 7f7e1eff5700 1 -- 172.21.15.60:0/3057423273 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f7e30099bf0 con 0x55603de7ec00 2023-10-05T15:26:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.712+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e2c0044e0 con 0x55603de7ec00 2023-10-05T15:26:13.726 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.725+0000 7f7e1eff5700 1 -- 172.21.15.60:0/3057423273 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e300a1f80 con 0x55603de7ec00 2023-10-05T15:26:13.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.732+0000 7f7e4d3c8b80 10 client.26371 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:13.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.732+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55603dbfc250 con 0x55603de7ec00 2023-10-05T15:26:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.741+0000 7f7e1eff5700 1 -- 172.21.15.60:0/3057423273 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e2c0044e0 con 0x55603de7ec00 2023-10-05T15:26:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.741+0000 7f7e1eff5700 1 -- 172.21.15.60:0/3057423273 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7e30098b50 con 0x55603de7ec00 2023-10-05T15:26:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.742+0000 7f7e4d3c8b80 10 client.26371 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.742+0000 7f7e4d3c8b80 10 client.26371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.742+0000 7f7e4d3c8b80 20 client.26371 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.742+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603deeeba0 0x55603def0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.742+0000 7f7e4d3c8b80 4 client.26371 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:26:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.742+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55603ddcbad0 con 0x55603deeeba0 2023-10-05T15:26:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.749+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603deeeba0 0x55603def0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.763+0000 7f7e1eff5700 10 client.26371 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:13.763+0000 7f7e3a59c700 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603deeeba0 0x55603def0fc0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5176ac8546d44ff server_cookie=8cc18495b6cb2fa3 in_seq=0 out_seq=0 2023-10-05T15:26:14.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:14 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:14.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:14 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:14.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:14 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:15.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:15 smithi135 ceph-mon[103360]: pgmap v297: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2023-10-05T15:26:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e1eff5700 1 -- 172.21.15.60:0/3057423273 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55603ddcbad0 con 0x55603deeeba0 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e1eff5700 10 client.26371 handle_command_reply: tid=0 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 client.26371 shutdown 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 msgr2=0x55603de8f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de8f0f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e300960f0 tx=0x7f7e30004750 comp rx=0 tx=0).stop 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 shutdown_connections 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55603deeeba0 0x55603def0fc0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55603de8a3d0 0x55603deecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55603de7ec00 0x55603de8f0f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 --2- 172.21.15.60:0/3057423273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55603de7f520 0x55603de8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 >> 172.21.15.60:0/3057423273 conn(0x55603ddf4200 msgr2=0x55603de82590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e1eff5700 0 client.26371 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 shutdown_connections 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.622+0000 7f7e4d3c8b80 1 -- 172.21.15.60:0/3057423273 wait complete. 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.623+0000 7f7e4d3c8b80 20 client.26371 trim_cache size 0 max 16384 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:26:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:26:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:26:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:26:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e240a16f0 msgr2=0x7f7e240a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e240a16f0 0x7f7e240a3bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e340062a0 tx=0x7f7e34009c00 comp rx=0 tx=0).stop 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 msgr2=0x7f7e3c118b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 0x7f7e3c118b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b530 tx=0x7f7e3000b840 comp rx=0 tx=0).stop 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 shutdown_connections 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e3c11a690 0x7f7e3c111b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7e240a16f0 0x7f7e240a3bb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e3c10f620 0x7f7e3c118b40 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b530 tx=0x7f7e3000b840 comp rx=0 tx=0).stop 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 --2- 172.21.15.60:0/442949990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e3c10fa90 0x7f7e3c1190c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.624+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 >> 172.21.15.60:0/442949990 conn(0x7f7e3c06cfa0 msgr2=0x7f7e3c06f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.634+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 shutdown_connections 2023-10-05T15:26:15.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:15.639+0000 7f7e411de700 1 -- 172.21.15.60:0/442949990 wait complete. 2023-10-05T15:26:15.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:15 smithi060 ceph-mon[99238]: pgmap v297: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2023-10-05T15:26:15.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:15 smithi092 ceph-mon[102944]: pgmap v297: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2023-10-05T15:26:16.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:16 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:26:16.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:16 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:26:16.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:16 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:26:16.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:16 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:26:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:16 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:26:16.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:16 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:26:16.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:16 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:26:16.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:16 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:26:16.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:16 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:26:17.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:17 smithi135 ceph-mon[103360]: pgmap v298: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 184 op/s 2023-10-05T15:26:17.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:17 smithi060 ceph-mon[99238]: pgmap v298: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 184 op/s 2023-10-05T15:26:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:17 smithi092 ceph-mon[102944]: pgmap v298: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 184 op/s 2023-10-05T15:26:19.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:19 smithi135 ceph-mon[103360]: pgmap v299: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 162 op/s 2023-10-05T15:26:19.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:19 smithi060 ceph-mon[99238]: pgmap v299: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 162 op/s 2023-10-05T15:26:19.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:19 smithi092 ceph-mon[102944]: pgmap v299: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 162 op/s 2023-10-05T15:26:21.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:21 smithi135 ceph-mon[103360]: pgmap v300: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 138 op/s 2023-10-05T15:26:21.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:21 smithi060 ceph-mon[99238]: pgmap v300: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 138 op/s 2023-10-05T15:26:21.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:21 smithi092 ceph-mon[102944]: pgmap v300: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 138 op/s 2023-10-05T15:26:22.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:22 smithi135 ceph-mon[103360]: pgmap v301: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 140 op/s 2023-10-05T15:26:22.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:22 smithi060 ceph-mon[99238]: pgmap v301: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 140 op/s 2023-10-05T15:26:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:22 smithi092 ceph-mon[102944]: pgmap v301: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 140 op/s 2023-10-05T15:26:25.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:25 smithi135 ceph-mon[103360]: pgmap v302: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 184 op/s 2023-10-05T15:26:25.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:25 smithi060 ceph-mon[99238]: pgmap v302: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 184 op/s 2023-10-05T15:26:25.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:25 smithi092 ceph-mon[102944]: pgmap v302: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 184 op/s 2023-10-05T15:26:27.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:27 smithi135 ceph-mon[103360]: pgmap v303: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 1.9 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2023-10-05T15:26:27.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:27 smithi060 ceph-mon[99238]: pgmap v303: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 1.9 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2023-10-05T15:26:27.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:27 smithi092 ceph-mon[102944]: pgmap v303: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 1.9 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2023-10-05T15:26:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 -- 172.21.15.60:0/3672364950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b810c880 msgr2=0x7fc6b8114400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 --2- 172.21.15.60:0/3672364950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b810c880 0x7fc6b8114400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009fc0 tx=0x7fc6b000b330 comp rx=0 tx=0).stop 2023-10-05T15:26:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 -- 172.21.15.60:0/3672364950 shutdown_connections 2023-10-05T15:26:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 --2- 172.21.15.60:0/3672364950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b810c880 0x7fc6b8114400 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 --2- 172.21.15.60:0/3672364950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8107840 0x7fc6b8107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 --2- 172.21.15.60:0/3672364950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b81081f0 0x7fc6b810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 -- 172.21.15.60:0/3672364950 >> 172.21.15.60:0/3672364950 conn(0x7fc6b8076d50 msgr2=0x7fc6b8105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 -- 172.21.15.60:0/3672364950 shutdown_connections 2023-10-05T15:26:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.844+0000 7fc6bf041700 1 -- 172.21.15.60:0/3672364950 wait complete. 2023-10-05T15:26:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 Processor -- start 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 -- start start 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8107840 0x7fc6b807efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b810c880 0x7fc6b807f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8079f40 0x7fc6b807a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b807aa30 con 0x7fc6b810c880 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b807aba0 con 0x7fc6b8107840 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bf041700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b807ad60 con 0x7fc6b8079f40 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.852+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8107840 0x7fc6b807efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8107840 0x7fc6b807efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55012/0 (socket says 172.21.15.60:55012) 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bcddd700 1 -- 172.21.15.60:0/2090059588 learned_addr learned my addr 172.21.15.60:0/2090059588 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8079f40 0x7fc6b807a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2090059588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8107840 msgr2=0x7fc6b807efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8107840 0x7fc6b807efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b810c880 msgr2=0x7fc6b807f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b810c880 0x7fc6b807f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2090059588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009c40 con 0x7fc6b8079f40 2023-10-05T15:26:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.853+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8079f40 0x7fc6b807a3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0015000 tx=0x7fc6b00079f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.854+0000 7fc6b5ffb700 1 -- 172.21.15.60:0/2090059588 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000e040 con 0x7fc6b8079f40 2023-10-05T15:26:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.854+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b807ddf0 con 0x7fc6b8079f40 2023-10-05T15:26:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.854+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b807e2c0 con 0x7fc6b8079f40 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.859+0000 7fc6cb22bb80 1 Processor -- start 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.859+0000 7fc6b5ffb700 1 -- 172.21.15.60:0/2090059588 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b000bbf0 con 0x7fc6b8079f40 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.859+0000 7fc6b5ffb700 1 -- 172.21.15.60:0/2090059588 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b001b460 con 0x7fc6b8079f40 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.859+0000 7fc6cb22bb80 1 -- start start 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.860+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a020fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.860+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 0x55a21a02be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.860+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a02e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.860+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219f8a400 con 0x55a21a02c3d0 2023-10-05T15:26:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.860+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219f7bbc0 con 0x55a21a020c00 2023-10-05T15:26:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.860+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219f794e0 con 0x55a21a021520 2023-10-05T15:26:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.862+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 0x55a21a02be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.862+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 0x55a21a02be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55126/0 (socket says 172.21.15.60:55126) 2023-10-05T15:26:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.862+0000 7fc6bcddd700 1 -- 172.21.15.60:0/1824601735 learned_addr learned my addr 172.21.15.60:0/1824601735 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.865+0000 7fc6bcddd700 1 -- 172.21.15.60:0/1824601735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 msgr2=0x55a21a020fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.865+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a020fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.865+0000 7fc6bcddd700 1 -- 172.21.15.60:0/1824601735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 msgr2=0x55a21a02e7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.865+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a02e7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.865+0000 7fc6bcddd700 1 -- 172.21.15.60:0/1824601735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a219d9fd80 con 0x55a21a021520 2023-10-05T15:26:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.865+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 0x55a21a02be90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009e50 tx=0x7fc6a8011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd9ffbeaae2ae2a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.866+0000 7fc6b5ffb700 1 -- 172.21.15.60:0/2090059588 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc6b001d470 con 0x7fc6b8079f40 2023-10-05T15:26:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.867+0000 7fc6b5ffb700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc6a00a1670 0x7fc6a00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.867+0000 7fc6b5ffb700 1 -- 172.21.15.60:0/2090059588 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fc6b00ce4b0 con 0x7fc6b8079f40 2023-10-05T15:26:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.868+0000 7fc69effd700 1 -- 172.21.15.60:0/1824601735 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8004a30 con 0x55a21a021520 2023-10-05T15:26:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.868+0000 7fc69effd700 1 -- 172.21.15.60:0/1824601735 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6a80054e0 con 0x55a21a021520 2023-10-05T15:26:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.873+0000 7fc69effd700 1 -- 172.21.15.60:0/1824601735 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8019a10 con 0x55a21a021520 2023-10-05T15:26:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.874+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc6a00a1670 0x7fc6a00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/1824601735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 msgr2=0x55a21a02be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 0x55a21a02be90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009e50 tx=0x7fc6a8011720 comp rx=0 tx=0).stop 2023-10-05T15:26:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/1824601735 shutdown_connections 2023-10-05T15:26:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a02e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a020fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/1824601735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a021520 0x55a21a02be90 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009e50 tx=0x7fc6a8011720 comp rx=0 tx=0).stop 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.875+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/1824601735 >> 172.21.15.60:0/1824601735 conn(0x55a219f96200 msgr2=0x55a21a01d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.876+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/1824601735 shutdown_connections 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.876+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/1824601735 wait complete. 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.876+0000 7fc6cb22bb80 1 -- start start 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.876+0000 7fc6cb22bb80 1 Processor -- start 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a029320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a029860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a029da0 0x55a21a038030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219f74dd0 con 0x55a21a02c3d0 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219f116b0 con 0x55a21a029da0 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219f11350 con 0x55a21a020c00 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6cb22bb80 10 client.0 _ll_register_callbacks cb 0x55a219d6e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6bd5de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a029da0 0x55a21a038030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6bd5de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a029da0 0x55a21a038030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55026/0 (socket says 172.21.15.60:55026) 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2437606893 learned_addr learned my addr 172.21.15.60:0/2437606893 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.877+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc6a00a1670 0x7fc6a00a3b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6b807b940 tx=0x7fc6ac009f70 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.878+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a029860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.878+0000 7fc6b7fff700 1 -- 172.21.15.60:0/2437606893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 msgr2=0x55a21a029320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:26:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.878+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a029320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.878+0000 7fc6b7fff700 1 -- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a029da0 msgr2=0x55a21a038030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.878+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a029da0 0x55a21a038030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.878+0000 7fc6b7fff700 1 -- 172.21.15.60:0/2437606893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a8009a80 con 0x55a21a02c3d0 2023-10-05T15:26:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.879+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a029860 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc6b806a590 tx=0x7fc6ac009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38b045b496d7e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.884+0000 7fc697fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:26:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.885+0000 7fc697fff700 1 -- 172.21.15.60:0/2437606893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac012e20 con 0x55a21a02c3d0 2023-10-05T15:26:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.885+0000 7fc697fff700 1 -- 172.21.15.60:0/2437606893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fc6ac020070 con 0x55a21a02c3d0 2023-10-05T15:26:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.885+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a21a014d50 con 0x55a21a02c3d0 2023-10-05T15:26:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.891+0000 7fc697fff700 1 -- 172.21.15.60:0/2437606893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6ac025480 con 0x55a21a02c3d0 2023-10-05T15:26:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.891+0000 7fc6cb22bb80 10 client.16860 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.891+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55a219d88c00 con 0x55a21a02c3d0 2023-10-05T15:26:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.892+0000 7fc697fff700 1 -- 172.21.15.60:0/2437606893 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a21a014d50 con 0x55a21a02c3d0 2023-10-05T15:26:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.892+0000 7fc697fff700 1 -- 172.21.15.60:0/2437606893 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fc6ac02f6c0 con 0x55a21a02c3d0 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6cb22bb80 10 client.16860 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6cb22bb80 10 client.16860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6cb22bb80 20 client.16860 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a03c6b0 0x55a21a03ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6cb22bb80 4 client.16860 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a219f6ddb0 con 0x55a21a03c6b0 2023-10-05T15:26:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.893+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a03c6b0 0x55a21a03ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.894+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a03c6b0 0x55a21a03ead0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81023951edfb95ee server_cookie=68da4fdf85fc28e7 in_seq=0 out_seq=0 2023-10-05T15:26:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.894+0000 7fc697fff700 10 client.16860 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.895+0000 7fc697fff700 1 -- 172.21.15.60:0/2437606893 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a219f6ddb0 con 0x55a21a03c6b0 2023-10-05T15:26:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.895+0000 7fc697fff700 10 client.16860 handle_command_reply: tid=0 2023-10-05T15:26:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.895+0000 7fc6cb22bb80 1 client.16860 shutdown 2023-10-05T15:26:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.896+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 msgr2=0x55a21a029860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.896+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a029860 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc6b806a590 tx=0x7fc6ac009310 comp rx=0 tx=0).stop 2023-10-05T15:26:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 shutdown_connections 2023-10-05T15:26:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a03c6b0 0x55a21a03ead0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a029da0 0x55a21a038030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a029320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2437606893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a02c3d0 0x55a21a029860 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 >> 172.21.15.60:0/2437606893 conn(0x55a219f96200 msgr2=0x55a21a01cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc697fff700 0 client.16860 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:28.900 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 shutdown_connections 2023-10-05T15:26:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2437606893 wait complete. 2023-10-05T15:26:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.897+0000 7fc6cb22bb80 20 client.16860 trim_cache size 0 max 16384 2023-10-05T15:26:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 Processor -- start 2023-10-05T15:26:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 -- start start 2023-10-05T15:26:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a032f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a037de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a02c3d0 0x55a21a0265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a219df58c0 con 0x55a21a029da0 2023-10-05T15:26:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21a019860 con 0x55a21a02c3d0 2023-10-05T15:26:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.921+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21a02a740 con 0x55a21a020c00 2023-10-05T15:26:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a032f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a032f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55138/0 (socket says 172.21.15.60:55138) 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bcddd700 1 -- 172.21.15.60:0/2558993865 learned_addr learned my addr 172.21.15.60:0/2558993865 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a02c3d0 0x55a21a0265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a037de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2558993865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 msgr2=0x55a21a032f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a032f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2558993865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 msgr2=0x55a21a037de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a037de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 -- 172.21.15.60:0/2558993865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a219dc61f0 con 0x55a21a02c3d0 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.922+0000 7fc6bd5de700 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a02c3d0 0x55a21a0265d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0025000 tx=0x7fc6b00098a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e52791fb7d42d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.923+0000 7fc69f7fe700 1 -- 172.21.15.60:0/2558993865 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b009aa10 con 0x55a21a02c3d0 2023-10-05T15:26:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.923+0000 7fc69f7fe700 1 -- 172.21.15.60:0/2558993865 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b009b7b0 con 0x55a21a02c3d0 2023-10-05T15:26:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.923+0000 7fc69f7fe700 1 -- 172.21.15.60:0/2558993865 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000bd60 con 0x55a21a02c3d0 2023-10-05T15:26:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.924+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2558993865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a02c3d0 msgr2=0x55a21a0265d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.924+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a02c3d0 0x55a21a0265d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0025000 tx=0x7fc6b00098a0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.934+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2558993865 shutdown_connections 2023-10-05T15:26:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.934+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a02c3d0 0x55a21a0265d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.934+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a020c00 0x55a21a032f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.934+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/2558993865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a037de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.934+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2558993865 >> 172.21.15.60:0/2558993865 conn(0x55a219f96200 msgr2=0x55a21a0376d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.940+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2558993865 shutdown_connections 2023-10-05T15:26:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.944+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/2558993865 wait complete. 2023-10-05T15:26:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.944+0000 7fc6cb22bb80 1 -- start start 2023-10-05T15:26:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.944+0000 7fc6cb22bb80 1 Processor -- start 2023-10-05T15:26:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a084470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a0849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a02c3d0 0x55a21a08f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21a085280 con 0x55a21a029da0 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21a08fa30 con 0x55a21a020c00 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21a08fb70 con 0x55a21a02c3d0 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6cb22bb80 10 client.0 _ll_register_callbacks cb 0x7fc6ac00eb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a084470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6bcddd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a084470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55036/0 (socket says 172.21.15.60:55036) 2023-10-05T15:26:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.952+0000 7fc6bcddd700 1 -- 172.21.15.60:0/3755093383 learned_addr learned my addr 172.21.15.60:0/3755093383 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a0849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6bcddd700 1 -- 172.21.15.60:0/3755093383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a02c3d0 msgr2=0x55a21a08f4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a02c3d0 0x55a21a08f4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6bcddd700 1 -- 172.21.15.60:0/3755093383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 msgr2=0x55a21a0849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a0849b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6bcddd700 1 -- 172.21.15.60:0/3755093383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b807e2c0 con 0x55a21a020c00 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.953+0000 7fc6bcddd700 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a084470 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55a21a01db90 tx=0x7fc6a80092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d6d349e237f13a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.955+0000 7fc697fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.955+0000 7fc697fff700 1 -- 172.21.15.60:0/3755093383 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8005030 con 0x55a21a020c00 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.955+0000 7fc697fff700 1 -- 172.21.15.60:0/3755093383 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fc6a8000e40 con 0x55a21a020c00 2023-10-05T15:26:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.955+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6a80054e0 con 0x55a21a020c00 2023-10-05T15:26:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.959+0000 7fc697fff700 1 -- 172.21.15.60:0/3755093383 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6a8005190 con 0x55a21a020c00 2023-10-05T15:26:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.961+0000 7fc6cb22bb80 10 client.26525 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.961+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55a219d9e250 con 0x55a21a020c00 2023-10-05T15:26:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc697fff700 1 -- 172.21.15.60:0/3755093383 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6a80054e0 con 0x55a21a020c00 2023-10-05T15:26:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc697fff700 1 -- 172.21.15.60:0/3755093383 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fc6a8011440 con 0x55a21a020c00 2023-10-05T15:26:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc6cb22bb80 10 client.26525 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc6cb22bb80 10 client.26525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc6cb22bb80 20 client.26525 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a0911a0 0x55a21a0935c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc6cb22bb80 4 client.26525 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:26:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.963+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a219f6dad0 con 0x55a21a0911a0 2023-10-05T15:26:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.964+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a0911a0 0x55a21a0935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.964+0000 7fc697fff700 10 client.26525 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:28.964+0000 7fc6b7fff700 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a0911a0 0x55a21a0935c0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bee22512e6660d5 server_cookie=b881c02bbadadb2b in_seq=0 out_seq=0 2023-10-05T15:26:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.045+0000 7fc697fff700 1 -- 172.21.15.60:0/3755093383 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a219f6dad0 con 0x55a21a0911a0 2023-10-05T15:26:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.045+0000 7fc697fff700 10 client.26525 handle_command_reply: tid=0 2023-10-05T15:26:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.047+0000 7fc6cb22bb80 1 client.26525 shutdown 2023-10-05T15:26:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.057+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 msgr2=0x55a21a084470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:29.059 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.057+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a084470 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55a21a01db90 tx=0x7fc6a80092d0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.064+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 shutdown_connections 2023-10-05T15:26:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.064+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55a21a0911a0 0x55a21a0935c0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.064+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21a02c3d0 0x55a21a08f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.064+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a21a020c00 0x55a21a084470 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.064+0000 7fc6cb22bb80 1 --2- 172.21.15.60:0/3755093383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a21a029da0 0x55a21a0849b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.064+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 >> 172.21.15.60:0/3755093383 conn(0x55a219f96200 msgr2=0x55a21a01c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.067+0000 7fc697fff700 0 client.26525 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.069+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 shutdown_connections 2023-10-05T15:26:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.069+0000 7fc6cb22bb80 1 -- 172.21.15.60:0/3755093383 wait complete. 2023-10-05T15:26:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.073+0000 7fc6cb22bb80 20 client.26525 trim_cache size 0 max 16384 2023-10-05T15:26:29.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:26:29.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:26:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:26:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc6a00a1670 msgr2=0x7fc6a00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc6a00a1670 0x7fc6a00a3b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6b807b940 tx=0x7fc6ac009f70 comp rx=0 tx=0).stop 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8079f40 msgr2=0x7fc6b807a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8079f40 0x7fc6b807a3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0015000 tx=0x7fc6b00079f0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 shutdown_connections 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8079f40 0x7fc6b807a3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fc6a00a1670 0x7fc6a00a3b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8107840 0x7fc6b807efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 --2- 172.21.15.60:0/2090059588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b810c880 0x7fc6b807f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.090+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 >> 172.21.15.60:0/2090059588 conn(0x7fc6b8076d50 msgr2=0x7fc6b810b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.098+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 shutdown_connections 2023-10-05T15:26:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:29.102+0000 7fc6bf041700 1 -- 172.21.15.60:0/2090059588 wait complete. 2023-10-05T15:26:29.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:29 smithi060 ceph-mon[99238]: pgmap v304: 129 pgs: 14 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 83 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-10-05T15:26:29.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:29 smithi092 ceph-mon[102944]: pgmap v304: 129 pgs: 14 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 83 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-10-05T15:26:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:29 smithi135 ceph-mon[103360]: pgmap v304: 129 pgs: 14 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 83 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-10-05T15:26:30.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:30 smithi060 ceph-mon[99238]: pgmap v305: 129 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 96 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 763 KiB/s wr, 166 op/s 2023-10-05T15:26:30.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:30 smithi092 ceph-mon[102944]: pgmap v305: 129 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 96 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 763 KiB/s wr, 166 op/s 2023-10-05T15:26:30.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:30 smithi135 ceph-mon[103360]: pgmap v305: 129 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 96 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 763 KiB/s wr, 166 op/s 2023-10-05T15:26:32.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:32 smithi135 ceph-mon[103360]: pgmap v306: 129 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 97 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 770 KiB/s wr, 158 op/s 2023-10-05T15:26:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:32 smithi060 ceph-mon[99238]: pgmap v306: 129 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 97 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 770 KiB/s wr, 158 op/s 2023-10-05T15:26:32.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:32 smithi092 ceph-mon[102944]: pgmap v306: 129 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 97 active+clean; 1.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 770 KiB/s wr, 158 op/s 2023-10-05T15:26:35.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:35 smithi135 ceph-mon[103360]: pgmap v307: 129 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 98 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1.0 MiB/s wr, 199 op/s 2023-10-05T15:26:35.670 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:35 smithi060 ceph-mon[99238]: pgmap v307: 129 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 98 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1.0 MiB/s wr, 199 op/s 2023-10-05T15:26:35.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:35 smithi092 ceph-mon[102944]: pgmap v307: 129 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 98 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1.0 MiB/s wr, 199 op/s 2023-10-05T15:26:37.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:37 smithi135 ceph-mon[103360]: pgmap v308: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 730 KiB/s wr, 186 op/s 2023-10-05T15:26:37.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:37 smithi060 ceph-mon[99238]: pgmap v308: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 730 KiB/s wr, 186 op/s 2023-10-05T15:26:37.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:37 smithi092 ceph-mon[102944]: pgmap v308: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 730 KiB/s wr, 186 op/s 2023-10-05T15:26:39.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:39 smithi135 ceph-mon[103360]: pgmap v309: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1024 KiB/s wr, 202 op/s 2023-10-05T15:26:39.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:39 smithi060 ceph-mon[99238]: pgmap v309: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1024 KiB/s wr, 202 op/s 2023-10-05T15:26:39.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:39 smithi092 ceph-mon[102944]: pgmap v309: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 1.9 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1024 KiB/s wr, 202 op/s 2023-10-05T15:26:41.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:41 smithi135 ceph-mon[103360]: pgmap v310: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 1.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 840 KiB/s wr, 200 op/s 2023-10-05T15:26:41.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:41 smithi060 ceph-mon[99238]: pgmap v310: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 1.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 840 KiB/s wr, 200 op/s 2023-10-05T15:26:41.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:41 smithi092 ceph-mon[102944]: pgmap v310: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 1.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 840 KiB/s wr, 200 op/s 2023-10-05T15:26:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 -- 172.21.15.60:0/3505154540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8103cd0 msgr2=0x7f9fd8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/3505154540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8103cd0 0x7f9fd8107d10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009990 tx=0x7f9fc8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 -- 172.21.15.60:0/3505154540 shutdown_connections 2023-10-05T15:26:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/3505154540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd8108440 0x7f9fd810ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/3505154540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fd8103320 0x7f9fd8103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/3505154540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8103cd0 0x7f9fd8107d10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 -- 172.21.15.60:0/3505154540 >> 172.21.15.60:0/3505154540 conn(0x7f9fd80feb60 msgr2=0x7f9fd8100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 -- 172.21.15.60:0/3505154540 shutdown_connections 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.274+0000 7f9fe03c3700 1 -- 172.21.15.60:0/3505154540 wait complete. 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 Processor -- start 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 -- start start 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fd8103320 0x7f9fd8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 0x7f9fd8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd819dde0 0x7f9fd819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd819e860 con 0x7f9fd8108440 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd819e9d0 con 0x7f9fd8103320 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fe03c3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd819eb90 con 0x7f9fd819dde0 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fdd95e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 0x7f9fd8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fdd95e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 0x7f9fd8199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41628/0 (socket says 172.21.15.60:41628) 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fdd95e700 1 -- 172.21.15.60:0/2964002208 learned_addr learned my addr 172.21.15.60:0/2964002208 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fde960700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd819dde0 0x7f9fd819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.275+0000 7f9fde15f700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fd8103320 0x7f9fd8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fdd95e700 1 -- 172.21.15.60:0/2964002208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd819dde0 msgr2=0x7f9fd819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd819dde0 0x7f9fd819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fdd95e700 1 -- 172.21.15.60:0/2964002208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fd8103320 msgr2=0x7f9fd8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fd8103320 0x7f9fd8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fdd95e700 1 -- 172.21.15.60:0/2964002208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc80095f0 con 0x7f9fd8108440 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 0x7f9fd8199770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80059d0 tx=0x7f9fc8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fcf7fe700 1 -- 172.21.15.60:0/2964002208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc801d070 con 0x7f9fd8108440 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd81a6090 con 0x7f9fd8108440 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fcf7fe700 1 -- 172.21.15.60:0/2964002208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fc8022470 con 0x7f9fd8108440 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.276+0000 7f9fcf7fe700 1 -- 172.21.15.60:0/2964002208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8017650 con 0x7f9fd8108440 2023-10-05T15:26:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.277+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd81a6510 con 0x7f9fd8108440 2023-10-05T15:26:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.278+0000 7f9fcf7fe700 1 -- 172.21.15.60:0/2964002208 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9fc8022850 con 0x7f9fd8108440 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.279+0000 7f9fcf7fe700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fc40a15f0 0x7f9fc40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.279+0000 7f9fcf7fe700 1 -- 172.21.15.60:0/2964002208 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f9fc80ce850 con 0x7f9fd8108440 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.279+0000 7f9fde15f700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fc40a15f0 0x7f9fc40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.280+0000 7f9fde15f700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fc40a15f0 0x7f9fc40a3ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009c60 tx=0x7f9fd4009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 Processor -- start 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 -- start start 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d021a400 con 0x5617d02b1520 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d020bbc0 con 0x5617d02bc3d0 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.281+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d02094e0 con 0x5617d02b0c00 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55166/0 (socket says 172.21.15.60:55166) 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 -- 172.21.15.60:0/2813427623 learned_addr learned my addr 172.21.15.60:0/2813427623 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde960700 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 -- 172.21.15.60:0/2813427623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 msgr2=0x5617d02be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02be7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 -- 172.21.15.60:0/2813427623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 msgr2=0x5617d02bbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 -- 172.21.15.60:0/2813427623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617d002fd80 con 0x5617d02b0c00 2023-10-05T15:26:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:26:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fde15f700 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02b0fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e4e0 tx=0x7f9fd4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4871fcbd4549168a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.282+0000 7f9fccd82700 1 -- 172.21.15.60:0/2813427623 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400ee00 con 0x5617d02b0c00 2023-10-05T15:26:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fccd82700 1 -- 172.21.15.60:0/2813427623 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fd4021070 con 0x5617d02b0c00 2023-10-05T15:26:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fccd82700 1 -- 172.21.15.60:0/2813427623 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd401d7b0 con 0x5617d02b0c00 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 -- 172.21.15.60:0/2813427623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 msgr2=0x5617d02b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02b0fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e4e0 tx=0x7f9fd4014000 comp rx=0 tx=0).stop 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 -- 172.21.15.60:0/2813427623 shutdown_connections 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02b0fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/2813427623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.283+0000 7f9fec5adb80 1 -- 172.21.15.60:0/2813427623 >> 172.21.15.60:0/2813427623 conn(0x5617d0226200 msgr2=0x5617d02ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.284+0000 7f9fec5adb80 1 -- 172.21.15.60:0/2813427623 shutdown_connections 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.284+0000 7f9fec5adb80 1 -- 172.21.15.60:0/2813427623 wait complete. 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.284+0000 7f9fec5adb80 1 -- start start 2023-10-05T15:26:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.284+0000 7f9fec5adb80 1 Processor -- start 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d0204dd0 con 0x5617d02b1520 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d01a16b0 con 0x5617d02bc3d0 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d01a1350 con 0x5617d02b0c00 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fec5adb80 10 client.0 _ll_register_callbacks cb 0x5617cfffe7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02bbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55170/0 (socket says 172.21.15.60:55170) 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 -- 172.21.15.60:0/3512049004 learned_addr learned my addr 172.21.15.60:0/3512049004 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 -- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 msgr2=0x5617d02b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 -- 172.21.15.60:0/3512049004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 msgr2=0x5617d02b90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.285+0000 7f9fde15f700 1 -- 172.21.15.60:0/3512049004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd81a6510 con 0x5617d02b0c00 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.286+0000 7f9fde15f700 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02bbe50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005950 tx=0x7f9fd400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9eebac6489b1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.286+0000 7f9fc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.286+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/3512049004 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4005410 con 0x5617d02b0c00 2023-10-05T15:26:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.286+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617d02a4d50 con 0x5617d02b0c00 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.287+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/3512049004 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f9fd4005570 con 0x5617d02b0c00 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.287+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/3512049004 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd4035730 con 0x5617d02b0c00 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.287+0000 7f9fec5adb80 10 client.26395 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.287+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f9fd4017070 con 0x5617d02b0c00 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.287+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/3512049004 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5617d02a4d50 con 0x5617d02b0c00 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/3512049004 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f9fd4003710 con 0x5617d02b0c00 2023-10-05T15:26:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fec5adb80 10 client.26395 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fec5adb80 10 client.26395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fec5adb80 20 client.26395 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02c2ec0 0x5617d02c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fec5adb80 4 client.26395 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617d01fddb0 con 0x5617d02c2ec0 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02c2ec0 0x5617d02c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fc1ffb700 10 client.26395 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.288+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02c2ec0 0x5617d02c52e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3694aab05a5263ce server_cookie=40d63b7ade5e2a03 in_seq=0 out_seq=0 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.290+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/3512049004 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5617d01fddb0 con 0x5617d02c2ec0 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.290+0000 7f9fc1ffb700 10 client.26395 handle_command_reply: tid=0 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.290+0000 7f9fec5adb80 1 client.26395 shutdown 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.290+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 msgr2=0x5617d02bbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.290+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02bbe50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005950 tx=0x7f9fd400edf0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 shutdown_connections 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02c2ec0 0x5617d02c52e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02bc3d0 0x5617d02b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02b0c00 0x5617d02bbe50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fc1ffb700 0 client.26395 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/3512049004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.291+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 >> 172.21.15.60:0/3512049004 conn(0x5617d0226200 msgr2=0x5617d02acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.296+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 shutdown_connections 2023-10-05T15:26:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.296+0000 7f9fec5adb80 1 -- 172.21.15.60:0/3512049004 wait complete. 2023-10-05T15:26:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.299+0000 7f9fec5adb80 20 client.26395 trim_cache size 0 max 16384 2023-10-05T15:26:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 Processor -- start 2023-10-05T15:26:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 -- start start 2023-10-05T15:26:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02b0c00 0x5617d02be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 0x5617d02b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d00858c0 con 0x5617d02b1520 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d02b1960 con 0x5617d02b0c00 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.324+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d02ba6b0 con 0x5617d02bc3d0 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 0x5617d02b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 0x5617d02b88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55178/0 (socket says 172.21.15.60:55178) 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 -- 172.21.15.60:0/4220556075 learned_addr learned my addr 172.21.15.60:0/4220556075 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 -- 172.21.15.60:0/4220556075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02b0c00 msgr2=0x5617d02be7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02b0c00 0x5617d02be7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 -- 172.21.15.60:0/4220556075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 msgr2=0x5617d02bb9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bb9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 -- 172.21.15.60:0/4220556075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617d0018c00 con 0x5617d02bc3d0 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fde960700 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 0x5617d02b88b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00099f0 tx=0x7f9fd0009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd3e44fa115516d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fcd583700 1 -- 172.21.15.60:0/4220556075 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0004db0 con 0x5617d02bc3d0 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.325+0000 7f9fcd583700 1 -- 172.21.15.60:0/4220556075 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fd000f040 con 0x5617d02bc3d0 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fcd583700 1 -- 172.21.15.60:0/4220556075 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007cf0 con 0x5617d02bc3d0 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 -- 172.21.15.60:0/4220556075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 msgr2=0x5617d02b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 0x5617d02b88b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00099f0 tx=0x7f9fd0009a20 comp rx=0 tx=0).stop 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 -- 172.21.15.60:0/4220556075 shutdown_connections 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02bc3d0 0x5617d02b88b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02b0c00 0x5617d02be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/4220556075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02b1520 0x5617d02bb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.326+0000 7f9fec5adb80 1 -- 172.21.15.60:0/4220556075 >> 172.21.15.60:0/4220556075 conn(0x5617d0226200 msgr2=0x5617d02bf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.328+0000 7f9fec5adb80 1 -- 172.21.15.60:0/4220556075 shutdown_connections 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.328+0000 7f9fec5adb80 1 -- 172.21.15.60:0/4220556075 wait complete. 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 -- start start 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 Processor -- start 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 0x5617d02c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02c80c0 0x5617d02c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02c8a60 0x5617d02da690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d02dabd0 con 0x5617d02bc3d0 2023-10-05T15:26:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d02dad40 con 0x5617d02c8a60 2023-10-05T15:26:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617d02daf00 con 0x5617d02c80c0 2023-10-05T15:26:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.329+0000 7f9fec5adb80 10 client.0 _ll_register_callbacks cb 0x7f9fd400e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 0x5617d02c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 0x5617d02c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41650/0 (socket says 172.21.15.60:41650) 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 -- 172.21.15.60:0/1485043834 learned_addr learned my addr 172.21.15.60:0/1485043834 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 -- 172.21.15.60:0/1485043834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02c80c0 msgr2=0x5617d02c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02c80c0 0x5617d02c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 -- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02c8a60 msgr2=0x5617d02da690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02c8a60 0x5617d02da690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 -- 172.21.15.60:0/1485043834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd0003d40 con 0x5617d02bc3d0 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fde15f700 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 0x5617d02c9c90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4014040 tx=0x7f9fd400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553ac64d367858ed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.330+0000 7f9fc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:26:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/1485043834 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4011ab0 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fd4021070 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/1485043834 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f9fd4003890 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/1485043834 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd40352b0 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 10 client.16878 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5617d00561f0 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/1485043834 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fd4021070 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/1485043834 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f9fd4005410 con 0x5617d02bc3d0 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 10 client.16878 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 10 client.16878 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 20 client.16878 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02dc3f0 0x5617d02de810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 4 client.16878 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:26:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.331+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5617d01fdad0 con 0x5617d02dc3f0 2023-10-05T15:26:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.335+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02dc3f0 0x5617d02de810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.336+0000 7f9fdd95e700 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02dc3f0 0x5617d02de810 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4d444b64487b4df server_cookie=8c8d48f86d309d0c in_seq=0 out_seq=0 2023-10-05T15:26:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.338+0000 7f9fc1ffb700 10 client.16878 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.395+0000 7f9fc1ffb700 1 -- 172.21.15.60:0/1485043834 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5617d01fdad0 con 0x5617d02dc3f0 2023-10-05T15:26:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.395+0000 7f9fc1ffb700 10 client.16878 handle_command_reply: tid=0 2023-10-05T15:26:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.395+0000 7f9fec5adb80 1 client.16878 shutdown 2023-10-05T15:26:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.401+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 msgr2=0x5617d02c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.401+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 0x5617d02c9c90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4014040 tx=0x7f9fd400ec70 comp rx=0 tx=0).stop 2023-10-05T15:26:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 shutdown_connections 2023-10-05T15:26:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5617d02dc3f0 0x5617d02de810 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617d02c8a60 0x5617d02da690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617d02bc3d0 0x5617d02c9c90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fec5adb80 1 --2- 172.21.15.60:0/1485043834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617d02c80c0 0x5617d02c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 >> 172.21.15.60:0/1485043834 conn(0x5617d0226200 msgr2=0x5617d02ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.403+0000 7f9fc1ffb700 0 client.16878 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.413+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 shutdown_connections 2023-10-05T15:26:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.419+0000 7f9fec5adb80 1 -- 172.21.15.60:0/1485043834 wait complete. 2023-10-05T15:26:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.422+0000 7f9fec5adb80 20 client.16878 trim_cache size 0 max 16384 2023-10-05T15:26:42.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:26:42.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:26:42.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:26:42.425 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:26:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.430+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fc40a15f0 msgr2=0x7f9fc40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.430+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fc40a15f0 0x7f9fc40a3ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009c60 tx=0x7f9fd4009260 comp rx=0 tx=0).stop 2023-10-05T15:26:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.430+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 msgr2=0x7f9fd8199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.430+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 0x7f9fd8199770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80059d0 tx=0x7f9fc8005740 comp rx=0 tx=0).stop 2023-10-05T15:26:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.435+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 shutdown_connections 2023-10-05T15:26:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.435+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd819dde0 0x7f9fd819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.435+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f9fc40a15f0 0x7f9fc40a3ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.435+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fd8103320 0x7f9fd8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.435+0000 7f9fe03c3700 1 --2- 172.21.15.60:0/2964002208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8108440 0x7f9fd8199770 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.435+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 >> 172.21.15.60:0/2964002208 conn(0x7f9fd80feb60 msgr2=0x7f9fd8106d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.442+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 shutdown_connections 2023-10-05T15:26:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:42.442+0000 7f9fe03c3700 1 -- 172.21.15.60:0/2964002208 wait complete. 2023-10-05T15:26:42.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:42 smithi135 ceph-mon[103360]: pgmap v311: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 1.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 720 KiB/s wr, 192 op/s 2023-10-05T15:26:42.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:42 smithi060 ceph-mon[99238]: pgmap v311: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 1.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 720 KiB/s wr, 192 op/s 2023-10-05T15:26:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:42 smithi092 ceph-mon[102944]: pgmap v311: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 1.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 720 KiB/s wr, 192 op/s 2023-10-05T15:26:45.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:45 smithi135 ceph-mon[103360]: pgmap v312: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 254 op/s 2023-10-05T15:26:45.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:45 smithi060 ceph-mon[99238]: pgmap v312: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 254 op/s 2023-10-05T15:26:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:45 smithi092 ceph-mon[102944]: pgmap v312: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 254 op/s 2023-10-05T15:26:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:47 smithi135 ceph-mon[103360]: pgmap v313: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 224 op/s 2023-10-05T15:26:47.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:47 smithi135 ceph-mon[103360]: osdmap e104: 12 total, 12 up, 12 in 2023-10-05T15:26:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:47 smithi060 ceph-mon[99238]: pgmap v313: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 224 op/s 2023-10-05T15:26:47.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:47 smithi060 ceph-mon[99238]: osdmap e104: 12 total, 12 up, 12 in 2023-10-05T15:26:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:47 smithi092 ceph-mon[102944]: pgmap v313: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 224 op/s 2023-10-05T15:26:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:47 smithi092 ceph-mon[102944]: osdmap e104: 12 total, 12 up, 12 in 2023-10-05T15:26:49.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:49 smithi135 ceph-mon[103360]: pgmap v315: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 947 KiB/s wr, 196 op/s 2023-10-05T15:26:49.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:49 smithi060 ceph-mon[99238]: pgmap v315: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 947 KiB/s wr, 196 op/s 2023-10-05T15:26:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:49 smithi092 ceph-mon[102944]: pgmap v315: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 947 KiB/s wr, 196 op/s 2023-10-05T15:26:51.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:51 smithi135 ceph-mon[103360]: pgmap v316: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 187 op/s 2023-10-05T15:26:51.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:51 smithi060 ceph-mon[99238]: pgmap v316: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 187 op/s 2023-10-05T15:26:51.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:51 smithi092 ceph-mon[102944]: pgmap v316: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 187 op/s 2023-10-05T15:26:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:52 smithi135 ceph-mon[103360]: osdmap e105: 12 total, 12 up, 12 in 2023-10-05T15:26:52.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:52 smithi135 ceph-mon[103360]: pgmap v318: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 718 KiB/s wr, 117 op/s 2023-10-05T15:26:52.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:52 smithi060 ceph-mon[99238]: osdmap e105: 12 total, 12 up, 12 in 2023-10-05T15:26:52.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:52 smithi060 ceph-mon[99238]: pgmap v318: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 718 KiB/s wr, 117 op/s 2023-10-05T15:26:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:52 smithi092 ceph-mon[102944]: osdmap e105: 12 total, 12 up, 12 in 2023-10-05T15:26:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:52 smithi092 ceph-mon[102944]: pgmap v318: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 718 KiB/s wr, 117 op/s 2023-10-05T15:26:55.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:55 smithi135 ceph-mon[103360]: pgmap v319: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 176 op/s 2023-10-05T15:26:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/1561981632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc101a70 msgr2=0x7fd5bc105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/1561981632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc101a70 0x7fd5bc105ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009990 tx=0x7fd5a8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/1561981632 shutdown_connections 2023-10-05T15:26:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/1561981632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5bc1061e0 0x7fd5bc10dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/1561981632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc1010c0 0x7fd5bc1014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/1561981632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc101a70 0x7fd5bc105ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/1561981632 >> 172.21.15.60:0/1561981632 conn(0x7fd5bc0fc940 msgr2=0x7fd5bc0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/1561981632 shutdown_connections 2023-10-05T15:26:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.619+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/1561981632 wait complete. 2023-10-05T15:26:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.620+0000 7fd5c2fd1700 1 Processor -- start 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 -- start start 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc1010c0 0x7fd5bc1a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5bc1061e0 0x7fd5bc1a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 0x7fd5bc10d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc10d5f0 con 0x7fd5bc1061e0 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc10d760 con 0x7fd5bc1010c0 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c2fd1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc10d920 con 0x7fd5bc10cba0 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 0x7fd5bc10d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 0x7fd5bc10d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55196/0 (socket says 172.21.15.60:55196) 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.621+0000 7fd5c156e700 1 -- 172.21.15.60:0/2099558211 learned_addr learned my addr 172.21.15.60:0/2099558211 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c156e700 1 -- 172.21.15.60:0/2099558211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc1010c0 msgr2=0x7fd5bc1a2510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:26:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c156e700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc1010c0 0x7fd5bc1a2510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c156e700 1 -- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5bc1061e0 msgr2=0x7fd5bc1a2a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:26:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c156e700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5bc1061e0 0x7fd5bc1a2a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c156e700 1 -- 172.21.15.60:0/2099558211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4009c40 con 0x7fd5bc10cba0 2023-10-05T15:26:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c156e700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 0x7fd5bc10d020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c370 tx=0x7fd5b400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5b9ffb700 1 -- 172.21.15.60:0/2099558211 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4017070 con 0x7fd5bc10cba0 2023-10-05T15:26:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5b9ffb700 1 -- 172.21.15.60:0/2099558211 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5b400f040 con 0x7fd5bc10cba0 2023-10-05T15:26:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a80095f0 con 0x7fd5bc10cba0 2023-10-05T15:26:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5b9ffb700 1 -- 172.21.15.60:0/2099558211 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400e050 con 0x7fd5bc10cba0 2023-10-05T15:26:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.622+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc1aa7f0 con 0x7fd5bc10cba0 2023-10-05T15:26:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.625+0000 7fd5b9ffb700 1 -- 172.21.15.60:0/2099558211 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd5b4004520 con 0x7fd5bc10cba0 2023-10-05T15:26:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.626+0000 7fd5b9ffb700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd5ac0a15f0 0x7fd5ac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.626+0000 7fd5b9ffb700 1 -- 172.21.15.60:0/2099558211 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9359+0+0 (secure 0 0 0) 0x7fd5b40cce60 con 0x7fd5bc10cba0 2023-10-05T15:26:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.626+0000 7fd5c0d6d700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd5ac0a15f0 0x7fd5ac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.627+0000 7fd5c0d6d700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd5ac0a15f0 0x7fd5ac0a3ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009af0 tx=0x7fd5b0009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.636+0000 7fd5cf1bbb80 1 Processor -- start 2023-10-05T15:26:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.639+0000 7fd5cf1bbb80 1 -- start start 2023-10-05T15:26:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 0x56410cb0bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0c520 0x56410cb16e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb197c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410ca75400 con 0x56410cb0bc00 2023-10-05T15:26:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410ca66bc0 con 0x56410cb173d0 2023-10-05T15:26:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410ca644e0 con 0x56410cb0c520 2023-10-05T15:26:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55092/0 (socket says 172.21.15.60:55092) 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.640+0000 7fd5c156e700 1 -- 172.21.15.60:0/2488184294 learned_addr learned my addr 172.21.15.60:0/2488184294 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5c156e700 1 -- 172.21.15.60:0/2488184294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0c520 msgr2=0x56410cb16e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5c156e700 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0c520 0x56410cb16e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5c156e700 1 -- 172.21.15.60:0/2488184294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 msgr2=0x56410cb0bfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5c156e700 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 0x56410cb0bfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5c156e700 1 -- 172.21.15.60:0/2488184294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56410c88ad80 con 0x56410cb173d0 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5c156e700 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb197c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4096570 tx=0x7fd5b4099a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7108e5563a2b4c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5a6ffd700 1 -- 172.21.15.60:0/2488184294 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4099b00 con 0x56410cb173d0 2023-10-05T15:26:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5a6ffd700 1 -- 172.21.15.60:0/2488184294 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5b409dc50 con 0x56410cb173d0 2023-10-05T15:26:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.641+0000 7fd5a6ffd700 1 -- 172.21.15.60:0/2488184294 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4099fc0 con 0x56410cb173d0 2023-10-05T15:26:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.642+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2488184294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 msgr2=0x56410cb197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.642+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb197c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4096570 tx=0x7fd5b4099a00 comp rx=0 tx=0).stop 2023-10-05T15:26:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2488184294 shutdown_connections 2023-10-05T15:26:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb197c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 0x56410cb0bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2488184294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0c520 0x56410cb16e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2488184294 >> 172.21.15.60:0/2488184294 conn(0x56410ca81200 msgr2=0x56410cb08080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2488184294 shutdown_connections 2023-10-05T15:26:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.644+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2488184294 wait complete. 2023-10-05T15:26:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.645+0000 7fd5cf1bbb80 1 -- start start 2023-10-05T15:26:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.645+0000 7fd5cf1bbb80 1 Processor -- start 2023-10-05T15:26:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 0x56410cb16e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb173d0 0x56410cb14820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410ca5fdd0 con 0x56410cb0bc00 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410c9fc6b0 con 0x56410cb0c520 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410c9fc350 con 0x56410cb173d0 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5cf1bbb80 10 client.0 _ll_register_callbacks cb 0x56410c8597a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5bbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5bbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55096/0 (socket says 172.21.15.60:55096) 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5bbfff700 1 -- 172.21.15.60:0/3516033407 learned_addr learned my addr 172.21.15.60:0/3516033407 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5bbfff700 1 -- 172.21.15.60:0/3516033407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb173d0 msgr2=0x56410cb14820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb173d0 0x56410cb14820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.647+0000 7fd5bbfff700 1 -- 172.21.15.60:0/3516033407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 msgr2=0x56410cb16e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.648+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 0x56410cb16e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.648+0000 7fd5bbfff700 1 -- 172.21.15.60:0/3516033407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc1aa7f0 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.648+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb140e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80059d0 tx=0x7fd5a8009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f26749eef033c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.648+0000 7fd59ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.648+0000 7fd59ffff700 1 -- 172.21.15.60:0/3516033407 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a801d070 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.648+0000 7fd59ffff700 1 -- 172.21.15.60:0/3516033407 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9359+0+0 (secure 0 0 0) 0x7fd5a800f670 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.649+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56410caffd50 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.649+0000 7fd59ffff700 1 -- 172.21.15.60:0/3516033407 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5a8004830 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.649+0000 7fd5cf1bbb80 10 client.26543 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.649+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56410c873c00 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.649+0000 7fd59ffff700 1 -- 172.21.15.60:0/3516033407 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56410caffd50 con 0x56410cb0c520 2023-10-05T15:26:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.650+0000 7fd59ffff700 1 -- 172.21.15.60:0/3516033407 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fd5a8021710 con 0x56410cb0c520 2023-10-05T15:26:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5cf1bbb80 10 client.26543 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5cf1bbb80 10 client.26543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5cf1bbb80 20 client.26543 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb38030 0x56410cb3a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5cf1bbb80 4 client.26543 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:26:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56410ca58db0 con 0x56410cb38030 2023-10-05T15:26:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.653+0000 7fd5c0d6d700 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb38030 0x56410cb3a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.654+0000 7fd5c0d6d700 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb38030 0x56410cb3a450 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cd90da388b94d10 server_cookie=e723d41d25e9e69c in_seq=0 out_seq=0 2023-10-05T15:26:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.654+0000 7fd59ffff700 10 client.26543 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.662+0000 7fd59ffff700 1 -- 172.21.15.60:0/3516033407 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56410ca58db0 con 0x56410cb38030 2023-10-05T15:26:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.662+0000 7fd59ffff700 10 client.26543 handle_command_reply: tid=0 2023-10-05T15:26:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.662+0000 7fd5cf1bbb80 1 client.26543 shutdown 2023-10-05T15:26:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.662+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 msgr2=0x56410cb140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.662+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb140e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80059d0 tx=0x7fd5a8009580 comp rx=0 tx=0).stop 2023-10-05T15:26:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 shutdown_connections 2023-10-05T15:26:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb38030 0x56410cb3a450 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:55 smithi060 ceph-mon[99238]: pgmap v319: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 176 op/s 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb173d0 0x56410cb14820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0bc00 0x56410cb16e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd59ffff700 0 client.26543 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3516033407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb140e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 >> 172.21.15.60:0/3516033407 conn(0x56410ca81200 msgr2=0x56410cb07c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 shutdown_connections 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3516033407 wait complete. 2023-10-05T15:26:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.663+0000 7fd5cf1bbb80 20 client.26543 trim_cache size 0 max 16384 2023-10-05T15:26:55.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:55 smithi092 ceph-mon[102944]: pgmap v319: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 176 op/s 2023-10-05T15:26:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 Processor -- start 2023-10-05T15:26:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 -- start start 2023-10-05T15:26:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb0eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0c520 0x56410cb1df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb07960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410c8e08c0 con 0x56410cb0c520 2023-10-05T15:26:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410cb0ce20 con 0x56410cb173d0 2023-10-05T15:26:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.691+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410cb08dc0 con 0x56410cb0bc00 2023-10-05T15:26:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.693+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb07960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.693+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb07960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55104/0 (socket says 172.21.15.60:55104) 2023-10-05T15:26:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.693+0000 7fd5c156e700 1 -- 172.21.15.60:0/2170366298 learned_addr learned my addr 172.21.15.60:0/2170366298 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.694+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0c520 0x56410cb1df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.694+0000 7fd5bbfff700 1 -- 172.21.15.60:0/2170366298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 msgr2=0x56410cb0eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.694+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb0eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.694+0000 7fd5bbfff700 1 -- 172.21.15.60:0/2170366298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 msgr2=0x56410cb07960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.694+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb07960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.694+0000 7fd5bbfff700 1 -- 172.21.15.60:0/2170366298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56410c8b11f0 con 0x56410cb0c520 2023-10-05T15:26:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.695+0000 7fd5bbfff700 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0c520 0x56410cb1df20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8021b20 tx=0x7fd5a8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c31d373a59bda1b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.695+0000 7fd5a77fe700 1 -- 172.21.15.60:0/2170366298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a801d040 con 0x56410cb0c520 2023-10-05T15:26:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.695+0000 7fd5a77fe700 1 -- 172.21.15.60:0/2170366298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5a8005bc0 con 0x56410cb0c520 2023-10-05T15:26:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.695+0000 7fd5a77fe700 1 -- 172.21.15.60:0/2170366298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8005070 con 0x56410cb0c520 2023-10-05T15:26:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.696+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2170366298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0c520 msgr2=0x56410cb1df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.696+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0c520 0x56410cb1df20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8021b20 tx=0x7fd5a8009290 comp rx=0 tx=0).stop 2023-10-05T15:26:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.699+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2170366298 shutdown_connections 2023-10-05T15:26:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.699+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb173d0 0x56410cb07960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.699+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb0eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.699+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/2170366298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb0c520 0x56410cb1df20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.699+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2170366298 >> 172.21.15.60:0/2170366298 conn(0x56410ca81200 msgr2=0x56410cb07250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.701+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2170366298 shutdown_connections 2023-10-05T15:26:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.702+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/2170366298 wait complete. 2023-10-05T15:26:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.702+0000 7fd5cf1bbb80 1 -- start start 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.702+0000 7fd5cf1bbb80 1 Processor -- start 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb87260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb173d0 0x56410cb1ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410cb1c180 con 0x56410cb173d0 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410cb1c2f0 con 0x56410cb0c520 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410cb1c4b0 con 0x56410cb0bc00 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5cf1bbb80 10 client.0 _ll_register_callbacks cb 0x7fd5b40097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c0d6d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb87260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c156e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb173d0 0x56410cb1ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c0d6d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb87260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55216/0 (socket says 172.21.15.60:55216) 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c0d6d700 1 -- 172.21.15.60:0/3467575205 learned_addr learned my addr 172.21.15.60:0/3467575205 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c156e700 1 -- 172.21.15.60:0/3467575205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 msgr2=0x56410cb87260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c156e700 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb87260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c156e700 1 -- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 msgr2=0x56410cb877a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c156e700 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb877a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.703+0000 7fd5c156e700 1 -- 172.21.15.60:0/3467575205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56410c873c00 con 0x56410cb173d0 2023-10-05T15:26:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.704+0000 7fd5c156e700 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb173d0 0x56410cb1ba70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40ca870 tx=0x7fd5b400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796c9b792cf5e26b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.704+0000 7fd59ffff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:26:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.704+0000 7fd59ffff700 1 -- 172.21.15.60:0/3467575205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40a1e90 con 0x56410cb173d0 2023-10-05T15:26:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.704+0000 7fd59ffff700 1 -- 172.21.15.60:0/3467575205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9359+0+0 (secure 0 0 0) 0x7fd5b4099200 con 0x56410cb173d0 2023-10-05T15:26:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56410ca58ad0 con 0x56410cb173d0 2023-10-05T15:26:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd59ffff700 1 -- 172.21.15.60:0/3467575205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5b40b2250 con 0x56410cb173d0 2023-10-05T15:26:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 10 client.16887 fetch_fsmap learned FSMap version 43 2023-10-05T15:26:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56410c889250 con 0x56410cb173d0 2023-10-05T15:26:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd59ffff700 1 -- 172.21.15.60:0/3467575205 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56410ca58ad0 con 0x56410cb173d0 2023-10-05T15:26:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd59ffff700 1 -- 172.21.15.60:0/3467575205 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fd5b4004c60 con 0x56410cb173d0 2023-10-05T15:26:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 10 client.16887 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:26:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 20 client.16887 populate_metadata read hostname 'smithi060' 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb9dcc0 0x56410cba00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 4 client.16887 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.708+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56410c8abf10 con 0x56410cb9dcc0 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.709+0000 7fd5c0d6d700 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb9dcc0 0x56410cba00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.711+0000 7fd59ffff700 10 client.16887 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.711+0000 7fd5c0d6d700 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb9dcc0 0x56410cba00e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78dd9f50d89844a3 server_cookie=43360bb0959bfe0f in_seq=0 out_seq=0 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.755+0000 7fd59ffff700 1 -- 172.21.15.60:0/3467575205 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56410c8abf10 con 0x56410cb9dcc0 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.755+0000 7fd59ffff700 10 client.16887 handle_command_reply: tid=0 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.755+0000 7fd5cf1bbb80 1 client.16887 shutdown 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.755+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb173d0 msgr2=0x56410cb1ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.755+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb173d0 0x56410cb1ba70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40ca870 tx=0x7fd5b400cf80 comp rx=0 tx=0).stop 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 shutdown_connections 2023-10-05T15:26:55.758 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x56410cb9dcc0 0x56410cba00e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56410cb173d0 0x56410cb1ba70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd59ffff700 0 client.16887 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56410cb0bc00 0x56410cb87260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 --2- 172.21.15.60:0/3467575205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56410cb0c520 0x56410cb877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 >> 172.21.15.60:0/3467575205 conn(0x56410ca81200 msgr2=0x56410cb07ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 shutdown_connections 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 1 -- 172.21.15.60:0/3467575205 wait complete. 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.756+0000 7fd5cf1bbb80 20 client.16887 trim_cache size 0 max 16384 2023-10-05T15:26:55.759 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:26:55.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:26:55.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:26:55.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:26:55.760 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd5ac0a15f0 msgr2=0x7fd5ac0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd5ac0a15f0 0x7fd5ac0a3ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009af0 tx=0x7fd5b0009260 comp rx=0 tx=0).stop 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 msgr2=0x7fd5bc10d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 0x7fd5bc10d020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c370 tx=0x7fd5b400c730 comp rx=0 tx=0).stop 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 shutdown_connections 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5bc10cba0 0x7fd5bc10d020 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd5ac0a15f0 0x7fd5ac0a3ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc1010c0 0x7fd5bc1a2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 --2- 172.21.15.60:0/2099558211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5bc1061e0 0x7fd5bc1a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 >> 172.21.15.60:0/2099558211 conn(0x7fd5bc0fc940 msgr2=0x7fd5bc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.761 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 shutdown_connections 2023-10-05T15:26:55.762 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:26:55.757+0000 7fd5c2fd1700 1 -- 172.21.15.60:0/2099558211 wait complete. 2023-10-05T15:26:57.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:57 smithi135 ceph-mon[103360]: pgmap v320: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2023-10-05T15:26:57.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:57 smithi060 ceph-mon[99238]: pgmap v320: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2023-10-05T15:26:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:57 smithi092 ceph-mon[102944]: pgmap v320: 129 pgs: 129 active+clean; 1.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2023-10-05T15:26:59.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:26:59 smithi135 ceph-mon[103360]: pgmap v321: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-10-05T15:26:59.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:26:59 smithi060 ceph-mon[99238]: pgmap v321: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-10-05T15:26:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:26:59 smithi092 ceph-mon[102944]: pgmap v321: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-10-05T15:27:01.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:01 smithi135 ceph-mon[103360]: pgmap v322: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-10-05T15:27:01.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:01 smithi060 ceph-mon[99238]: pgmap v322: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-10-05T15:27:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:01 smithi092 ceph-mon[102944]: pgmap v322: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-10-05T15:27:02.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:02 smithi135 ceph-mon[103360]: pgmap v323: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 211 op/s 2023-10-05T15:27:02.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:02 smithi060 ceph-mon[99238]: pgmap v323: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 211 op/s 2023-10-05T15:27:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:02 smithi092 ceph-mon[102944]: pgmap v323: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 211 op/s 2023-10-05T15:27:05.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:05 smithi135 ceph-mon[103360]: pgmap v324: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-10-05T15:27:05.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:05 smithi060 ceph-mon[99238]: pgmap v324: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-10-05T15:27:05.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:05 smithi092 ceph-mon[102944]: pgmap v324: 129 pgs: 129 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-10-05T15:27:07.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:07 smithi135 ceph-mon[103360]: pgmap v325: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 251 op/s 2023-10-05T15:27:07.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:07 smithi060 ceph-mon[99238]: pgmap v325: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 251 op/s 2023-10-05T15:27:07.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:07 smithi092 ceph-mon[102944]: pgmap v325: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 251 op/s 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.963+0000 7f904b899700 1 -- 172.21.15.60:0/3932735430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904410fa90 msgr2=0x7f90441083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.963+0000 7f904b899700 1 --2- 172.21.15.60:0/3932735430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904410fa90 0x7f90441083f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f90400098f0 tx=0x7f9040009c00 comp rx=0 tx=0).stop 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.964+0000 7f904b899700 1 -- 172.21.15.60:0/3932735430 shutdown_connections 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.964+0000 7f904b899700 1 --2- 172.21.15.60:0/3932735430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f904411a690 0x7f904411ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.964+0000 7f904b899700 1 --2- 172.21.15.60:0/3932735430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f904410f620 0x7f9044107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.964+0000 7f904b899700 1 --2- 172.21.15.60:0/3932735430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904410fa90 0x7f90441083f0 secure :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f90400098f0 tx=0x7f9040009c00 comp rx=0 tx=0).stop 2023-10-05T15:27:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.964+0000 7f904b899700 1 -- 172.21.15.60:0/3932735430 >> 172.21.15.60:0/3932735430 conn(0x7f904406cfa0 msgr2=0x7f904406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.969+0000 7f904b899700 1 -- 172.21.15.60:0/3932735430 shutdown_connections 2023-10-05T15:27:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.969+0000 7f904b899700 1 -- 172.21.15.60:0/3932735430 wait complete. 2023-10-05T15:27:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.970+0000 7f904b899700 1 Processor -- start 2023-10-05T15:27:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.970+0000 7f904b899700 1 -- start start 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f904b899700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 0x7f9044118e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f904b899700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9044111c00 0x7f9044112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f904b899700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90441125c0 0x7f9044116990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f904b899700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044119530 con 0x7f904411a690 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f904b899700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044116f00 con 0x7f90441125c0 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f904b899700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90441170c0 con 0x7f9044111c00 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 0x7f9044118e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 0x7f9044118e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41696/0 (socket says 172.21.15.60:41696) 2023-10-05T15:27:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 -- 172.21.15.60:0/3062647933 learned_addr learned my addr 172.21.15.60:0/3062647933 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 -- 172.21.15.60:0/3062647933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9044111c00 msgr2=0x7f9044112080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:27:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9044111c00 0x7f9044112080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 -- 172.21.15.60:0/3062647933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90441125c0 msgr2=0x7f9044116990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:27:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90441125c0 0x7f9044116990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.971+0000 7f9049635700 1 -- 172.21.15.60:0/3062647933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009520 con 0x7f904411a690 2023-10-05T15:27:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.972+0000 7f9049635700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 0x7f9044118e00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f903400b450 tx=0x7f903400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.972+0000 7f903a7fc700 1 -- 172.21.15.60:0/3062647933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034011630 con 0x7f904411a690 2023-10-05T15:27:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.972+0000 7f903a7fc700 1 -- 172.21.15.60:0/3062647933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9034011c50 con 0x7f904411a690 2023-10-05T15:27:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.972+0000 7f903a7fc700 1 -- 172.21.15.60:0/3062647933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034010cb0 con 0x7f904411a690 2023-10-05T15:27:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.972+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90441173a0 con 0x7f904411a690 2023-10-05T15:27:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.973+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90441bc350 con 0x7f904411a690 2023-10-05T15:27:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.980+0000 7f9057a83b80 1 Processor -- start 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.982+0000 7f903a7fc700 1 -- 172.21.15.60:0/3062647933 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9034011790 con 0x7f904411a690 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.983+0000 7f903a7fc700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f90300a1670 0x7f90300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.983+0000 7f903a7fc700 1 -- 172.21.15.60:0/3062647933 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f90340ccb30 con 0x7f904411a690 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.983+0000 7f9057a83b80 1 -- start start 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 0x55f7a95b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b5520 0x55f7a95bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95c03d0 0x55f7a95c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9057a83b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a951e400 con 0x55f7a95b4c00 2023-10-05T15:27:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9057a83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a950fbc0 con 0x55f7a95b5520 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9057a83b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a950d4e0 con 0x55f7a95c03d0 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 0x55f7a95b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 0x55f7a95b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41700/0 (socket says 172.21.15.60:41700) 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 -- 172.21.15.60:0/3230450684 learned_addr learned my addr 172.21.15.60:0/3230450684 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 -- 172.21.15.60:0/3230450684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95c03d0 msgr2=0x55f7a95c27c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95c03d0 0x55f7a95c27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 -- 172.21.15.60:0/3230450684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b5520 msgr2=0x55f7a95bfe90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b5520 0x55f7a95bfe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.984+0000 7f9049635700 1 -- 172.21.15.60:0/3230450684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a9333d80 con 0x55f7a95b4c00 2023-10-05T15:27:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.985+0000 7f9049635700 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 0x55f7a95b4fe0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9034095cf0 tx=0x7f9034011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292547497841e540 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.986+0000 7f9049e36700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f90300a1670 0x7f90300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.987+0000 7f9049e36700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f90300a1670 0x7f90300a3b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f903c0060b0 tx=0x7f903c00b040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.987+0000 7f902f7fe700 1 -- 172.21.15.60:0/3230450684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903409d940 con 0x55f7a95b4c00 2023-10-05T15:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.987+0000 7f902f7fe700 1 -- 172.21.15.60:0/3230450684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90340a1b80 con 0x55f7a95b4c00 2023-10-05T15:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.988+0000 7f902f7fe700 1 -- 172.21.15.60:0/3230450684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034010490 con 0x55f7a95b4c00 2023-10-05T15:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.990+0000 7f9057a83b80 1 -- 172.21.15.60:0/3230450684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 msgr2=0x55f7a95b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.990+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 0x55f7a95b4fe0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9034095cf0 tx=0x7f9034011dc0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.997+0000 7f9057a83b80 1 -- 172.21.15.60:0/3230450684 shutdown_connections 2023-10-05T15:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.997+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95c03d0 0x55f7a95c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.997+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b4c00 0x55f7a95b4fe0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.997+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3230450684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b5520 0x55f7a95bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:08.997+0000 7f9057a83b80 1 -- 172.21.15.60:0/3230450684 >> 172.21.15.60:0/3230450684 conn(0x55f7a952a200 msgr2=0x55f7a95b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.002+0000 7f9057a83b80 1 -- 172.21.15.60:0/3230450684 shutdown_connections 2023-10-05T15:27:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.004+0000 7f9057a83b80 1 -- 172.21.15.60:0/3230450684 wait complete. 2023-10-05T15:27:09.006 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 -- start start 2023-10-05T15:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 Processor -- start 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 0x55f7a95bd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9508dd0 con 0x55f7a95c03d0 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a94a56b0 con 0x55f7a95b4c00 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.005+0000 7f9057a83b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a94a5350 con 0x55f7a95b5520 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.006+0000 7f9057a83b80 10 client.0 _ll_register_callbacks cb 0x55f7a93027a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.006+0000 7f9049e36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.006+0000 7f9049e36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95bdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41704/0 (socket says 172.21.15.60:41704) 2023-10-05T15:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.006+0000 7f9049e36700 1 -- 172.21.15.60:0/393548026 learned_addr learned my addr 172.21.15.60:0/393548026 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 -- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 msgr2=0x55f7a95bd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 0x55f7a95bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 -- 172.21.15.60:0/393548026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 msgr2=0x55f7a95bdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95bdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 -- 172.21.15.60:0/393548026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90441bc350 con 0x55f7a95b5520 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f9048e34700 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bd7b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9040008000 tx=0x7f904000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea3c82b2ac68028 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.008+0000 7f902cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.009+0000 7f902cff9700 1 -- 172.21.15.60:0/393548026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904001c070 con 0x55f7a95b5520 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.009+0000 7f902cff9700 1 -- 172.21.15.60:0/393548026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f904000f8e0 con 0x55f7a95b5520 2023-10-05T15:27:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.009+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7a95a8d50 con 0x55f7a95b5520 2023-10-05T15:27:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.011+0000 7f902cff9700 1 -- 172.21.15.60:0/393548026 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f904000b560 con 0x55f7a95b5520 2023-10-05T15:27:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.014+0000 7f9057a83b80 10 client.26410 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.014+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55f7a931cc00 con 0x55f7a95b5520 2023-10-05T15:27:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f902cff9700 1 -- 172.21.15.60:0/393548026 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f7a95a8d50 con 0x55f7a95b5520 2023-10-05T15:27:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f902cff9700 1 -- 172.21.15.60:0/393548026 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f9040015020 con 0x55f7a95b5520 2023-10-05T15:27:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f9057a83b80 10 client.26410 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f9057a83b80 10 client.26410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f9057a83b80 20 client.26410 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f9057a83b80 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a95d0070 0x55f7a95d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.023 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f9057a83b80 4 client.26410 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:27:09.023 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.015+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7a9501db0 con 0x55f7a95d0070 2023-10-05T15:27:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.025+0000 7f9049635700 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a95d0070 0x55f7a95d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.028+0000 7f902cff9700 10 client.26410 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.028+0000 7f9049635700 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a95d0070 0x55f7a95d2490 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9012be72bce203ec server_cookie=8ec7db638b0bb343 in_seq=0 out_seq=0 2023-10-05T15:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.029+0000 7f902cff9700 1 -- 172.21.15.60:0/393548026 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f7a9501db0 con 0x55f7a95d0070 2023-10-05T15:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.029+0000 7f902cff9700 10 client.26410 handle_command_reply: tid=0 2023-10-05T15:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.031+0000 7f9057a83b80 1 client.26410 shutdown 2023-10-05T15:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.036+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 msgr2=0x55f7a95bd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.036+0000 7f9057a83b80 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bd7b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9040008000 tx=0x7f904000f740 comp rx=0 tx=0).stop 2023-10-05T15:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.038+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 shutdown_connections 2023-10-05T15:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.038+0000 7f9057a83b80 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a95d0070 0x55f7a95d2490 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.038+0000 7f9057a83b80 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95bdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.038+0000 7f9057a83b80 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 0x55f7a95bd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.038+0000 7f9057a83b80 1 --2- 172.21.15.60:0/393548026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bd7b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.038+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 >> 172.21.15.60:0/393548026 conn(0x55f7a952a200 msgr2=0x55f7a95b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.042+0000 7f902cff9700 0 client.26410 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.042+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 shutdown_connections 2023-10-05T15:27:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.042+0000 7f9057a83b80 1 -- 172.21.15.60:0/393548026 wait complete. 2023-10-05T15:27:09.048 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.047+0000 7f9057a83b80 20 client.26410 trim_cache size 0 max 16384 2023-10-05T15:27:09.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 Processor -- start 2023-10-05T15:27:09.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 -- start start 2023-10-05T15:27:09.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 0x55f7a95c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95ba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.086 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a93898c0 con 0x55f7a95c03d0 2023-10-05T15:27:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a95b12a0 con 0x55f7a95b4c00 2023-10-05T15:27:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.083+0000 7f9057a83b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a95b5e20 con 0x55f7a95b5520 2023-10-05T15:27:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41712/0 (socket says 172.21.15.60:41712) 2023-10-05T15:27:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 -- 172.21.15.60:0/3597160663 learned_addr learned my addr 172.21.15.60:0/3597160663 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9048e34700 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 -- 172.21.15.60:0/3597160663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 msgr2=0x55f7a95bdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 -- 172.21.15.60:0/3597160663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 msgr2=0x55f7a95c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 0x55f7a95c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.084+0000 7f9049e36700 1 -- 172.21.15.60:0/3597160663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a935a1f0 con 0x55f7a95c03d0 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.085+0000 7f9049e36700 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95ba500 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f903c037430 tx=0x7f903c033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5639cd9580ea4cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.086+0000 7f902ffff700 1 -- 172.21.15.60:0/3597160663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c037dd0 con 0x55f7a95c03d0 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.086+0000 7f902ffff700 1 -- 172.21.15.60:0/3597160663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f903c043930 con 0x55f7a95c03d0 2023-10-05T15:27:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.086+0000 7f902ffff700 1 -- 172.21.15.60:0/3597160663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c035a40 con 0x55f7a95c03d0 2023-10-05T15:27:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.090+0000 7f9057a83b80 1 -- 172.21.15.60:0/3597160663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 msgr2=0x55f7a95ba500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.090+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95ba500 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f903c037430 tx=0x7f903c033000 comp rx=0 tx=0).stop 2023-10-05T15:27:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.093+0000 7f9057a83b80 1 -- 172.21.15.60:0/3597160663 shutdown_connections 2023-10-05T15:27:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.093+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95c03d0 0x55f7a95ba500 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.093+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95b4c00 0x55f7a95c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.093+0000 7f9057a83b80 1 --2- 172.21.15.60:0/3597160663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b5520 0x55f7a95bdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.093+0000 7f9057a83b80 1 -- 172.21.15.60:0/3597160663 >> 172.21.15.60:0/3597160663 conn(0x55f7a952a200 msgr2=0x55f7a95b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.101 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.099+0000 7f9057a83b80 1 -- 172.21.15.60:0/3597160663 shutdown_connections 2023-10-05T15:27:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.101+0000 7f9057a83b80 1 -- 172.21.15.60:0/3597160663 wait complete. 2023-10-05T15:27:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.101+0000 7f9057a83b80 1 -- start start 2023-10-05T15:27:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 Processor -- start 2023-10-05T15:27:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b4c00 0x55f7a95c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 0x55f7a95c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95c03d0 0x55f7a961be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a961c3a0 con 0x55f7a95b5520 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a961c510 con 0x55f7a95c03d0 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a961c6d0 con 0x55f7a95b4c00 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.102+0000 7f9057a83b80 10 client.0 _ll_register_callbacks cb 0x7f903c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 0x55f7a95c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 0x55f7a95c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41720/0 (socket says 172.21.15.60:41720) 2023-10-05T15:27:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 -- 172.21.15.60:0/4214927319 learned_addr learned my addr 172.21.15.60:0/4214927319 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9049e36700 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95c03d0 0x55f7a961be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 -- 172.21.15.60:0/4214927319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b4c00 msgr2=0x55f7a95c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b4c00 0x55f7a95c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 -- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95c03d0 msgr2=0x55f7a961be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95c03d0 0x55f7a961be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 -- 172.21.15.60:0/4214927319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c030d20 con 0x55f7a95b5520 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f9048e34700 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 0x55f7a95c5630 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x55f7a95be7b0 tx=0x7f904000fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba1156b6a879829 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f902cff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.103+0000 7f902cff9700 1 -- 172.21.15.60:0/4214927319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904001c040 con 0x55f7a95b5520 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90340a1b80 con 0x55f7a95b5520 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f902cff9700 1 -- 172.21.15.60:0/4214927319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f9040005280 con 0x55f7a95b5520 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f902cff9700 1 -- 172.21.15.60:0/4214927319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9040003930 con 0x55f7a95b5520 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f9057a83b80 10 client.16905 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55f7a9332250 con 0x55f7a95b5520 2023-10-05T15:27:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f902cff9700 1 -- 172.21.15.60:0/4214927319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9040039030 con 0x55f7a95b5520 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f902cff9700 1 -- 172.21.15.60:0/4214927319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f9040009c70 con 0x55f7a95b5520 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.104+0000 7f9057a83b80 10 client.16905 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9057a83b80 10 client.16905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9057a83b80 20 client.16905 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9057a83b80 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a9624e60 0x55f7a9627280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9057a83b80 4 client.16905 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f7a9501ad0 con 0x55f7a9624e60 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9049635700 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a9624e60 0x55f7a9627280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f902cff9700 10 client.16905 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.105+0000 7f9049635700 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a9624e60 0x55f7a9627280 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b118638aac002d6 server_cookie=b155f561bf6cd76c in_seq=0 out_seq=0 2023-10-05T15:27:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.175+0000 7f902cff9700 1 -- 172.21.15.60:0/4214927319 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f7a9501ad0 con 0x55f7a9624e60 2023-10-05T15:27:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.175+0000 7f902cff9700 10 client.16905 handle_command_reply: tid=0 2023-10-05T15:27:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.180+0000 7f9057a83b80 1 client.16905 shutdown 2023-10-05T15:27:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.181+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 msgr2=0x55f7a95c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.181+0000 7f9057a83b80 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 0x55f7a95c5630 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x55f7a95be7b0 tx=0x7f904000fa90 comp rx=0 tx=0).stop 2023-10-05T15:27:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.184+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 shutdown_connections 2023-10-05T15:27:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.184+0000 7f9057a83b80 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55f7a9624e60 0x55f7a9627280 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.184+0000 7f9057a83b80 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7a95c03d0 0x55f7a961be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.184+0000 7f9057a83b80 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7a95b4c00 0x55f7a95c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.184+0000 7f9057a83b80 1 --2- 172.21.15.60:0/4214927319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7a95b5520 0x55f7a95c5630 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.184+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 >> 172.21.15.60:0/4214927319 conn(0x55f7a952a200 msgr2=0x55f7a95bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.186+0000 7f902cff9700 0 client.16905 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.190+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 shutdown_connections 2023-10-05T15:27:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.194+0000 7f9057a83b80 1 -- 172.21.15.60:0/4214927319 wait complete. 2023-10-05T15:27:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:27:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:27:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:27:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:27:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.199+0000 7f9057a83b80 20 client.16905 trim_cache size 0 max 16384 2023-10-05T15:27:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.205+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f90300a1670 msgr2=0x7f90300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.205+0000 7f904b899700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f90300a1670 0x7f90300a3b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f903c0060b0 tx=0x7f903c00b040 comp rx=0 tx=0).stop 2023-10-05T15:27:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.205+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 msgr2=0x7f9044118e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.205+0000 7f904b899700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 0x7f9044118e00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f903400b450 tx=0x7f903400b810 comp rx=0 tx=0).stop 2023-10-05T15:27:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.209+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 shutdown_connections 2023-10-05T15:27:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.209+0000 7f904b899700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f90300a1670 0x7f90300a3b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.209+0000 7f904b899700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90441125c0 0x7f9044116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.209+0000 7f904b899700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f904411a690 0x7f9044118e00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.209+0000 7f904b899700 1 --2- 172.21.15.60:0/3062647933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9044111c00 0x7f9044112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.209+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 >> 172.21.15.60:0/3062647933 conn(0x7f904406cfa0 msgr2=0x7f904406f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.214+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 shutdown_connections 2023-10-05T15:27:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:09.214+0000 7f904b899700 1 -- 172.21.15.60:0/3062647933 wait complete. 2023-10-05T15:27:09.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:09 smithi135 ceph-mon[103360]: pgmap v326: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 260 op/s 2023-10-05T15:27:09.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:09 smithi135 ceph-mon[103360]: osdmap e106: 12 total, 12 up, 12 in 2023-10-05T15:27:09.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:09 smithi060 ceph-mon[99238]: pgmap v326: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 260 op/s 2023-10-05T15:27:09.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:09 smithi060 ceph-mon[99238]: osdmap e106: 12 total, 12 up, 12 in 2023-10-05T15:27:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:09 smithi092 ceph-mon[102944]: pgmap v326: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 260 op/s 2023-10-05T15:27:09.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:09 smithi092 ceph-mon[102944]: osdmap e106: 12 total, 12 up, 12 in 2023-10-05T15:27:11.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:11 smithi135 ceph-mon[103360]: pgmap v328: 129 pgs: 8 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 94 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 254 op/s 2023-10-05T15:27:11.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:11 smithi060 ceph-mon[99238]: pgmap v328: 129 pgs: 8 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 94 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 254 op/s 2023-10-05T15:27:11.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:11 smithi092 ceph-mon[102944]: pgmap v328: 129 pgs: 8 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 94 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 254 op/s 2023-10-05T15:27:12.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:12 smithi060 ceph-mon[99238]: pgmap v329: 129 pgs: 14 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-10-05T15:27:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:12 smithi092 ceph-mon[102944]: pgmap v329: 129 pgs: 14 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-10-05T15:27:13.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:12 smithi135 ceph-mon[103360]: pgmap v329: 129 pgs: 14 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-10-05T15:27:15.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:15 smithi135 ceph-mon[103360]: pgmap v330: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 204 op/s 2023-10-05T15:27:15.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:15 smithi060 ceph-mon[99238]: pgmap v330: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 204 op/s 2023-10-05T15:27:15.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:15 smithi092 ceph-mon[102944]: pgmap v330: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 204 op/s 2023-10-05T15:27:16.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:16 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:16.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:16 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:16.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:16 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:17.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:17 smithi135 ceph-mon[103360]: pgmap v331: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 177 op/s 2023-10-05T15:27:17.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:17 smithi060 ceph-mon[99238]: pgmap v331: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 177 op/s 2023-10-05T15:27:17.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:17 smithi092 ceph-mon[102944]: pgmap v331: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 177 op/s 2023-10-05T15:27:19.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:19 smithi060 ceph-mon[99238]: pgmap v332: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 151 op/s 2023-10-05T15:27:19.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:19 smithi092 ceph-mon[102944]: pgmap v332: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 151 op/s 2023-10-05T15:27:19.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:19 smithi135 ceph-mon[103360]: pgmap v332: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 151 op/s 2023-10-05T15:27:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:21 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:21 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:21 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:21 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:21 smithi135 ceph-mon[103360]: pgmap v333: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 136 op/s 2023-10-05T15:27:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:21 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:21 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:21 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:21 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:21 smithi092 ceph-mon[102944]: pgmap v333: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 136 op/s 2023-10-05T15:27:21.427 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:21 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.427 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:21 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.427 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:21 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.427 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:21 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:21.427 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:21 smithi060 ceph-mon[99238]: pgmap v333: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 136 op/s 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:22.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:22.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi135 to 196.2M 2023-10-05T15:27:22.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:22 smithi060 ceph-mon[99238]: Unable to set osd_memory_target on smithi135 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-05T15:27:22.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi135 to 196.2M 2023-10-05T15:27:22.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:22 smithi092 ceph-mon[102944]: Unable to set osd_memory_target on smithi135 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-05T15:27:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.434+0000 7f3410745700 1 -- 172.21.15.60:0/355860920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3408105100 msgr2=0x7f340810cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.434+0000 7f3410745700 1 --2- 172.21.15.60:0/355860920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3408105100 0x7f340810cc80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3404009990 tx=0x7f3404009ca0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.444+0000 7f3410745700 1 -- 172.21.15.60:0/355860920 shutdown_connections 2023-10-05T15:27:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.444+0000 7f3410745700 1 --2- 172.21.15.60:0/355860920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3408105100 0x7f340810cc80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.444+0000 7f3410745700 1 --2- 172.21.15.60:0/355860920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34080fffe0 0x7f34081003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.444+0000 7f3410745700 1 --2- 172.21.15.60:0/355860920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408100990 0x7f34081049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.444+0000 7f3410745700 1 -- 172.21.15.60:0/355860920 >> 172.21.15.60:0/355860920 conn(0x7f34080fb880 msgr2=0x7f34080fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.453+0000 7f3410745700 1 -- 172.21.15.60:0/355860920 shutdown_connections 2023-10-05T15:27:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.454+0000 7f3410745700 1 -- 172.21.15.60:0/355860920 wait complete. 2023-10-05T15:27:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.455+0000 7f3410745700 1 Processor -- start 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.455+0000 7f3410745700 1 -- start start 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f3410745700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34080fffe0 0x7f340819bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f3410745700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408105100 0x7f340819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f3410745700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408194da0 0x7f3408195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f3410745700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408195a20 con 0x7f3408194da0 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f3410745700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408195b90 con 0x7f34080fffe0 2023-10-05T15:27:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f3410745700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408199ae0 con 0x7f3408105100 2023-10-05T15:27:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f340e4e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34080fffe0 0x7f340819bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f340e4e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34080fffe0 0x7f340819bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55154/0 (socket says 172.21.15.60:55154) 2023-10-05T15:27:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.456+0000 7f340e4e1700 1 -- 172.21.15.60:0/2771009296 learned_addr learned my addr 172.21.15.60:0/2771009296 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.457+0000 7f340ece2700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408194da0 0x7f3408195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.459+0000 7f340ece2700 1 -- 172.21.15.60:0/2771009296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408105100 msgr2=0x7f340819c4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:27:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.459+0000 7f340ece2700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408105100 0x7f340819c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.459+0000 7f340ece2700 1 -- 172.21.15.60:0/2771009296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34080fffe0 msgr2=0x7f340819bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.459+0000 7f340ece2700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34080fffe0 0x7f340819bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.459+0000 7f340ece2700 1 -- 172.21.15.60:0/2771009296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040095f0 con 0x7f3408194da0 2023-10-05T15:27:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.459+0000 7f340ece2700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408194da0 0x7f3408195250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3404009990 tx=0x7f340400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.462+0000 7f33ff7fe700 1 -- 172.21.15.60:0/2771009296 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404003e30 con 0x7f3408194da0 2023-10-05T15:27:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.462+0000 7f33ff7fe700 1 -- 172.21.15.60:0/2771009296 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3404005410 con 0x7f3408194da0 2023-10-05T15:27:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.462+0000 7f33ff7fe700 1 -- 172.21.15.60:0/2771009296 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340401f400 con 0x7f3408194da0 2023-10-05T15:27:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.463+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3408199d60 con 0x7f3408194da0 2023-10-05T15:27:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.463+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340819a220 con 0x7f3408194da0 2023-10-05T15:27:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.468+0000 7f33ff7fe700 1 -- 172.21.15.60:0/2771009296 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3404005580 con 0x7f3408194da0 2023-10-05T15:27:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.468+0000 7f33ff7fe700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33f40a1780 0x7f33f40a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.469+0000 7f33ff7fe700 1 -- 172.21.15.60:0/2771009296 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f34040ce120 con 0x7f3408194da0 2023-10-05T15:27:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.469+0000 7f340e4e1700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33f40a1780 0x7f33f40a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.469+0000 7f340e4e1700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33f40a1780 0x7f33f40a3c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009ad0 tx=0x7f33f8009290 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.474+0000 7f341c92fb80 1 Processor -- start 2023-10-05T15:27:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 -- start start 2023-10-05T15:27:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a564f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f9520 0x559a56503e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a565043d0 0x559a565067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a56462400 con 0x559a565043d0 2023-10-05T15:27:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a56453bc0 con 0x559a564f8c00 2023-10-05T15:27:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.475+0000 7f341c92fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a564514e0 con 0x559a564f9520 2023-10-05T15:27:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.478+0000 7f340e4e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a564f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.478+0000 7f340e4e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a564f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55160/0 (socket says 172.21.15.60:55160) 2023-10-05T15:27:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.478+0000 7f340e4e1700 1 -- 172.21.15.60:0/1909982872 learned_addr learned my addr 172.21.15.60:0/1909982872 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.478+0000 7f340ece2700 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a565043d0 0x559a565067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.480+0000 7f340e4e1700 1 -- 172.21.15.60:0/1909982872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f9520 msgr2=0x559a56503e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:27:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.480+0000 7f340e4e1700 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f9520 0x559a56503e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.480+0000 7f340e4e1700 1 -- 172.21.15.60:0/1909982872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a565043d0 msgr2=0x559a565067c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.480+0000 7f340e4e1700 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a565043d0 0x559a565067c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.480+0000 7f340e4e1700 1 -- 172.21.15.60:0/1909982872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a56277d80 con 0x559a564f8c00 2023-10-05T15:27:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.482+0000 7f340e4e1700 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a564f8fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f33f800eac0 tx=0x7f33f8011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecdc36d7a7bbe5e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.483+0000 7f33fcff9700 1 -- 172.21.15.60:0/1909982872 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8015480 con 0x559a564f8c00 2023-10-05T15:27:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.487+0000 7f33fcff9700 1 -- 172.21.15.60:0/1909982872 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33f8015aa0 con 0x559a564f8c00 2023-10-05T15:27:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.487+0000 7f33fcff9700 1 -- 172.21.15.60:0/1909982872 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8013bb0 con 0x559a564f8c00 2023-10-05T15:27:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.488+0000 7f341c92fb80 1 -- 172.21.15.60:0/1909982872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 msgr2=0x559a564f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.488+0000 7f341c92fb80 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a564f8fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f33f800eac0 tx=0x7f33f8011000 comp rx=0 tx=0).stop 2023-10-05T15:27:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.491+0000 7f341c92fb80 1 -- 172.21.15.60:0/1909982872 shutdown_connections 2023-10-05T15:27:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.491+0000 7f341c92fb80 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a565043d0 0x559a565067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.491+0000 7f341c92fb80 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a564f8fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.491+0000 7f341c92fb80 1 --2- 172.21.15.60:0/1909982872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f9520 0x559a56503e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.491+0000 7f341c92fb80 1 -- 172.21.15.60:0/1909982872 >> 172.21.15.60:0/1909982872 conn(0x559a5646e200 msgr2=0x559a564f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.503+0000 7f341c92fb80 1 -- 172.21.15.60:0/1909982872 shutdown_connections 2023-10-05T15:27:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.503+0000 7f341c92fb80 1 -- 172.21.15.60:0/1909982872 wait complete. 2023-10-05T15:27:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 -- start start 2023-10-05T15:27:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 Processor -- start 2023-10-05T15:27:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f8c00 0x559a56503d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56501070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a565043d0 0x559a565016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a5644cdd0 con 0x559a564f9520 2023-10-05T15:27:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a563e96b0 con 0x559a565043d0 2023-10-05T15:27:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a563e9350 con 0x559a564f8c00 2023-10-05T15:27:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.504+0000 7f341c92fb80 10 client.0 _ll_register_callbacks cb 0x559a562467a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.506+0000 7f340ece2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a565043d0 0x559a565016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.506+0000 7f340ece2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a565043d0 0x559a565016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55168/0 (socket says 172.21.15.60:55168) 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.506+0000 7f340ece2700 1 -- 172.21.15.60:0/4022976185 learned_addr learned my addr 172.21.15.60:0/4022976185 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.508+0000 7f340dce0700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56501070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.509+0000 7f340e4e1700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f8c00 0x559a56503d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.509+0000 7f340dce0700 1 -- 172.21.15.60:0/4022976185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f8c00 msgr2=0x559a56503d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.509+0000 7f340dce0700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f8c00 0x559a56503d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.509+0000 7f340dce0700 1 -- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a565043d0 msgr2=0x559a565016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.509+0000 7f340dce0700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a565043d0 0x559a565016a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.509+0000 7f340dce0700 1 -- 172.21.15.60:0/4022976185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f800e7a0 con 0x559a564f9520 2023-10-05T15:27:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.511+0000 7f340dce0700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56501070 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f340806a6f0 tx=0x7f340000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3210d00513506dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.511+0000 7f33f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:27:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.514+0000 7f33f1ffb700 1 -- 172.21.15.60:0/4022976185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000f800 con 0x559a564f9520 2023-10-05T15:27:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.514+0000 7f33f1ffb700 1 -- 172.21.15.60:0/4022976185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f3400006e40 con 0x559a564f9520 2023-10-05T15:27:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.516+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a564ecd50 con 0x559a564f9520 2023-10-05T15:27:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.519+0000 7f33f1ffb700 1 -- 172.21.15.60:0/4022976185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f340000f960 con 0x559a564f9520 2023-10-05T15:27:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.521+0000 7f341c92fb80 10 client.16914 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.521+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x559a56260c00 con 0x559a564f9520 2023-10-05T15:27:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f33f1ffb700 1 -- 172.21.15.60:0/4022976185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a564ecd50 con 0x559a564f9520 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f33f1ffb700 1 -- 172.21.15.60:0/4022976185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f3400015020 con 0x559a564f9520 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f341c92fb80 10 client.16914 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f341c92fb80 10 client.16914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f341c92fb80 20 client.16914 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f341c92fb80 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a56513fa0 0x559a565163c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f341c92fb80 4 client.16914 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:27:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.528+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a56445db0 con 0x559a56513fa0 2023-10-05T15:27:22.538 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.537+0000 7f340e4e1700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a56513fa0 0x559a565163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.550+0000 7f340e4e1700 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a56513fa0 0x559a565163c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c67b0925d542316b server_cookie=4a67be00983b52c in_seq=0 out_seq=0 2023-10-05T15:27:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.551+0000 7f33f1ffb700 10 client.16914 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.559+0000 7f33f1ffb700 1 -- 172.21.15.60:0/4022976185 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a56445db0 con 0x559a56513fa0 2023-10-05T15:27:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.559+0000 7f33f1ffb700 10 client.16914 handle_command_reply: tid=0 2023-10-05T15:27:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.560+0000 7f341c92fb80 1 client.16914 shutdown 2023-10-05T15:27:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 msgr2=0x559a56501070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.575 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56501070 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f340806a6f0 tx=0x7f340000bbe0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 shutdown_connections 2023-10-05T15:27:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a56513fa0 0x559a565163c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a565043d0 0x559a565016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a564f8c00 0x559a56503d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 --2- 172.21.15.60:0/4022976185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56501070 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.573+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 >> 172.21.15.60:0/4022976185 conn(0x559a5646e200 msgr2=0x559a564f4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.576+0000 7f33f1ffb700 0 client.16914 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.577+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 shutdown_connections 2023-10-05T15:27:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.578+0000 7f341c92fb80 1 -- 172.21.15.60:0/4022976185 wait complete. 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi135 to 196.2M 2023-10-05T15:27:22.586 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:22 smithi135 ceph-mon[103360]: Unable to set osd_memory_target on smithi135 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-05T15:27:22.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.583+0000 7f341c92fb80 20 client.16914 trim_cache size 0 max 16384 2023-10-05T15:27:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.608+0000 7f341c92fb80 1 Processor -- start 2023-10-05T15:27:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 -- start start 2023-10-05T15:27:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a5650af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56503920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 0x559a564fc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a562cd8c0 con 0x559a564f9520 2023-10-05T15:27:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a564f65d0 con 0x559a564f8c00 2023-10-05T15:27:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.612+0000 7f341c92fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a564fbb80 con 0x559a565043d0 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.613+0000 7f340e4e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a5650af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.613+0000 7f340e4e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a5650af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55174/0 (socket says 172.21.15.60:55174) 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.613+0000 7f340e4e1700 1 -- 172.21.15.60:0/570992814 learned_addr learned my addr 172.21.15.60:0/570992814 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.613+0000 7f340dce0700 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56503920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f340dce0700 1 -- 172.21.15.60:0/570992814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 msgr2=0x559a564fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f340dce0700 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 0x559a564fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f340dce0700 1 -- 172.21.15.60:0/570992814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 msgr2=0x559a5650af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f340dce0700 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a5650af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f340dce0700 1 -- 172.21.15.60:0/570992814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a56506990 con 0x559a564f9520 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f340dce0700 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56503920 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3400000f80 tx=0x7f34000174a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7396fb1eac26f120 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f33fd7fa700 1 -- 172.21.15.60:0/570992814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34000176e0 con 0x559a564f9520 2023-10-05T15:27:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f33fd7fa700 1 -- 172.21.15.60:0/570992814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3400017d90 con 0x559a564f9520 2023-10-05T15:27:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.614+0000 7f33fd7fa700 1 -- 172.21.15.60:0/570992814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400021420 con 0x559a564f9520 2023-10-05T15:27:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 -- 172.21.15.60:0/570992814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 msgr2=0x559a56503920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56503920 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3400000f80 tx=0x7f34000174a0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 -- 172.21.15.60:0/570992814 shutdown_connections 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 0x559a564fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f8c00 0x559a5650af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 --2- 172.21.15.60:0/570992814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f9520 0x559a56503920 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 -- 172.21.15.60:0/570992814 >> 172.21.15.60:0/570992814 conn(0x559a5646e200 msgr2=0x559a5650f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 -- 172.21.15.60:0/570992814 shutdown_connections 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.620+0000 7f341c92fb80 1 -- 172.21.15.60:0/570992814 wait complete. 2023-10-05T15:27:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 -- start start 2023-10-05T15:27:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 Processor -- start 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f8c00 0x559a56506f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 0x559a56507490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 0x559a565079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a56566da0 con 0x559a564f8c00 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a56566ee0 con 0x559a564f9520 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a56567020 con 0x559a565043d0 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.621+0000 7f341c92fb80 10 client.0 _ll_register_callbacks cb 0x7f3400009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 0x559a56507490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 0x559a56507490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55184/0 (socket says 172.21.15.60:55184) 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 -- 172.21.15.60:0/2442193219 learned_addr learned my addr 172.21.15.60:0/2442193219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 -- 172.21.15.60:0/2442193219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 msgr2=0x559a565079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 0x559a565079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 -- 172.21.15.60:0/2442193219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f8c00 msgr2=0x559a56506f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f8c00 0x559a56506f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 -- 172.21.15.60:0/2442193219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a56260c00 con 0x559a564f9520 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.622+0000 7f340dce0700 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 0x559a56507490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f340000b520 tx=0x7f3400017f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e3835593fc879f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.623+0000 7f33f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.629+0000 7f33f1ffb700 1 -- 172.21.15.60:0/2442193219 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000f800 con 0x559a564f9520 2023-10-05T15:27:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.629+0000 7f33f1ffb700 1 -- 172.21.15.60:0/2442193219 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f3400026070 con 0x559a564f9520 2023-10-05T15:27:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.629+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33f8015aa0 con 0x559a564f9520 2023-10-05T15:27:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.633+0000 7f33f1ffb700 1 -- 172.21.15.60:0/2442193219 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3400017be0 con 0x559a564f9520 2023-10-05T15:27:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.634+0000 7f341c92fb80 10 client.26570 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.634+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x559a5629e1f0 con 0x559a564f9520 2023-10-05T15:27:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f33f1ffb700 1 -- 172.21.15.60:0/2442193219 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33f8015aa0 con 0x559a564f9520 2023-10-05T15:27:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f33f1ffb700 1 -- 172.21.15.60:0/2442193219 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f3400055030 con 0x559a564f9520 2023-10-05T15:27:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f341c92fb80 10 client.26570 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f341c92fb80 10 client.26570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f341c92fb80 20 client.26570 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:22.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f341c92fb80 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a565683f0 0x559a5656a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:22.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f341c92fb80 4 client.26570 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:27:22.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.641+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559a56445ad0 con 0x559a565683f0 2023-10-05T15:27:22.651 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.649+0000 7f340e4e1700 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a565683f0 0x559a5656a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.661+0000 7f340e4e1700 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a565683f0 0x559a5656a810 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de61e532e098ce57 server_cookie=cd58e07ad69337ae in_seq=0 out_seq=0 2023-10-05T15:27:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.665+0000 7f33f1ffb700 10 client.26570 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.775+0000 7f33f1ffb700 1 -- 172.21.15.60:0/2442193219 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559a56445ad0 con 0x559a565683f0 2023-10-05T15:27:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.775+0000 7f33f1ffb700 10 client.26570 handle_command_reply: tid=0 2023-10-05T15:27:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.778+0000 7f341c92fb80 1 client.26570 shutdown 2023-10-05T15:27:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.780+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 msgr2=0x559a56507490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.780+0000 7f341c92fb80 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 0x559a56507490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f340000b520 tx=0x7f3400017f90 comp rx=0 tx=0).stop 2023-10-05T15:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 shutdown_connections 2023-10-05T15:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f341c92fb80 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x559a565683f0 0x559a5656a810 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f341c92fb80 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a565043d0 0x559a565079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f341c92fb80 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a564f8c00 0x559a56506f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f341c92fb80 1 --2- 172.21.15.60:0/2442193219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a564f9520 0x559a56507490 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f33f1ffb700 0 client.26570 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.793+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 >> 172.21.15.60:0/2442193219 conn(0x559a5646e200 msgr2=0x559a564fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.795+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 shutdown_connections 2023-10-05T15:27:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.801+0000 7f341c92fb80 1 -- 172.21.15.60:0/2442193219 wait complete. 2023-10-05T15:27:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.802+0000 7f341c92fb80 20 client.26570 trim_cache size 0 max 16384 2023-10-05T15:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.804+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33f40a1780 msgr2=0x7f33f40a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.804+0000 7f3410745700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33f40a1780 0x7f33f40a3c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009ad0 tx=0x7f33f8009290 comp rx=0 tx=0).stop 2023-10-05T15:27:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.804+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408194da0 msgr2=0x7f3408195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.804+0000 7f3410745700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408194da0 0x7f3408195250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3404009990 tx=0x7f340400ef90 comp rx=0 tx=0).stop 2023-10-05T15:27:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.813+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 shutdown_connections 2023-10-05T15:27:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.813+0000 7f3410745700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408194da0 0x7f3408195250 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.813+0000 7f3410745700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f33f40a1780 0x7f33f40a3c40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.813+0000 7f3410745700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34080fffe0 0x7f340819bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.813+0000 7f3410745700 1 --2- 172.21.15.60:0/2771009296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408105100 0x7f340819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.813+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 >> 172.21.15.60:0/2771009296 conn(0x7f34080fb880 msgr2=0x7f34080fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.823+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 shutdown_connections 2023-10-05T15:27:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:22.823+0000 7f3410745700 1 -- 172.21.15.60:0/2771009296 wait complete. 2023-10-05T15:27:23.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: pgmap v334: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-10-05T15:27:23.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:23.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:23.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: pgmap v334: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-10-05T15:27:23.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:23.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:23.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: pgmap v334: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:23.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:23.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:27:25.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:25 smithi135 ceph-mon[103360]: pgmap v335: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-10-05T15:27:25.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:25 smithi060 ceph-mon[99238]: pgmap v335: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-10-05T15:27:25.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:25 smithi092 ceph-mon[102944]: pgmap v335: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-10-05T15:27:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:27 smithi060 ceph-mon[99238]: pgmap v336: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2023-10-05T15:27:27.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:27 smithi092 ceph-mon[102944]: pgmap v336: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2023-10-05T15:27:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:27 smithi135 ceph-mon[103360]: pgmap v336: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2023-10-05T15:27:29.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:29 smithi060 ceph-mon[99238]: pgmap v337: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-10-05T15:27:29.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:29 smithi092 ceph-mon[102944]: pgmap v337: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-10-05T15:27:29.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:29 smithi135 ceph-mon[103360]: pgmap v337: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-10-05T15:27:30.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:30 smithi135 ceph-mon[103360]: pgmap v338: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 844 KiB/s wr, 87 op/s 2023-10-05T15:27:30.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:30 smithi060 ceph-mon[99238]: pgmap v338: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 844 KiB/s wr, 87 op/s 2023-10-05T15:27:30.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:30 smithi092 ceph-mon[102944]: pgmap v338: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 844 KiB/s wr, 87 op/s 2023-10-05T15:27:32.920 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:32 smithi060 ceph-mon[99238]: pgmap v339: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 687 KiB/s wr, 82 op/s 2023-10-05T15:27:32.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:32 smithi092 ceph-mon[102944]: pgmap v339: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 687 KiB/s wr, 82 op/s 2023-10-05T15:27:33.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:32 smithi135 ceph-mon[103360]: pgmap v339: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 687 KiB/s wr, 82 op/s 2023-10-05T15:27:35.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:35 smithi135 ceph-mon[103360]: pgmap v340: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-10-05T15:27:35.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:35 smithi060 ceph-mon[99238]: pgmap v340: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-10-05T15:27:35.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:35 smithi092 ceph-mon[102944]: pgmap v340: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-10-05T15:27:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.046+0000 7fe8d4250700 1 -- 172.21.15.60:0/2398451428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc11a690 msgr2=0x7fe8cc11ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.046+0000 7fe8d4250700 1 --2- 172.21.15.60:0/2398451428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc11a690 0x7fe8cc11ca80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0098f0 tx=0x7fe8bc009c00 comp rx=0 tx=0).stop 2023-10-05T15:27:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.048+0000 7fe8d4250700 1 -- 172.21.15.60:0/2398451428 shutdown_connections 2023-10-05T15:27:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.048+0000 7fe8d4250700 1 --2- 172.21.15.60:0/2398451428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc11a690 0x7fe8cc11ca80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.048+0000 7fe8d4250700 1 --2- 172.21.15.60:0/2398451428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8cc10f620 0x7fe8cc107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.048+0000 7fe8d4250700 1 --2- 172.21.15.60:0/2398451428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10fa90 0x7fe8cc1083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.048+0000 7fe8d4250700 1 -- 172.21.15.60:0/2398451428 >> 172.21.15.60:0/2398451428 conn(0x7fe8cc06cfa0 msgr2=0x7fe8cc06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.052+0000 7fe8d4250700 1 -- 172.21.15.60:0/2398451428 shutdown_connections 2023-10-05T15:27:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.052+0000 7fe8d4250700 1 -- 172.21.15.60:0/2398451428 wait complete. 2023-10-05T15:27:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.053+0000 7fe8d4250700 1 Processor -- start 2023-10-05T15:27:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.053+0000 7fe8d4250700 1 -- start start 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d4250700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10f620 0x7fe8cc1199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d4250700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc10fa90 0x7fe8cc119f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d4250700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8cc11a690 0x7fe8cc112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d4250700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc113020 con 0x7fe8cc10fa90 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d4250700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc113190 con 0x7fe8cc11a690 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d4250700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc113350 con 0x7fe8cc10f620 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d27ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8cc11a690 0x7fe8cc112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d1fec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10f620 0x7fe8cc1199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d1fec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10f620 0x7fe8cc1199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55302/0 (socket says 172.21.15.60:55302) 2023-10-05T15:27:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.054+0000 7fe8d1fec700 1 -- 172.21.15.60:0/1479611319 learned_addr learned my addr 172.21.15.60:0/1479611319 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.058+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc10fa90 0x7fe8cc119f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.058+0000 7fe8d17eb700 1 -- 172.21.15.60:0/1479611319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10f620 msgr2=0x7fe8cc1199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.058+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10f620 0x7fe8cc1199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.058+0000 7fe8d17eb700 1 -- 172.21.15.60:0/1479611319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8cc11a690 msgr2=0x7fe8cc112850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.058+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8cc11a690 0x7fe8cc112850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.058+0000 7fe8d17eb700 1 -- 172.21.15.60:0/1479611319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc009520 con 0x7fe8cc10fa90 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.059+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc10fa90 0x7fe8cc119f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800b450 tx=0x7fe8c800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.059+0000 7fe8c2ffd700 1 -- 172.21.15.60:0/1479611319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8011830 con 0x7fe8cc10fa90 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.059+0000 7fe8c2ffd700 1 -- 172.21.15.60:0/1479611319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8c8011e50 con 0x7fe8cc10fa90 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.059+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc113630 con 0x7fe8cc10fa90 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.059+0000 7fe8c2ffd700 1 -- 172.21.15.60:0/1479611319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8010e70 con 0x7fe8cc10fa90 2023-10-05T15:27:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.059+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc117920 con 0x7fe8cc10fa90 2023-10-05T15:27:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.062+0000 7fe8c2ffd700 1 -- 172.21.15.60:0/1479611319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe8c8010510 con 0x7fe8cc10fa90 2023-10-05T15:27:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.063+0000 7fe8c2ffd700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe8b80a1670 0x7fe8b80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.063+0000 7fe8c2ffd700 1 -- 172.21.15.60:0/1479611319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fe8c80ccd30 con 0x7fe8cc10fa90 2023-10-05T15:27:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.063+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe8b80a1670 0x7fe8b80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.064+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe8b80a1670 0x7fe8b80a3b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40060b0 tx=0x7fe8c4009130 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.069+0000 7fe8e043ab80 1 Processor -- start 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 -- start start 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1061c00 0x563bb1061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb106d3d0 0x563bb106f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0fcb400 con 0x563bb106d3d0 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0fbcbc0 con 0x563bb1062520 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0fba4e0 con 0x563bb1061c00 2023-10-05T15:27:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8d17eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8d17eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55202/0 (socket says 172.21.15.60:55202) 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.070+0000 7fe8d17eb700 1 -- 172.21.15.60:0/2963800887 learned_addr learned my addr 172.21.15.60:0/2963800887 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.071+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb106d3d0 0x563bb106f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.071+0000 7fe8d27ed700 1 -- 172.21.15.60:0/2963800887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1061c00 msgr2=0x563bb1061fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.071+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1061c00 0x563bb1061fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.071+0000 7fe8d27ed700 1 -- 172.21.15.60:0/2963800887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 msgr2=0x563bb106ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.071+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.071+0000 7fe8d27ed700 1 -- 172.21.15.60:0/2963800887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bb0de0d80 con 0x563bb106d3d0 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.072+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb106d3d0 0x563bb106f7c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00b2e0 tx=0x7fe8bc0057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba6099ff4ec0643 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.072+0000 7fe8b7fff700 1 -- 172.21.15.60:0/2963800887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc01c070 con 0x563bb106d3d0 2023-10-05T15:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.072+0000 7fe8b7fff700 1 -- 172.21.15.60:0/2963800887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8bc00f610 con 0x563bb106d3d0 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.072+0000 7fe8b7fff700 1 -- 172.21.15.60:0/2963800887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00bad0 con 0x563bb106d3d0 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2963800887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb106d3d0 msgr2=0x563bb106f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb106d3d0 0x563bb106f7c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00b2e0 tx=0x7fe8bc0057d0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2963800887 shutdown_connections 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb106d3d0 0x563bb106f7c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1061c00 0x563bb1061fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2963800887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2963800887 >> 172.21.15.60:0/2963800887 conn(0x563bb0fd7200 msgr2=0x563bb105e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2963800887 shutdown_connections 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.073+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2963800887 wait complete. 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.074+0000 7fe8e043ab80 1 -- start start 2023-10-05T15:27:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.074+0000 7fe8e043ab80 1 Processor -- start 2023-10-05T15:27:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.074+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb106ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 0x563bb106a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0fb5dd0 con 0x563bb1061c00 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0f526b0 con 0x563bb1062520 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0f52350 con 0x563bb106d3d0 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8e043ab80 10 client.0 _ll_register_callbacks cb 0x563bb0daf7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb106ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb106ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41784/0 (socket says 172.21.15.60:41784) 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 -- 172.21.15.60:0/3505444120 learned_addr learned my addr 172.21.15.60:0/3505444120 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 -- 172.21.15.60:0/3505444120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 msgr2=0x563bb106a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 0x563bb106a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 -- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 msgr2=0x563bb106a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 -- 172.21.15.60:0/3505444120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc11d3b0 con 0x563bb1061c00 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb106ce10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4007fb0 tx=0x7fe8c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4239406291a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.075+0000 7fe8b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.076+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3505444120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4016620 con 0x563bb1061c00 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.076+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3505444120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fe8c4016780 con 0x563bb1061c00 2023-10-05T15:27:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.076+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563bb1055d50 con 0x563bb1061c00 2023-10-05T15:27:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.076+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3505444120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8c4016940 con 0x563bb1061c00 2023-10-05T15:27:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.076+0000 7fe8e043ab80 10 client.16929 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.076+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563bb0dc9c00 con 0x563bb1061c00 2023-10-05T15:27:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.084+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3505444120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563bb1055d50 con 0x563bb1061c00 2023-10-05T15:27:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.084+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3505444120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fe8c4014cf0 con 0x563bb1061c00 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.084+0000 7fe8e043ab80 10 client.16929 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.084+0000 7fe8e043ab80 10 client.16929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.085+0000 7fe8e043ab80 20 client.16929 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.085+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb10c0f20 0x563bb10c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.085+0000 7fe8e043ab80 4 client.16929 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.085+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563bb0faedb0 con 0x563bb10c0f20 2023-10-05T15:27:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.085+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb10c0f20 0x563bb10c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.090+0000 7fe8d17eb700 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb10c0f20 0x563bb10c3340 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f52b39e5fd233c1a server_cookie=3bad8126893ec924 in_seq=0 out_seq=0 2023-10-05T15:27:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.090+0000 7fe8b57fa700 10 client.16929 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.091+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3505444120 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563bb0faedb0 con 0x563bb10c0f20 2023-10-05T15:27:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.091+0000 7fe8b57fa700 10 client.16929 handle_command_reply: tid=0 2023-10-05T15:27:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.091+0000 7fe8e043ab80 1 client.16929 shutdown 2023-10-05T15:27:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.092+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 msgr2=0x563bb106ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.092+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb106ce10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4007fb0 tx=0x7fe8c4004ad0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 shutdown_connections 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb10c0f20 0x563bb10c3340 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 0x563bb106a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb106ce10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3505444120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1062520 0x563bb106a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 >> 172.21.15.60:0/3505444120 conn(0x563bb0fd7200 msgr2=0x563bb105dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8b57fa700 0 client.16929 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 shutdown_connections 2023-10-05T15:27:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.106+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3505444120 wait complete. 2023-10-05T15:27:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.108+0000 7fe8e043ab80 20 client.16929 trim_cache size 0 max 16384 2023-10-05T15:27:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.140+0000 7fe8e043ab80 1 Processor -- start 2023-10-05T15:27:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 -- start start 2023-10-05T15:27:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 0x563bb10b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1062520 0x563bb10bd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 0x563bb10653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb0e368c0 con 0x563bb1062520 2023-10-05T15:27:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb1062e20 con 0x563bb1061c00 2023-10-05T15:27:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.141+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb1063a90 con 0x563bb106d3d0 2023-10-05T15:27:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 0x563bb10b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 0x563bb10b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55214/0 (socket says 172.21.15.60:55214) 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 -- 172.21.15.60:0/2615794163 learned_addr learned my addr 172.21.15.60:0/2615794163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 -- 172.21.15.60:0/2615794163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 msgr2=0x563bb10653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 0x563bb10653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 -- 172.21.15.60:0/2615794163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1062520 msgr2=0x563bb10bd040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1062520 0x563bb10bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.142+0000 7fe8d1fec700 1 -- 172.21.15.60:0/2615794163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bb0e071f0 con 0x563bb1061c00 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.143+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 0x563bb10b7f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009430 tx=0x7fe8c4003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c5ef0f488c08bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.143+0000 7fe8c0ff9700 1 -- 172.21.15.60:0/2615794163 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4020810 con 0x563bb1061c00 2023-10-05T15:27:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.143+0000 7fe8c0ff9700 1 -- 172.21.15.60:0/2615794163 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8c4031440 con 0x563bb1061c00 2023-10-05T15:27:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.143+0000 7fe8c0ff9700 1 -- 172.21.15.60:0/2615794163 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4016680 con 0x563bb1061c00 2023-10-05T15:27:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.149+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2615794163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 msgr2=0x563bb10b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.149+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 0x563bb10b7f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009430 tx=0x7fe8c4003ba0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.161+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2615794163 shutdown_connections 2023-10-05T15:27:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.161+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb106d3d0 0x563bb10653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.161+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb1061c00 0x563bb10b7f10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.161+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/2615794163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1062520 0x563bb10bd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.161+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2615794163 >> 172.21.15.60:0/2615794163 conn(0x563bb0fd7200 msgr2=0x563bb105d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.167+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2615794163 shutdown_connections 2023-10-05T15:27:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.167+0000 7fe8e043ab80 1 -- 172.21.15.60:0/2615794163 wait complete. 2023-10-05T15:27:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.167+0000 7fe8e043ab80 1 -- start start 2023-10-05T15:27:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.167+0000 7fe8e043ab80 1 Processor -- start 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb10b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1062520 0x563bb10b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 0x563bb10b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb10b6970 con 0x563bb1061c00 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb10b6ae0 con 0x563bb106d3d0 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bb10b6ca0 con 0x563bb1062520 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.174+0000 7fe8e043ab80 10 client.0 _ll_register_callbacks cb 0x7fe8c4007950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 0x563bb10b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 0x563bb10b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55220/0 (socket says 172.21.15.60:55220) 2023-10-05T15:27:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 -- 172.21.15.60:0/3856602170 learned_addr learned my addr 172.21.15.60:0/3856602170 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 -- 172.21.15.60:0/3856602170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1062520 msgr2=0x563bb10b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1062520 0x563bb10b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 -- 172.21.15.60:0/3856602170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 msgr2=0x563bb10b7af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:27:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb10b7af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.175+0000 7fe8d27ed700 1 -- 172.21.15.60:0/3856602170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563bb0dc9c00 con 0x563bb106d3d0 2023-10-05T15:27:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.176+0000 7fe8d27ed700 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 0x563bb10b6430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0092a0 tx=0x7fe8bc0054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6bb967b5063f22 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.176+0000 7fe8b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:27:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.177+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3856602170 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc01c070 con 0x563bb106d3d0 2023-10-05T15:27:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.178+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3856602170 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fe8bc005b00 con 0x563bb106d3d0 2023-10-05T15:27:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.178+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8bc00f610 con 0x563bb106d3d0 2023-10-05T15:27:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.178+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3856602170 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8bc005cc0 con 0x563bb106d3d0 2023-10-05T15:27:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.190+0000 7fe8e043ab80 10 client.26588 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.190+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563bb0ddf250 con 0x563bb106d3d0 2023-10-05T15:27:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3856602170 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8bc00f610 con 0x563bb106d3d0 2023-10-05T15:27:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3856602170 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fe8bc02c050 con 0x563bb106d3d0 2023-10-05T15:27:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8e043ab80 10 client.26588 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8e043ab80 10 client.26588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8e043ab80 20 client.26588 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb1115e40 0x563bb1118260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8e043ab80 4 client.26588 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.191+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563bb0faead0 con 0x563bb1115e40 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.192+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb1115e40 0x563bb1118260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.192+0000 7fe8d1fec700 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb1115e40 0x563bb1118260 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34eae1c67d6e9075 server_cookie=2bc9ad24dbe6abe9 in_seq=0 out_seq=0 2023-10-05T15:27:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.192+0000 7fe8b57fa700 10 client.26588 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:36.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.342+0000 7fe8b57fa700 1 -- 172.21.15.60:0/3856602170 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563bb0faead0 con 0x563bb1115e40 2023-10-05T15:27:36.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.342+0000 7fe8b57fa700 10 client.26588 handle_command_reply: tid=0 2023-10-05T15:27:36.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.343+0000 7fe8e043ab80 1 client.26588 shutdown 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 msgr2=0x563bb10b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 0x563bb10b6430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0092a0 tx=0x7fe8bc0054b0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 shutdown_connections 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x563bb1115e40 0x563bb1118260 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563bb106d3d0 0x563bb10b6430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bb1061c00 0x563bb10b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8b57fa700 0 client.26588 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 --2- 172.21.15.60:0/3856602170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bb1062520 0x563bb10b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.347+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 >> 172.21.15.60:0/3856602170 conn(0x563bb0fd7200 msgr2=0x563bb10bd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.355+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 shutdown_connections 2023-10-05T15:27:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.357+0000 7fe8e043ab80 1 -- 172.21.15.60:0/3856602170 wait complete. 2023-10-05T15:27:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.364+0000 7fe8e043ab80 20 client.26588 trim_cache size 0 max 16384 2023-10-05T15:27:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.365+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe8b80a1670 msgr2=0x7fe8b80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.365+0000 7fe8d4250700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe8b80a1670 0x7fe8b80a3b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40060b0 tx=0x7fe8c4009130 comp rx=0 tx=0).stop 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.365+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc10fa90 msgr2=0x7fe8cc119f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.365+0000 7fe8d4250700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc10fa90 0x7fe8cc119f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800b450 tx=0x7fe8c800b760 comp rx=0 tx=0).stop 2023-10-05T15:27:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.366+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 shutdown_connections 2023-10-05T15:27:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.366+0000 7fe8d4250700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe8b80a1670 0x7fe8b80a3b30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.366+0000 7fe8d4250700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8cc11a690 0x7fe8cc112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.366+0000 7fe8d4250700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8cc10f620 0x7fe8cc1199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.366+0000 7fe8d4250700 1 --2- 172.21.15.60:0/1479611319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8cc10fa90 0x7fe8cc119f70 secure :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800b450 tx=0x7fe8c800b760 comp rx=0 tx=0).stop 2023-10-05T15:27:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.366+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 >> 172.21.15.60:0/1479611319 conn(0x7fe8cc06cfa0 msgr2=0x7fe8cc0718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.375+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 shutdown_connections 2023-10-05T15:27:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:36.377+0000 7fe8d4250700 1 -- 172.21.15.60:0/1479611319 wait complete. 2023-10-05T15:27:37.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:37 smithi060 ceph-mon[99238]: pgmap v341: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 674 KiB/s wr, 87 op/s 2023-10-05T15:27:37.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:37 smithi092 ceph-mon[102944]: pgmap v341: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 674 KiB/s wr, 87 op/s 2023-10-05T15:27:37.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:37 smithi135 ceph-mon[103360]: pgmap v341: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 674 KiB/s wr, 87 op/s 2023-10-05T15:27:39.664 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:39 smithi060 ceph-mon[99238]: pgmap v342: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 882 KiB/s wr, 95 op/s 2023-10-05T15:27:39.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:39 smithi092 ceph-mon[102944]: pgmap v342: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 882 KiB/s wr, 95 op/s 2023-10-05T15:27:39.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:39 smithi135 ceph-mon[103360]: pgmap v342: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 882 KiB/s wr, 95 op/s 2023-10-05T15:27:41.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:41 smithi060 ceph-mon[99238]: pgmap v343: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-10-05T15:27:41.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:41 smithi092 ceph-mon[102944]: pgmap v343: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-10-05T15:27:41.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:41 smithi135 ceph-mon[103360]: pgmap v343: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-10-05T15:27:42.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:42 smithi060 ceph-mon[99238]: pgmap v344: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 976 KiB/s wr, 89 op/s 2023-10-05T15:27:42.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:42 smithi092 ceph-mon[102944]: pgmap v344: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 976 KiB/s wr, 89 op/s 2023-10-05T15:27:43.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:42 smithi135 ceph-mon[103360]: pgmap v344: 129 pgs: 19 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 976 KiB/s wr, 89 op/s 2023-10-05T15:27:45.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:45 smithi135 ceph-mon[103360]: pgmap v345: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2023-10-05T15:27:45.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:45 smithi060 ceph-mon[99238]: pgmap v345: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2023-10-05T15:27:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:45 smithi092 ceph-mon[102944]: pgmap v345: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2023-10-05T15:27:47.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:47 smithi060 ceph-mon[99238]: pgmap v346: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 989 KiB/s wr, 104 op/s 2023-10-05T15:27:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:47 smithi092 ceph-mon[102944]: pgmap v346: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 989 KiB/s wr, 104 op/s 2023-10-05T15:27:47.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:47 smithi135 ceph-mon[103360]: pgmap v346: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 989 KiB/s wr, 104 op/s 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 -- 172.21.15.60:0/3725983689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f8107ea0 msgr2=0x7f51f8114360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 --2- 172.21.15.60:0/3725983689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f8107ea0 0x7f51f8114360 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f51f000b0d0 tx=0x7f51f000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 -- 172.21.15.60:0/3725983689 shutdown_connections 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 --2- 172.21.15.60:0/3725983689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f8107ea0 0x7f51f8114360 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 --2- 172.21.15.60:0/3725983689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f810d5a0 0x7f51f810d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 --2- 172.21.15.60:0/3725983689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f81074e0 0x7f51f8107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 -- 172.21.15.60:0/3725983689 >> 172.21.15.60:0/3725983689 conn(0x7f51f8076cd0 msgr2=0x7f51f8105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 -- 172.21.15.60:0/3725983689 shutdown_connections 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.574+0000 7f51fea75700 1 -- 172.21.15.60:0/3725983689 wait complete. 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 Processor -- start 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 -- start start 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f81074e0 0x7f51f81a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 0x7f51f81a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f810d5a0 0x7f51f819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819dac0 con 0x7f51f81074e0 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819dc30 con 0x7f51f810d5a0 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.575+0000 7f51fea75700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819ddf0 con 0x7f51f8107ea0 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 0x7f51f81a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 0x7f51f81a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55342/0 (socket says 172.21.15.60:55342) 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 -- 172.21.15.60:0/2714913822 learned_addr learned my addr 172.21.15.60:0/2714913822 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 -- 172.21.15.60:0/2714913822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f810d5a0 msgr2=0x7f51f819d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f810d5a0 0x7f51f819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 -- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f81074e0 msgr2=0x7f51f81a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f81074e0 0x7f51f81a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.576+0000 7f51f7fff700 1 -- 172.21.15.60:0/2714913822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009d00 con 0x7f51f8107ea0 2023-10-05T15:27:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.577+0000 7f51f7fff700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 0x7f51f81a3b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51e400e9a0 tx=0x7f51e400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.577+0000 7f51f5ffb700 1 -- 172.21.15.60:0/2714913822 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400cbd0 con 0x7f51f8107ea0 2023-10-05T15:27:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.577+0000 7f51f5ffb700 1 -- 172.21.15.60:0/2714913822 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e400cd30 con 0x7f51f8107ea0 2023-10-05T15:27:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.577+0000 7f51f5ffb700 1 -- 172.21.15.60:0/2714913822 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4018710 con 0x7f51f8107ea0 2023-10-05T15:27:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.583+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f819e0d0 con 0x7f51f8107ea0 2023-10-05T15:27:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.583+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81aa5e0 con 0x7f51f8107ea0 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 Processor -- start 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 -- start start 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606bce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86061b400 con 0x55b8606bd3d0 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86060cbc0 con 0x55b8606b1c00 2023-10-05T15:27:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.588+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86060a4e0 con 0x55b8606b2520 2023-10-05T15:27:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.590+0000 7f51f5ffb700 1 -- 172.21.15.60:0/2714913822 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f51e4010980 con 0x7f51f8107ea0 2023-10-05T15:27:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.590+0000 7f51f7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.590+0000 7f51f7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606bf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41816/0 (socket says 172.21.15.60:41816) 2023-10-05T15:27:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.590+0000 7f51f7fff700 1 -- 172.21.15.60:0/1319733618 learned_addr learned my addr 172.21.15.60:0/1319733618 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f5ffb700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51e80a1670 0x7f51e80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51fc811700 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606bce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51fd012700 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f5ffb700 1 -- 172.21.15.60:0/2714913822 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f51e4014070 con 0x7f51f8107ea0 2023-10-05T15:27:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f7fff700 1 -- 172.21.15.60:0/1319733618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 msgr2=0x55b8606bce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f7fff700 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606bce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f7fff700 1 -- 172.21.15.60:0/1319733618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 msgr2=0x55b8606b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f7fff700 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51f7fff700 1 -- 172.21.15.60:0/1319733618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b860430d80 con 0x55b8606bd3d0 2023-10-05T15:27:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.591+0000 7f51fd012700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51e80a1670 0x7f51e80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.595+0000 7f51f7fff700 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606bf7c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f51e40ca810 tx=0x7f51e4010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37ac5871493e2e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.596+0000 7f51e2ffd700 1 -- 172.21.15.60:0/1319733618 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4099e10 con 0x55b8606bd3d0 2023-10-05T15:27:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.596+0000 7f51e2ffd700 1 -- 172.21.15.60:0/1319733618 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e4099b80 con 0x55b8606bd3d0 2023-10-05T15:27:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.596+0000 7f51e2ffd700 1 -- 172.21.15.60:0/1319733618 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e409a500 con 0x55b8606bd3d0 2023-10-05T15:27:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.597+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1319733618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 msgr2=0x55b8606bf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.597+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606bf7c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f51e40ca810 tx=0x7f51e4010d80 comp rx=0 tx=0).stop 2023-10-05T15:27:49.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.603+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1319733618 shutdown_connections 2023-10-05T15:27:49.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.603+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606bf7c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.603+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.603+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1319733618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606bce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.603+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1319733618 >> 172.21.15.60:0/1319733618 conn(0x55b860627200 msgr2=0x55b8606ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.603+0000 7f51fd012700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51e80a1670 0x7f51e80a3b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009fd0 tx=0x7f51f00099e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.606+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1319733618 shutdown_connections 2023-10-05T15:27:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.606+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1319733618 wait complete. 2023-10-05T15:27:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.607+0000 7f520ac5fb80 1 -- start start 2023-10-05T15:27:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.607+0000 7f520ac5fb80 1 Processor -- start 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b860605dd0 con 0x55b8606bd3d0 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8605a26b0 con 0x55b8606b1c00 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8605a2350 con 0x55b8606b2520 2023-10-05T15:27:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.609+0000 7f520ac5fb80 10 client.0 _ll_register_callbacks cb 0x55b8603ff7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.611+0000 7f51fc811700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.611+0000 7f51fc811700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55244/0 (socket says 172.21.15.60:55244) 2023-10-05T15:27:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.611+0000 7f51fc811700 1 -- 172.21.15.60:0/4047795331 learned_addr learned my addr 172.21.15.60:0/4047795331 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:49.614 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.611+0000 7f51f7fff700 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.614 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51f7fff700 1 -- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 msgr2=0x55b8606bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51f7fff700 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51f7fff700 1 -- 172.21.15.60:0/4047795331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 msgr2=0x55b8606ba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51f7fff700 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51f7fff700 1 -- 172.21.15.60:0/4047795331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81aa5e0 con 0x55b8606b2520 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51f7fff700 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606ba0e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51e4099cf0 tx=0x7f51e409a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd304ef6e86207a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51d7fff700 1 -- 172.21.15.60:0/4047795331 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4099e10 con 0x55b8606b2520 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51d7fff700 1 -- 172.21.15.60:0/4047795331 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f51e409a740 con 0x55b8606b2520 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8606a5d50 con 0x55b8606b2520 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f51d7fff700 1 -- 172.21.15.60:0/4047795331 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51e40a23d0 con 0x55b8606b2520 2023-10-05T15:27:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f520ac5fb80 10 client.26431 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.612+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b860419c00 con 0x55b8606b2520 2023-10-05T15:27:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f51d7fff700 1 -- 172.21.15.60:0/4047795331 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b8606a5d50 con 0x55b8606b2520 2023-10-05T15:27:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f51d7fff700 1 -- 172.21.15.60:0/4047795331 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f51e4095e30 con 0x55b8606b2520 2023-10-05T15:27:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f520ac5fb80 10 client.26431 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f520ac5fb80 10 client.26431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f520ac5fb80 20 client.26431 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b8606ddce0 0x55b8606e0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f520ac5fb80 4 client.26431 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:27:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.613+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8605fedb0 con 0x55b8606ddce0 2023-10-05T15:27:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.626+0000 7f51fc811700 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b8606ddce0 0x55b8606e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.628+0000 7f51fc811700 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b8606ddce0 0x55b8606e0140 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7822a6607552c7f server_cookie=45896487682971f2 in_seq=0 out_seq=0 2023-10-05T15:27:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.629+0000 7f51d7fff700 10 client.26431 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.638+0000 7f51d7fff700 1 -- 172.21.15.60:0/4047795331 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b8605fedb0 con 0x55b8606ddce0 2023-10-05T15:27:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.638+0000 7f51d7fff700 10 client.26431 handle_command_reply: tid=0 2023-10-05T15:27:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.638+0000 7f520ac5fb80 1 client.26431 shutdown 2023-10-05T15:27:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.643+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 msgr2=0x55b8606ba0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.643+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606ba0e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51e4099cf0 tx=0x7f51e409a560 comp rx=0 tx=0).stop 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 shutdown_connections 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b8606ddce0 0x55b8606e0140 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b1c00 0x55b8606bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/4047795331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b2520 0x55b8606ba0e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 >> 172.21.15.60:0/4047795331 conn(0x55b860627200 msgr2=0x55b8606adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.646+0000 7f51d7fff700 0 client.26431 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.649+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 shutdown_connections 2023-10-05T15:27:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.649+0000 7f520ac5fb80 1 -- 172.21.15.60:0/4047795331 wait complete. 2023-10-05T15:27:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.649+0000 7f520ac5fb80 20 client.26431 trim_cache size 0 max 16384 2023-10-05T15:27:49.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:49 smithi060 ceph-mon[99238]: pgmap v347: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1000 KiB/s wr, 119 op/s 2023-10-05T15:27:49.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:49 smithi092 ceph-mon[102944]: pgmap v347: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1000 KiB/s wr, 119 op/s 2023-10-05T15:27:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.677+0000 7f520ac5fb80 1 Processor -- start 2023-10-05T15:27:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.677+0000 7f520ac5fb80 1 -- start start 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b1c00 0x55b8606b9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8604868c0 con 0x55b8606bd3d0 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8606c4450 con 0x55b8606b2520 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8606a5bb0 con 0x55b8606b1c00 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f51f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f51f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55254/0 (socket says 172.21.15.60:55254) 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f51f7fff700 1 -- 172.21.15.60:0/2036131528 learned_addr learned my addr 172.21.15.60:0/2036131528 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.678+0000 7f51fd012700 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.679+0000 7f51fd012700 1 -- 172.21.15.60:0/2036131528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b1c00 msgr2=0x55b8606b9980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:27:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.679+0000 7f51fd012700 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b1c00 0x55b8606b9980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.679+0000 7f51fd012700 1 -- 172.21.15.60:0/2036131528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 msgr2=0x55b8606c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.679+0000 7f51fd012700 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.679+0000 7f51fd012700 1 -- 172.21.15.60:0/2036131528 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8604571f0 con 0x55b8606bd3d0 2023-10-05T15:27:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.681+0000 7f51fd012700 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606c8670 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f51f81a42f0 tx=0x7f51f000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179a8cd2e8bf56c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.686+0000 7f51e37fe700 1 -- 172.21.15.60:0/2036131528 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f000e070 con 0x55b8606bd3d0 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.686+0000 7f51e37fe700 1 -- 172.21.15.60:0/2036131528 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51f0004c10 con 0x55b8606bd3d0 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.686+0000 7f51e37fe700 1 -- 172.21.15.60:0/2036131528 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0005800 con 0x55b8606bd3d0 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 -- 172.21.15.60:0/2036131528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 msgr2=0x55b8606c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606c8670 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f51f81a42f0 tx=0x7f51f000b730 comp rx=0 tx=0).stop 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 -- 172.21.15.60:0/2036131528 shutdown_connections 2023-10-05T15:27:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606bd3d0 0x55b8606c8670 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606b1c00 0x55b8606b9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/2036131528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.687+0000 7f520ac5fb80 1 -- 172.21.15.60:0/2036131528 >> 172.21.15.60:0/2036131528 conn(0x55b860627200 msgr2=0x55b8606e4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.693+0000 7f520ac5fb80 1 -- 172.21.15.60:0/2036131528 shutdown_connections 2023-10-05T15:27:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.693+0000 7f520ac5fb80 1 -- 172.21.15.60:0/2036131528 wait complete. 2023-10-05T15:27:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.693+0000 7f520ac5fb80 1 -- start start 2023-10-05T15:27:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 Processor -- start 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 0x55b8606b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606bd3d0 0x55b8606b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8606b70c0 con 0x55b8606b1c00 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8606b7230 con 0x55b8606b2520 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b860742ba0 con 0x55b8606bd3d0 2023-10-05T15:27:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.694+0000 7f520ac5fb80 10 client.0 _ll_register_callbacks cb 0x55b8603ff7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:27:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.699+0000 7f51fd012700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606bd3d0 0x55b8606b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.699+0000 7f51fc811700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 0x55b8606b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.699+0000 7f51fc811700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 0x55b8606b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41836/0 (socket says 172.21.15.60:41836) 2023-10-05T15:27:49.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.699+0000 7f51fc811700 1 -- 172.21.15.60:0/1481446099 learned_addr learned my addr 172.21.15.60:0/1481446099 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:27:49.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.700+0000 7f51fc811700 1 -- 172.21.15.60:0/1481446099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606bd3d0 msgr2=0x55b8606b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.706 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.700+0000 7f51fc811700 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606bd3d0 0x55b8606b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.700+0000 7f51fc811700 1 -- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 msgr2=0x55b8606b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:27:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.700+0000 7f51fc811700 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.700+0000 7f51fc811700 1 -- 172.21.15.60:0/1481446099 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f8114c60 con 0x55b8606b1c00 2023-10-05T15:27:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.700+0000 7f51fc811700 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 0x55b8606b7cc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x55b8606e0a30 tx=0x7f51ec01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852cff9b05d087f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.701+0000 7f51d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:27:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.704+0000 7f51d7fff700 1 -- 172.21.15.60:0/1481446099 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec017040 con 0x55b8606b1c00 2023-10-05T15:27:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.704+0000 7f51d7fff700 1 -- 172.21.15.60:0/1481446099 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7f51ec010630 con 0x55b8606b1c00 2023-10-05T15:27:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.704+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51e4099b80 con 0x55b8606b1c00 2023-10-05T15:27:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.706+0000 7f51d7fff700 1 -- 172.21.15.60:0/1481446099 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51ec0107f0 con 0x55b8606b1c00 2023-10-05T15:27:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.706+0000 7f520ac5fb80 10 client.16941 fetch_fsmap learned FSMap version 43 2023-10-05T15:27:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.706+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b86042f250 con 0x55b8606b1c00 2023-10-05T15:27:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.706+0000 7f51d7fff700 1 -- 172.21.15.60:0/1481446099 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e4099b80 con 0x55b8606b1c00 2023-10-05T15:27:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f51d7fff700 1 -- 172.21.15.60:0/1481446099 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f51ec02e9d0 con 0x55b8606b1c00 2023-10-05T15:27:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f520ac5fb80 10 client.16941 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:27:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f520ac5fb80 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:27:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f520ac5fb80 20 client.16941 populate_metadata read hostname 'smithi060' 2023-10-05T15:27:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b860744300 0x55b860746720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f520ac5fb80 4 client.16941 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:27:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.712+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b8605fead0 con 0x55b860744300 2023-10-05T15:27:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.726+0000 7f51f7fff700 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b860744300 0x55b860746720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.730+0000 7f51d7fff700 10 client.16941 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.730+0000 7f51f7fff700 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b860744300 0x55b860746720 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7644c8556293865 server_cookie=4de7fc423b260796 in_seq=0 out_seq=0 2023-10-05T15:27:49.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:49 smithi135 ceph-mon[103360]: pgmap v347: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1000 KiB/s wr, 119 op/s 2023-10-05T15:27:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.857+0000 7f51d7fff700 1 -- 172.21.15.60:0/1481446099 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b8605fead0 con 0x55b860744300 2023-10-05T15:27:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.857+0000 7f51d7fff700 10 client.16941 handle_command_reply: tid=0 2023-10-05T15:27:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.858+0000 7f520ac5fb80 1 client.16941 shutdown 2023-10-05T15:27:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.864+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 msgr2=0x55b8606b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.864+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 0x55b8606b7cc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x55b8606e0a30 tx=0x7f51ec01cbe0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.866+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 shutdown_connections 2023-10-05T15:27:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.866+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b860744300 0x55b860746720 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.866+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b8606bd3d0 0x55b8606b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.866+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8606b1c00 0x55b8606b7cc0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.866+0000 7f520ac5fb80 1 --2- 172.21.15.60:0/1481446099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8606b2520 0x55b8606b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.866+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 >> 172.21.15.60:0/1481446099 conn(0x55b860627200 msgr2=0x55b8606c8670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.868+0000 7f51d7fff700 0 client.16941 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:27:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.870+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 shutdown_connections 2023-10-05T15:27:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.871+0000 7f520ac5fb80 1 -- 172.21.15.60:0/1481446099 wait complete. 2023-10-05T15:27:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.872+0000 7f520ac5fb80 20 client.16941 trim_cache size 0 max 16384 2023-10-05T15:27:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:27:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:27:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:27:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:27:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.872+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51e80a1670 msgr2=0x7f51e80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.872+0000 7f51fea75700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51e80a1670 0x7f51e80a3b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009fd0 tx=0x7f51f00099e0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.872+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 msgr2=0x7f51f81a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.872+0000 7f51fea75700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 0x7f51f81a3b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51e400e9a0 tx=0x7f51e400ed60 comp rx=0 tx=0).stop 2023-10-05T15:27:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.882+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 shutdown_connections 2023-10-05T15:27:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.882+0000 7f51fea75700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f51e80a1670 0x7f51e80a3b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.882+0000 7f51fea75700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f810d5a0 0x7f51f819d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.882+0000 7f51fea75700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f81074e0 0x7f51f81a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.882+0000 7f51fea75700 1 --2- 172.21.15.60:0/2714913822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f8107ea0 0x7f51f81a3b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.882+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 >> 172.21.15.60:0/2714913822 conn(0x7f51f8076cd0 msgr2=0x7f51f8077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.893+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 shutdown_connections 2023-10-05T15:27:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:27:49.897+0000 7f51fea75700 1 -- 172.21.15.60:0/2714913822 wait complete. 2023-10-05T15:27:51.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:51 smithi060 ceph-mon[99238]: pgmap v348: 129 pgs: 15 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-10-05T15:27:51.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:51 smithi092 ceph-mon[102944]: pgmap v348: 129 pgs: 15 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-10-05T15:27:51.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:51 smithi135 ceph-mon[103360]: pgmap v348: 129 pgs: 15 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-10-05T15:27:52.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:52 smithi060 ceph-mon[99238]: pgmap v349: 129 pgs: 15 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 913 KiB/s wr, 116 op/s 2023-10-05T15:27:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:52 smithi092 ceph-mon[102944]: pgmap v349: 129 pgs: 15 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 913 KiB/s wr, 116 op/s 2023-10-05T15:27:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:52 smithi135 ceph-mon[103360]: pgmap v349: 129 pgs: 15 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 913 KiB/s wr, 116 op/s 2023-10-05T15:27:55.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:55 smithi060 ceph-mon[99238]: pgmap v350: 129 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 96 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 151 op/s 2023-10-05T15:27:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:55 smithi092 ceph-mon[102944]: pgmap v350: 129 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 96 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 151 op/s 2023-10-05T15:27:55.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:55 smithi135 ceph-mon[103360]: pgmap v350: 129 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 96 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 151 op/s 2023-10-05T15:27:57.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:57 smithi060 ceph-mon[99238]: pgmap v351: 129 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 789 KiB/s wr, 134 op/s 2023-10-05T15:27:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:57 smithi092 ceph-mon[102944]: pgmap v351: 129 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 789 KiB/s wr, 134 op/s 2023-10-05T15:27:57.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:57 smithi135 ceph-mon[103360]: pgmap v351: 129 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 789 KiB/s wr, 134 op/s 2023-10-05T15:27:59.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:27:59 smithi060 ceph-mon[99238]: pgmap v352: 129 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 98 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 151 op/s 2023-10-05T15:27:59.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:27:59 smithi092 ceph-mon[102944]: pgmap v352: 129 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 98 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 151 op/s 2023-10-05T15:27:59.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:27:59 smithi135 ceph-mon[103360]: pgmap v352: 129 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 98 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 151 op/s 2023-10-05T15:28:01.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:01 smithi060 ceph-mon[99238]: pgmap v353: 129 pgs: 8 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 115 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 149 op/s 2023-10-05T15:28:01.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:01 smithi092 ceph-mon[102944]: pgmap v353: 129 pgs: 8 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 115 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 149 op/s 2023-10-05T15:28:01.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:01 smithi135 ceph-mon[103360]: pgmap v353: 129 pgs: 8 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 115 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 149 op/s 2023-10-05T15:28:02.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:02 smithi060 ceph-mon[99238]: pgmap v354: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.1 MiB/s wr, 139 op/s 2023-10-05T15:28:02.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:02 smithi092 ceph-mon[102944]: pgmap v354: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.1 MiB/s wr, 139 op/s 2023-10-05T15:28:03.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:02 smithi135 ceph-mon[103360]: pgmap v354: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.1 MiB/s wr, 139 op/s 2023-10-05T15:28:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.100+0000 7fa2080a1700 1 -- 172.21.15.60:0/2472493751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa200107eb0 msgr2=0x7fa200108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.100+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2472493751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa200107eb0 0x7fa200108330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009990 tx=0x7fa1f0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.104+0000 7fa2080a1700 1 -- 172.21.15.60:0/2472493751 shutdown_connections 2023-10-05T15:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.104+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2472493751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa200108870 0x7fa200079110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.104+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2472493751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa20010d520 0x7fa20010d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.104+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2472493751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa200107eb0 0x7fa200108330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.104+0000 7fa2080a1700 1 -- 172.21.15.60:0/2472493751 >> 172.21.15.60:0/2472493751 conn(0x7fa20006cfa0 msgr2=0x7fa20006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.111+0000 7fa2080a1700 1 -- 172.21.15.60:0/2472493751 shutdown_connections 2023-10-05T15:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.115+0000 7fa2080a1700 1 -- 172.21.15.60:0/2472493751 wait complete. 2023-10-05T15:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 Processor -- start 2023-10-05T15:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 -- start start 2023-10-05T15:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa200107eb0 0x7fa2000836b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa200108870 0x7fa20007d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 0x7fa20007d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20007df00 con 0x7fa200107eb0 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20007e070 con 0x7fa20010d520 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa2080a1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20007e230 con 0x7fa200108870 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa20663e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 0x7fa20007d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.116+0000 7fa20663e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 0x7fa20007d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55268/0 (socket says 172.21.15.60:55268) 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa20663e700 1 -- 172.21.15.60:0/2277028470 learned_addr learned my addr 172.21.15.60:0/2277028470 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa200107eb0 0x7fa2000836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 -- 172.21.15.60:0/2277028470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa200108870 msgr2=0x7fa20007d480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa200108870 0x7fa20007d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 -- 172.21.15.60:0/2277028470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 msgr2=0x7fa20007d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 0x7fa20007d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 -- 172.21.15.60:0/2277028470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00095f0 con 0x7fa200107eb0 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa20663e700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 0x7fa20007d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa205e3d700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa200107eb0 0x7fa2000836b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b450 tx=0x7fa1fc00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.117+0000 7fa1f6ffd700 1 -- 172.21.15.60:0/2277028470 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc011830 con 0x7fa200107eb0 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.118+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001bb0e0 con 0x7fa200107eb0 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.118+0000 7fa1f6ffd700 1 -- 172.21.15.60:0/2277028470 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1fc011e50 con 0x7fa200107eb0 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.118+0000 7fa1f6ffd700 1 -- 172.21.15.60:0/2277028470 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc010de0 con 0x7fa200107eb0 2023-10-05T15:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.118+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001bb5f0 con 0x7fa200107eb0 2023-10-05T15:28:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.121+0000 7fa1f6ffd700 1 -- 172.21.15.60:0/2277028470 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa1fc010480 con 0x7fa200107eb0 2023-10-05T15:28:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.122+0000 7fa1f6ffd700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa1ec0a15f0 0x7fa1ec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.122+0000 7fa1f6ffd700 1 -- 172.21.15.60:0/2277028470 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fa1fc0cce60 con 0x7fa200107eb0 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.122+0000 7fa20563c700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa1ec0a15f0 0x7fa1ec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.122+0000 7fa21428bb80 1 Processor -- start 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.122+0000 7fa21428bb80 1 -- start start 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x562791748fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x562791753e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa21428bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627916b2400 con 0x5627917543d0 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa21428bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627916a3bc0 con 0x562791748c00 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa21428bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627916a14e0 con 0x562791749520 2023-10-05T15:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x562791753e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20663e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x562791753e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55386/0 (socket says 172.21.15.60:55386) 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 -- 172.21.15.60:0/350730514 learned_addr learned my addr 172.21.15.60:0/350730514 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa205e3d700 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x562791748fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 -- 172.21.15.60:0/350730514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 msgr2=0x562791748fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x562791748fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 -- 172.21.15.60:0/350730514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 msgr2=0x5627917567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 -- 172.21.15.60:0/350730514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627914c7d80 con 0x562791749520 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20663e700 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.123+0000 7fa20563c700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa1ec0a15f0 0x7fa1ec0a3ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000b6f0 tx=0x7fa1f0004740 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.124+0000 7fa20563c700 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x562791753e90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009990 tx=0x7fa1f0026000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28c616f0a7006024 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.124+0000 7fa1ebfff700 1 -- 172.21.15.60:0/350730514 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002d070 con 0x562791749520 2023-10-05T15:28:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.124+0000 7fa1ebfff700 1 -- 172.21.15.60:0/350730514 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f00047b0 con 0x562791749520 2023-10-05T15:28:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.124+0000 7fa1ebfff700 1 -- 172.21.15.60:0/350730514 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0005290 con 0x562791749520 2023-10-05T15:28:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 -- 172.21.15.60:0/350730514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 msgr2=0x562791753e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x562791753e90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009990 tx=0x7fa1f0026000 comp rx=0 tx=0).stop 2023-10-05T15:28:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 -- 172.21.15.60:0/350730514 shutdown_connections 2023-10-05T15:28:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x562791748fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 --2- 172.21.15.60:0/350730514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x562791753e90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 -- 172.21.15.60:0/350730514 >> 172.21.15.60:0/350730514 conn(0x5627916be200 msgr2=0x562791745080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 -- 172.21.15.60:0/350730514 shutdown_connections 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.125+0000 7fa21428bb80 1 -- 172.21.15.60:0/350730514 wait complete. 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 -- start start 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 Processor -- start 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562791748c00 0x562791753e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627917543d0 0x5627917517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279169cdd0 con 0x562791748c00 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627916396b0 con 0x5627917543d0 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562791639350 con 0x562791749520 2023-10-05T15:28:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.126+0000 7fa21428bb80 10 client.0 _ll_register_callbacks cb 0x5627914967a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.127+0000 7fa205e3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562791748c00 0x562791753e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.127+0000 7fa205e3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562791748c00 0x562791753e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41862/0 (socket says 172.21.15.60:41862) 2023-10-05T15:28:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.127+0000 7fa205e3d700 1 -- 172.21.15.60:0/3796286474 learned_addr learned my addr 172.21.15.60:0/3796286474 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627917543d0 0x5627917517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 -- 172.21.15.60:0/3796286474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 msgr2=0x5627917510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 -- 172.21.15.60:0/3796286474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562791748c00 msgr2=0x562791753e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562791748c00 0x562791753e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 -- 172.21.15.60:0/3796286474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f8009110 con 0x5627917543d0 2023-10-05T15:28:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa20663e700 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627917543d0 0x5627917517b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8007fb0 tx=0x7fa1f800e7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f939ae0e8f6ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.130+0000 7fa1e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:28:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.132+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3796286474 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8004db0 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3796286474 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fa1f8003a00 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56279173cd50 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3796286474 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1f8005020 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa21428bb80 10 client.26612 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fa200079b40 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3796286474 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56279173cd50 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3796286474 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fa1f80285e0 con 0x5627917543d0 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa21428bb80 10 client.26612 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.133+0000 7fa21428bb80 10 client.26612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.134+0000 7fa21428bb80 20 client.26612 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.134+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562791764000 0x5627917664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.134+0000 7fa21428bb80 4 client.26612 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.134+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562791695db0 con 0x562791764000 2023-10-05T15:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.139+0000 7fa205e3d700 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562791764000 0x5627917664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.139+0000 7fa205e3d700 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562791764000 0x5627917664a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5960e20269e32e2 server_cookie=769c4db244f28f02 in_seq=0 out_seq=0 2023-10-05T15:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.139+0000 7fa1e97fa700 10 client.26612 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.140+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3796286474 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562791695db0 con 0x562791764000 2023-10-05T15:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.140+0000 7fa1e97fa700 10 client.26612 handle_command_reply: tid=0 2023-10-05T15:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.140+0000 7fa21428bb80 1 client.26612 shutdown 2023-10-05T15:28:03.162 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627917543d0 msgr2=0x5627917517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627917543d0 0x5627917517b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8007fb0 tx=0x7fa1f800e7d0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 shutdown_connections 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562791764000 0x5627917664a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627917543d0 0x5627917517b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562791748c00 0x562791753e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3796286474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.159+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 >> 172.21.15.60:0/3796286474 conn(0x5627916be200 msgr2=0x562791744c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.164+0000 7fa1e97fa700 0 client.26612 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.164+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 shutdown_connections 2023-10-05T15:28:03.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.166+0000 7fa21428bb80 1 -- 172.21.15.60:0/3796286474 wait complete. 2023-10-05T15:28:03.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.166+0000 7fa21428bb80 20 client.26612 trim_cache size 0 max 16384 2023-10-05T15:28:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.196+0000 7fa21428bb80 1 Processor -- start 2023-10-05T15:28:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.196+0000 7fa21428bb80 1 -- start start 2023-10-05T15:28:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.197+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x5627917516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.197+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.197+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.197+0000 7fa21428bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279151d8c0 con 0x5627917543d0 2023-10-05T15:28:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.197+0000 7fa21428bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562791741150 con 0x562791748c00 2023-10-05T15:28:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.197+0000 7fa21428bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279174f660 con 0x562791749520 2023-10-05T15:28:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.201+0000 7fa20563c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55398/0 (socket says 172.21.15.60:55398) 2023-10-05T15:28:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 -- 172.21.15.60:0/2811046093 learned_addr learned my addr 172.21.15.60:0/2811046093 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 -- 172.21.15.60:0/2811046093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 msgr2=0x5627917516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x5627917516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 -- 172.21.15.60:0/2811046093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 msgr2=0x5627917539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 -- 172.21.15.60:0/2811046093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627914b0c00 con 0x562791749520 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa20563c700 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917508c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0005b40 tx=0x7fa1f000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e217a4af775f8b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.202+0000 7fa1f4ff9700 1 -- 172.21.15.60:0/2811046093 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002d070 con 0x562791749520 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.203+0000 7fa1f4ff9700 1 -- 172.21.15.60:0/2811046093 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f00055a0 con 0x562791749520 2023-10-05T15:28:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.203+0000 7fa1f4ff9700 1 -- 172.21.15.60:0/2811046093 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0004920 con 0x562791749520 2023-10-05T15:28:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.208+0000 7fa21428bb80 1 -- 172.21.15.60:0/2811046093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 msgr2=0x5627917508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.208+0000 7fa21428bb80 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917508c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0005b40 tx=0x7fa1f000b8f0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.216+0000 7fa21428bb80 1 -- 172.21.15.60:0/2811046093 shutdown_connections 2023-10-05T15:28:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.216+0000 7fa21428bb80 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x5627917539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.216+0000 7fa21428bb80 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791748c00 0x5627917516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.216+0000 7fa21428bb80 1 --2- 172.21.15.60:0/2811046093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791749520 0x5627917508c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.216+0000 7fa21428bb80 1 -- 172.21.15.60:0/2811046093 >> 172.21.15.60:0/2811046093 conn(0x5627916be200 msgr2=0x562791766010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.220+0000 7fa21428bb80 1 -- 172.21.15.60:0/2811046093 shutdown_connections 2023-10-05T15:28:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.220+0000 7fa21428bb80 1 -- 172.21.15.60:0/2811046093 wait complete. 2023-10-05T15:28:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.220+0000 7fa21428bb80 1 -- start start 2023-10-05T15:28:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.220+0000 7fa21428bb80 1 Processor -- start 2023-10-05T15:28:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791748c00 0x562791758ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791749520 0x5627917593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x562791759920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279175b4a0 con 0x5627917543d0 2023-10-05T15:28:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627917b6ef0 con 0x562791749520 2023-10-05T15:28:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627917b7080 con 0x562791748c00 2023-10-05T15:28:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa21428bb80 10 client.0 _ll_register_callbacks cb 0x7fa1f8007c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa20663e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x562791759920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa20663e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x562791759920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41876/0 (socket says 172.21.15.60:41876) 2023-10-05T15:28:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa20663e700 1 -- 172.21.15.60:0/3452251776 learned_addr learned my addr 172.21.15.60:0/3452251776 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.221+0000 7fa205e3d700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791748c00 0x562791758ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa20563c700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791749520 0x5627917593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa205e3d700 1 -- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791749520 msgr2=0x5627917593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa205e3d700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791749520 0x5627917593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa205e3d700 1 -- 172.21.15.60:0/3452251776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 msgr2=0x562791759920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa205e3d700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x562791759920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa205e3d700 1 -- 172.21.15.60:0/3452251776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627914c7d80 con 0x562791748c00 2023-10-05T15:28:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.222+0000 7fa205e3d700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791748c00 0x562791758ea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0965f0 tx=0x7fa1fc09a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc87c9353b63c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa1e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:28:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3452251776 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0b2420 con 0x562791748c00 2023-10-05T15:28:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3452251776 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9491+0+0 (secure 0 0 0) 0x7fa1fc09dcd0 con 0x562791748c00 2023-10-05T15:28:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1f00047b0 con 0x562791748c00 2023-10-05T15:28:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3452251776 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1fc0a1f10 con 0x562791748c00 2023-10-05T15:28:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 10 client.26446 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5627914ee1f0 con 0x562791748c00 2023-10-05T15:28:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3452251776 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f00047b0 con 0x562791748c00 2023-10-05T15:28:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3452251776 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fa1fc099070 con 0x562791748c00 2023-10-05T15:28:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 10 client.26446 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 20 client.26446 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5627917da8e0 0x5627917dcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 4 client.26446 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:28:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.223+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562791695ad0 con 0x5627917da8e0 2023-10-05T15:28:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.224+0000 7fa20563c700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5627917da8e0 0x5627917dcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.225+0000 7fa1e97fa700 10 client.26446 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.225+0000 7fa20563c700 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5627917da8e0 0x5627917dcd00 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4def1f2fe5b34c server_cookie=d4b5e851127a0517 in_seq=0 out_seq=0 2023-10-05T15:28:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa1e97fa700 1 -- 172.21.15.60:0/3452251776 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562791695ad0 con 0x5627917da8e0 2023-10-05T15:28:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa1e97fa700 10 client.26446 handle_command_reply: tid=0 2023-10-05T15:28:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 client.26446 shutdown 2023-10-05T15:28:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791748c00 msgr2=0x562791758ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791748c00 0x562791758ea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0965f0 tx=0x7fa1fc09a2e0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 shutdown_connections 2023-10-05T15:28:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5627917da8e0 0x5627917dcd00 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627917543d0 0x562791759920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562791748c00 0x562791758ea0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 --2- 172.21.15.60:0/3452251776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562791749520 0x5627917593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 >> 172.21.15.60:0/3452251776 conn(0x5627916be200 msgr2=0x56279174c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.306+0000 7fa1e97fa700 0 client.26446 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.307+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 shutdown_connections 2023-10-05T15:28:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.307+0000 7fa21428bb80 1 -- 172.21.15.60:0/3452251776 wait complete. 2023-10-05T15:28:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.308+0000 7fa21428bb80 20 client.26446 trim_cache size 0 max 16384 2023-10-05T15:28:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:28:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:28:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:28:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:28:03.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.321+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa1ec0a15f0 msgr2=0x7fa1ec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.321+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa1ec0a15f0 0x7fa1ec0a3ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000b6f0 tx=0x7fa1f0004740 comp rx=0 tx=0).stop 2023-10-05T15:28:03.323 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.321+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa200107eb0 msgr2=0x7fa2000836b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:03.324 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.321+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa200107eb0 0x7fa2000836b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b450 tx=0x7fa1fc00b760 comp rx=0 tx=0).stop 2023-10-05T15:28:03.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.323+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 shutdown_connections 2023-10-05T15:28:03.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.323+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa1ec0a15f0 0x7fa1ec0a3ab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.323+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa20010d520 0x7fa20007d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.323+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa200107eb0 0x7fa2000836b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.323+0000 7fa2080a1700 1 --2- 172.21.15.60:0/2277028470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa200108870 0x7fa20007d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:03.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.323+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 >> 172.21.15.60:0/2277028470 conn(0x7fa20006cfa0 msgr2=0x7fa2000730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:03.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.324+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 shutdown_connections 2023-10-05T15:28:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:03.327+0000 7fa2080a1700 1 -- 172.21.15.60:0/2277028470 wait complete. 2023-10-05T15:28:05.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:05 smithi060 ceph-mon[99238]: pgmap v355: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 174 op/s 2023-10-05T15:28:05.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:05 smithi092 ceph-mon[102944]: pgmap v355: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 174 op/s 2023-10-05T15:28:05.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:05 smithi135 ceph-mon[103360]: pgmap v355: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 174 op/s 2023-10-05T15:28:07.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:07 smithi060 ceph-mon[99238]: pgmap v356: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-10-05T15:28:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:07 smithi092 ceph-mon[102944]: pgmap v356: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-10-05T15:28:07.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:07 smithi135 ceph-mon[103360]: pgmap v356: 129 pgs: 7 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 116 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-10-05T15:28:09.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:09 smithi060 ceph-mon[99238]: pgmap v357: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-10-05T15:28:09.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:09 smithi060 ceph-mon[99238]: osdmap e107: 12 total, 12 up, 12 in 2023-10-05T15:28:09.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:09 smithi092 ceph-mon[102944]: pgmap v357: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-10-05T15:28:09.680 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:09 smithi092 ceph-mon[102944]: osdmap e107: 12 total, 12 up, 12 in 2023-10-05T15:28:09.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:09 smithi135 ceph-mon[103360]: pgmap v357: 129 pgs: 5 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 118 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-10-05T15:28:09.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:09 smithi135 ceph-mon[103360]: osdmap e107: 12 total, 12 up, 12 in 2023-10-05T15:28:11.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:11 smithi060 ceph-mon[99238]: pgmap v359: 129 pgs: 10 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 85 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 157 op/s 2023-10-05T15:28:11.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:11 smithi092 ceph-mon[102944]: pgmap v359: 129 pgs: 10 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 85 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 157 op/s 2023-10-05T15:28:11.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:11 smithi135 ceph-mon[103360]: pgmap v359: 129 pgs: 10 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 85 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 157 op/s 2023-10-05T15:28:12.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:12 smithi060 ceph-mon[99238]: pgmap v360: 129 pgs: 18 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 57 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 159 op/s 2023-10-05T15:28:12.930 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:12 smithi092 ceph-mon[102944]: pgmap v360: 129 pgs: 18 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 57 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 159 op/s 2023-10-05T15:28:13.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:12 smithi135 ceph-mon[103360]: pgmap v360: 129 pgs: 18 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 57 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 159 op/s 2023-10-05T15:28:15.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:15 smithi060 ceph-mon[99238]: pgmap v361: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 809 KiB/s wr, 130 op/s 2023-10-05T15:28:15.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:15 smithi092 ceph-mon[102944]: pgmap v361: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 809 KiB/s wr, 130 op/s 2023-10-05T15:28:15.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:15 smithi135 ceph-mon[103360]: pgmap v361: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 809 KiB/s wr, 130 op/s 2023-10-05T15:28:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.566+0000 7f280215c700 1 -- 172.21.15.60:0/102111912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc10d050 msgr2=0x7f27fc114c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.566+0000 7f280215c700 1 --2- 172.21.15.60:0/102111912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc10d050 0x7f27fc114c20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f27f000aaa0 tx=0x7f27f000adb0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.575+0000 7f280215c700 1 -- 172.21.15.60:0/102111912 shutdown_connections 2023-10-05T15:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.575+0000 7f280215c700 1 --2- 172.21.15.60:0/102111912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc10d050 0x7f27fc114c20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.575+0000 7f280215c700 1 --2- 172.21.15.60:0/102111912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc1089b0 0x7f27fc108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.575+0000 7f280215c700 1 --2- 172.21.15.60:0/102111912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27fc109360 0x7f27fc10c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.575+0000 7f280215c700 1 -- 172.21.15.60:0/102111912 >> 172.21.15.60:0/102111912 conn(0x7f27fc06cfa0 msgr2=0x7f27fc06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.576+0000 7f280215c700 1 -- 172.21.15.60:0/102111912 shutdown_connections 2023-10-05T15:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.581+0000 7f280215c700 1 -- 172.21.15.60:0/102111912 wait complete. 2023-10-05T15:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.581+0000 7f280215c700 1 Processor -- start 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.583+0000 7f280215c700 1 -- start start 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.584+0000 7f280215c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc1089b0 0x7f27fc115f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.584+0000 7f280215c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 0x7f27fc116460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.584+0000 7f280215c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27fc1169a0 0x7f27fc1b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.584+0000 7f280215c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc1b2840 con 0x7f27fc1089b0 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.584+0000 7f280215c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc1a3a60 con 0x7f27fc10d050 2023-10-05T15:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.584+0000 7f280215c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc1a3c20 con 0x7f27fc1169a0 2023-10-05T15:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 0x7f27fc116460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 0x7f27fc116460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55310/0 (socket says 172.21.15.60:55310) 2023-10-05T15:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 -- 172.21.15.60:0/738394411 learned_addr learned my addr 172.21.15.60:0/738394411 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 -- 172.21.15.60:0/738394411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27fc1169a0 msgr2=0x7f27fc1b2300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27fc1169a0 0x7f27fc1b2300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 -- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc1089b0 msgr2=0x7f27fc115f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc1089b0 0x7f27fc115f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.585+0000 7f27faffd700 1 -- 172.21.15.60:0/738394411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f000a700 con 0x7f27fc10d050 2023-10-05T15:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.586+0000 7f27faffd700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 0x7f27fc116460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00b520 tx=0x7f27ec00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.588+0000 7f27f8ff9700 1 -- 172.21.15.60:0/738394411 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec011830 con 0x7f27fc10d050 2023-10-05T15:28:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.588+0000 7f27f8ff9700 1 -- 172.21.15.60:0/738394411 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27ec011e50 con 0x7f27fc10d050 2023-10-05T15:28:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.588+0000 7f27f8ff9700 1 -- 172.21.15.60:0/738394411 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00f2e0 con 0x7f27fc10d050 2023-10-05T15:28:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.593+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc1a3f00 con 0x7f27fc10d050 2023-10-05T15:28:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.593+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc1a4390 con 0x7f27fc10d050 2023-10-05T15:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 Processor -- start 2023-10-05T15:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 -- start start 2023-10-05T15:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c4ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c5ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c5d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124bb9400 con 0x55b124c5b3d0 2023-10-05T15:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124baabc0 con 0x55b124c50520 2023-10-05T15:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.598+0000 7f280e346b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124ba84e0 con 0x55b124c4fc00 2023-10-05T15:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.602+0000 7f27f8ff9700 1 -- 172.21.15.60:0/738394411 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f27ec011990 con 0x7f27fc10d050 2023-10-05T15:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.603+0000 7f27f8ff9700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f27e40a17c0 0x7f27e40a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.603+0000 7f27f8ff9700 1 -- 172.21.15.60:0/738394411 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9523+0+0 (secure 0 0 0) 0x7f27ec0cef70 con 0x7f27fc10d050 2023-10-05T15:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.604+0000 7f27faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c5d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.604+0000 7f27faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c5d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41896/0 (socket says 172.21.15.60:41896) 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.604+0000 7f27faffd700 1 -- 172.21.15.60:0/4226082629 learned_addr learned my addr 172.21.15.60:0/4226082629 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27fbfff700 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c4ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27fb7fe700 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c5ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27faffd700 1 -- 172.21.15.60:0/4226082629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 msgr2=0x55b124c4ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27faffd700 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c4ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27faffd700 1 -- 172.21.15.60:0/4226082629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 msgr2=0x55b124c5ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27faffd700 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c5ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27faffd700 1 -- 172.21.15.60:0/4226082629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1249ced80 con 0x55b124c5b3d0 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27fbfff700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f27e40a17c0 0x7f27e40a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.605+0000 7f27faffd700 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c5d7c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f27ec098680 tx=0x7f27ec010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a411be23816fd63f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.606+0000 7f27e1ffb700 1 -- 172.21.15.60:0/4226082629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0b3070 con 0x55b124c5b3d0 2023-10-05T15:28:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.606+0000 7f27e1ffb700 1 -- 172.21.15.60:0/4226082629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27ec09bc10 con 0x55b124c5b3d0 2023-10-05T15:28:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.606+0000 7f27e1ffb700 1 -- 172.21.15.60:0/4226082629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec010580 con 0x55b124c5b3d0 2023-10-05T15:28:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.608+0000 7f280e346b80 1 -- 172.21.15.60:0/4226082629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 msgr2=0x55b124c5d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.608+0000 7f280e346b80 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c5d7c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f27ec098680 tx=0x7f27ec010f30 comp rx=0 tx=0).stop 2023-10-05T15:28:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.608+0000 7f27fbfff700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f27e40a17c0 0x7f27e40a3c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c6d0 tx=0x7f27f000a420 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.609+0000 7f280e346b80 1 -- 172.21.15.60:0/4226082629 shutdown_connections 2023-10-05T15:28:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.609+0000 7f280e346b80 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c5d7c0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.609+0000 7f280e346b80 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c4ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.609+0000 7f280e346b80 1 --2- 172.21.15.60:0/4226082629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c5ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.609+0000 7f280e346b80 1 -- 172.21.15.60:0/4226082629 >> 172.21.15.60:0/4226082629 conn(0x55b124bc5200 msgr2=0x55b124c4c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.622+0000 7f280e346b80 1 -- 172.21.15.60:0/4226082629 shutdown_connections 2023-10-05T15:28:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.622+0000 7f280e346b80 1 -- 172.21.15.60:0/4226082629 wait complete. 2023-10-05T15:28:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.622+0000 7f280e346b80 1 -- start start 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.622+0000 7f280e346b80 1 Processor -- start 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c58c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124ba3dd0 con 0x55b124c5b3d0 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124b406b0 con 0x55b124c50520 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124b40350 con 0x55b124c4fc00 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f280e346b80 10 client.0 _ll_register_callbacks cb 0x55b12499d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c58c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c58c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41902/0 (socket says 172.21.15.60:41902) 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55430/0 (socket says 172.21.15.60:55430) 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f27fbfff700 1 -- 172.21.15.60:0/1043584250 learned_addr learned my addr 172.21.15.60:0/1043584250 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.623+0000 7f27faffd700 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27fbfff700 1 -- 172.21.15.60:0/1043584250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 msgr2=0x55b124c581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27fbfff700 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27fbfff700 1 -- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 msgr2=0x55b124c586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27fbfff700 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27fbfff700 1 -- 172.21.15.60:0/1043584250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc1a4390 con 0x55b124c5b3d0 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27fbfff700 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c58c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f27f00043c0 tx=0x7f27f000adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d83ff3813c3165b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27daffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27daffd700 1 -- 172.21.15.60:0/1043584250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00248a0 con 0x55b124c5b3d0 2023-10-05T15:28:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27daffd700 1 -- 172.21.15.60:0/1043584250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9523+0+0 (secure 0 0 0) 0x7f27f0012070 con 0x55b124c5b3d0 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b124c43d50 con 0x55b124c5b3d0 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27daffd700 1 -- 172.21.15.60:0/1043584250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27f0024a00 con 0x55b124c5b3d0 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f280e346b80 10 client.16962 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b1249b7c00 con 0x55b124c5b3d0 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.624+0000 7f27daffd700 1 -- 172.21.15.60:0/1043584250 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b124c43d50 con 0x55b124c5b3d0 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f27daffd700 1 -- 172.21.15.60:0/1043584250 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f27f000ed10 con 0x55b124c5b3d0 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f280e346b80 10 client.16962 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f280e346b80 10 client.16962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f280e346b80 20 client.16962 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f280e346b80 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124c6b070 0x55b124c6d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f280e346b80 4 client.16962 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:28:16.631 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.625+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b124b9cdb0 con 0x55b124c6b070 2023-10-05T15:28:16.641 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.638+0000 7f27fb7fe700 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124c6b070 0x55b124c6d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.658 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.656+0000 7f27fb7fe700 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124c6b070 0x55b124c6d490 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c9f50de6c6fece3 server_cookie=fc7f626f2c3557de in_seq=0 out_seq=0 2023-10-05T15:28:16.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.661+0000 7f27daffd700 10 client.16962 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:16.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.661+0000 7f27daffd700 1 -- 172.21.15.60:0/1043584250 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b124b9cdb0 con 0x55b124c6b070 2023-10-05T15:28:16.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.661+0000 7f27daffd700 10 client.16962 handle_command_reply: tid=0 2023-10-05T15:28:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.665+0000 7f280e346b80 1 client.16962 shutdown 2023-10-05T15:28:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 msgr2=0x55b124c58c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c58c30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f27f00043c0 tx=0x7f27f000adb0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 shutdown_connections 2023-10-05T15:28:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124c6b070 0x55b124c6d490 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c58c30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124c581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 --2- 172.21.15.60:0/1043584250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.666+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 >> 172.21.15.60:0/1043584250 conn(0x55b124bc5200 msgr2=0x55b124c4bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.672+0000 7f27daffd700 0 client.16962 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.672+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 shutdown_connections 2023-10-05T15:28:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.679+0000 7f280e346b80 1 -- 172.21.15.60:0/1043584250 wait complete. 2023-10-05T15:28:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.680+0000 7f280e346b80 20 client.16962 trim_cache size 0 max 16384 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.712+0000 7f280e346b80 1 Processor -- start 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 -- start start 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c4fc00 0x55b124c52c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c61f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c5b3d0 0x55b124c55460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124a248c0 con 0x55b124c4fc00 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124c68620 con 0x55b124c50520 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f280e346b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124c462c0 con 0x55b124c5b3d0 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c4fc00 0x55b124c52c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c4fc00 0x55b124c52c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41908/0 (socket says 172.21.15.60:41908) 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f27fb7fe700 1 -- 172.21.15.60:0/529278807 learned_addr learned my addr 172.21.15.60:0/529278807 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f27faffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c61f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.713+0000 7f27fbfff700 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c5b3d0 0x55b124c55460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27faffd700 1 -- 172.21.15.60:0/529278807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c5b3d0 msgr2=0x55b124c55460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27faffd700 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c5b3d0 0x55b124c55460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27faffd700 1 -- 172.21.15.60:0/529278807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c4fc00 msgr2=0x55b124c52c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27faffd700 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c4fc00 0x55b124c52c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27faffd700 1 -- 172.21.15.60:0/529278807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b124c720c0 con 0x55b124c50520 2023-10-05T15:28:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27faffd700 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c61f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f27ec098110 tx=0x7f27ec010850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7010ef9f0fc11c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.714+0000 7f27e27fc700 1 -- 172.21.15.60:0/529278807 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0b3040 con 0x55b124c50520 2023-10-05T15:28:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.715+0000 7f27e27fc700 1 -- 172.21.15.60:0/529278807 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27ec09b750 con 0x55b124c50520 2023-10-05T15:28:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.715+0000 7f27e27fc700 1 -- 172.21.15.60:0/529278807 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec09be70 con 0x55b124c50520 2023-10-05T15:28:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.715+0000 7f280e346b80 1 -- 172.21.15.60:0/529278807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 msgr2=0x55b124c61f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.715+0000 7f280e346b80 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c61f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f27ec098110 tx=0x7f27ec010850 comp rx=0 tx=0).stop 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 -- 172.21.15.60:0/529278807 shutdown_connections 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c5b3d0 0x55b124c55460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c4fc00 0x55b124c52c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 --2- 172.21.15.60:0/529278807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124c61f20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 -- 172.21.15.60:0/529278807 >> 172.21.15.60:0/529278807 conn(0x55b124bc5200 msgr2=0x55b124c534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 -- 172.21.15.60:0/529278807 shutdown_connections 2023-10-05T15:28:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.719+0000 7f280e346b80 1 -- 172.21.15.60:0/529278807 wait complete. 2023-10-05T15:28:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.720+0000 7f280e346b80 1 -- start start 2023-10-05T15:28:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.720+0000 7f280e346b80 1 Processor -- start 2023-10-05T15:28:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124cb7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124cb7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124c61ba0 con 0x55b124c5b3d0 2023-10-05T15:28:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124c61d10 con 0x55b124c50520 2023-10-05T15:28:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b124c61ed0 con 0x55b124c4fc00 2023-10-05T15:28:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.721+0000 7f280e346b80 10 client.0 _ll_register_callbacks cb 0x7f27f00041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.722+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124cb7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.722+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124cb7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55448/0 (socket says 172.21.15.60:55448) 2023-10-05T15:28:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.722+0000 7f27fb7fe700 1 -- 172.21.15.60:0/392085989 learned_addr learned my addr 172.21.15.60:0/392085989 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.722+0000 7f27fb7fe700 1 -- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 msgr2=0x55b124cb7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.722+0000 7f27fb7fe700 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124cb7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.723+0000 7f27fb7fe700 1 -- 172.21.15.60:0/392085989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 msgr2=0x55b124c615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.723+0000 7f27fb7fe700 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.723+0000 7f27fb7fe700 1 -- 172.21.15.60:0/392085989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1249ced80 con 0x55b124c4fc00 2023-10-05T15:28:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.723+0000 7f27fb7fe700 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124cb7a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27f40079e0 tx=0x7f27f4017df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b227c169d791824 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.725+0000 7f27daffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:28:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.725+0000 7f27daffd700 1 -- 172.21.15.60:0/392085989 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f403d070 con 0x55b124c4fc00 2023-10-05T15:28:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.725+0000 7f27daffd700 1 -- 172.21.15.60:0/392085989 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9523+0+0 (secure 0 0 0) 0x7f27f4017560 con 0x55b124c4fc00 2023-10-05T15:28:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.725+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27ec09bc10 con 0x55b124c4fc00 2023-10-05T15:28:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.725+0000 7f27daffd700 1 -- 172.21.15.60:0/392085989 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27f4014640 con 0x55b124c4fc00 2023-10-05T15:28:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.726+0000 7f280e346b80 10 client.26458 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.726+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b1249f51f0 con 0x55b124c4fc00 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f27daffd700 1 -- 172.21.15.60:0/392085989 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27ec09bc10 con 0x55b124c4fc00 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f27daffd700 1 -- 172.21.15.60:0/392085989 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f27f4049070 con 0x55b124c4fc00 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f280e346b80 10 client.26458 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f280e346b80 10 client.26458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f280e346b80 20 client.26458 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f280e346b80 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124cbf970 0x55b124cc1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f280e346b80 4 client.26458 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:28:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b124b9cad0 con 0x55b124cbf970 2023-10-05T15:28:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.727+0000 7f27faffd700 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124cbf970 0x55b124cc1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.728+0000 7f27daffd700 10 client.26458 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.728+0000 7f27faffd700 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124cbf970 0x55b124cc1dd0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9411cdd1e9b1fde server_cookie=5e8dee1975df4775 in_seq=0 out_seq=0 2023-10-05T15:28:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.839+0000 7f27daffd700 1 -- 172.21.15.60:0/392085989 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b124b9cad0 con 0x55b124cbf970 2023-10-05T15:28:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.839+0000 7f27daffd700 10 client.26458 handle_command_reply: tid=0 2023-10-05T15:28:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.839+0000 7f280e346b80 1 client.26458 shutdown 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 msgr2=0x55b124cb7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124cb7a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27f40079e0 tx=0x7f27f4017df0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 shutdown_connections 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b124cbf970 0x55b124cc1dd0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b124c5b3d0 0x55b124c615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b124c4fc00 0x55b124cb7a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 --2- 172.21.15.60:0/392085989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b124c50520 0x55b124cb7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.846+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 >> 172.21.15.60:0/392085989 conn(0x55b124bc5200 msgr2=0x55b124c59ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.849+0000 7f27daffd700 0 client.26458 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.849+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 shutdown_connections 2023-10-05T15:28:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.849+0000 7f280e346b80 1 -- 172.21.15.60:0/392085989 wait complete. 2023-10-05T15:28:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:28:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:28:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:28:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:28:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.850+0000 7f280e346b80 20 client.26458 trim_cache size 0 max 16384 2023-10-05T15:28:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.854+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f27e40a17c0 msgr2=0x7f27e40a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.854+0000 7f280215c700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f27e40a17c0 0x7f27e40a3c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c6d0 tx=0x7f27f000a420 comp rx=0 tx=0).stop 2023-10-05T15:28:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.854+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 msgr2=0x7f27fc116460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.854+0000 7f280215c700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 0x7f27fc116460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00b520 tx=0x7f27ec00b8e0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.858+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 shutdown_connections 2023-10-05T15:28:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.858+0000 7f280215c700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27fc1169a0 0x7f27fc1b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.858+0000 7f280215c700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27fc1089b0 0x7f27fc115f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.858+0000 7f280215c700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f27e40a17c0 0x7f27e40a3c80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.858+0000 7f280215c700 1 --2- 172.21.15.60:0/738394411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27fc10d050 0x7f27fc116460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.858+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 >> 172.21.15.60:0/738394411 conn(0x7f27fc06cfa0 msgr2=0x7f27fc0709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.872+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 shutdown_connections 2023-10-05T15:28:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:16.872+0000 7f280215c700 1 -- 172.21.15.60:0/738394411 wait complete. 2023-10-05T15:28:17.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:17 smithi060 ceph-mon[99238]: pgmap v362: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 122 op/s 2023-10-05T15:28:17.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:17 smithi092 ceph-mon[102944]: pgmap v362: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 122 op/s 2023-10-05T15:28:17.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:17 smithi135 ceph-mon[103360]: pgmap v362: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 122 op/s 2023-10-05T15:28:19.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:19 smithi060 ceph-mon[99238]: pgmap v363: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 641 KiB/s wr, 109 op/s 2023-10-05T15:28:19.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:19 smithi092 ceph-mon[102944]: pgmap v363: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 641 KiB/s wr, 109 op/s 2023-10-05T15:28:19.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:19 smithi135 ceph-mon[103360]: pgmap v363: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 641 KiB/s wr, 109 op/s 2023-10-05T15:28:21.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:21 smithi135 ceph-mon[103360]: pgmap v364: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 546 KiB/s wr, 104 op/s 2023-10-05T15:28:21.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:21 smithi060 ceph-mon[99238]: pgmap v364: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 546 KiB/s wr, 104 op/s 2023-10-05T15:28:21.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:21 smithi092 ceph-mon[102944]: pgmap v364: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 546 KiB/s wr, 104 op/s 2023-10-05T15:28:22.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:22 smithi060 ceph-mon[99238]: pgmap v365: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 869 KiB/s wr, 95 op/s 2023-10-05T15:28:22.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:22 smithi092 ceph-mon[102944]: pgmap v365: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 869 KiB/s wr, 95 op/s 2023-10-05T15:28:23.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:22 smithi135 ceph-mon[103360]: pgmap v365: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 869 KiB/s wr, 95 op/s 2023-10-05T15:28:23.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:23 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:23.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:23 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:24.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:23 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:24.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:24 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:24 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:24.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:24 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:28:24.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:24 smithi060 ceph-mon[99238]: pgmap v366: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 582 KiB/s wr, 100 op/s 2023-10-05T15:28:24.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:24 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:24 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:24.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:24 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:28:24.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:24 smithi092 ceph-mon[102944]: pgmap v366: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 582 KiB/s wr, 100 op/s 2023-10-05T15:28:25.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:24 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:25.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:24 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:25.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:24 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:28:25.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:24 smithi135 ceph-mon[103360]: pgmap v366: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 582 KiB/s wr, 100 op/s 2023-10-05T15:28:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:27 smithi060 ceph-mon[99238]: pgmap v367: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-05T15:28:27.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:27 smithi060 ceph-mon[99238]: osdmap e108: 12 total, 12 up, 12 in 2023-10-05T15:28:27.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:27 smithi092 ceph-mon[102944]: pgmap v367: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-05T15:28:27.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:27 smithi092 ceph-mon[102944]: osdmap e108: 12 total, 12 up, 12 in 2023-10-05T15:28:27.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:27 smithi135 ceph-mon[103360]: pgmap v367: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-05T15:28:27.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:27 smithi135 ceph-mon[103360]: osdmap e108: 12 total, 12 up, 12 in 2023-10-05T15:28:29.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:29 smithi060 ceph-mon[99238]: pgmap v369: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 956 KiB/s wr, 85 op/s 2023-10-05T15:28:29.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:29 smithi092 ceph-mon[102944]: pgmap v369: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 956 KiB/s wr, 85 op/s 2023-10-05T15:28:29.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:29 smithi135 ceph-mon[103360]: pgmap v369: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 956 KiB/s wr, 85 op/s 2023-10-05T15:28:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.091+0000 7fbf57b01700 1 -- 172.21.15.60:0/1203169663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf501086d0 msgr2=0x7fbf5010a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.091+0000 7fbf57b01700 1 --2- 172.21.15.60:0/1203169663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf501086d0 0x7fbf5010a170 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009990 tx=0x7fbf4c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.096+0000 7fbf57b01700 1 -- 172.21.15.60:0/1203169663 shutdown_connections 2023-10-05T15:28:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.096+0000 7fbf57b01700 1 --2- 172.21.15.60:0/1203169663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf50108b50 0x7fbf50108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.096+0000 7fbf57b01700 1 --2- 172.21.15.60:0/1203169663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50109850 0x7fbf50109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.096+0000 7fbf57b01700 1 --2- 172.21.15.60:0/1203169663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf501086d0 0x7fbf5010a170 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.096+0000 7fbf57b01700 1 -- 172.21.15.60:0/1203169663 >> 172.21.15.60:0/1203169663 conn(0x7fbf5006d3e0 msgr2=0x7fbf5006d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.103+0000 7fbf57b01700 1 -- 172.21.15.60:0/1203169663 shutdown_connections 2023-10-05T15:28:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.113+0000 7fbf57b01700 1 -- 172.21.15.60:0/1203169663 wait complete. 2023-10-05T15:28:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.113+0000 7fbf57b01700 1 Processor -- start 2023-10-05T15:28:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 -- start start 2023-10-05T15:28:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 0x7fbf50110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50108b50 0x7fbf5010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf50109850 0x7fbf5010e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5010ecd0 con 0x7fbf50109850 2023-10-05T15:28:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5010ee40 con 0x7fbf501086d0 2023-10-05T15:28:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf57b01700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501b25f0 con 0x7fbf50108b50 2023-10-05T15:28:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf5589d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 0x7fbf50110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf5589d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 0x7fbf50110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55348/0 (socket says 172.21.15.60:55348) 2023-10-05T15:28:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.114+0000 7fbf5589d700 1 -- 172.21.15.60:0/3435090333 learned_addr learned my addr 172.21.15.60:0/3435090333 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.117+0000 7fbf5509c700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50108b50 0x7fbf5010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.121+0000 7fbf5589d700 1 -- 172.21.15.60:0/3435090333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50108b50 msgr2=0x7fbf5010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.121+0000 7fbf5589d700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50108b50 0x7fbf5010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.121+0000 7fbf5589d700 1 -- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf50109850 msgr2=0x7fbf5010e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.121+0000 7fbf5589d700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf50109850 0x7fbf5010e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.121+0000 7fbf5589d700 1 -- 172.21.15.60:0/3435090333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0095f0 con 0x7fbf501086d0 2023-10-05T15:28:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.124+0000 7fbf5589d700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 0x7fbf50110160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000b550 tx=0x7fbf4000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.124+0000 7fbf46ffd700 1 -- 172.21.15.60:0/3435090333 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40011830 con 0x7fbf501086d0 2023-10-05T15:28:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.124+0000 7fbf46ffd700 1 -- 172.21.15.60:0/3435090333 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf40011e50 con 0x7fbf501086d0 2023-10-05T15:28:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.124+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf501b28d0 con 0x7fbf501086d0 2023-10-05T15:28:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.124+0000 7fbf46ffd700 1 -- 172.21.15.60:0/3435090333 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000f2e0 con 0x7fbf501086d0 2023-10-05T15:28:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.124+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf501b2de0 con 0x7fbf501086d0 2023-10-05T15:28:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.127+0000 7fbf46ffd700 1 -- 172.21.15.60:0/3435090333 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbf400105a0 con 0x7fbf501086d0 2023-10-05T15:28:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.128+0000 7fbf46ffd700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fbf3c0a1670 0x7fbf3c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.128+0000 7fbf46ffd700 1 -- 172.21.15.60:0/3435090333 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9463+0+0 (secure 0 0 0) 0x7fbf400ccea0 con 0x7fbf501086d0 2023-10-05T15:28:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.129+0000 7fbf63cebb80 1 Processor -- start 2023-10-05T15:28:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.129+0000 7fbf63cebb80 1 -- start start 2023-10-05T15:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c49c00 0x562151c49fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c4a520 0x562151c54e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151bb3400 con 0x562151c553d0 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151ba4bc0 con 0x562151c49c00 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151ba24e0 con 0x562151c4a520 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5609e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5589d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c49c00 0x562151c49fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5609e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41938/0 (socket says 172.21.15.60:41938) 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5609e700 1 -- 172.21.15.60:0/3403168884 learned_addr learned my addr 172.21.15.60:0/3403168884 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5589d700 1 -- 172.21.15.60:0/3403168884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c4a520 msgr2=0x562151c54e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5589d700 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c4a520 0x562151c54e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5589d700 1 -- 172.21.15.60:0/3403168884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 msgr2=0x562151c577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5589d700 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.130+0000 7fbf5589d700 1 -- 172.21.15.60:0/3403168884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621519c8d80 con 0x562151c49c00 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.131+0000 7fbf5589d700 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c49c00 0x562151c49fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ca350 tx=0x7fbf400997f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a4b3bec996c0352 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.132+0000 7fbf3bfff700 1 -- 172.21.15.60:0/3403168884 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4009dd30 con 0x562151c49c00 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.132+0000 7fbf3bfff700 1 -- 172.21.15.60:0/3403168884 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf400a1f70 con 0x562151c49c00 2023-10-05T15:28:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.132+0000 7fbf3bfff700 1 -- 172.21.15.60:0/3403168884 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400990d0 con 0x562151c49c00 2023-10-05T15:28:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.136+0000 7fbf63cebb80 1 -- 172.21.15.60:0/3403168884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c49c00 msgr2=0x562151c49fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.136+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c49c00 0x562151c49fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ca350 tx=0x7fbf400997f0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.143+0000 7fbf5509c700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fbf3c0a1670 0x7fbf3c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.143+0000 7fbf63cebb80 1 -- 172.21.15.60:0/3403168884 shutdown_connections 2023-10-05T15:28:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.143+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.143+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c49c00 0x562151c49fe0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.143+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/3403168884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c4a520 0x562151c54e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.143+0000 7fbf63cebb80 1 -- 172.21.15.60:0/3403168884 >> 172.21.15.60:0/3403168884 conn(0x562151bbf200 msgr2=0x562151c46080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.150+0000 7fbf63cebb80 1 -- 172.21.15.60:0/3403168884 shutdown_connections 2023-10-05T15:28:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.153+0000 7fbf5509c700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fbf3c0a1670 0x7fbf3c0a3b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf5010f9c0 tx=0x7fbf4c00b260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.155+0000 7fbf63cebb80 1 -- 172.21.15.60:0/3403168884 wait complete. 2023-10-05T15:28:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.156+0000 7fbf63cebb80 1 -- start start 2023-10-05T15:28:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.156+0000 7fbf63cebb80 1 Processor -- start 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c522a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c4a520 0x562151c527e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 0x562151c52d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151b9ddd0 con 0x562151c4a520 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151b3a6b0 con 0x562151c553d0 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151b3a350 con 0x562151c49c00 2023-10-05T15:28:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.157+0000 7fbf63cebb80 10 client.0 _ll_register_callbacks cb 0x5621519977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.159+0000 7fbf5609e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 0x562151c52d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.159+0000 7fbf5609e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 0x562151c52d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55362/0 (socket says 172.21.15.60:55362) 2023-10-05T15:28:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.159+0000 7fbf5609e700 1 -- 172.21.15.60:0/2687488130 learned_addr learned my addr 172.21.15.60:0/2687488130 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.161+0000 7fbf5609e700 1 -- 172.21.15.60:0/2687488130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 msgr2=0x562151c522a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.161+0000 7fbf5609e700 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c522a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.161+0000 7fbf5609e700 1 -- 172.21.15.60:0/2687488130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c4a520 msgr2=0x562151c527e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.161+0000 7fbf5609e700 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c4a520 0x562151c527e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.161+0000 7fbf5609e700 1 -- 172.21.15.60:0/2687488130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf501b2de0 con 0x562151c553d0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf5609e700 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 0x562151c52d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf48007e50 tx=0x7fbf480104a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924551f940fec034 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf397fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf397fa700 1 -- 172.21.15.60:0/2687488130 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800e050 con 0x562151c553d0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf397fa700 1 -- 172.21.15.60:0/2687488130 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9463+0+0 (secure 0 0 0) 0x7fbf48015440 con 0x562151c553d0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562151c3dd50 con 0x562151c553d0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf397fa700 1 -- 172.21.15.60:0/2687488130 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf48015600 con 0x562151c553d0 2023-10-05T15:28:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf63cebb80 10 client.26636 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.166+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5621519b1c00 con 0x562151c553d0 2023-10-05T15:28:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf397fa700 1 -- 172.21.15.60:0/2687488130 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562151c3dd50 con 0x562151c553d0 2023-10-05T15:28:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf397fa700 1 -- 172.21.15.60:0/2687488130 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fbf48016830 con 0x562151c553d0 2023-10-05T15:28:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf63cebb80 10 client.26636 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf63cebb80 10 client.26636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf63cebb80 20 client.26636 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151c651e0 0x562151c67600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf63cebb80 4 client.26636 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562151b96db0 con 0x562151c651e0 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.167+0000 7fbf5589d700 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151c651e0 0x562151c67600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.168+0000 7fbf5589d700 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151c651e0 0x562151c67600 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=138cb9bba9b8f867 server_cookie=ccec32d39a4c4e53 in_seq=0 out_seq=0 2023-10-05T15:28:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.168+0000 7fbf397fa700 10 client.26636 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.169+0000 7fbf397fa700 1 -- 172.21.15.60:0/2687488130 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562151b96db0 con 0x562151c651e0 2023-10-05T15:28:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.169+0000 7fbf397fa700 10 client.26636 handle_command_reply: tid=0 2023-10-05T15:28:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.169+0000 7fbf63cebb80 1 client.26636 shutdown 2023-10-05T15:28:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.169+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 msgr2=0x562151c52d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.169+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 0x562151c52d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf48007e50 tx=0x7fbf480104a0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 shutdown_connections 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151c651e0 0x562151c67600 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c553d0 0x562151c52d20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2687488130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c4a520 0x562151c527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 >> 172.21.15.60:0/2687488130 conn(0x562151bbf200 msgr2=0x562151c45c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.174+0000 7fbf397fa700 0 client.26636 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.176+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 shutdown_connections 2023-10-05T15:28:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.176+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2687488130 wait complete. 2023-10-05T15:28:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.176+0000 7fbf63cebb80 20 client.26636 trim_cache size 0 max 16384 2023-10-05T15:28:30.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.202+0000 7fbf63cebb80 1 Processor -- start 2023-10-05T15:28:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 -- start start 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c5bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c4d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c4db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151a1e8c0 con 0x562151c553d0 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151c428d0 con 0x562151c4a520 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.206+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151c462e0 con 0x562151c49c00 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5609e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c4db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5609e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c4db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41946/0 (socket says 172.21.15.60:41946) 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5609e700 1 -- 172.21.15.60:0/64204428 learned_addr learned my addr 172.21.15.60:0/64204428 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5589d700 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c5bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5589d700 1 -- 172.21.15.60:0/64204428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 msgr2=0x562151c4d610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:28:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5589d700 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c4d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5589d700 1 -- 172.21.15.60:0/64204428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 msgr2=0x562151c4db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5589d700 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c4db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.209+0000 7fbf5589d700 1 -- 172.21.15.60:0/64204428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562151c51e10 con 0x562151c49c00 2023-10-05T15:28:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.213+0000 7fbf5589d700 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c5bf10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x562151c4a9f0 tx=0x7fbf400109a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4acb07818388c340 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.224+0000 7fbf44d82700 1 -- 172.21.15.60:0/64204428 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40099720 con 0x562151c49c00 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.224+0000 7fbf44d82700 1 -- 172.21.15.60:0/64204428 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf40097f80 con 0x562151c49c00 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.224+0000 7fbf44d82700 1 -- 172.21.15.60:0/64204428 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4009a0a0 con 0x562151c49c00 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.225+0000 7fbf63cebb80 1 -- 172.21.15.60:0/64204428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 msgr2=0x562151c5bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.225+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c5bf10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x562151c4a9f0 tx=0x7fbf400109a0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.226+0000 7fbf63cebb80 1 -- 172.21.15.60:0/64204428 shutdown_connections 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.226+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151c4db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.226+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c5bf10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.226+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/64204428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c4d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.226+0000 7fbf63cebb80 1 -- 172.21.15.60:0/64204428 >> 172.21.15.60:0/64204428 conn(0x562151bbf200 msgr2=0x562151c60670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.235+0000 7fbf63cebb80 1 -- 172.21.15.60:0/64204428 shutdown_connections 2023-10-05T15:28:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.235+0000 7fbf63cebb80 1 -- 172.21.15.60:0/64204428 wait complete. 2023-10-05T15:28:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.236+0000 7fbf63cebb80 1 -- start start 2023-10-05T15:28:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.236+0000 7fbf63cebb80 1 Processor -- start 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c59f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c5a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151cb8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151c5ac50 con 0x562151c553d0 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151c5adc0 con 0x562151c4a520 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562151cb85d0 con 0x562151c49c00 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.246+0000 7fbf63cebb80 10 client.0 _ll_register_callbacks cb 0x7fbf48007780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.249+0000 7fbf5509c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c5a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.249+0000 7fbf5509c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c5a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55372/0 (socket says 172.21.15.60:55372) 2023-10-05T15:28:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.249+0000 7fbf5509c700 1 -- 172.21.15.60:0/2741149502 learned_addr learned my addr 172.21.15.60:0/2741149502 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.255+0000 7fbf5609e700 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151cb8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.255+0000 7fbf5509c700 1 -- 172.21.15.60:0/2741149502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 msgr2=0x562151c59f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.255+0000 7fbf5509c700 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c59f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.255+0000 7fbf5509c700 1 -- 172.21.15.60:0/2741149502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 msgr2=0x562151cb8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.255+0000 7fbf5509c700 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151cb8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.255+0000 7fbf5509c700 1 -- 172.21.15.60:0/2741149502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621519c8d80 con 0x562151c4a520 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.261+0000 7fbf5509c700 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c5a440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c000c00 tx=0x7fbf4c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2777c223b0f6f48b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.266+0000 7fbf397fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.267+0000 7fbf397fa700 1 -- 172.21.15.60:0/2741149502 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c004ae0 con 0x562151c4a520 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.267+0000 7fbf397fa700 1 -- 172.21.15.60:0/2741149502 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9463+0+0 (secure 0 0 0) 0x7fbf4c004c40 con 0x562151c4a520 2023-10-05T15:28:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.267+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf400a1f70 con 0x562151c4a520 2023-10-05T15:28:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.273+0000 7fbf397fa700 1 -- 172.21.15.60:0/2741149502 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf4c004e40 con 0x562151c4a520 2023-10-05T15:28:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.274+0000 7fbf63cebb80 10 client.26639 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.274+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5621519ef1f0 con 0x562151c4a520 2023-10-05T15:28:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.279+0000 7fbf397fa700 1 -- 172.21.15.60:0/2741149502 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf400a1f70 con 0x562151c4a520 2023-10-05T15:28:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.279+0000 7fbf397fa700 1 -- 172.21.15.60:0/2741149502 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fbf4c00f720 con 0x562151c4a520 2023-10-05T15:28:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf63cebb80 10 client.26639 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf63cebb80 10 client.26639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf63cebb80 20 client.26639 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151cb9db0 0x562151cbc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf63cebb80 4 client.26639 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:28:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562151b96ad0 con 0x562151cb9db0 2023-10-05T15:28:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.280+0000 7fbf5589d700 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151cb9db0 0x562151cbc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.290+0000 7fbf5589d700 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151cb9db0 0x562151cbc1d0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a9d157333a18f2 server_cookie=49fb440ef676abd2 in_seq=0 out_seq=0 2023-10-05T15:28:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.290+0000 7fbf397fa700 10 client.26639 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.432+0000 7fbf397fa700 1 -- 172.21.15.60:0/2741149502 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562151b96ad0 con 0x562151cb9db0 2023-10-05T15:28:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.432+0000 7fbf397fa700 10 client.26639 handle_command_reply: tid=0 2023-10-05T15:28:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.432+0000 7fbf63cebb80 1 client.26639 shutdown 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.432+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 msgr2=0x562151c5a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.432+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c5a440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c000c00 tx=0x7fbf4c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 shutdown_connections 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x562151cb9db0 0x562151cbc1d0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562151c553d0 0x562151cb8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562151c49c00 0x562151c59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf63cebb80 1 --2- 172.21.15.60:0/2741149502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562151c4a520 0x562151c5a440 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 >> 172.21.15.60:0/2741149502 conn(0x562151bbf200 msgr2=0x562151c4d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.433+0000 7fbf397fa700 0 client.26639 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.437+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 shutdown_connections 2023-10-05T15:28:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.437+0000 7fbf63cebb80 1 -- 172.21.15.60:0/2741149502 wait complete. 2023-10-05T15:28:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.442+0000 7fbf63cebb80 20 client.26639 trim_cache size 0 max 16384 2023-10-05T15:28:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:28:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:28:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:28:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.454+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fbf3c0a1670 msgr2=0x7fbf3c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.454+0000 7fbf57b01700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fbf3c0a1670 0x7fbf3c0a3b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf5010f9c0 tx=0x7fbf4c00b260 comp rx=0 tx=0).stop 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.454+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 msgr2=0x7fbf50110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.454+0000 7fbf57b01700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 0x7fbf50110160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000b550 tx=0x7fbf4000b910 comp rx=0 tx=0).stop 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.455+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 shutdown_connections 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.455+0000 7fbf57b01700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf50109850 0x7fbf5010e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.455+0000 7fbf57b01700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fbf3c0a1670 0x7fbf3c0a3b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.455+0000 7fbf57b01700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf501086d0 0x7fbf50110160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.455+0000 7fbf57b01700 1 --2- 172.21.15.60:0/3435090333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf50108b50 0x7fbf5010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.455+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 >> 172.21.15.60:0/3435090333 conn(0x7fbf5006d3e0 msgr2=0x7fbf50071660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.456+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 shutdown_connections 2023-10-05T15:28:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:30.456+0000 7fbf57b01700 1 -- 172.21.15.60:0/3435090333 wait complete. 2023-10-05T15:28:31.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:31 smithi135 ceph-mon[103360]: pgmap v370: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 947 KiB/s wr, 84 op/s 2023-10-05T15:28:31.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:31 smithi060 ceph-mon[99238]: pgmap v370: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 947 KiB/s wr, 84 op/s 2023-10-05T15:28:31.930 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:31 smithi092 ceph-mon[102944]: pgmap v370: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 947 KiB/s wr, 84 op/s 2023-10-05T15:28:32.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:32 smithi060 ceph-mon[99238]: pgmap v371: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1005 KiB/s wr, 86 op/s 2023-10-05T15:28:32.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:32 smithi092 ceph-mon[102944]: pgmap v371: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1005 KiB/s wr, 86 op/s 2023-10-05T15:28:33.085 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:32 smithi135 ceph-mon[103360]: pgmap v371: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1005 KiB/s wr, 86 op/s 2023-10-05T15:28:35.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:35 smithi060 ceph-mon[99238]: pgmap v372: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 1007 KiB/s wr, 87 op/s 2023-10-05T15:28:35.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:35 smithi092 ceph-mon[102944]: pgmap v372: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 1007 KiB/s wr, 87 op/s 2023-10-05T15:28:35.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:35 smithi135 ceph-mon[103360]: pgmap v372: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 1007 KiB/s wr, 87 op/s 2023-10-05T15:28:37.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:37 smithi060 ceph-mon[99238]: pgmap v373: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 533 KiB/s wr, 89 op/s 2023-10-05T15:28:37.679 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:37 smithi092 ceph-mon[102944]: pgmap v373: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 533 KiB/s wr, 89 op/s 2023-10-05T15:28:37.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:37 smithi135 ceph-mon[103360]: pgmap v373: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 533 KiB/s wr, 89 op/s 2023-10-05T15:28:39.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:39 smithi060 ceph-mon[99238]: pgmap v374: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 747 KiB/s wr, 90 op/s 2023-10-05T15:28:39.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:39 smithi092 ceph-mon[102944]: pgmap v374: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 747 KiB/s wr, 90 op/s 2023-10-05T15:28:39.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:39 smithi135 ceph-mon[103360]: pgmap v374: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 747 KiB/s wr, 90 op/s 2023-10-05T15:28:41.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:41 smithi135 ceph-mon[103360]: pgmap v375: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 723 KiB/s wr, 80 op/s 2023-10-05T15:28:41.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:41 smithi060 ceph-mon[99238]: pgmap v375: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 723 KiB/s wr, 80 op/s 2023-10-05T15:28:41.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:41 smithi092 ceph-mon[102944]: pgmap v375: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 723 KiB/s wr, 80 op/s 2023-10-05T15:28:42.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:42 smithi060 ceph-mon[99238]: pgmap v376: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 82 op/s 2023-10-05T15:28:42.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:42 smithi092 ceph-mon[102944]: pgmap v376: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 82 op/s 2023-10-05T15:28:43.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:42 smithi135 ceph-mon[103360]: pgmap v376: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 82 op/s 2023-10-05T15:28:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.680+0000 7fdf13199700 1 -- 172.21.15.60:0/494016388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c11a690 msgr2=0x7fdf0c11ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.680+0000 7fdf13199700 1 --2- 172.21.15.60:0/494016388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c11a690 0x7fdf0c11ca80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fdf0401c0d0 tx=0x7fdf0401c3e0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.687+0000 7fdf13199700 1 -- 172.21.15.60:0/494016388 shutdown_connections 2023-10-05T15:28:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.687+0000 7fdf13199700 1 --2- 172.21.15.60:0/494016388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c11a690 0x7fdf0c11ca80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.687+0000 7fdf13199700 1 --2- 172.21.15.60:0/494016388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf0c10f620 0x7fdf0c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.687+0000 7fdf13199700 1 --2- 172.21.15.60:0/494016388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c10fa90 0x7fdf0c1083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.687+0000 7fdf13199700 1 -- 172.21.15.60:0/494016388 >> 172.21.15.60:0/494016388 conn(0x7fdf0c06cfa0 msgr2=0x7fdf0c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.690+0000 7fdf13199700 1 -- 172.21.15.60:0/494016388 shutdown_connections 2023-10-05T15:28:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.692+0000 7fdf13199700 1 -- 172.21.15.60:0/494016388 wait complete. 2023-10-05T15:28:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.692+0000 7fdf13199700 1 Processor -- start 2023-10-05T15:28:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.692+0000 7fdf13199700 1 -- start start 2023-10-05T15:28:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf13199700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf0c10f620 0x7fdf0c115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf13199700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c10fa90 0x7fdf0c1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf13199700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 0x7fdf0c1a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf13199700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1a2a20 con 0x7fdf0c10fa90 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf13199700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1a2b90 con 0x7fdf0c11a690 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf13199700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1a2d50 con 0x7fdf0c10f620 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 0x7fdf0c1a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 0x7fdf0c1a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55382/0 (socket says 172.21.15.60:55382) 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 -- 172.21.15.60:0/1005695212 learned_addr learned my addr 172.21.15.60:0/1005695212 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 -- 172.21.15.60:0/1005695212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf0c10f620 msgr2=0x7fdf0c115b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf0c10f620 0x7fdf0c115b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 -- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c10fa90 msgr2=0x7fdf0c1160b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c10fa90 0x7fdf0c1160b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.693+0000 7fdf11736700 1 -- 172.21.15.60:0/1005695212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0401ad10 con 0x7fdf0c11a690 2023-10-05T15:28:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.694+0000 7fdf11736700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 0x7fdf0c1a2310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003fa0 tx=0x7fdf04018680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.694+0000 7fdf09ffb700 1 -- 172.21.15.60:0/1005695212 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0401f070 con 0x7fdf0c11a690 2023-10-05T15:28:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.694+0000 7fdf09ffb700 1 -- 172.21.15.60:0/1005695212 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf04018af0 con 0x7fdf0c11a690 2023-10-05T15:28:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.694+0000 7fdf09ffb700 1 -- 172.21.15.60:0/1005695212 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0402b9b0 con 0x7fdf0c11a690 2023-10-05T15:28:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.694+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c1a2fd0 con 0x7fdf0c11a690 2023-10-05T15:28:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.694+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1aa5b0 con 0x7fdf0c11a690 2023-10-05T15:28:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.699+0000 7fdf09ffb700 1 -- 172.21.15.60:0/1005695212 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdf040052b0 con 0x7fdf0c11a690 2023-10-05T15:28:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.700+0000 7fdf1f383b80 1 Processor -- start 2023-10-05T15:28:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.705+0000 7fdf1f383b80 1 -- start start 2023-10-05T15:28:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cd1c00 0x55cc45cd1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cdce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45c3b400 con 0x55cc45cd1c00 2023-10-05T15:28:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45c2cbc0 con 0x55cc45cd2520 2023-10-05T15:28:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45c2a4e0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.706+0000 7fdf09ffb700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdef40a16b0 0x7fdef40a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.707+0000 7fdf09ffb700 1 -- 172.21.15.60:0/1005695212 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9463+0+0 (secure 0 0 0) 0x7fdf040df1d0 con 0x7fdf0c11a690 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cd1c00 0x55cc45cd1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cd1c00 0x55cc45cd1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41964/0 (socket says 172.21.15.60:41964) 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 -- 172.21.15.60:0/2412216326 learned_addr learned my addr 172.21.15.60:0/2412216326 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 -- 172.21.15.60:0/2412216326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 msgr2=0x55cc45cdce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cdce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 -- 172.21.15.60:0/2412216326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cd1c00 msgr2=0x55cc45cd1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cd1c00 0x55cc45cd1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 -- 172.21.15.60:0/2412216326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc45a50d80 con 0x55cc45cdd3d0 2023-10-05T15:28:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.709+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdf7c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf00012960 tx=0x7fdf000090e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c004fa688d973129 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.710+0000 7fdef2ffd700 1 -- 172.21.15.60:0/2412216326 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00004a90 con 0x55cc45cdd3d0 2023-10-05T15:28:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.710+0000 7fdef2ffd700 1 -- 172.21.15.60:0/2412216326 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf000065d0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.710+0000 7fdef2ffd700 1 -- 172.21.15.60:0/2412216326 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000148b0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.711+0000 7fdf11736700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdef40a16b0 0x7fdef40a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 -- 172.21.15.60:0/2412216326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cdd3d0 msgr2=0x55cc45cdf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdf7c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf00012960 tx=0x7fdf000090e0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 -- 172.21.15.60:0/2412216326 shutdown_connections 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdf7c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cd1c00 0x55cc45cd1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/2412216326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cdce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.712+0000 7fdf1f383b80 1 -- 172.21.15.60:0/2412216326 >> 172.21.15.60:0/2412216326 conn(0x55cc45c47200 msgr2=0x55cc45cce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.717+0000 7fdf11736700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdef40a16b0 0x7fdef40a3b70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf040abb90 tx=0x7fdf0401a040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.718+0000 7fdf1f383b80 1 -- 172.21.15.60:0/2412216326 shutdown_connections 2023-10-05T15:28:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.718+0000 7fdf1f383b80 1 -- 172.21.15.60:0/2412216326 wait complete. 2023-10-05T15:28:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.719+0000 7fdf1f383b80 1 -- start start 2023-10-05T15:28:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.719+0000 7fdf1f383b80 1 Processor -- start 2023-10-05T15:28:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45cda170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cda6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45c25dd0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45bc26b0 con 0x55cc45cd2520 2023-10-05T15:28:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45bc2350 con 0x55cc45cd1c00 2023-10-05T15:28:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.726+0000 7fdf1f383b80 10 client.0 _ll_register_callbacks cb 0x55cc45a1f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.730+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45cda170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.730+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45cda170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55500/0 (socket says 172.21.15.60:55500) 2023-10-05T15:28:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.730+0000 7fdf0bfff700 1 -- 172.21.15.60:0/1883921856 learned_addr learned my addr 172.21.15.60:0/1883921856 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.731+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cda6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.732+0000 7fdf10f35700 1 -- 172.21.15.60:0/1883921856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 msgr2=0x55cc45cda170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.732+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45cda170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.732+0000 7fdf10f35700 1 -- 172.21.15.60:0/1883921856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 msgr2=0x55cc45cdabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.732+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.732+0000 7fdf10f35700 1 -- 172.21.15.60:0/1883921856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf00012610 con 0x55cc45cd2520 2023-10-05T15:28:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.733+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cda6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c116960 tx=0x7fdefc00b3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0a3907d6270682 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.733+0000 7fdef07f8700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:28:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.733+0000 7fdef07f8700 1 -- 172.21.15.60:0/1883921856 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00be60 con 0x55cc45cd2520 2023-10-05T15:28:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.733+0000 7fdef07f8700 1 -- 172.21.15.60:0/1883921856 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9463+0+0 (secure 0 0 0) 0x7fdefc011420 con 0x55cc45cd2520 2023-10-05T15:28:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.733+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc45cc5d50 con 0x55cc45cd2520 2023-10-05T15:28:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.734+0000 7fdef07f8700 1 -- 172.21.15.60:0/1883921856 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdefc0115e0 con 0x55cc45cd2520 2023-10-05T15:28:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.734+0000 7fdf1f383b80 10 client.26645 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.734+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55cc45a39c00 con 0x55cc45cd2520 2023-10-05T15:28:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.734+0000 7fdef07f8700 1 -- 172.21.15.60:0/1883921856 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cc45cc5d50 con 0x55cc45cd2520 2023-10-05T15:28:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdef07f8700 1 -- 172.21.15.60:0/1883921856 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fdefc0199f0 con 0x55cc45cd2520 2023-10-05T15:28:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdf1f383b80 10 client.26645 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdf1f383b80 10 client.26645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdf1f383b80 20 client.26645 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45ced050 0x55cc45cef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdf1f383b80 4 client.26645 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:28:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.735+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc45c1edb0 con 0x55cc45ced050 2023-10-05T15:28:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.739+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45ced050 0x55cc45cef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.739+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45ced050 0x55cc45cef470 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1d79f08deb8a947 server_cookie=47c5ba95eda40194 in_seq=0 out_seq=0 2023-10-05T15:28:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.739+0000 7fdef07f8700 10 client.26645 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.750+0000 7fdef07f8700 1 -- 172.21.15.60:0/1883921856 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc45c1edb0 con 0x55cc45ced050 2023-10-05T15:28:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.750+0000 7fdef07f8700 10 client.26645 handle_command_reply: tid=0 2023-10-05T15:28:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.750+0000 7fdf1f383b80 1 client.26645 shutdown 2023-10-05T15:28:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.764+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 msgr2=0x55cc45cda6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.764+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cda6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c116960 tx=0x7fdefc00b3c0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 shutdown_connections 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45ced050 0x55cc45cef470 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cdabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45cda170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1883921856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cda6b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 >> 172.21.15.60:0/1883921856 conn(0x55cc45c47200 msgr2=0x55cc45ccdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.769+0000 7fdef07f8700 0 client.26645 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.780+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 shutdown_connections 2023-10-05T15:28:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.780+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1883921856 wait complete. 2023-10-05T15:28:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.787+0000 7fdf1f383b80 20 client.26645 trim_cache size 0 max 16384 2023-10-05T15:28:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.825+0000 7fdf1f383b80 1 Processor -- start 2023-10-05T15:28:43.833 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.830+0000 7fdf1f383b80 1 -- start start 2023-10-05T15:28:43.833 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45ce3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cd5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cd5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45aa68c0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45cd5080 con 0x55cc45cd2520 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45ccf680 con 0x55cc45cd1c00 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf10f35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cd5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf10f35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cd5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55398/0 (socket says 172.21.15.60:55398) 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf10f35700 1 -- 172.21.15.60:0/3659114011 learned_addr learned my addr 172.21.15.60:0/3659114011 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:43.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cd5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.835 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45ce3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf0bfff700 1 -- 172.21.15.60:0/3659114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 msgr2=0x55cc45ce3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45ce3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf0bfff700 1 -- 172.21.15.60:0/3659114011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 msgr2=0x55cc45cd5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.831+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cd5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.832+0000 7fdf0bfff700 1 -- 172.21.15.60:0/3659114011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc45a771f0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.832+0000 7fdf10f35700 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cd5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:28:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.840+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cd5a70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x55cc45cefd50 tx=0x7fdf00004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2976370bfa57bb4c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.840+0000 7fdef37fe700 1 -- 172.21.15.60:0/3659114011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00023040 con 0x55cc45cdd3d0 2023-10-05T15:28:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.840+0000 7fdef37fe700 1 -- 172.21.15.60:0/3659114011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf0002b070 con 0x55cc45cdd3d0 2023-10-05T15:28:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.840+0000 7fdef37fe700 1 -- 172.21.15.60:0/3659114011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00004ea0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 -- 172.21.15.60:0/3659114011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 msgr2=0x55cc45cd5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cd5a70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x55cc45cefd50 tx=0x7fdf00004e00 comp rx=0 tx=0).stop 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 -- 172.21.15.60:0/3659114011 shutdown_connections 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45cd5a70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd1c00 0x55cc45ce3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/3659114011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd2520 0x55cc45cd5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.841+0000 7fdf1f383b80 1 -- 172.21.15.60:0/3659114011 >> 172.21.15.60:0/3659114011 conn(0x55cc45c47200 msgr2=0x55cc45cef060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:43.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.846+0000 7fdf1f383b80 1 -- 172.21.15.60:0/3659114011 shutdown_connections 2023-10-05T15:28:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.856+0000 7fdf1f383b80 1 -- 172.21.15.60:0/3659114011 wait complete. 2023-10-05T15:28:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.856+0000 7fdf1f383b80 1 -- start start 2023-10-05T15:28:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 Processor -- start 2023-10-05T15:28:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 0x55cc45d35000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd2520 0x55cc45d35540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45d39fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45d3a4f0 con 0x55cc45cdd3d0 2023-10-05T15:28:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45d3a660 con 0x55cc45cd1c00 2023-10-05T15:28:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc45d3a820 con 0x55cc45cd2520 2023-10-05T15:28:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf1f383b80 10 client.0 _ll_register_callbacks cb 0x7fdefc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 0x55cc45d35000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 0x55cc45d35000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55404/0 (socket says 172.21.15.60:55404) 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf0bfff700 1 -- 172.21.15.60:0/1338794853 learned_addr learned my addr 172.21.15.60:0/1338794853 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.857+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45d39fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd2520 0x55cc45d35540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf0bfff700 1 -- 172.21.15.60:0/1338794853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd2520 msgr2=0x55cc45d35540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd2520 0x55cc45d35540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf0bfff700 1 -- 172.21.15.60:0/1338794853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 msgr2=0x55cc45d39fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45d39fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf0bfff700 1 -- 172.21.15.60:0/1338794853 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc45a39c00 con 0x55cc45cd1c00 2023-10-05T15:28:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.858+0000 7fdf0bfff700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 0x55cc45d35000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf000068c0 tx=0x7fdf00004e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9e2897287f5e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.862+0000 7fdef07f8700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:28:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.862+0000 7fdef07f8700 1 -- 172.21.15.60:0/1338794853 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000252a0 con 0x55cc45cd1c00 2023-10-05T15:28:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.862+0000 7fdef07f8700 1 -- 172.21.15.60:0/1338794853 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9463+0+0 (secure 0 0 0) 0x7fdf00025400 con 0x55cc45cd1c00 2023-10-05T15:28:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.862+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf000065d0 con 0x55cc45cd1c00 2023-10-05T15:28:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.862+0000 7fdef07f8700 1 -- 172.21.15.60:0/1338794853 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf00006070 con 0x55cc45cd1c00 2023-10-05T15:28:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.873+0000 7fdf1f383b80 10 client.26651 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.873+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55cc45a50d80 con 0x55cc45cd1c00 2023-10-05T15:28:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.877+0000 7fdef07f8700 1 -- 172.21.15.60:0/1338794853 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf000065d0 con 0x55cc45cd1c00 2023-10-05T15:28:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.877+0000 7fdef07f8700 1 -- 172.21.15.60:0/1338794853 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fdf00003740 con 0x55cc45cd1c00 2023-10-05T15:28:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.886+0000 7fdf1f383b80 10 client.26651 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.886+0000 7fdf1f383b80 10 client.26651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.886+0000 7fdf1f383b80 20 client.26651 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.886+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45d41ca0 0x55cc45d440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.886+0000 7fdf1f383b80 4 client.26651 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:28:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.886+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc45c1ead0 con 0x55cc45d41ca0 2023-10-05T15:28:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.888+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45d41ca0 0x55cc45d440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.893+0000 7fdef07f8700 10 client.26651 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:43.893+0000 7fdf10f35700 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45d41ca0 0x55cc45d440c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f63c5db214b362 server_cookie=88dc9461efb36242 in_seq=0 out_seq=0 2023-10-05T15:28:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.012+0000 7fdef07f8700 1 -- 172.21.15.60:0/1338794853 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc45c1ead0 con 0x55cc45d41ca0 2023-10-05T15:28:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.012+0000 7fdef07f8700 10 client.26651 handle_command_reply: tid=0 2023-10-05T15:28:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.012+0000 7fdf1f383b80 1 client.26651 shutdown 2023-10-05T15:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.021+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 msgr2=0x55cc45d35000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.021+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 0x55cc45d35000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf000068c0 tx=0x7fdf00004e00 comp rx=0 tx=0).stop 2023-10-05T15:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.028+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 shutdown_connections 2023-10-05T15:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.028+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55cc45d41ca0 0x55cc45d440c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.028+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cc45cdd3d0 0x55cc45d39fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.028+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc45cd1c00 0x55cc45d35000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.028+0000 7fdf1f383b80 1 --2- 172.21.15.60:0/1338794853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc45cd2520 0x55cc45d35540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.028+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 >> 172.21.15.60:0/1338794853 conn(0x55cc45c47200 msgr2=0x55cc45cd5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.033+0000 7fdef07f8700 0 client.26651 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.034+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 shutdown_connections 2023-10-05T15:28:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.034+0000 7fdf1f383b80 1 -- 172.21.15.60:0/1338794853 wait complete. 2023-10-05T15:28:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.044+0000 7fdf1f383b80 20 client.26651 trim_cache size 0 max 16384 2023-10-05T15:28:44.052 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:28:44.052 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:28:44.052 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:28:44.052 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:28:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.054+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdef40a16b0 msgr2=0x7fdef40a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.054+0000 7fdf13199700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdef40a16b0 0x7fdef40a3b70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf040abb90 tx=0x7fdf0401a040 comp rx=0 tx=0).stop 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.054+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 msgr2=0x7fdf0c1a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.054+0000 7fdf13199700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 0x7fdf0c1a2310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003fa0 tx=0x7fdf04018680 comp rx=0 tx=0).stop 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.059+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 shutdown_connections 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.059+0000 7fdf13199700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdef40a16b0 0x7fdef40a3b70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.059+0000 7fdf13199700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf0c11a690 0x7fdf0c1a2310 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.059+0000 7fdf13199700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf0c10f620 0x7fdf0c115b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.059+0000 7fdf13199700 1 --2- 172.21.15.60:0/1005695212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf0c10fa90 0x7fdf0c1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.059+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 >> 172.21.15.60:0/1005695212 conn(0x7fdf0c06cfa0 msgr2=0x7fdf0c0718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.060+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 shutdown_connections 2023-10-05T15:28:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:44.060+0000 7fdf13199700 1 -- 172.21.15.60:0/1005695212 wait complete. 2023-10-05T15:28:45.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:45 smithi060 ceph-mon[99238]: pgmap v377: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 671 KiB/s wr, 88 op/s 2023-10-05T15:28:45.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:45 smithi092 ceph-mon[102944]: pgmap v377: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 671 KiB/s wr, 88 op/s 2023-10-05T15:28:45.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:45 smithi135 ceph-mon[103360]: pgmap v377: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 671 KiB/s wr, 88 op/s 2023-10-05T15:28:47.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:47 smithi060 ceph-mon[99238]: pgmap v378: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 926 KiB/s wr, 83 op/s 2023-10-05T15:28:47.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:47 smithi060 ceph-mon[99238]: osdmap e109: 12 total, 12 up, 12 in 2023-10-05T15:28:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:47 smithi092 ceph-mon[102944]: pgmap v378: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 926 KiB/s wr, 83 op/s 2023-10-05T15:28:47.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:47 smithi092 ceph-mon[102944]: osdmap e109: 12 total, 12 up, 12 in 2023-10-05T15:28:47.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:47 smithi135 ceph-mon[103360]: pgmap v378: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 926 KiB/s wr, 83 op/s 2023-10-05T15:28:47.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:47 smithi135 ceph-mon[103360]: osdmap e109: 12 total, 12 up, 12 in 2023-10-05T15:28:49.677 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:49 smithi092 ceph-mon[102944]: pgmap v380: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 711 KiB/s wr, 85 op/s 2023-10-05T15:28:49.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:49 smithi135 ceph-mon[103360]: pgmap v380: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 711 KiB/s wr, 85 op/s 2023-10-05T15:28:49.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:49 smithi060 ceph-mon[99238]: pgmap v380: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 711 KiB/s wr, 85 op/s 2023-10-05T15:28:51.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:51 smithi135 ceph-mon[103360]: pgmap v381: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 876 KiB/s wr, 87 op/s 2023-10-05T15:28:51.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:51 smithi060 ceph-mon[99238]: pgmap v381: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 876 KiB/s wr, 87 op/s 2023-10-05T15:28:51.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:51 smithi092 ceph-mon[102944]: pgmap v381: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 876 KiB/s wr, 87 op/s 2023-10-05T15:28:52.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:52 smithi060 ceph-mon[99238]: pgmap v382: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 719 KiB/s wr, 85 op/s 2023-10-05T15:28:52.931 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:52 smithi092 ceph-mon[102944]: pgmap v382: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 719 KiB/s wr, 85 op/s 2023-10-05T15:28:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:52 smithi135 ceph-mon[103360]: pgmap v382: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 719 KiB/s wr, 85 op/s 2023-10-05T15:28:55.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:55 smithi060 ceph-mon[99238]: pgmap v383: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 957 KiB/s wr, 90 op/s 2023-10-05T15:28:55.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:55 smithi092 ceph-mon[102944]: pgmap v383: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 957 KiB/s wr, 90 op/s 2023-10-05T15:28:55.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:55 smithi135 ceph-mon[103360]: pgmap v383: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 957 KiB/s wr, 90 op/s 2023-10-05T15:28:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.269+0000 7f6e252f9700 1 -- 172.21.15.60:0/614582196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 msgr2=0x7f6e20114c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.269+0000 7f6e252f9700 1 --2- 172.21.15.60:0/614582196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 0x7f6e20114c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400aaa0 tx=0x7f6e1400adb0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 -- 172.21.15.60:0/614582196 shutdown_connections 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 --2- 172.21.15.60:0/614582196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 0x7f6e20114c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 --2- 172.21.15.60:0/614582196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e20108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 --2- 172.21.15.60:0/614582196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e20109360 0x7f6e2010c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 -- 172.21.15.60:0/614582196 >> 172.21.15.60:0/614582196 conn(0x7f6e2006cfa0 msgr2=0x7f6e2006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 -- 172.21.15.60:0/614582196 shutdown_connections 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 -- 172.21.15.60:0/614582196 wait complete. 2023-10-05T15:28:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.272+0000 7f6e252f9700 1 Processor -- start 2023-10-05T15:28:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 -- start start 2023-10-05T15:28:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e2010ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 0x7f6e2010f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2010f740 0x7f6e201b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201b2700 con 0x7f6e201089b0 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201a3920 con 0x7f6e2010d050 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e252f9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201a3ae0 con 0x7f6e2010f740 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e2010ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e2010ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41996/0 (socket says 172.21.15.60:41996) 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.273+0000 7f6e1effd700 1 -- 172.21.15.60:0/909380219 learned_addr learned my addr 172.21.15.60:0/909380219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.274+0000 7f6e1effd700 1 -- 172.21.15.60:0/909380219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2010f740 msgr2=0x7f6e201b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.274+0000 7f6e1effd700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2010f740 0x7f6e201b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.274+0000 7f6e1effd700 1 -- 172.21.15.60:0/909380219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 msgr2=0x7f6e2010f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.274+0000 7f6e1effd700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 0x7f6e2010f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.274+0000 7f6e1effd700 1 -- 172.21.15.60:0/909380219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1400a700 con 0x7f6e201089b0 2023-10-05T15:28:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.274+0000 7f6e1effd700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e2010ecc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800ef10 tx=0x7f6e1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.280+0000 7f6e07fff700 1 -- 172.21.15.60:0/909380219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800ca50 con 0x7f6e201089b0 2023-10-05T15:28:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.280+0000 7f6e07fff700 1 -- 172.21.15.60:0/909380219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e1800f040 con 0x7f6e201089b0 2023-10-05T15:28:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.280+0000 7f6e07fff700 1 -- 172.21.15.60:0/909380219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e180146e0 con 0x7f6e201089b0 2023-10-05T15:28:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.280+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e201a3d60 con 0x7f6e201089b0 2023-10-05T15:28:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.280+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e201a4220 con 0x7f6e201089b0 2023-10-05T15:28:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.285+0000 7f6e07fff700 1 -- 172.21.15.60:0/909380219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6e18004ad0 con 0x7f6e201089b0 2023-10-05T15:28:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.292+0000 7f6e07fff700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6e080a1780 0x7f6e080a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.292+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6e080a1780 0x7f6e080a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.292+0000 7f6e07fff700 1 -- 172.21.15.60:0/909380219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9463+0+0 (secure 0 0 0) 0x7f6e180cd150 con 0x7f6e201089b0 2023-10-05T15:28:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 Processor -- start 2023-10-05T15:28:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 -- start start 2023-10-05T15:28:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a12fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a13520 0x564d12a1de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 0x564d12a207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d1297c400 con 0x564d12a12c00 2023-10-05T15:28:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d1296dbc0 con 0x564d12a1e3d0 2023-10-05T15:28:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.296+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d1296b4e0 con 0x564d12a13520 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 0x564d12a207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 0x564d12a207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55426/0 (socket says 172.21.15.60:55426) 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/4094532662 learned_addr learned my addr 172.21.15.60:0/4094532662 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/4094532662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a13520 msgr2=0x564d12a1de90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a13520 0x564d12a1de90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/4094532662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 msgr2=0x564d12a12fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a12fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.297+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/4094532662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d12791d80 con 0x564d12a1e3d0 2023-10-05T15:28:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.299+0000 7f6e1f7fe700 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 0x564d12a207c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6e14005910 tx=0x7f6e1400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b783bde7f645667e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.306+0000 7f6e057fa700 1 -- 172.21.15.60:0/4094532662 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400cb70 con 0x564d12a1e3d0 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.306+0000 7f6e057fa700 1 -- 172.21.15.60:0/4094532662 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e1400ccd0 con 0x564d12a1e3d0 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.306+0000 7f6e057fa700 1 -- 172.21.15.60:0/4094532662 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e6b0 con 0x564d12a1e3d0 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 -- 172.21.15.60:0/4094532662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 msgr2=0x564d12a207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 0x564d12a207c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6e14005910 tx=0x7f6e1400a620 comp rx=0 tx=0).stop 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 -- 172.21.15.60:0/4094532662 shutdown_connections 2023-10-05T15:28:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a1e3d0 0x564d12a207c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a12fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/4094532662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a13520 0x564d12a1de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.307+0000 7f6e314e3b80 1 -- 172.21.15.60:0/4094532662 >> 172.21.15.60:0/4094532662 conn(0x564d12988200 msgr2=0x564d12a0f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.315+0000 7f6e314e3b80 1 -- 172.21.15.60:0/4094532662 shutdown_connections 2023-10-05T15:28:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.316+0000 7f6e314e3b80 1 -- 172.21.15.60:0/4094532662 wait complete. 2023-10-05T15:28:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.317+0000 7f6e314e3b80 1 -- start start 2023-10-05T15:28:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.317+0000 7f6e314e3b80 1 Processor -- start 2023-10-05T15:28:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.318+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6e080a1780 0x7f6e080a3c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e201106c0 tx=0x7f6e10009620 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.321+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a1b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.321+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a1b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a1e3d0 0x564d12a1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12966dd0 con 0x564d12a12c00 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d129036b0 con 0x564d12a13520 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12903350 con 0x564d12a1e3d0 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e314e3b80 10 client.0 _ll_register_callbacks cb 0x564d127607a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a1b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a1b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42006/0 (socket says 172.21.15.60:42006) 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 -- 172.21.15.60:0/518259145 learned_addr learned my addr 172.21.15.60:0/518259145 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 -- 172.21.15.60:0/518259145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a1e3d0 msgr2=0x564d12a1bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a1e3d0 0x564d12a1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 -- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 msgr2=0x564d12a1b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a1b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 -- 172.21.15.60:0/518259145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1401a040 con 0x564d12a12c00 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e1effd700 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a1b100 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6e180090a0 tx=0x7f6e180a0100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0eb746da0cba1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.322+0000 7f6e02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:28:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.323+0000 7f6e02ff5700 1 -- 172.21.15.60:0/518259145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18099e10 con 0x564d12a12c00 2023-10-05T15:28:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.323+0000 7f6e02ff5700 1 -- 172.21.15.60:0/518259145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9463+0+0 (secure 0 0 0) 0x7f6e1809df60 con 0x564d12a12c00 2023-10-05T15:28:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.326+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d1295fdb0 con 0x564d12a12c00 2023-10-05T15:28:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.327+0000 7f6e02ff5700 1 -- 172.21.15.60:0/518259145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e180a2110 con 0x564d12a12c00 2023-10-05T15:28:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.327+0000 7f6e314e3b80 10 client.16998 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.327+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x564d1277ac00 con 0x564d12a12c00 2023-10-05T15:28:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e02ff5700 1 -- 172.21.15.60:0/518259145 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564d1295fdb0 con 0x564d12a12c00 2023-10-05T15:28:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e02ff5700 1 -- 172.21.15.60:0/518259145 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f6e180a1c80 con 0x564d12a12c00 2023-10-05T15:28:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e314e3b80 10 client.16998 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e314e3b80 10 client.16998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e314e3b80 20 client.16998 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a2e020 0x564d12a30440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e314e3b80 4 client.16998 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:28:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.332+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d1295fad0 con 0x564d12a2e020 2023-10-05T15:28:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.337+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a2e020 0x564d12a30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.339+0000 7f6e02ff5700 10 client.16998 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.339+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a2e020 0x564d12a30440 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcdefa42b28875e3 server_cookie=2a64f82dec30797 in_seq=0 out_seq=0 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e02ff5700 1 -- 172.21.15.60:0/518259145 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564d1295fad0 con 0x564d12a2e020 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e02ff5700 10 client.16998 handle_command_reply: tid=0 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 client.16998 shutdown 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 msgr2=0x564d12a1b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a1b100 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6e180090a0 tx=0x7f6e180a0100 comp rx=0 tx=0).stop 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 shutdown_connections 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a2e020 0x564d12a30440 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a1e3d0 0x564d12a1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e02ff5700 0 client.16998 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a12c00 0x564d12a1b100 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/518259145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a1b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.340+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 >> 172.21.15.60:0/518259145 conn(0x564d12988200 msgr2=0x564d12a0ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.341+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 shutdown_connections 2023-10-05T15:28:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.341+0000 7f6e314e3b80 1 -- 172.21.15.60:0/518259145 wait complete. 2023-10-05T15:28:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.347+0000 7f6e314e3b80 20 client.16998 trim_cache size 0 max 16384 2023-10-05T15:28:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 Processor -- start 2023-10-05T15:28:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 -- start start 2023-10-05T15:28:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a1b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 0x564d12a1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d127e78c0 con 0x564d12a1e3d0 2023-10-05T15:28:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12a14ae0 con 0x564d12a13520 2023-10-05T15:28:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.380+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12a092c0 con 0x564d12a16be0 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 0x564d12a1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 0x564d12a1bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55546/0 (socket says 172.21.15.60:55546) 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/2470331394 learned_addr learned my addr 172.21.15.60:0/2470331394 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1effd700 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/2470331394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 msgr2=0x564d12a3dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/2470331394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 msgr2=0x564d12a1b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a1b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1f7fe700 1 -- 172.21.15.60:0/2470331394 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d127b81f0 con 0x564d12a16be0 2023-10-05T15:28:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.381+0000 7f6e1effd700 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:28:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.382+0000 7f6e1f7fe700 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 0x564d12a1bb80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e14000c00 tx=0x7f6e1400a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df149fc189b9e965 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.382+0000 7f6e05ffb700 1 -- 172.21.15.60:0/2470331394 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400cb70 con 0x564d12a16be0 2023-10-05T15:28:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.382+0000 7f6e05ffb700 1 -- 172.21.15.60:0/2470331394 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e1400ccd0 con 0x564d12a16be0 2023-10-05T15:28:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.382+0000 7f6e05ffb700 1 -- 172.21.15.60:0/2470331394 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e740 con 0x564d12a16be0 2023-10-05T15:28:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.384+0000 7f6e314e3b80 1 -- 172.21.15.60:0/2470331394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 msgr2=0x564d12a1bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.384+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 0x564d12a1bb80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e14000c00 tx=0x7f6e1400a410 comp rx=0 tx=0).stop 2023-10-05T15:28:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.395+0000 7f6e314e3b80 1 -- 172.21.15.60:0/2470331394 shutdown_connections 2023-10-05T15:28:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.395+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a16be0 0x564d12a1bb80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.395+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.395+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/2470331394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a1b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.395+0000 7f6e314e3b80 1 -- 172.21.15.60:0/2470331394 >> 172.21.15.60:0/2470331394 conn(0x564d12988200 msgr2=0x564d12a164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.404+0000 7f6e314e3b80 1 -- 172.21.15.60:0/2470331394 shutdown_connections 2023-10-05T15:28:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.413+0000 7f6e314e3b80 1 -- 172.21.15.60:0/2470331394 wait complete. 2023-10-05T15:28:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.413+0000 7f6e314e3b80 1 -- start start 2023-10-05T15:28:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.413+0000 7f6e314e3b80 1 Processor -- start 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a3dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a3bc50 0x564d12a3c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12a3c6b0 con 0x564d12a1e3d0 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12a3c820 con 0x564d12a13520 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d12a3c9e0 con 0x564d12a3bc50 2023-10-05T15:28:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.414+0000 7f6e314e3b80 10 client.0 _ll_register_callbacks cb 0x7f6e18099990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:28:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a3dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a3dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42022/0 (socket says 172.21.15.60:42022) 2023-10-05T15:28:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 -- 172.21.15.60:0/1450907035 learned_addr learned my addr 172.21.15.60:0/1450907035 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 -- 172.21.15.60:0/1450907035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a3bc50 msgr2=0x564d12a3c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a3bc50 0x564d12a3c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 -- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 msgr2=0x564d12a3d6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.420+0000 7f6e1e7fc700 1 -- 172.21.15.60:0/1450907035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d1277ac00 con 0x564d12a1e3d0 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.421+0000 7f6e1e7fc700 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a3dc00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009940 tx=0x7f6e10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58dab3b59966da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.421+0000 7f6e02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:28:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.426+0000 7f6e02ff5700 1 -- 172.21.15.60:0/1450907035 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e100225c0 con 0x564d12a1e3d0 2023-10-05T15:28:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.426+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d127b2f10 con 0x564d12a1e3d0 2023-10-05T15:28:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.431+0000 7f6e02ff5700 1 -- 172.21.15.60:0/1450907035 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9463+0+0 (secure 0 0 0) 0x7f6e100227a0 con 0x564d12a1e3d0 2023-10-05T15:28:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.431+0000 7f6e02ff5700 1 -- 172.21.15.60:0/1450907035 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e100229a0 con 0x564d12a1e3d0 2023-10-05T15:28:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.431+0000 7f6e314e3b80 10 client.17001 fetch_fsmap learned FSMap version 43 2023-10-05T15:28:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.431+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x564d12791d80 con 0x564d12a1e3d0 2023-10-05T15:28:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.431+0000 7f6e02ff5700 1 -- 172.21.15.60:0/1450907035 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564d127b2f10 con 0x564d12a1e3d0 2023-10-05T15:28:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.432+0000 7f6e02ff5700 1 -- 172.21.15.60:0/1450907035 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f6e10010af0 con 0x564d12a1e3d0 2023-10-05T15:28:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.433+0000 7f6e314e3b80 10 client.17001 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:28:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.433+0000 7f6e314e3b80 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:28:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.433+0000 7f6e314e3b80 20 client.17001 populate_metadata read hostname 'smithi060' 2023-10-05T15:28:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.433+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a85cb0 0x564d12a880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.433+0000 7f6e314e3b80 4 client.17001 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:28:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.433+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564d127e7f00 con 0x564d12a85cb0 2023-10-05T15:28:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.436+0000 7f6e1effd700 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a85cb0 0x564d12a880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.436+0000 7f6e1effd700 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a85cb0 0x564d12a880d0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f351fe5d4bf8b1 server_cookie=750af3036f86c9d0 in_seq=0 out_seq=0 2023-10-05T15:28:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.439+0000 7f6e02ff5700 10 client.17001 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.545+0000 7f6e02ff5700 1 -- 172.21.15.60:0/1450907035 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564d127e7f00 con 0x564d12a85cb0 2023-10-05T15:28:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.545+0000 7f6e02ff5700 10 client.17001 handle_command_reply: tid=0 2023-10-05T15:28:57.554 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.550+0000 7f6e314e3b80 1 client.17001 shutdown 2023-10-05T15:28:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:28:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:28:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:28:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.562+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 msgr2=0x564d12a3dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.562+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a3dc00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009940 tx=0x7f6e10004750 comp rx=0 tx=0).stop 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 shutdown_connections 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x564d12a85cb0 0x564d12a880d0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d12a3bc50 0x564d12a3c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d12a13520 0x564d12a3d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 --2- 172.21.15.60:0/1450907035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d12a1e3d0 0x564d12a3dc00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 >> 172.21.15.60:0/1450907035 conn(0x564d12988200 msgr2=0x564d12a1b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e02ff5700 0 client.17001 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 shutdown_connections 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.564+0000 7f6e314e3b80 1 -- 172.21.15.60:0/1450907035 wait complete. 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.565+0000 7f6e314e3b80 20 client.17001 trim_cache size 0 max 16384 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.565+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6e080a1780 msgr2=0x7f6e080a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.565+0000 7f6e252f9700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6e080a1780 0x7f6e080a3c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e201106c0 tx=0x7f6e10009620 comp rx=0 tx=0).stop 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.565+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 msgr2=0x7f6e2010ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.565+0000 7f6e252f9700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e2010ecc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800ef10 tx=0x7f6e1800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.569+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 shutdown_connections 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.569+0000 7f6e252f9700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2010f740 0x7f6e201b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.569+0000 7f6e252f9700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e201089b0 0x7f6e2010ecc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.569+0000 7f6e252f9700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f6e080a1780 0x7f6e080a3c40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.569+0000 7f6e252f9700 1 --2- 172.21.15.60:0/909380219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d050 0x7f6e2010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.569+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 >> 172.21.15.60:0/909380219 conn(0x7f6e2006cfa0 msgr2=0x7f6e200708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.574+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 shutdown_connections 2023-10-05T15:28:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:28:57.581+0000 7f6e252f9700 1 -- 172.21.15.60:0/909380219 wait complete. 2023-10-05T15:28:57.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:57 smithi092 ceph-mon[102944]: pgmap v384: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 652 KiB/s wr, 88 op/s 2023-10-05T15:28:57.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:57 smithi135 ceph-mon[103360]: pgmap v384: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 652 KiB/s wr, 88 op/s 2023-10-05T15:28:57.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:57 smithi060 ceph-mon[99238]: pgmap v384: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 652 KiB/s wr, 88 op/s 2023-10-05T15:28:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:28:59 smithi135 ceph-mon[103360]: pgmap v385: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-10-05T15:28:59.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:28:59 smithi060 ceph-mon[99238]: pgmap v385: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-10-05T15:28:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:28:59 smithi092 ceph-mon[102944]: pgmap v385: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-10-05T15:29:01.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:01 smithi135 ceph-mon[103360]: pgmap v386: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 91 op/s 2023-10-05T15:29:01.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:01 smithi060 ceph-mon[99238]: pgmap v386: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 91 op/s 2023-10-05T15:29:01.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:01 smithi092 ceph-mon[102944]: pgmap v386: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 91 op/s 2023-10-05T15:29:02.922 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:02 smithi060 ceph-mon[99238]: pgmap v387: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 968 KiB/s wr, 99 op/s 2023-10-05T15:29:02.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:02 smithi092 ceph-mon[102944]: pgmap v387: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 968 KiB/s wr, 99 op/s 2023-10-05T15:29:03.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:02 smithi135 ceph-mon[103360]: pgmap v387: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 968 KiB/s wr, 99 op/s 2023-10-05T15:29:05.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:05 smithi060 ceph-mon[99238]: pgmap v388: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-10-05T15:29:05.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:05 smithi092 ceph-mon[102944]: pgmap v388: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-10-05T15:29:05.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:05 smithi135 ceph-mon[103360]: pgmap v388: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-10-05T15:29:07.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:07 smithi060 ceph-mon[99238]: pgmap v389: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 125 op/s 2023-10-05T15:29:07.676 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:07 smithi092 ceph-mon[102944]: pgmap v389: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 125 op/s 2023-10-05T15:29:07.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:07 smithi135 ceph-mon[103360]: pgmap v389: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 125 op/s 2023-10-05T15:29:09.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:09 smithi135 ceph-mon[103360]: pgmap v390: 129 pgs: 13 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 82 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 143 op/s 2023-10-05T15:29:09.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:09 smithi135 ceph-mon[103360]: osdmap e110: 12 total, 12 up, 12 in 2023-10-05T15:29:09.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:09 smithi060 ceph-mon[99238]: pgmap v390: 129 pgs: 13 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 82 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 143 op/s 2023-10-05T15:29:09.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:09 smithi060 ceph-mon[99238]: osdmap e110: 12 total, 12 up, 12 in 2023-10-05T15:29:09.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:09 smithi092 ceph-mon[102944]: pgmap v390: 129 pgs: 13 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 82 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 143 op/s 2023-10-05T15:29:09.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:09 smithi092 ceph-mon[102944]: osdmap e110: 12 total, 12 up, 12 in 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 -- 172.21.15.60:0/2655801999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109030 msgr2=0x7f216c1094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 --2- 172.21.15.60:0/2655801999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109030 0x7f216c1094b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2160009990 tx=0x7f2160009ca0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 -- 172.21.15.60:0/2655801999 shutdown_connections 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 --2- 172.21.15.60:0/2655801999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109ad0 0x7f216c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 --2- 172.21.15.60:0/2655801999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 --2- 172.21.15.60:0/2655801999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109030 0x7f216c1094b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.808+0000 7f21708ee700 1 -- 172.21.15.60:0/2655801999 >> 172.21.15.60:0/2655801999 conn(0x7f216c06cfa0 msgr2=0x7f216c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.812+0000 7f21708ee700 1 -- 172.21.15.60:0/2655801999 shutdown_connections 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.813+0000 7f21708ee700 1 -- 172.21.15.60:0/2655801999 wait complete. 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 Processor -- start 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 -- start start 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c1a7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109030 0x7f216c1a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109ad0 0x7f216c1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1a1f00 con 0x7f216c109ad0 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1a2070 con 0x7f216c108710 2023-10-05T15:29:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.814+0000 7f21708ee700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1a2230 con 0x7f216c109030 2023-10-05T15:29:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.816+0000 7f2169d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109030 0x7f216c1a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.817+0000 7f216a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c1a7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.817+0000 7f216a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c1a7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55454/0 (socket says 172.21.15.60:55454) 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.817+0000 7f216a59c700 1 -- 172.21.15.60:0/3975789085 learned_addr learned my addr 172.21.15.60:0/3975789085 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f216a59c700 1 -- 172.21.15.60:0/3975789085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109030 msgr2=0x7f216c1a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f216a59c700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109030 0x7f216c1a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f216a59c700 1 -- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109ad0 msgr2=0x7f216c1a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f216a59c700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109ad0 0x7f216c1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f216a59c700 1 -- 172.21.15.60:0/3975789085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600095f0 con 0x7f216c108710 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f2169d9b700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109030 0x7f216c1a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f216a59c700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c1a7a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e9a0 tx=0x7f215c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f215b7fe700 1 -- 172.21.15.60:0/3975789085 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00c7c0 con 0x7f216c108710 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f215b7fe700 1 -- 172.21.15.60:0/3975789085 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f215c00cde0 con 0x7f216c108710 2023-10-05T15:29:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.818+0000 7f215b7fe700 1 -- 172.21.15.60:0/3975789085 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c01fe10 con 0x7f216c108710 2023-10-05T15:29:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.820+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c1a2510 con 0x7f216c108710 2023-10-05T15:29:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.820+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c116cc0 con 0x7f216c108710 2023-10-05T15:29:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.829+0000 7f217cad8b80 1 Processor -- start 2023-10-05T15:29:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f215b7fe700 1 -- 172.21.15.60:0/3975789085 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f215c017300 con 0x7f216c108710 2023-10-05T15:29:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 -- start start 2023-10-05T15:29:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 0x55e8b51edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b51f8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b51fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b5157400 con 0x55e8b51ee520 2023-10-05T15:29:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b5148bc0 con 0x55e8b51f93d0 2023-10-05T15:29:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.830+0000 7f217cad8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b51464e0 con 0x55e8b51edc00 2023-10-05T15:29:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.835+0000 7f215b7fe700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21540b2680 0x7f21540b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.835+0000 7f215b7fe700 1 -- 172.21.15.60:0/3975789085 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7f215c0ce4c0 con 0x7f216c108710 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.835+0000 7f216a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b51f8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.835+0000 7f216a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b51f8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42040/0 (socket says 172.21.15.60:42040) 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.835+0000 7f216a59c700 1 -- 172.21.15.60:0/67004611 learned_addr learned my addr 172.21.15.60:0/67004611 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.836+0000 7f216a59c700 1 -- 172.21.15.60:0/67004611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 msgr2=0x55e8b51edfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.836+0000 7f216a59c700 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 0x55e8b51edfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.836+0000 7f216a59c700 1 -- 172.21.15.60:0/67004611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 msgr2=0x55e8b51fb7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.836+0000 7f216a59c700 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b51fb7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.836+0000 7f216a59c700 1 -- 172.21.15.60:0/67004611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8b4f6cd80 con 0x55e8b51ee520 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.836+0000 7f216a59c700 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b51f8e90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f215c0a2fa0 tx=0x7f215c09b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5e0325cccc1c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.838+0000 7f2158ff9700 1 -- 172.21.15.60:0/67004611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c09b140 con 0x55e8b51ee520 2023-10-05T15:29:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.838+0000 7f2158ff9700 1 -- 172.21.15.60:0/67004611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f215c09f290 con 0x55e8b51ee520 2023-10-05T15:29:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.838+0000 7f2158ff9700 1 -- 172.21.15.60:0/67004611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c09b3a0 con 0x55e8b51ee520 2023-10-05T15:29:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.838+0000 7f217cad8b80 1 -- 172.21.15.60:0/67004611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 msgr2=0x55e8b51f8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f217cad8b80 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b51f8e90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f215c0a2fa0 tx=0x7f215c09b010 comp rx=0 tx=0).stop 2023-10-05T15:29:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f216ad9d700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21540b2680 0x7f21540b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f217cad8b80 1 -- 172.21.15.60:0/67004611 shutdown_connections 2023-10-05T15:29:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f217cad8b80 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b51fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f217cad8b80 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 0x55e8b51edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f217cad8b80 1 --2- 172.21.15.60:0/67004611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b51f8e90 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f217cad8b80 1 -- 172.21.15.60:0/67004611 >> 172.21.15.60:0/67004611 conn(0x55e8b5163200 msgr2=0x55e8b51ea080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.839+0000 7f216ad9d700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21540b2680 0x7f21540b4b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f216c1a8730 tx=0x7f21640015e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:10.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.846+0000 7f217cad8b80 1 -- 172.21.15.60:0/67004611 shutdown_connections 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.852+0000 7f217cad8b80 1 -- 172.21.15.60:0/67004611 wait complete. 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.852+0000 7f217cad8b80 1 -- start start 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.852+0000 7f217cad8b80 1 Processor -- start 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51f6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b5141dd0 con 0x55e8b51f93d0 2023-10-05T15:29:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b50de6b0 con 0x55e8b51edc00 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b50de350 con 0x55e8b51ee520 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f217cad8b80 10 client.0 _ll_register_callbacks cb 0x55e8b4f3b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f216ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f216ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42046/0 (socket says 172.21.15.60:42046) 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.854+0000 7f216ad9d700 1 -- 172.21.15.60:0/2420546171 learned_addr learned my addr 172.21.15.60:0/2420546171 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f2169d9b700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216a59c700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216ad9d700 1 -- 172.21.15.60:0/2420546171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 msgr2=0x55e8b51f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216ad9d700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216ad9d700 1 -- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 msgr2=0x55e8b51f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216ad9d700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216ad9d700 1 -- 172.21.15.60:0/2420546171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c116cc0 con 0x55e8b51f93d0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f2169d9b700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f216ad9d700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51f6bb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f21640167c0 tx=0x7f21640012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaeae6f83c43806 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f2151ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f2151ffb700 1 -- 172.21.15.60:0/2420546171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216401b070 con 0x55e8b51f93d0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f2151ffb700 1 -- 172.21.15.60:0/2420546171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7f2164014420 con 0x55e8b51f93d0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.855+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8b51e1d50 con 0x55e8b51f93d0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f2151ffb700 1 -- 172.21.15.60:0/2420546171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21640162e0 con 0x55e8b51f93d0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 10 client.17010 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e8b4f55c00 con 0x55e8b51f93d0 2023-10-05T15:29:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f2151ffb700 1 -- 172.21.15.60:0/2420546171 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e8b51e1d50 con 0x55e8b51f93d0 2023-10-05T15:29:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f2151ffb700 1 -- 172.21.15.60:0/2420546171 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f2164027070 con 0x55e8b51f93d0 2023-10-05T15:29:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 10 client.17010 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 10 client.17010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 20 client.17010 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b5209150 0x55e8b520b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 4 client.17010 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:29:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.856+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8b513adb0 con 0x55e8b5209150 2023-10-05T15:29:10.867 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.861+0000 7f216a59c700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b5209150 0x55e8b520b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.868 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.862+0000 7f216a59c700 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b5209150 0x55e8b520b570 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18590e321c020b14 server_cookie=234a320eab108b30 in_seq=0 out_seq=0 2023-10-05T15:29:10.869 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.867+0000 7f2151ffb700 10 client.17010 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:10.869 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.867+0000 7f2151ffb700 1 -- 172.21.15.60:0/2420546171 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8b513adb0 con 0x55e8b5209150 2023-10-05T15:29:10.869 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.867+0000 7f2151ffb700 10 client.17010 handle_command_reply: tid=0 2023-10-05T15:29:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.869+0000 7f217cad8b80 1 client.17010 shutdown 2023-10-05T15:29:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.874+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 msgr2=0x55e8b51f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.874+0000 7f217cad8b80 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51f6bb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f21640167c0 tx=0x7f21640012e0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.874+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 shutdown_connections 2023-10-05T15:29:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.874+0000 7f217cad8b80 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b5209150 0x55e8b520b570 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.874+0000 7f217cad8b80 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51f6bb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.875+0000 7f217cad8b80 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.875+0000 7f217cad8b80 1 --2- 172.21.15.60:0/2420546171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.875+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 >> 172.21.15.60:0/2420546171 conn(0x55e8b5163200 msgr2=0x55e8b51e9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.875+0000 7f2151ffb700 0 client.17010 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.886+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 shutdown_connections 2023-10-05T15:29:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.889+0000 7f217cad8b80 1 -- 172.21.15.60:0/2420546171 wait complete. 2023-10-05T15:29:10.902 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.896+0000 7f217cad8b80 20 client.17010 trim_cache size 0 max 16384 2023-10-05T15:29:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.924+0000 7f217cad8b80 1 Processor -- start 2023-10-05T15:29:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 -- start start 2023-10-05T15:29:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51fff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b4fc28c0 con 0x55e8b51f93d0 2023-10-05T15:29:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b51ea630 con 0x55e8b51edc00 2023-10-05T15:29:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.929+0000 7f217cad8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b51f0ff0 con 0x55e8b51ee520 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.934+0000 7f216a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.934+0000 7f216a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55474/0 (socket says 172.21.15.60:55474) 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.934+0000 7f216a59c700 1 -- 172.21.15.60:0/4112857147 learned_addr learned my addr 172.21.15.60:0/4112857147 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f216a59c700 1 -- 172.21.15.60:0/4112857147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 msgr2=0x55e8b51e9bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f216a59c700 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51e9bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f216a59c700 1 -- 172.21.15.60:0/4112857147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 msgr2=0x55e8b51ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f216a59c700 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f216a59c700 1 -- 172.21.15.60:0/4112857147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8b4f931f0 con 0x55e8b51edc00 2023-10-05T15:29:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f216a59c700 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51fff50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f215c09b080 tx=0x7f215c009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48fc358e2881b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f21597fa700 1 -- 172.21.15.60:0/4112857147 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c09b140 con 0x55e8b51edc00 2023-10-05T15:29:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f21597fa700 1 -- 172.21.15.60:0/4112857147 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f215c0a34d0 con 0x55e8b51edc00 2023-10-05T15:29:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.935+0000 7f21597fa700 1 -- 172.21.15.60:0/4112857147 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c09a870 con 0x55e8b51edc00 2023-10-05T15:29:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.937+0000 7f217cad8b80 1 -- 172.21.15.60:0/4112857147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 msgr2=0x55e8b51fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.937+0000 7f217cad8b80 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51fff50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f215c09b080 tx=0x7f215c009850 comp rx=0 tx=0).stop 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.941+0000 7f217cad8b80 1 -- 172.21.15.60:0/4112857147 shutdown_connections 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.941+0000 7f217cad8b80 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51f93d0 0x55e8b51ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.941+0000 7f217cad8b80 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51edc00 0x55e8b51fff50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.941+0000 7f217cad8b80 1 --2- 172.21.15.60:0/4112857147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51ee520 0x55e8b51e9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.941+0000 7f217cad8b80 1 -- 172.21.15.60:0/4112857147 >> 172.21.15.60:0/4112857147 conn(0x55e8b5163200 msgr2=0x55e8b51f14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.944+0000 7f217cad8b80 1 -- 172.21.15.60:0/4112857147 shutdown_connections 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.944+0000 7f217cad8b80 1 -- 172.21.15.60:0/4112857147 wait complete. 2023-10-05T15:29:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.944+0000 7f217cad8b80 1 -- start start 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 Processor -- start 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 0x55e8b5250f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b5251450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b52519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b525c120 con 0x55e8b51ee520 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b525c290 con 0x55e8b51f93d0 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b525c450 con 0x55e8b51edc00 2023-10-05T15:29:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.945+0000 7f217cad8b80 10 client.0 _ll_register_callbacks cb 0x7f216400cd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.946+0000 7f216ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b52519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b5251450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b5251450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42060/0 (socket says 172.21.15.60:42060) 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 -- 172.21.15.60:0/1361110085 learned_addr learned my addr 172.21.15.60:0/1361110085 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 -- 172.21.15.60:0/1361110085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 msgr2=0x55e8b5250f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 0x55e8b5250f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 -- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 msgr2=0x55e8b52519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b52519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.950+0000 7f2169d9b700 1 -- 172.21.15.60:0/1361110085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8b4f6cd80 con 0x55e8b51ee520 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.951+0000 7f2169d9b700 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b5251450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2160009990 tx=0x7f2160005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bac15574eaab24d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.951+0000 7f2151ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.951+0000 7f2151ffb700 1 -- 172.21.15.60:0/1361110085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160028070 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.951+0000 7f2151ffb700 1 -- 172.21.15.60:0/1361110085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7f2160004710 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f215c09f290 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f2151ffb700 1 -- 172.21.15.60:0/1361110085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21600048d0 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 10 client.17013 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e8b4f6b250 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f2151ffb700 1 -- 172.21.15.60:0/1361110085 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f215c09f290 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f2151ffb700 1 -- 172.21.15.60:0/1361110085 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f216002b020 con 0x55e8b51ee520 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 10 client.17013 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 10 client.17013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 20 client.17013 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b525dda0 0x55e8b52601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 4 client.17013 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:29:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.952+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e8b513aad0 con 0x55e8b525dda0 2023-10-05T15:29:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.957+0000 7f216a59c700 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b525dda0 0x55e8b52601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.967+0000 7f2151ffb700 10 client.17013 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:10.967+0000 7f216a59c700 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b525dda0 0x55e8b52601c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=817bcdbc4812fcb4 server_cookie=b745a2651c3d6960 in_seq=0 out_seq=0 2023-10-05T15:29:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.093+0000 7f2151ffb700 1 -- 172.21.15.60:0/1361110085 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e8b513aad0 con 0x55e8b525dda0 2023-10-05T15:29:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.093+0000 7f2151ffb700 10 client.17013 handle_command_reply: tid=0 2023-10-05T15:29:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.093+0000 7f217cad8b80 1 client.17013 shutdown 2023-10-05T15:29:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.097+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 msgr2=0x55e8b5251450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.097+0000 7f217cad8b80 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b5251450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2160009990 tx=0x7f2160005300 comp rx=0 tx=0).stop 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.099+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 shutdown_connections 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.099+0000 7f217cad8b80 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e8b525dda0 0x55e8b52601c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.099+0000 7f217cad8b80 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8b51f93d0 0x55e8b52519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.099+0000 7f217cad8b80 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8b51edc00 0x55e8b5250f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.100+0000 7f217cad8b80 1 --2- 172.21.15.60:0/1361110085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8b51ee520 0x55e8b5251450 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.100+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 >> 172.21.15.60:0/1361110085 conn(0x55e8b5163200 msgr2=0x55e8b51e9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.100+0000 7f2151ffb700 0 client.17013 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.100+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 shutdown_connections 2023-10-05T15:29:11.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.100+0000 7f217cad8b80 1 -- 172.21.15.60:0/1361110085 wait complete. 2023-10-05T15:29:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:29:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:29:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:29:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:29:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.102+0000 7f217cad8b80 20 client.17013 trim_cache size 0 max 16384 2023-10-05T15:29:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21540b2680 msgr2=0x7f21540b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21540b2680 0x7f21540b4b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f216c1a8730 tx=0x7f21640015e0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 msgr2=0x7f216c1a7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c1a7a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e9a0 tx=0x7f215c00ed60 comp rx=0 tx=0).stop 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 shutdown_connections 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f216c109ad0 0x7f216c1a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21540b2680 0x7f21540b4b40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c108710 0x7f216c1a7a30 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e9a0 tx=0x7f215c00ed60 comp rx=0 tx=0).stop 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 --2- 172.21.15.60:0/3975789085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c109030 0x7f216c1a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.103+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 >> 172.21.15.60:0/3975789085 conn(0x7f216c06cfa0 msgr2=0x7f216c10c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.116+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 shutdown_connections 2023-10-05T15:29:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:11.122+0000 7f21708ee700 1 -- 172.21.15.60:0/3975789085 wait complete. 2023-10-05T15:29:11.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:11 smithi135 ceph-mon[103360]: pgmap v392: 129 pgs: 13 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 82 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-05T15:29:11.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:11 smithi060 ceph-mon[99238]: pgmap v392: 129 pgs: 13 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 82 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-05T15:29:11.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:11 smithi092 ceph-mon[102944]: pgmap v392: 129 pgs: 13 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 82 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-05T15:29:12.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:12 smithi060 ceph-mon[99238]: pgmap v393: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-05T15:29:12.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:12 smithi092 ceph-mon[102944]: pgmap v393: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-05T15:29:13.085 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:12 smithi135 ceph-mon[103360]: pgmap v393: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2023-10-05T15:29:15.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:15 smithi092 ceph-mon[102944]: pgmap v394: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 939 KiB/s wr, 147 op/s 2023-10-05T15:29:15.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:15 smithi135 ceph-mon[103360]: pgmap v394: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 939 KiB/s wr, 147 op/s 2023-10-05T15:29:15.925 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:15 smithi060 ceph-mon[99238]: pgmap v394: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 939 KiB/s wr, 147 op/s 2023-10-05T15:29:17.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:17 smithi135 ceph-mon[103360]: pgmap v395: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 133 op/s 2023-10-05T15:29:17.929 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:17 smithi060 ceph-mon[99238]: pgmap v395: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 133 op/s 2023-10-05T15:29:17.932 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:17 smithi092 ceph-mon[102944]: pgmap v395: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 133 op/s 2023-10-05T15:29:19.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:19 smithi135 ceph-mon[103360]: pgmap v396: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 768 KiB/s wr, 119 op/s 2023-10-05T15:29:19.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:19 smithi060 ceph-mon[99238]: pgmap v396: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 768 KiB/s wr, 119 op/s 2023-10-05T15:29:19.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:19 smithi092 ceph-mon[102944]: pgmap v396: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 768 KiB/s wr, 119 op/s 2023-10-05T15:29:21.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:21 smithi135 ceph-mon[103360]: pgmap v397: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 837 KiB/s wr, 110 op/s 2023-10-05T15:29:21.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:21 smithi060 ceph-mon[99238]: pgmap v397: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 837 KiB/s wr, 110 op/s 2023-10-05T15:29:21.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:21 smithi092 ceph-mon[102944]: pgmap v397: 129 pgs: 24 active+clean+snaptrim, 71 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 837 KiB/s wr, 110 op/s 2023-10-05T15:29:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:22 smithi135 ceph-mon[103360]: pgmap v398: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 924 KiB/s wr, 114 op/s 2023-10-05T15:29:23.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:22 smithi060 ceph-mon[99238]: pgmap v398: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 924 KiB/s wr, 114 op/s 2023-10-05T15:29:23.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:22 smithi092 ceph-mon[102944]: pgmap v398: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 924 KiB/s wr, 114 op/s 2023-10-05T15:29:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.327+0000 7fe923198700 1 -- 172.21.15.60:0/2042971521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1048a0 msgr2=0x7fe91c10c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.327+0000 7fe923198700 1 --2- 172.21.15.60:0/2042971521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1048a0 0x7fe91c10c440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe91400b140 tx=0x7fe91400b450 comp rx=0 tx=0).stop 2023-10-05T15:29:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.343+0000 7fe923198700 1 -- 172.21.15.60:0/2042971521 shutdown_connections 2023-10-05T15:29:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.343+0000 7fe923198700 1 --2- 172.21.15.60:0/2042971521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1048a0 0x7fe91c10c440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.343+0000 7fe923198700 1 --2- 172.21.15.60:0/2042971521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 0x7fe91c0ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.343+0000 7fe923198700 1 --2- 172.21.15.60:0/2042971521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c100300 0x7fe91c104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.343+0000 7fe923198700 1 -- 172.21.15.60:0/2042971521 >> 172.21.15.60:0/2042971521 conn(0x7fe91c0762e0 msgr2=0x7fe91c0766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.350+0000 7fe923198700 1 -- 172.21.15.60:0/2042971521 shutdown_connections 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.351+0000 7fe923198700 1 -- 172.21.15.60:0/2042971521 wait complete. 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.351+0000 7fe923198700 1 Processor -- start 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.351+0000 7fe923198700 1 -- start start 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe923198700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 0x7fe91c1a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe923198700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c1048a0 0x7fe91c1a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe923198700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1aa8d0 0x7fe91c1aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe923198700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1ab350 con 0x7fe91c1048a0 2023-10-05T15:29:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe923198700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1ab4c0 con 0x7fe91c1aa8d0 2023-10-05T15:29:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe923198700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1ab680 con 0x7fe91c0ff950 2023-10-05T15:29:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c1048a0 0x7fe91c1a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c1048a0 0x7fe91c1a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42068/0 (socket says 172.21.15.60:42068) 2023-10-05T15:29:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.352+0000 7fe91bfff700 1 -- 172.21.15.60:0/2300480781 learned_addr learned my addr 172.21.15.60:0/2300480781 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.355+0000 7fe920f34700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 0x7fe91c1a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.355+0000 7fe920f34700 1 -- 172.21.15.60:0/2300480781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1aa8d0 msgr2=0x7fe91c1aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe920f34700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1aa8d0 0x7fe91c1aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe920f34700 1 -- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c1048a0 msgr2=0x7fe91c1a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe920f34700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c1048a0 0x7fe91c1a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe920f34700 1 -- 172.21.15.60:0/2300480781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91400ad20 con 0x7fe91c0ff950 2023-10-05T15:29:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe920f34700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 0x7fe91c1a5d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe910006fd0 tx=0x7fe91000b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe919ffb700 1 -- 172.21.15.60:0/2300480781 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011830 con 0x7fe91c0ff950 2023-10-05T15:29:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.356+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c113100 con 0x7fe91c0ff950 2023-10-05T15:29:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.357+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c113610 con 0x7fe91c0ff950 2023-10-05T15:29:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.357+0000 7fe919ffb700 1 -- 172.21.15.60:0/2300480781 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe910011e50 con 0x7fe91c0ff950 2023-10-05T15:29:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.357+0000 7fe919ffb700 1 -- 172.21.15.60:0/2300480781 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000f2e0 con 0x7fe91c0ff950 2023-10-05T15:29:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.360+0000 7fe919ffb700 1 -- 172.21.15.60:0/2300480781 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe910010380 con 0x7fe91c0ff950 2023-10-05T15:29:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.361+0000 7fe919ffb700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe90c0a16f0 0x7fe90c0a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.361+0000 7fe919ffb700 1 -- 172.21.15.60:0/2300480781 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fe9100cce40 con 0x7fe91c0ff950 2023-10-05T15:29:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.361+0000 7fe91bfff700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe90c0a16f0 0x7fe90c0a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.362+0000 7fe91bfff700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe90c0a16f0 0x7fe90c0a3bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe91c1a7540 tx=0x7fe90800f040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.368+0000 7fe92f382b80 1 Processor -- start 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 -- start start 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43913c400 con 0x55c4391d2c00 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43912dbc0 con 0x55c4391d3520 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe92f382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43912b4e0 con 0x55c4391ef3e0 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55500/0 (socket says 172.21.15.60:55500) 2023-10-05T15:29:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.371+0000 7fe91bfff700 1 -- 172.21.15.60:0/3042828747 learned_addr learned my addr 172.21.15.60:0/3042828747 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.372+0000 7fe91bfff700 1 -- 172.21.15.60:0/3042828747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 msgr2=0x55c4391f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.372+0000 7fe91bfff700 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.372+0000 7fe91bfff700 1 -- 172.21.15.60:0/3042828747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 msgr2=0x55c4391d2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.372+0000 7fe91bfff700 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.372+0000 7fe91bfff700 1 -- 172.21.15.60:0/3042828747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c438f51d80 con 0x55c4391d3520 2023-10-05T15:29:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.376+0000 7fe91bfff700 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391eeea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe90800bd10 tx=0x7fe908013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3207189617cf32d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.382+0000 7fe906ffd700 1 -- 172.21.15.60:0/3042828747 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908012040 con 0x55c4391d3520 2023-10-05T15:29:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.383+0000 7fe906ffd700 1 -- 172.21.15.60:0/3042828747 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe908018bb0 con 0x55c4391d3520 2023-10-05T15:29:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.383+0000 7fe906ffd700 1 -- 172.21.15.60:0/3042828747 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080155a0 con 0x55c4391d3520 2023-10-05T15:29:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.384+0000 7fe92f382b80 1 -- 172.21.15.60:0/3042828747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 msgr2=0x55c4391eeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.384+0000 7fe92f382b80 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391eeea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe90800bd10 tx=0x7fe908013000 comp rx=0 tx=0).stop 2023-10-05T15:29:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.393+0000 7fe92f382b80 1 -- 172.21.15.60:0/3042828747 shutdown_connections 2023-10-05T15:29:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.393+0000 7fe92f382b80 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.393+0000 7fe92f382b80 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391d2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.393+0000 7fe92f382b80 1 --2- 172.21.15.60:0/3042828747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391eeea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.393+0000 7fe92f382b80 1 -- 172.21.15.60:0/3042828747 >> 172.21.15.60:0/3042828747 conn(0x55c439148200 msgr2=0x55c4391cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.394+0000 7fe92f382b80 1 -- 172.21.15.60:0/3042828747 shutdown_connections 2023-10-05T15:29:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.396+0000 7fe92f382b80 1 -- 172.21.15.60:0/3042828747 wait complete. 2023-10-05T15:29:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.396+0000 7fe92f382b80 1 -- start start 2023-10-05T15:29:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.396+0000 7fe92f382b80 1 Processor -- start 2023-10-05T15:29:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 0x55c4391e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d3520 0x55c4391e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391dda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c439126dd0 con 0x55c4391d3520 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4390c36b0 con 0x55c4391d2c00 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4390c3350 con 0x55c4391ef3e0 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.397+0000 7fe92f382b80 10 client.0 _ll_register_callbacks cb 0x55c438f207a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 0x55c4391e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 0x55c4391e26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55508/0 (socket says 172.21.15.60:55508) 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 -- 172.21.15.60:0/1490311528 learned_addr learned my addr 172.21.15.60:0/1490311528 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 -- 172.21.15.60:0/1490311528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 msgr2=0x55c4391dda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 -- 172.21.15.60:0/1490311528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d3520 msgr2=0x55c4391e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d3520 0x55c4391e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 -- 172.21.15.60:0/1490311528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90800ba50 con 0x55c4391d2c00 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe920f34700 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 0x55c4391e26e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe91000bbe0 tx=0x7fe910099420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d2ab62049c82b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.398+0000 7fe8fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.399+0000 7fe8fbfff700 1 -- 172.21.15.60:0/1490311528 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910099f20 con 0x55c4391d2c00 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.399+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4391c6d50 con 0x55c4391d2c00 2023-10-05T15:29:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.399+0000 7fe8fbfff700 1 -- 172.21.15.60:0/1490311528 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fe91009dc10 con 0x55c4391d2c00 2023-10-05T15:29:24.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe8fbfff700 1 -- 172.21.15.60:0/1490311528 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9100a1e50 con 0x55c4391d2c00 2023-10-05T15:29:24.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 10 client.26681 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:24.419 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55c438f3ac00 con 0x55c4391d2c00 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe8fbfff700 1 -- 172.21.15.60:0/1490311528 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c4391c6d50 con 0x55c4391d2c00 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe8fbfff700 1 -- 172.21.15.60:0/1490311528 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fe9100a19c0 con 0x55c4391d2c00 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 10 client.26681 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 10 client.26681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 20 client.26681 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c4391edd00 0x55c4391ee110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 4 client.26681 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:29:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.417+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c43911fdb0 con 0x55c4391edd00 2023-10-05T15:29:24.429 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.427+0000 7fe91bfff700 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c4391edd00 0x55c4391ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.432 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.430+0000 7fe91bfff700 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c4391edd00 0x55c4391ee110 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664b325f0c84dda2 server_cookie=3432b60109cbd821 in_seq=0 out_seq=0 2023-10-05T15:29:24.432 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.430+0000 7fe8fbfff700 10 client.26681 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:24.433 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.431+0000 7fe8fbfff700 1 -- 172.21.15.60:0/1490311528 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c43911fdb0 con 0x55c4391edd00 2023-10-05T15:29:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.431+0000 7fe8fbfff700 10 client.26681 handle_command_reply: tid=0 2023-10-05T15:29:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.431+0000 7fe92f382b80 1 client.26681 shutdown 2023-10-05T15:29:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.436+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 msgr2=0x55c4391e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.436+0000 7fe92f382b80 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 0x55c4391e26e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe91000bbe0 tx=0x7fe910099420 comp rx=0 tx=0).stop 2023-10-05T15:29:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 shutdown_connections 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe92f382b80 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c4391edd00 0x55c4391ee110 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe92f382b80 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe92f382b80 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d2c00 0x55c4391e26e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe92f382b80 1 --2- 172.21.15.60:0/1490311528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d3520 0x55c4391e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 >> 172.21.15.60:0/1490311528 conn(0x55c439148200 msgr2=0x55c4391cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.442+0000 7fe8fbfff700 0 client.26681 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.443+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 shutdown_connections 2023-10-05T15:29:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.443+0000 7fe92f382b80 1 -- 172.21.15.60:0/1490311528 wait complete. 2023-10-05T15:29:24.446 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.445+0000 7fe92f382b80 20 client.26681 trim_cache size 0 max 16384 2023-10-05T15:29:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.473+0000 7fe92f382b80 1 Processor -- start 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.477+0000 7fe92f382b80 1 -- start start 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391dd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe92f382b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c438fa78c0 con 0x55c4391d2c00 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe92f382b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4391cfdf0 con 0x55c4391d3520 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe92f382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4391d5d50 con 0x55c4391ef3e0 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42090/0 (socket says 172.21.15.60:42090) 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 -- 172.21.15.60:0/2042970886 learned_addr learned my addr 172.21.15.60:0/2042970886 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe921735700 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391e22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 -- 172.21.15.60:0/2042970886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 msgr2=0x55c4391e22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391e22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 -- 172.21.15.60:0/2042970886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 msgr2=0x55c4391dd720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391dd720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 -- 172.21.15.60:0/2042970886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4391cda80 con 0x55c4391d2c00 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.478+0000 7fe920f34700 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391dd1e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe9100997c0 tx=0x7fe910098070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fac823b6e8279d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.484+0000 7fe9077fe700 1 -- 172.21.15.60:0/2042970886 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910010870 con 0x55c4391d2c00 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.484+0000 7fe9077fe700 1 -- 172.21.15.60:0/2042970886 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91009dc10 con 0x55c4391d2c00 2023-10-05T15:29:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.484+0000 7fe9077fe700 1 -- 172.21.15.60:0/2042970886 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100b2200 con 0x55c4391d2c00 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.485+0000 7fe92f382b80 1 -- 172.21.15.60:0/2042970886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 msgr2=0x55c4391dd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.485+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391dd1e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe9100997c0 tx=0x7fe910098070 comp rx=0 tx=0).stop 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.486+0000 7fe92f382b80 1 -- 172.21.15.60:0/2042970886 shutdown_connections 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.486+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391ef3e0 0x55c4391e22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.486+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391d2c00 0x55c4391dd1e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.486+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2042970886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391dd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.486+0000 7fe92f382b80 1 -- 172.21.15.60:0/2042970886 >> 172.21.15.60:0/2042970886 conn(0x55c439148200 msgr2=0x55c4391d54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.497+0000 7fe92f382b80 1 -- 172.21.15.60:0/2042970886 shutdown_connections 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.498+0000 7fe92f382b80 1 -- 172.21.15.60:0/2042970886 wait complete. 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.498+0000 7fe92f382b80 1 -- start start 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 Processor -- start 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391d2c00 0x55c4391f5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391ef3e0 0x55c4391f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4391f1700 con 0x55c4391ef3e0 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4391f1870 con 0x55c4391d3520 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c439241890 con 0x55c4391d2c00 2023-10-05T15:29:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe92f382b80 10 client.0 _ll_register_callbacks cb 0x7fe910095ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe921735700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391ef3e0 0x55c4391f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.499+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391f0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55516/0 (socket says 172.21.15.60:55516) 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe91bfff700 1 -- 172.21.15.60:0/2831115823 learned_addr learned my addr 172.21.15.60:0/2831115823 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe920f34700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391d2c00 0x55c4391f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe921735700 1 -- 172.21.15.60:0/2831115823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391d2c00 msgr2=0x55c4391f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe921735700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391d2c00 0x55c4391f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe921735700 1 -- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 msgr2=0x55c4391f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe921735700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe921735700 1 -- 172.21.15.60:0/2831115823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c438f3ac00 con 0x55c4391ef3e0 2023-10-05T15:29:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe920f34700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391d2c00 0x55c4391f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:29:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.500+0000 7fe921735700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391ef3e0 0x55c4391f0ff0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe9140060b0 tx=0x7fe91400a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81de8d4c6cdbabe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.501+0000 7fe8fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:29:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.501+0000 7fe8fbfff700 1 -- 172.21.15.60:0/2831115823 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914016210 con 0x55c4391ef3e0 2023-10-05T15:29:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.501+0000 7fe8fbfff700 1 -- 172.21.15.60:0/2831115823 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fe914016370 con 0x55c4391ef3e0 2023-10-05T15:29:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.501+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe908018bb0 con 0x55c4391ef3e0 2023-10-05T15:29:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.501+0000 7fe8fbfff700 1 -- 172.21.15.60:0/2831115823 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe914016530 con 0x55c4391ef3e0 2023-10-05T15:29:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 10 client.17025 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55c438f781f0 con 0x55c4391ef3e0 2023-10-05T15:29:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe8fbfff700 1 -- 172.21.15.60:0/2831115823 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe908018bb0 con 0x55c4391ef3e0 2023-10-05T15:29:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe8fbfff700 1 -- 172.21.15.60:0/2831115823 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fe914008b90 con 0x55c4391ef3e0 2023-10-05T15:29:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 10 client.17025 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 20 client.17025 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c439242f60 0x55c439245380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 4 client.17025 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:29:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.507+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c43911fad0 con 0x55c439242f60 2023-10-05T15:29:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.514+0000 7fe920f34700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c439242f60 0x55c439245380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.532+0000 7fe920f34700 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c439242f60 0x55c439245380 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a04459414d82b4d server_cookie=d4248f2a07d74a3c in_seq=0 out_seq=0 2023-10-05T15:29:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.532+0000 7fe8fbfff700 10 client.17025 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.628+0000 7fe8fbfff700 1 -- 172.21.15.60:0/2831115823 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c43911fad0 con 0x55c439242f60 2023-10-05T15:29:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.628+0000 7fe8fbfff700 10 client.17025 handle_command_reply: tid=0 2023-10-05T15:29:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.628+0000 7fe92f382b80 1 client.17025 shutdown 2023-10-05T15:29:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391ef3e0 msgr2=0x55c4391f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391ef3e0 0x55c4391f0ff0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe9140060b0 tx=0x7fe91400a670 comp rx=0 tx=0).stop 2023-10-05T15:29:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 shutdown_connections 2023-10-05T15:29:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55c439242f60 0x55c439245380 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4391ef3e0 0x55c4391f0ff0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4391d2c00 0x55c4391f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 --2- 172.21.15.60:0/2831115823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c4391d3520 0x55c4391f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.634+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 >> 172.21.15.60:0/2831115823 conn(0x55c439148200 msgr2=0x55c4391e9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.636+0000 7fe8fbfff700 0 client.17025 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.636+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 shutdown_connections 2023-10-05T15:29:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.636+0000 7fe92f382b80 1 -- 172.21.15.60:0/2831115823 wait complete. 2023-10-05T15:29:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.640+0000 7fe92f382b80 20 client.17025 trim_cache size 0 max 16384 2023-10-05T15:29:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:29:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:29:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:29:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.650+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe90c0a16f0 msgr2=0x7fe90c0a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.650+0000 7fe923198700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe90c0a16f0 0x7fe90c0a3bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe91c1a7540 tx=0x7fe90800f040 comp rx=0 tx=0).stop 2023-10-05T15:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.650+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 msgr2=0x7fe91c1a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.650+0000 7fe923198700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 0x7fe91c1a5d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe910006fd0 tx=0x7fe91000b7e0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 shutdown_connections 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fe90c0a16f0 0x7fe90c0a3bb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe91c1aa8d0 0x7fe91c1aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ff950 0x7fe91c1a5d20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 --2- 172.21.15.60:0/2300480781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c1048a0 0x7fe91c1a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 >> 172.21.15.60:0/2300480781 conn(0x7fe91c0762e0 msgr2=0x7fe91c0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 shutdown_connections 2023-10-05T15:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:24.651+0000 7fe923198700 1 -- 172.21.15.60:0/2300480781 wait complete. 2023-10-05T15:29:25.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:25 smithi092 ceph-mon[102944]: pgmap v399: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-10-05T15:29:25.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:25 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:25.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:25 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:25.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:25 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:25.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:25 smithi135 ceph-mon[103360]: pgmap v399: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-10-05T15:29:25.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:25 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:25.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:25 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:25.844 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:25 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:25 smithi060 ceph-mon[99238]: pgmap v399: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-10-05T15:29:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:25 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:25 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:25.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:25 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:27.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:27 smithi135 ceph-mon[103360]: pgmap v400: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 734 KiB/s wr, 100 op/s 2023-10-05T15:29:27.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:27 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:27.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:27 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:27.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:27 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:27.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:27 smithi060 ceph-mon[99238]: pgmap v400: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 734 KiB/s wr, 100 op/s 2023-10-05T15:29:27.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:27 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:27.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:27 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:27.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:27 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:27.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:27 smithi092 ceph-mon[102944]: pgmap v400: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 734 KiB/s wr, 100 op/s 2023-10-05T15:29:27.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:27 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:27.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:27 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:27.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:27 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:29:29.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:29 smithi135 ceph-mon[103360]: pgmap v401: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 849 KiB/s wr, 107 op/s 2023-10-05T15:29:29.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:29 smithi060 ceph-mon[99238]: pgmap v401: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 849 KiB/s wr, 107 op/s 2023-10-05T15:29:29.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:29 smithi092 ceph-mon[102944]: pgmap v401: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 849 KiB/s wr, 107 op/s 2023-10-05T15:29:31.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:31 smithi135 ceph-mon[103360]: pgmap v402: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 862 KiB/s wr, 96 op/s 2023-10-05T15:29:31.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:31 smithi060 ceph-mon[99238]: pgmap v402: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 862 KiB/s wr, 96 op/s 2023-10-05T15:29:32.136 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:31 smithi092 ceph-mon[102944]: pgmap v402: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 862 KiB/s wr, 96 op/s 2023-10-05T15:29:33.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:32 smithi135 ceph-mon[103360]: pgmap v403: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 683 KiB/s wr, 106 op/s 2023-10-05T15:29:33.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:32 smithi060 ceph-mon[99238]: pgmap v403: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 683 KiB/s wr, 106 op/s 2023-10-05T15:29:33.284 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:32 smithi092 ceph-mon[102944]: pgmap v403: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 683 KiB/s wr, 106 op/s 2023-10-05T15:29:35.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:35 smithi060 ceph-mon[99238]: pgmap v404: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 814 KiB/s wr, 120 op/s 2023-10-05T15:29:35.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:35 smithi092 ceph-mon[102944]: pgmap v404: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 814 KiB/s wr, 120 op/s 2023-10-05T15:29:35.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:35 smithi135 ceph-mon[103360]: pgmap v404: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 814 KiB/s wr, 120 op/s 2023-10-05T15:29:37.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:37 smithi135 ceph-mon[103360]: pgmap v405: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 992 KiB/s wr, 121 op/s 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 -- 172.21.15.60:0/771262813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c104b60 msgr2=0x7fb79c104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 --2- 172.21.15.60:0/771262813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c104b60 0x7fb79c104f40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb78c01a9a0 tx=0x7fb78c01acb0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 -- 172.21.15.60:0/771262813 shutdown_connections 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 --2- 172.21.15.60:0/771262813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 0x7fb79c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 --2- 172.21.15.60:0/771262813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c104b60 0x7fb79c104f40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 --2- 172.21.15.60:0/771262813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79c105480 0x7fb79c0ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.846+0000 7fb7a2546700 1 -- 172.21.15.60:0/771262813 >> 172.21.15.60:0/771262813 conn(0x7fb79c0762e0 msgr2=0x7fb79c0766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.858+0000 7fb7a2546700 1 -- 172.21.15.60:0/771262813 shutdown_connections 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.858+0000 7fb7a2546700 1 -- 172.21.15.60:0/771262813 wait complete. 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.859+0000 7fb7a2546700 1 Processor -- start 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.859+0000 7fb7a2546700 1 -- start start 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.859+0000 7fb7a2546700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 0x7fb79c10c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a2546700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79c104b60 0x7fb79c10ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a2546700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c071380 0x7fb79c071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a2546700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c071e60 con 0x7fb79c0ffc20 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a2546700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c071fd0 con 0x7fb79c071380 2023-10-05T15:29:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a2546700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c072190 con 0x7fb79c104b60 2023-10-05T15:29:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c071380 0x7fb79c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c071380 0x7fb79c071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55530/0 (socket says 172.21.15.60:55530) 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/1723789462 learned_addr learned my addr 172.21.15.60:0/1723789462 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 0x7fb79c10c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb79bfff700 1 -- 172.21.15.60:0/1723789462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79c104b60 msgr2=0x7fb79c10ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79c104b60 0x7fb79c10ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb79bfff700 1 -- 172.21.15.60:0/1723789462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c071380 msgr2=0x7fb79c071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.860+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c071380 0x7fb79c071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb79bfff700 1 -- 172.21.15.60:0/1723789462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c01a600 con 0x7fb79c0ffc20 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 0x7fb79c10c970 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb78c000c00 tx=0x7fb78c003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb7997fa700 1 -- 172.21.15.60:0/1723789462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0054d0 con 0x7fb79c0ffc20 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb7997fa700 1 -- 172.21.15.60:0/1723789462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb78c005630 con 0x7fb79c0ffc20 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb7997fa700 1 -- 172.21.15.60:0/1723789462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c01f770 con 0x7fb79c0ffc20 2023-10-05T15:29:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c114950 con 0x7fb79c0ffc20 2023-10-05T15:29:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.861+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c114db0 con 0x7fb79c0ffc20 2023-10-05T15:29:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.866+0000 7fb7ae730b80 1 Processor -- start 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 -- start start 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae79fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae7a520 0x55b0aae84e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae853d0 0x55b0aae877c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aade3400 con 0x55b0aae79c00 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aadd4bc0 con 0x55b0aae7a520 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.868+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aadd24e0 con 0x55b0aae853d0 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.869+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae79fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.869+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae79fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42112/0 (socket says 172.21.15.60:42112) 2023-10-05T15:29:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.869+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/1828035681 learned_addr learned my addr 172.21.15.60:0/1828035681 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.869+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae7a520 0x55b0aae84e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/1828035681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae853d0 msgr2=0x55b0aae877c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae853d0 0x55b0aae877c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/1828035681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae7a520 msgr2=0x55b0aae84e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae7a520 0x55b0aae84e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/1828035681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0aabf8d80 con 0x55b0aae79c00 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae79fe0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb790009e20 tx=0x7fb790033730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e521b7847cab96f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.870+0000 7fb7997fa700 1 -- 172.21.15.60:0/1723789462 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb78c00da20 con 0x7fb79c0ffc20 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.871+0000 7fb7997fa700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb7840a17c0 0x7fb7840a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.871+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb7840a17c0 0x7fb7840a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.871+0000 7fb7997fa700 1 -- 172.21.15.60:0/1723789462 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fb78c0ce5c0 con 0x7fb79c0ffc20 2023-10-05T15:29:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.872+0000 7fb7827fc700 1 -- 172.21.15.60:0/1828035681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79003b630 con 0x55b0aae79c00 2023-10-05T15:29:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.872+0000 7fb7827fc700 1 -- 172.21.15.60:0/1828035681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb79003bc50 con 0x55b0aae79c00 2023-10-05T15:29:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.872+0000 7fb7827fc700 1 -- 172.21.15.60:0/1828035681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790031cc0 con 0x55b0aae79c00 2023-10-05T15:29:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.873+0000 7fb7ae730b80 1 -- 172.21.15.60:0/1828035681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 msgr2=0x55b0aae79fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.873+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae79fe0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb790009e20 tx=0x7fb790033730 comp rx=0 tx=0).stop 2023-10-05T15:29:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.873+0000 7fb79bfff700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb7840a17c0 0x7fb7840a3c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb78c01a9a0 tx=0x7fb78c01acb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.876+0000 7fb7ae730b80 1 -- 172.21.15.60:0/1828035681 shutdown_connections 2023-10-05T15:29:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.876+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae853d0 0x55b0aae877c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.876+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae79fe0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.876+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/1828035681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae7a520 0x55b0aae84e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.876+0000 7fb7ae730b80 1 -- 172.21.15.60:0/1828035681 >> 172.21.15.60:0/1828035681 conn(0x55b0aadef200 msgr2=0x55b0aae76080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.887+0000 7fb7ae730b80 1 -- 172.21.15.60:0/1828035681 shutdown_connections 2023-10-05T15:29:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.895+0000 7fb7ae730b80 1 -- 172.21.15.60:0/1828035681 wait complete. 2023-10-05T15:29:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 -- start start 2023-10-05T15:29:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 Processor -- start 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae82180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae82c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aadcddd0 con 0x55b0aae79c00 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aad6a6b0 con 0x55b0aae853d0 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.896+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aad6a350 con 0x55b0aae7a520 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.897+0000 7fb7ae730b80 10 client.0 _ll_register_callbacks cb 0x55b0aabc77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.903+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae82c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.903+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae82180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.903+0000 7fb7a0ae3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae82180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42118/0 (socket says 172.21.15.60:42118) 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.903+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/413154489 learned_addr learned my addr 172.21.15.60:0/413154489 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/413154489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 msgr2=0x55b0aae826c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae826c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 msgr2=0x55b0aae82c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae82c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb7a0ae3700 1 -- 172.21.15.60:0/413154489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb790009b00 con 0x55b0aae79c00 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae82180 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb790009230 tx=0x7fb790031800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ba4526773b0ba5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb77fff7700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:29:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb77fff7700 1 -- 172.21.15.60:0/413154489 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790005460 con 0x55b0aae79c00 2023-10-05T15:29:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.904+0000 7fb77fff7700 1 -- 172.21.15.60:0/413154489 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fb7900055c0 con 0x55b0aae79c00 2023-10-05T15:29:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.905+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0aae6dd50 con 0x55b0aae79c00 2023-10-05T15:29:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.905+0000 7fb77fff7700 1 -- 172.21.15.60:0/413154489 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb79003b430 con 0x55b0aae79c00 2023-10-05T15:29:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.905+0000 7fb7ae730b80 10 client.17037 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.905+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b0aabe1c00 con 0x55b0aae79c00 2023-10-05T15:29:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb77fff7700 1 -- 172.21.15.60:0/413154489 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0aae6dd50 con 0x55b0aae79c00 2023-10-05T15:29:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb77fff7700 1 -- 172.21.15.60:0/413154489 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fb790052070 con 0x55b0aae79c00 2023-10-05T15:29:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb7ae730b80 10 client.17037 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb7ae730b80 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb7ae730b80 20 client.17037 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aae94f90 0x55b0aae973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb7ae730b80 4 client.17037 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:29:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.910+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0aadc6db0 con 0x55b0aae94f90 2023-10-05T15:29:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.911+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aae94f90 0x55b0aae973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.911+0000 7fb77fff7700 10 client.17037 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.911+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aae94f90 0x55b0aae973b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7bff5cb9873770 server_cookie=31f02110d055f870 in_seq=0 out_seq=0 2023-10-05T15:29:37.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:37 smithi060 ceph-mon[99238]: pgmap v405: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 992 KiB/s wr, 121 op/s 2023-10-05T15:29:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb77fff7700 1 -- 172.21.15.60:0/413154489 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0aadc6db0 con 0x55b0aae94f90 2023-10-05T15:29:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb77fff7700 10 client.17037 handle_command_reply: tid=0 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 client.17037 shutdown 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 msgr2=0x55b0aae82180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae82180 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb790009230 tx=0x7fb790031800 comp rx=0 tx=0).stop 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 shutdown_connections 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aae94f90 0x55b0aae973b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae82c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb77fff7700 0 client.17037 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae82180 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/413154489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae826c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 >> 172.21.15.60:0/413154489 conn(0x55b0aadef200 msgr2=0x55b0aae75c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 shutdown_connections 2023-10-05T15:29:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 1 -- 172.21.15.60:0/413154489 wait complete. 2023-10-05T15:29:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.913+0000 7fb7ae730b80 20 client.17037 trim_cache size 0 max 16384 2023-10-05T15:29:37.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:37 smithi092 ceph-mon[102944]: pgmap v405: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 992 KiB/s wr, 121 op/s 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 Processor -- start 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 -- start start 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae7d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aac4e8c0 con 0x55b0aae79c00 2023-10-05T15:29:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aae83760 con 0x55b0aae853d0 2023-10-05T15:29:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.937+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aae72860 con 0x55b0aae7a520 2023-10-05T15:29:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae816f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55656/0 (socket says 172.21.15.60:55656) 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2097493273 learned_addr learned my addr 172.21.15.60:0/2097493273 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2097493273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 msgr2=0x55b0aae7d430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae7d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2097493273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 msgr2=0x55b0aae7caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae7caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.939+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2097493273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0aac1f1f0 con 0x55b0aae7a520 2023-10-05T15:29:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.941+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae816f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0776f0 tx=0x7fb794009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21b634ddfbf16f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.947+0000 7fb782ffd700 1 -- 172.21.15.60:0/2097493273 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400dd70 con 0x55b0aae7a520 2023-10-05T15:29:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.947+0000 7fb782ffd700 1 -- 172.21.15.60:0/2097493273 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb794014050 con 0x55b0aae7a520 2023-10-05T15:29:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.947+0000 7fb782ffd700 1 -- 172.21.15.60:0/2097493273 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400c650 con 0x55b0aae7a520 2023-10-05T15:29:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.948+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2097493273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 msgr2=0x55b0aae816f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.948+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae816f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0776f0 tx=0x7fb794009230 comp rx=0 tx=0).stop 2023-10-05T15:29:37.961 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.960+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2097493273 shutdown_connections 2023-10-05T15:29:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.960+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae7d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.960+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae79c00 0x55b0aae7caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.960+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2097493273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae7a520 0x55b0aae816f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.960+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2097493273 >> 172.21.15.60:0/2097493273 conn(0x55b0aadef200 msgr2=0x55b0aae90670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.963+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2097493273 shutdown_connections 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2097493273 wait complete. 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 -- start start 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 Processor -- start 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae79c00 0x55b0aae8bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 0x55b0aae89f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae8a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aae8a9f0 con 0x55b0aae7a520 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aae8ab60 con 0x55b0aae853d0 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.966+0000 7fb7ae730b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0aae8ad20 con 0x55b0aae79c00 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.967+0000 7fb7ae730b80 10 client.0 _ll_register_callbacks cb 0x7fb79003e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.971+0000 7fb79b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 0x55b0aae89f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.971+0000 7fb79b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 0x55b0aae89f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42128/0 (socket says 172.21.15.60:42128) 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.971+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2336628740 learned_addr learned my addr 172.21.15.60:0/2336628740 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2336628740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae79c00 msgr2=0x55b0aae8bc40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae79c00 0x55b0aae8bc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 msgr2=0x55b0aae8a4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae8a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb79b7fe700 1 -- 172.21.15.60:0/2336628740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79400aac0 con 0x55b0aae7a520 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb79b7fe700 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 0x55b0aae89f70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb79401d000 tx=0x7fb794016230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16e604c853262ed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.972+0000 7fb77fff7700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.973+0000 7fb77fff7700 1 -- 172.21.15.60:0/2336628740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794022040 con 0x55b0aae7a520 2023-10-05T15:29:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.973+0000 7fb77fff7700 1 -- 172.21.15.60:0/2336628740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fb794016a20 con 0x55b0aae7a520 2023-10-05T15:29:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.980+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb79003bc50 con 0x55b0aae7a520 2023-10-05T15:29:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.982+0000 7fb77fff7700 1 -- 172.21.15.60:0/2336628740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb794016be0 con 0x55b0aae7a520 2023-10-05T15:29:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.986+0000 7fb7ae730b80 10 client.17040 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.986+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b0aabf7250 con 0x55b0aae7a520 2023-10-05T15:29:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.989+0000 7fb77fff7700 1 -- 172.21.15.60:0/2336628740 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb79003bc50 con 0x55b0aae7a520 2023-10-05T15:29:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.989+0000 7fb77fff7700 1 -- 172.21.15.60:0/2336628740 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fb79402e050 con 0x55b0aae7a520 2023-10-05T15:29:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.997+0000 7fb7ae730b80 10 client.17040 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.997+0000 7fb7ae730b80 10 client.17040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.997+0000 7fb7ae730b80 20 client.17040 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.997+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aaeea0f0 0x55b0aaeec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.997+0000 7fb7ae730b80 4 client.17040 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:29:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:37.997+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b0aadc6ad0 con 0x55b0aaeea0f0 2023-10-05T15:29:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.001+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aaeea0f0 0x55b0aaeec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.002+0000 7fb7a0ae3700 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aaeea0f0 0x55b0aaeec510 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ba98e49c2d46403 server_cookie=28a74fd75e3907cb in_seq=0 out_seq=0 2023-10-05T15:29:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.002+0000 7fb77fff7700 10 client.17040 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.080+0000 7fb77fff7700 1 -- 172.21.15.60:0/2336628740 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b0aadc6ad0 con 0x55b0aaeea0f0 2023-10-05T15:29:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.080+0000 7fb77fff7700 10 client.17040 handle_command_reply: tid=0 2023-10-05T15:29:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.080+0000 7fb7ae730b80 1 client.17040 shutdown 2023-10-05T15:29:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.087+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 msgr2=0x55b0aae89f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.087+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 0x55b0aae89f70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb79401d000 tx=0x7fb794016230 comp rx=0 tx=0).stop 2023-10-05T15:29:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:29:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:29:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:29:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:29:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.092+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 shutdown_connections 2023-10-05T15:29:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.092+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55b0aaeea0f0 0x55b0aaeec510 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.092+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0aae853d0 0x55b0aae8a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.092+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0aae79c00 0x55b0aae8bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.092+0000 7fb7ae730b80 1 --2- 172.21.15.60:0/2336628740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0aae7a520 0x55b0aae89f70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.092+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 >> 172.21.15.60:0/2336628740 conn(0x55b0aadef200 msgr2=0x55b0aae75250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.093+0000 7fb77fff7700 0 client.17040 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 shutdown_connections 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7ae730b80 1 -- 172.21.15.60:0/2336628740 wait complete. 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7ae730b80 20 client.17040 trim_cache size 0 max 16384 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb7840a17c0 msgr2=0x7fb7840a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7a2546700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb7840a17c0 0x7fb7840a3c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb78c01a9a0 tx=0x7fb78c01acb0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 msgr2=0x7fb79c10c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.095+0000 7fb7a2546700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 0x7fb79c10c970 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb78c000c00 tx=0x7fb78c003e70 comp rx=0 tx=0).stop 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 shutdown_connections 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb7840a17c0 0x7fb7840a3c80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb79c071380 0x7fb79c071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79c0ffc20 0x7fb79c10c970 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 --2- 172.21.15.60:0/1723789462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79c104b60 0x7fb79c10ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 >> 172.21.15.60:0/1723789462 conn(0x7fb79c0762e0 msgr2=0x7fb79c101700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.096+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 shutdown_connections 2023-10-05T15:29:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:38.101+0000 7fb7a2546700 1 -- 172.21.15.60:0/1723789462 wait complete. 2023-10-05T15:29:39.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:39 smithi135 ceph-mon[103360]: pgmap v406: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 990 KiB/s wr, 132 op/s 2023-10-05T15:29:39.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:39 smithi060 ceph-mon[99238]: pgmap v406: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 990 KiB/s wr, 132 op/s 2023-10-05T15:29:39.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:39 smithi092 ceph-mon[102944]: pgmap v406: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 990 KiB/s wr, 132 op/s 2023-10-05T15:29:41.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:41 smithi135 ceph-mon[103360]: pgmap v407: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 939 KiB/s wr, 110 op/s 2023-10-05T15:29:41.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:41 smithi060 ceph-mon[99238]: pgmap v407: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 939 KiB/s wr, 110 op/s 2023-10-05T15:29:41.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:41 smithi092 ceph-mon[102944]: pgmap v407: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 939 KiB/s wr, 110 op/s 2023-10-05T15:29:43.087 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:42 smithi135 ceph-mon[103360]: pgmap v408: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 925 KiB/s wr, 115 op/s 2023-10-05T15:29:43.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:42 smithi060 ceph-mon[99238]: pgmap v408: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 925 KiB/s wr, 115 op/s 2023-10-05T15:29:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:42 smithi092 ceph-mon[102944]: pgmap v408: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 925 KiB/s wr, 115 op/s 2023-10-05T15:29:45.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:45 smithi135 ceph-mon[103360]: pgmap v409: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-05T15:29:45.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:45 smithi060 ceph-mon[99238]: pgmap v409: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-05T15:29:45.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:45 smithi092 ceph-mon[102944]: pgmap v409: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-10-05T15:29:47.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:47 smithi135 ceph-mon[103360]: pgmap v410: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 110 op/s 2023-10-05T15:29:47.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:47 smithi060 ceph-mon[99238]: pgmap v410: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 110 op/s 2023-10-05T15:29:47.931 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:47 smithi092 ceph-mon[102944]: pgmap v410: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 110 op/s 2023-10-05T15:29:49.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:49 smithi135 ceph-mon[103360]: pgmap v411: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.1 MiB/s wr, 116 op/s 2023-10-05T15:29:49.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:49 smithi060 ceph-mon[99238]: pgmap v411: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.1 MiB/s wr, 116 op/s 2023-10-05T15:29:49.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:49 smithi092 ceph-mon[102944]: pgmap v411: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.1 MiB/s wr, 116 op/s 2023-10-05T15:29:50.670 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:29:50 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:29:50.266+0000 7f27d023a700 -1 calc_pg_upmaps abort due to max <= 0 2023-10-05T15:29:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.463+0000 7fd464de8700 1 -- 172.21.15.60:0/1581737809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4600ffef0 msgr2=0x7fd4601002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.463+0000 7fd464de8700 1 --2- 172.21.15.60:0/1581737809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4600ffef0 0x7fd4601002d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098f0 tx=0x7fd450009c00 comp rx=0 tx=0).stop 2023-10-05T15:29:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.466+0000 7fd464de8700 1 -- 172.21.15.60:0/1581737809 shutdown_connections 2023-10-05T15:29:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.466+0000 7fd464de8700 1 --2- 172.21.15.60:0/1581737809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4601052f0 0x7fd4601057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.466+0000 7fd464de8700 1 --2- 172.21.15.60:0/1581737809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4600ffef0 0x7fd4601002d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.466+0000 7fd464de8700 1 --2- 172.21.15.60:0/1581737809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd460100810 0x7fd460104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.466+0000 7fd464de8700 1 -- 172.21.15.60:0/1581737809 >> 172.21.15.60:0/1581737809 conn(0x7fd460076eb0 msgr2=0x7fd4600772c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.478+0000 7fd464de8700 1 -- 172.21.15.60:0/1581737809 shutdown_connections 2023-10-05T15:29:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.478+0000 7fd464de8700 1 -- 172.21.15.60:0/1581737809 wait complete. 2023-10-05T15:29:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 Processor -- start 2023-10-05T15:29:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 -- start start 2023-10-05T15:29:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4600ffef0 0x7fd460071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 0x7fd4600719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4601052f0 0x7fd4601144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46010d300 con 0x7fd4601052f0 2023-10-05T15:29:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46010d470 con 0x7fd460100810 2023-10-05T15:29:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.479+0000 7fd464de8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46010d630 con 0x7fd4600ffef0 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 0x7fd4600719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 0x7fd4600719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55568/0 (socket says 172.21.15.60:55568) 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 -- 172.21.15.60:0/4240510846 learned_addr learned my addr 172.21.15.60:0/4240510846 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45e59c700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4600ffef0 0x7fd460071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 -- 172.21.15.60:0/4240510846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4600ffef0 msgr2=0x7fd460071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4600ffef0 0x7fd460071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 -- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4601052f0 msgr2=0x7fd4601144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4601052f0 0x7fd4601144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 -- 172.21.15.60:0/4240510846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009520 con 0x7fd460100810 2023-10-05T15:29:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.480+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 0x7fd4600719a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b530 tx=0x7fd45400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.481+0000 7fd44f7fe700 1 -- 172.21.15.60:0/4240510846 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454011830 con 0x7fd460100810 2023-10-05T15:29:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.482+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46010d8b0 con 0x7fd460100810 2023-10-05T15:29:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.482+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46010de10 con 0x7fd460100810 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.486+0000 7fd44f7fe700 1 -- 172.21.15.60:0/4240510846 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd454011e50 con 0x7fd460100810 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.487+0000 7fd470fd2b80 1 Processor -- start 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.487+0000 7fd470fd2b80 1 -- start start 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.488+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc0449c00 0x55dcc0449fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.488+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc044a520 0x55dcc0454e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.488+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 0x55dcc04577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.488+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc03b3400 con 0x55dcc0449c00 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.488+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc03a4bc0 con 0x55dcc04553d0 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.488+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc03a24e0 con 0x55dcc044a520 2023-10-05T15:29:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.489+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc044a520 0x55dcc0454e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.489+0000 7fd44f7fe700 1 -- 172.21.15.60:0/4240510846 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400f2e0 con 0x7fd460100810 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.489+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc044a520 0x55dcc0454e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55678/0 (socket says 172.21.15.60:55678) 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.489+0000 7fd45e59c700 1 -- 172.21.15.60:0/3353962524 learned_addr learned my addr 172.21.15.60:0/3353962524 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc0449c00 0x55dcc0449fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 -- 172.21.15.60:0/3353962524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc044a520 msgr2=0x55dcc0454e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc044a520 0x55dcc0454e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 -- 172.21.15.60:0/3353962524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 msgr2=0x55dcc04577c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 0x55dcc04577c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 -- 172.21.15.60:0/3353962524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc01c8d80 con 0x55dcc0449c00 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd45ed9d700 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc0449c00 0x55dcc0449fe0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd45801aba0 tx=0x7fd45801aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09ec640cd5b5426 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.492+0000 7fd44cff9700 1 -- 172.21.15.60:0/3353962524 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458028070 con 0x55dcc0449c00 2023-10-05T15:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.493+0000 7fd44cff9700 1 -- 172.21.15.60:0/3353962524 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd458020040 con 0x55dcc0449c00 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.493+0000 7fd44cff9700 1 -- 172.21.15.60:0/3353962524 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580059c0 con 0x55dcc0449c00 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.494+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3353962524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc0449c00 msgr2=0x55dcc0449fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.494+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc0449c00 0x55dcc0449fe0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd45801aba0 tx=0x7fd45801aeb0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.495+0000 7fd44f7fe700 1 -- 172.21.15.60:0/4240510846 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd454011990 con 0x7fd460100810 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.495+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3353962524 shutdown_connections 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.495+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 0x55dcc04577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.495+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc0449c00 0x55dcc0449fe0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.495+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3353962524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc044a520 0x55dcc0454e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.495+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3353962524 >> 172.21.15.60:0/3353962524 conn(0x55dcc03bf200 msgr2=0x55dcc0446080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.498+0000 7fd44f7fe700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4480c35e0 0x7fd4480c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd45e59c700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4480c35e0 0x7fd4480c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd44f7fe700 1 -- 172.21.15.60:0/4240510846 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fd4540ccdf0 con 0x7fd460100810 2023-10-05T15:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3353962524 shutdown_connections 2023-10-05T15:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3353962524 wait complete. 2023-10-05T15:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd45e59c700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4480c35e0 0x7fd4480c5aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098c0 tx=0x7fd450019040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd470fd2b80 1 -- start start 2023-10-05T15:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.499+0000 7fd470fd2b80 1 Processor -- start 2023-10-05T15:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0454e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0452090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 0x55dcc04527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc039ddd0 con 0x55dcc04553d0 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc033a6b0 con 0x55dcc044a520 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc033a350 con 0x55dcc0449c00 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd470fd2b80 10 client.0 _ll_register_callbacks cb 0x55dcc01977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0452090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0454e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0452090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55580/0 (socket says 172.21.15.60:55580) 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0454e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55686/0 (socket says 172.21.15.60:55686) 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.500+0000 7fd45dd9b700 1 -- 172.21.15.60:0/2765635974 learned_addr learned my addr 172.21.15.60:0/2765635974 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45dd9b700 1 -- 172.21.15.60:0/2765635974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 msgr2=0x55dcc0454e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0454e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45dd9b700 1 -- 172.21.15.60:0/2765635974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 msgr2=0x55dcc04527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 0x55dcc04527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45dd9b700 1 -- 172.21.15.60:0/2765635974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45801a420 con 0x55dcc044a520 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0454e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0452090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4540964e0 tx=0x7fd454099ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d77a6de1f06332 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd445ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd445ffb700 1 -- 172.21.15.60:0/2765635974 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454099ed0 con 0x55dcc044a520 2023-10-05T15:29:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.501+0000 7fd445ffb700 1 -- 172.21.15.60:0/2765635974 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fd454098f60 con 0x55dcc044a520 2023-10-05T15:29:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.505+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcc043dd50 con 0x55dcc044a520 2023-10-05T15:29:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.507+0000 7fd445ffb700 1 -- 172.21.15.60:0/2765635974 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd454099120 con 0x55dcc044a520 2023-10-05T15:29:51.512 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.511+0000 7fd470fd2b80 10 client.26705 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.511+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dcc01b1c00 con 0x55dcc044a520 2023-10-05T15:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd445ffb700 1 -- 172.21.15.60:0/2765635974 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dcc043dd50 con 0x55dcc044a520 2023-10-05T15:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd445ffb700 1 -- 172.21.15.60:0/2765635974 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fd4540989d0 con 0x55dcc044a520 2023-10-05T15:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd470fd2b80 10 client.26705 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd470fd2b80 10 client.26705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd470fd2b80 20 client.26705 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc0465030 0x55dcc0467450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd470fd2b80 4 client.26705 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.515+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcc0396db0 con 0x55dcc0465030 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.516+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc0465030 0x55dcc0467450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.516+0000 7fd445ffb700 10 client.26705 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.516+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc0465030 0x55dcc0467450 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a2e123224b4f3f server_cookie=5f237c2e28cf1921 in_seq=0 out_seq=0 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.517+0000 7fd445ffb700 1 -- 172.21.15.60:0/2765635974 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dcc0396db0 con 0x55dcc0465030 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.517+0000 7fd445ffb700 10 client.26705 handle_command_reply: tid=0 2023-10-05T15:29:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.520+0000 7fd470fd2b80 1 client.26705 shutdown 2023-10-05T15:29:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.532+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 msgr2=0x55dcc0452090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.532+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0452090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4540964e0 tx=0x7fd454099ac0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 shutdown_connections 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc0465030 0x55dcc0467450 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 0x55dcc04527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0454e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2765635974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0452090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 >> 172.21.15.60:0/2765635974 conn(0x55dcc03bf200 msgr2=0x55dcc0445c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd445ffb700 0 client.26705 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.543+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 shutdown_connections 2023-10-05T15:29:51.558 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.557+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2765635974 wait complete. 2023-10-05T15:29:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.576+0000 7fd470fd2b80 20 client.26705 trim_cache size 0 max 16384 2023-10-05T15:29:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 Processor -- start 2023-10-05T15:29:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 -- start start 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc04577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0451850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 0x55dcc04606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc021e8c0 con 0x55dcc04553d0 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc0462590 con 0x55dcc044a520 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc04505f0 con 0x55dcc0449c00 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0451850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0451850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55586/0 (socket says 172.21.15.60:55586) 2023-10-05T15:29:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.604+0000 7fd45dd9b700 1 -- 172.21.15.60:0/3200092921 learned_addr learned my addr 172.21.15.60:0/3200092921 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:51.611 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.605+0000 7fd45dd9b700 1 -- 172.21.15.60:0/3200092921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 msgr2=0x55dcc04577c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.605+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc04577c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.605+0000 7fd45dd9b700 1 -- 172.21.15.60:0/3200092921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 msgr2=0x55dcc04606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.605+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 0x55dcc04606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.605+0000 7fd45dd9b700 1 -- 172.21.15.60:0/3200092921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc01ef1f0 con 0x55dcc044a520 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.605+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0451850 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd45400bc40 tx=0x7fd454098020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e5ed1028c87c58 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.606+0000 7fd44d7fa700 1 -- 172.21.15.60:0/3200092921 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540b90b0 con 0x55dcc044a520 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.606+0000 7fd44d7fa700 1 -- 172.21.15.60:0/3200092921 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4540989d0 con 0x55dcc044a520 2023-10-05T15:29:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.606+0000 7fd44d7fa700 1 -- 172.21.15.60:0/3200092921 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540a1970 con 0x55dcc044a520 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3200092921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 msgr2=0x55dcc0451850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0451850 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd45400bc40 tx=0x7fd454098020 comp rx=0 tx=0).stop 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3200092921 shutdown_connections 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc04553d0 0x55dcc04606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc04577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/3200092921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc044a520 0x55dcc0451850 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.611+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3200092921 >> 172.21.15.60:0/3200092921 conn(0x55dcc03bf200 msgr2=0x55dcc04447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.617+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3200092921 shutdown_connections 2023-10-05T15:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.617+0000 7fd470fd2b80 1 -- 172.21.15.60:0/3200092921 wait complete. 2023-10-05T15:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 -- start start 2023-10-05T15:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 Processor -- start 2023-10-05T15:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0457f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc044a520 0x55dcc0458490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 0x55dcc04589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc04b7e50 con 0x55dcc044a520 2023-10-05T15:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc04b7f90 con 0x55dcc04553d0 2023-10-05T15:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc04b80d0 con 0x55dcc0449c00 2023-10-05T15:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.618+0000 7fd470fd2b80 10 client.0 _ll_register_callbacks cb 0x7fd454099410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:29:51.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.621+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc044a520 0x55dcc0458490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.621+0000 7fd45dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc044a520 0x55dcc0458490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42170/0 (socket says 172.21.15.60:42170) 2023-10-05T15:29:51.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.621+0000 7fd45dd9b700 1 -- 172.21.15.60:0/2346379470 learned_addr learned my addr 172.21.15.60:0/2346379470 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:29:51.623 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.621+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0457f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.624+0000 7fd45e59c700 1 -- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 msgr2=0x55dcc04589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.624+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 0x55dcc04589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.624+0000 7fd45e59c700 1 -- 172.21.15.60:0/2346379470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc044a520 msgr2=0x55dcc0458490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.624+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc044a520 0x55dcc0458490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.624+0000 7fd45e59c700 1 -- 172.21.15.60:0/2346379470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc01b1c00 con 0x55dcc0449c00 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.624+0000 7fd45e59c700 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0457f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd450009810 tx=0x7fd450009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf6f9a00b24be11 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.631+0000 7fd445ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.631+0000 7fd445ffb700 1 -- 172.21.15.60:0/2346379470 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45000ba60 con 0x55dcc0449c00 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.631+0000 7fd445ffb700 1 -- 172.21.15.60:0/2346379470 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7fd45000bbc0 con 0x55dcc0449c00 2023-10-05T15:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.631+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd458020040 con 0x55dcc0449c00 2023-10-05T15:29:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.640+0000 7fd445ffb700 1 -- 172.21.15.60:0/2346379470 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd450035150 con 0x55dcc0449c00 2023-10-05T15:29:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.640+0000 7fd470fd2b80 10 client.26515 fetch_fsmap learned FSMap version 43 2023-10-05T15:29:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.640+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dcc01c7250 con 0x55dcc0449c00 2023-10-05T15:29:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.652+0000 7fd445ffb700 1 -- 172.21.15.60:0/2346379470 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd458020040 con 0x55dcc0449c00 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.652+0000 7fd445ffb700 1 -- 172.21.15.60:0/2346379470 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fd450024cf0 con 0x55dcc0449c00 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.653+0000 7fd470fd2b80 10 client.26515 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.653+0000 7fd470fd2b80 10 client.26515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.653+0000 7fd470fd2b80 20 client.26515 populate_metadata read hostname 'smithi060' 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.653+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc04b9730 0x55dcc04bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.653+0000 7fd470fd2b80 4 client.26515 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.653+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dcc0396ad0 con 0x55dcc04b9730 2023-10-05T15:29:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.656+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc04b9730 0x55dcc04bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.658+0000 7fd45dd9b700 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc04b9730 0x55dcc04bbb50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7b6095b21835c server_cookie=493ffb4a6a1714c5 in_seq=0 out_seq=0 2023-10-05T15:29:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.665+0000 7fd445ffb700 10 client.26515 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.818+0000 7fd445ffb700 1 -- 172.21.15.60:0/2346379470 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dcc0396ad0 con 0x55dcc04b9730 2023-10-05T15:29:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.818+0000 7fd445ffb700 10 client.26515 handle_command_reply: tid=0 2023-10-05T15:29:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.819+0000 7fd470fd2b80 1 client.26515 shutdown 2023-10-05T15:29:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.821+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 msgr2=0x55dcc0457f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.821+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0457f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd450009810 tx=0x7fd450009c00 comp rx=0 tx=0).stop 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 shutdown_connections 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55dcc04b9730 0x55dcc04bbb50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcc04553d0 0x55dcc04589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcc0449c00 0x55dcc0457f50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd470fd2b80 1 --2- 172.21.15.60:0/2346379470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dcc044a520 0x55dcc0458490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 >> 172.21.15.60:0/2346379470 conn(0x55dcc03bf200 msgr2=0x55dcc044d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.823+0000 7fd445ffb700 0 client.26515 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:29:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.825+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 shutdown_connections 2023-10-05T15:29:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.826+0000 7fd470fd2b80 1 -- 172.21.15.60:0/2346379470 wait complete. 2023-10-05T15:29:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.826+0000 7fd470fd2b80 20 client.26515 trim_cache size 0 max 16384 2023-10-05T15:29:51.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:51 smithi135 ceph-mon[103360]: pgmap v412: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-10-05T15:29:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:29:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:29:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:29:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:29:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.834+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4480c35e0 msgr2=0x7fd4480c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.834+0000 7fd464de8700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4480c35e0 0x7fd4480c5aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098c0 tx=0x7fd450019040 comp rx=0 tx=0).stop 2023-10-05T15:29:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.834+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 msgr2=0x7fd4600719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.834+0000 7fd464de8700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 0x7fd4600719a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b530 tx=0x7fd45400b840 comp rx=0 tx=0).stop 2023-10-05T15:29:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.839+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 shutdown_connections 2023-10-05T15:29:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.839+0000 7fd464de8700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4601052f0 0x7fd4601144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.839+0000 7fd464de8700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4600ffef0 0x7fd460071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.839+0000 7fd464de8700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4480c35e0 0x7fd4480c5aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.839+0000 7fd464de8700 1 --2- 172.21.15.60:0/4240510846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd460100810 0x7fd4600719a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.839+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 >> 172.21.15.60:0/4240510846 conn(0x7fd460076eb0 msgr2=0x7fd460102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:51.848 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.846+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 shutdown_connections 2023-10-05T15:29:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:29:51.847+0000 7fd464de8700 1 -- 172.21.15.60:0/4240510846 wait complete. 2023-10-05T15:29:51.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:51 smithi092 ceph-mon[102944]: pgmap v412: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-10-05T15:29:51.929 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:51 smithi060 ceph-mon[99238]: pgmap v412: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-10-05T15:29:52.930 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:52 smithi092 ceph-mon[102944]: pgmap v413: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 108 op/s 2023-10-05T15:29:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:52 smithi135 ceph-mon[103360]: pgmap v413: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 108 op/s 2023-10-05T15:29:53.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:52 smithi060 ceph-mon[99238]: pgmap v413: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 108 op/s 2023-10-05T15:29:55.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:55 smithi135 ceph-mon[103360]: pgmap v414: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2023-10-05T15:29:55.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:55 smithi060 ceph-mon[99238]: pgmap v414: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2023-10-05T15:29:55.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:55 smithi092 ceph-mon[102944]: pgmap v414: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2023-10-05T15:29:57.841 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:57 smithi135 ceph-mon[103360]: pgmap v415: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 952 KiB/s wr, 107 op/s 2023-10-05T15:29:57.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:57 smithi060 ceph-mon[99238]: pgmap v415: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 952 KiB/s wr, 107 op/s 2023-10-05T15:29:57.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:57 smithi092 ceph-mon[102944]: pgmap v415: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 952 KiB/s wr, 107 op/s 2023-10-05T15:29:59.839 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:29:59 smithi135 ceph-mon[103360]: pgmap v416: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 112 op/s 2023-10-05T15:29:59.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:29:59 smithi060 ceph-mon[99238]: pgmap v416: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 112 op/s 2023-10-05T15:29:59.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:29:59 smithi092 ceph-mon[102944]: pgmap v416: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 112 op/s 2023-10-05T15:30:00.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:29:59.999+0000 7fc4d5ab8700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:30:00.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:00 smithi135 ceph-mon[103360]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:30:00.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:00 smithi060 ceph-mon[99238]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:30:00.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:00 smithi092 ceph-mon[102944]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-10-05T15:30:01.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:01 smithi135 ceph-mon[103360]: pgmap v417: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 94 op/s 2023-10-05T15:30:01.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:01 smithi060 ceph-mon[99238]: pgmap v417: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 94 op/s 2023-10-05T15:30:01.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:01 smithi092 ceph-mon[102944]: pgmap v417: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 94 op/s 2023-10-05T15:30:03.088 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:02 smithi135 ceph-mon[103360]: pgmap v418: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 113 op/s 2023-10-05T15:30:03.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:02 smithi060 ceph-mon[99238]: pgmap v418: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 113 op/s 2023-10-05T15:30:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:02 smithi092 ceph-mon[102944]: pgmap v418: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 113 op/s 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 -- 172.21.15.60:0/1742576622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c11a690 msgr2=0x7f214c11ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 --2- 172.21.15.60:0/1742576622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c11a690 0x7f214c11ca80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f214401a9a0 tx=0x7f214401acb0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 -- 172.21.15.60:0/1742576622 shutdown_connections 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 --2- 172.21.15.60:0/1742576622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c11a690 0x7f214c11ca80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 --2- 172.21.15.60:0/1742576622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c10f620 0x7f214c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 --2- 172.21.15.60:0/1742576622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f214c10fa90 0x7f214c1083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.093+0000 7f21513e6700 1 -- 172.21.15.60:0/1742576622 >> 172.21.15.60:0/1742576622 conn(0x7f214c06cfa0 msgr2=0x7f214c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.098+0000 7f21513e6700 1 -- 172.21.15.60:0/1742576622 shutdown_connections 2023-10-05T15:30:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.107+0000 7f21513e6700 1 -- 172.21.15.60:0/1742576622 wait complete. 2023-10-05T15:30:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.107+0000 7f21513e6700 1 Processor -- start 2023-10-05T15:30:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 -- start start 2023-10-05T15:30:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c10f620 0x7f214c115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f214c10fa90 0x7f214c116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c11a690 0x7f214c1a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1a29b0 con 0x7f214c10fa90 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1a2b20 con 0x7f214c11a690 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f21513e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1a2ce0 con 0x7f214c10f620 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c11a690 0x7f214c1a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c11a690 0x7f214c1a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55600/0 (socket says 172.21.15.60:55600) 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.108+0000 7f214b7fe700 1 -- 172.21.15.60:0/2871976172 learned_addr learned my addr 172.21.15.60:0/2871976172 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c10f620 0x7f214c115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 -- 172.21.15.60:0/2871976172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c11a690 msgr2=0x7f214c1a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c11a690 0x7f214c1a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 -- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f214c10fa90 msgr2=0x7f214c116130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f214c10fa90 0x7f214c116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 -- 172.21.15.60:0/2871976172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214401a600 con 0x7f214c10f620 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.110+0000 7f214affd700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c10f620 0x7f214c115bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2134006fd0 tx=0x7f213400b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.111+0000 7f2148ff9700 1 -- 172.21.15.60:0/2871976172 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134011830 con 0x7f214c10f620 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.111+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c1a2fc0 con 0x7f214c10f620 2023-10-05T15:30:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.111+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1cc6c0 con 0x7f214c10f620 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 Processor -- start 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 -- start start 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f27fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f28520 0x55e0f9f32e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f333d0 0x55e0f9f357c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9e91400 con 0x55e0f9f333d0 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9e82bc0 con 0x55e0f9f28520 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.116+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9e804e0 con 0x55e0f9f27c00 2023-10-05T15:30:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.117+0000 7f2148ff9700 1 -- 172.21.15.60:0/2871976172 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2134011e50 con 0x7f214c10f620 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.117+0000 7f2148ff9700 1 -- 172.21.15.60:0/2871976172 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134010e80 con 0x7f214c10f620 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f27fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f28520 0x55e0f9f32e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f27fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55714/0 (socket says 172.21.15.60:55714) 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214b7fe700 1 -- 172.21.15.60:0/3234170320 learned_addr learned my addr 172.21.15.60:0/3234170320 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214affd700 1 -- 172.21.15.60:0/3234170320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 msgr2=0x55e0f9f27fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214affd700 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f27fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214affd700 1 -- 172.21.15.60:0/3234170320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f333d0 msgr2=0x55e0f9f357c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214affd700 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f333d0 0x55e0f9f357c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.118+0000 7f214affd700 1 -- 172.21.15.60:0/3234170320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0f9ca6d80 con 0x55e0f9f28520 2023-10-05T15:30:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.122+0000 7f214affd700 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f28520 0x55e0f9f32e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2134020000 tx=0x7f2134010660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9737577d07c6663 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.124+0000 7f21417fa700 1 -- 172.21.15.60:0/3234170320 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21340106d0 con 0x55e0f9f28520 2023-10-05T15:30:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.126+0000 7f21417fa700 1 -- 172.21.15.60:0/3234170320 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f213401ae00 con 0x55e0f9f28520 2023-10-05T15:30:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.126+0000 7f21417fa700 1 -- 172.21.15.60:0/3234170320 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134024d50 con 0x55e0f9f28520 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3234170320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f28520 msgr2=0x55e0f9f32e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f28520 0x55e0f9f32e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2134020000 tx=0x7f2134010660 comp rx=0 tx=0).stop 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3234170320 shutdown_connections 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f333d0 0x55e0f9f357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f27fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3234170320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f28520 0x55e0f9f32e90 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2134020000 tx=0x7f2134010660 comp rx=0 tx=0).stop 2023-10-05T15:30:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.127+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3234170320 >> 172.21.15.60:0/3234170320 conn(0x55e0f9e9d200 msgr2=0x55e0f9f24080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.128+0000 7f2148ff9700 1 -- 172.21.15.60:0/2871976172 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f213402e3f0 con 0x7f214c10f620 2023-10-05T15:30:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.129+0000 7f2148ff9700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21380c36c0 0x7f21380c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.129+0000 7f2148ff9700 1 -- 172.21.15.60:0/2871976172 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7f21340d0450 con 0x7f214c10f620 2023-10-05T15:30:05.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.135+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3234170320 shutdown_connections 2023-10-05T15:30:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.137+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3234170320 wait complete. 2023-10-05T15:30:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.137+0000 7f215d5d0b80 1 -- start start 2023-10-05T15:30:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.137+0000 7f215d5d0b80 1 Processor -- start 2023-10-05T15:30:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.137+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f333d0 0x55e0f9f306f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9e7bdd0 con 0x55e0f9f27c00 2023-10-05T15:30:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9e186b0 con 0x55e0f9f30c30 2023-10-05T15:30:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9e18350 con 0x55e0f9f333d0 2023-10-05T15:30:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f215d5d0b80 10 client.0 _ll_register_callbacks cb 0x55e0f9c757a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f301b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42190/0 (socket says 172.21.15.60:42190) 2023-10-05T15:30:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 -- 172.21.15.60:0/308339538 learned_addr learned my addr 172.21.15.60:0/308339538 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214b7fe700 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 -- 172.21.15.60:0/308339538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f333d0 msgr2=0x55e0f9f306f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f333d0 0x55e0f9f306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 -- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f30c30 msgr2=0x55e0f9f3efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.138+0000 7f214affd700 1 -- 172.21.15.60:0/308339538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1cc6c0 con 0x55e0f9f27c00 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.139+0000 7f214affd700 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f301b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f21340996c0 tx=0x7f213409cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7241449c6f96ea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.145+0000 7f21327fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.146+0000 7f21427fc700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21380c36c0 0x7f21380c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.146+0000 7f21427fc700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21380c36c0 0x7f21380c5b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55e0f9f1e290 tx=0x7f213c00b250 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.149+0000 7f21327fc700 1 -- 172.21.15.60:0/308339538 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213409d1c0 con 0x55e0f9f27c00 2023-10-05T15:30:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.149+0000 7f21327fc700 1 -- 172.21.15.60:0/308339538 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7f21340a1310 con 0x55e0f9f27c00 2023-10-05T15:30:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.149+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0f9f1bd50 con 0x55e0f9f27c00 2023-10-05T15:30:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.156+0000 7f21327fc700 1 -- 172.21.15.60:0/308339538 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21340a10d0 con 0x55e0f9f27c00 2023-10-05T15:30:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.164+0000 7f215d5d0b80 10 client.17049 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.164+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e0f9c8fc00 con 0x55e0f9f27c00 2023-10-05T15:30:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.164+0000 7f21327fc700 1 -- 172.21.15.60:0/308339538 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e0f9f1bd50 con 0x55e0f9f27c00 2023-10-05T15:30:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.165+0000 7f21327fc700 1 -- 172.21.15.60:0/308339538 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f21340d0120 con 0x55e0f9f27c00 2023-10-05T15:30:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f215d5d0b80 10 client.17049 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f215d5d0b80 10 client.17049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f215d5d0b80 20 client.17049 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f43270 0x55e0f9f45690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f215d5d0b80 4 client.17049 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:30:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0f9e74db0 con 0x55e0f9f43270 2023-10-05T15:30:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.166+0000 7f21427fc700 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f43270 0x55e0f9f45690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.167+0000 7f21427fc700 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f43270 0x55e0f9f45690 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc4b234e20e5b29 server_cookie=5f1c02b2d37bc8e6 in_seq=0 out_seq=0 2023-10-05T15:30:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.167+0000 7f21327fc700 10 client.17049 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.171+0000 7f21327fc700 1 -- 172.21.15.60:0/308339538 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e0f9e74db0 con 0x55e0f9f43270 2023-10-05T15:30:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f21327fc700 10 client.17049 handle_command_reply: tid=0 2023-10-05T15:30:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 client.17049 shutdown 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 msgr2=0x55e0f9f301b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f301b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f21340996c0 tx=0x7f213409cb90 comp rx=0 tx=0).stop 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 shutdown_connections 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f43270 0x55e0f9f45690 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f301b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/308339538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f333d0 0x55e0f9f306f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 >> 172.21.15.60:0/308339538 conn(0x55e0f9e9d200 msgr2=0x55e0f9f23c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f21327fc700 0 client.17049 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:05.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 shutdown_connections 2023-10-05T15:30:05.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 1 -- 172.21.15.60:0/308339538 wait complete. 2023-10-05T15:30:05.176 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.172+0000 7f215d5d0b80 20 client.17049 trim_cache size 0 max 16384 2023-10-05T15:30:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.214+0000 7f215d5d0b80 1 Processor -- start 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.216+0000 7f215d5d0b80 1 -- start start 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.217+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f2abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.217+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.217+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f3eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.217+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9cfc8c0 con 0x55e0f9f30c30 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.217+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9f27fe0 con 0x55e0f9f333d0 2023-10-05T15:30:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.217+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9f3f0c0 con 0x55e0f9f27c00 2023-10-05T15:30:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f3eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f3eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55620/0 (socket says 172.21.15.60:55620) 2023-10-05T15:30:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 -- 172.21.15.60:0/3258875584 learned_addr learned my addr 172.21.15.60:0/3258875584 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 -- 172.21.15.60:0/3258875584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 msgr2=0x55e0f9f2abf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f2abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 -- 172.21.15.60:0/3258875584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f30c30 msgr2=0x55e0f9f3e640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.218+0000 7f214b7fe700 1 -- 172.21.15.60:0/3258875584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0f9ccd1f0 con 0x55e0f9f333d0 2023-10-05T15:30:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.219+0000 7f214b7fe700 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f3eb80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f214401ca20 tx=0x7f214401ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3d5c2731e4e7805 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.221+0000 7f2141ffb700 1 -- 172.21.15.60:0/3258875584 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144015070 con 0x55e0f9f333d0 2023-10-05T15:30:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.221+0000 7f2141ffb700 1 -- 172.21.15.60:0/3258875584 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f214401cce0 con 0x55e0f9f333d0 2023-10-05T15:30:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.221+0000 7f2141ffb700 1 -- 172.21.15.60:0/3258875584 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144004ac0 con 0x55e0f9f333d0 2023-10-05T15:30:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3258875584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 msgr2=0x55e0f9f3eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f3eb80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f214401ca20 tx=0x7f214401ca50 comp rx=0 tx=0).stop 2023-10-05T15:30:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3258875584 shutdown_connections 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f3eb80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f27c00 0x55e0f9f2abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/3258875584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f30c30 0x55e0f9f3e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3258875584 >> 172.21.15.60:0/3258875584 conn(0x55e0f9e9d200 msgr2=0x55e0f9f2b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3258875584 shutdown_connections 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.222+0000 7f215d5d0b80 1 -- 172.21.15.60:0/3258875584 wait complete. 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.223+0000 7f215d5d0b80 1 -- start start 2023-10-05T15:30:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.223+0000 7f215d5d0b80 1 Processor -- start 2023-10-05T15:30:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f37ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f30c30 0x55e0f9f38410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f96060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9f38bb0 con 0x55e0f9f27c00 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9f38d20 con 0x55e0f9f333d0 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f9f965a0 con 0x55e0f9f30c30 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f215d5d0b80 10 client.0 _ll_register_callbacks cb 0x7f214401ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.232+0000 7f214affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f37ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.233+0000 7f214affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f37ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42200/0 (socket says 172.21.15.60:42200) 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.233+0000 7f214affd700 1 -- 172.21.15.60:0/2952856816 learned_addr learned my addr 172.21.15.60:0/2952856816 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.234+0000 7f214affd700 1 -- 172.21.15.60:0/2952856816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f30c30 msgr2=0x55e0f9f38410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.234+0000 7f214affd700 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f30c30 0x55e0f9f38410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.234+0000 7f214affd700 1 -- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 msgr2=0x55e0f9f96060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.234+0000 7f214affd700 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f96060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.234+0000 7f214affd700 1 -- 172.21.15.60:0/2952856816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c11d3b0 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f214affd700 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f37ed0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2134009fd0 tx=0x7f213409d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5bf2bc95ce638b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f21327fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f21327fc700 1 -- 172.21.15.60:0/2952856816 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21340a10d0 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f21327fc700 1 -- 172.21.15.60:0/2952856816 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9555+0+0 (secure 0 0 0) 0x7f21340a1310 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f213401ae00 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f21327fc700 1 -- 172.21.15.60:0/2952856816 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f213409d1c0 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f215d5d0b80 10 client.17052 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e0f9ca5250 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.235+0000 7f21327fc700 1 -- 172.21.15.60:0/2952856816 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21340b9070 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f21327fc700 1 -- 172.21.15.60:0/2952856816 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f21340a5030 con 0x55e0f9f27c00 2023-10-05T15:30:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f215d5d0b80 10 client.17052 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f215d5d0b80 10 client.17052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f215d5d0b80 20 client.17052 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f97980 0x55e0f9f99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f215d5d0b80 4 client.17052 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0f9e74ad0 con 0x55e0f9f97980 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f21427fc700 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f97980 0x55e0f9f99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f21427fc700 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f97980 0x55e0f9f99e00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc15e41f1213e452 server_cookie=7d063ef6560bb66 in_seq=0 out_seq=0 2023-10-05T15:30:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.236+0000 7f21327fc700 10 client.17052 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:05.469 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.467+0000 7f21327fc700 1 -- 172.21.15.60:0/2952856816 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0f9e74ad0 con 0x55e0f9f97980 2023-10-05T15:30:05.469 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.467+0000 7f21327fc700 10 client.17052 handle_command_reply: tid=0 2023-10-05T15:30:05.469 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.467+0000 7f215d5d0b80 1 client.17052 shutdown 2023-10-05T15:30:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.476+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 msgr2=0x55e0f9f37ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.476+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f37ed0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2134009fd0 tx=0x7f213409d520 comp rx=0 tx=0).stop 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 shutdown_connections 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55e0f9f97980 0x55e0f9f99e00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0f9f333d0 0x55e0f9f96060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0f9f27c00 0x55e0f9f37ed0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f215d5d0b80 1 --2- 172.21.15.60:0/2952856816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f9f30c30 0x55e0f9f38410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 >> 172.21.15.60:0/2952856816 conn(0x55e0f9e9d200 msgr2=0x55e0f9f2b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.478+0000 7f21327fc700 0 client.17052 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.480+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 shutdown_connections 2023-10-05T15:30:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.480+0000 7f215d5d0b80 1 -- 172.21.15.60:0/2952856816 wait complete. 2023-10-05T15:30:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.485+0000 7f215d5d0b80 20 client.17052 trim_cache size 0 max 16384 2023-10-05T15:30:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:30:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:30:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:30:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:30:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.499+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21380c36c0 msgr2=0x7f21380c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.499+0000 7f21513e6700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21380c36c0 0x7f21380c5b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55e0f9f1e290 tx=0x7f213c00b250 comp rx=0 tx=0).stop 2023-10-05T15:30:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.499+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c10f620 msgr2=0x7f214c115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.499+0000 7f21513e6700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c10f620 0x7f214c115bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2134006fd0 tx=0x7f213400b7e0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.500+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 shutdown_connections 2023-10-05T15:30:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.500+0000 7f21513e6700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f21380c36c0 0x7f21380c5b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.500+0000 7f21513e6700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c11a690 0x7f214c1a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.500+0000 7f21513e6700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f214c10f620 0x7f214c115bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.500+0000 7f21513e6700 1 --2- 172.21.15.60:0/2871976172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f214c10fa90 0x7f214c116130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.500+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 >> 172.21.15.60:0/2871976172 conn(0x7f214c06cfa0 msgr2=0x7f214c11bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.513+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 shutdown_connections 2023-10-05T15:30:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:05.520+0000 7f21513e6700 1 -- 172.21.15.60:0/2871976172 wait complete. 2023-10-05T15:30:05.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:05 smithi135 ceph-mon[103360]: pgmap v419: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 119 op/s 2023-10-05T15:30:05.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:05 smithi060 ceph-mon[99238]: pgmap v419: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 119 op/s 2023-10-05T15:30:05.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:05 smithi092 ceph-mon[102944]: pgmap v419: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 119 op/s 2023-10-05T15:30:07.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:07 smithi135 ceph-mon[103360]: pgmap v420: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 884 KiB/s wr, 122 op/s 2023-10-05T15:30:07.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:07 smithi060 ceph-mon[99238]: pgmap v420: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 884 KiB/s wr, 122 op/s 2023-10-05T15:30:07.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:07 smithi092 ceph-mon[102944]: pgmap v420: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 884 KiB/s wr, 122 op/s 2023-10-05T15:30:09.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:09 smithi135 ceph-mon[103360]: pgmap v421: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 136 op/s 2023-10-05T15:30:09.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:09 smithi135 ceph-mon[103360]: osdmap e111: 12 total, 12 up, 12 in 2023-10-05T15:30:09.921 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:09 smithi060 ceph-mon[99238]: pgmap v421: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 136 op/s 2023-10-05T15:30:09.956 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:09 smithi060 ceph-mon[99238]: osdmap e111: 12 total, 12 up, 12 in 2023-10-05T15:30:09.956 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:09 smithi092 ceph-mon[102944]: pgmap v421: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 136 op/s 2023-10-05T15:30:09.956 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:09 smithi092 ceph-mon[102944]: osdmap e111: 12 total, 12 up, 12 in 2023-10-05T15:30:11.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:11 smithi135 ceph-mon[103360]: pgmap v423: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 873 KiB/s wr, 126 op/s 2023-10-05T15:30:11.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:11 smithi060 ceph-mon[99238]: pgmap v423: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 873 KiB/s wr, 126 op/s 2023-10-05T15:30:11.932 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:11 smithi092 ceph-mon[102944]: pgmap v423: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 873 KiB/s wr, 126 op/s 2023-10-05T15:30:13.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:12 smithi135 ceph-mon[103360]: osdmap e112: 12 total, 12 up, 12 in 2023-10-05T15:30:13.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:12 smithi135 ceph-mon[103360]: pgmap v425: 129 pgs: 22 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 488 KiB/s wr, 103 op/s 2023-10-05T15:30:13.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:12 smithi060 ceph-mon[99238]: osdmap e112: 12 total, 12 up, 12 in 2023-10-05T15:30:13.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:12 smithi060 ceph-mon[99238]: pgmap v425: 129 pgs: 22 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 488 KiB/s wr, 103 op/s 2023-10-05T15:30:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:12 smithi092 ceph-mon[102944]: osdmap e112: 12 total, 12 up, 12 in 2023-10-05T15:30:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:12 smithi092 ceph-mon[102944]: pgmap v425: 129 pgs: 22 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 488 KiB/s wr, 103 op/s 2023-10-05T15:30:15.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:15 smithi135 ceph-mon[103360]: pgmap v426: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 655 KiB/s wr, 102 op/s 2023-10-05T15:30:15.922 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:15 smithi060 ceph-mon[99238]: pgmap v426: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 655 KiB/s wr, 102 op/s 2023-10-05T15:30:15.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:15 smithi092 ceph-mon[102944]: pgmap v426: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 655 KiB/s wr, 102 op/s 2023-10-05T15:30:17.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:17 smithi135 ceph-mon[103360]: pgmap v427: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 741 KiB/s wr, 81 op/s 2023-10-05T15:30:17.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:17 smithi060 ceph-mon[99238]: pgmap v427: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 741 KiB/s wr, 81 op/s 2023-10-05T15:30:17.930 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:17 smithi092 ceph-mon[102944]: pgmap v427: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 741 KiB/s wr, 81 op/s 2023-10-05T15:30:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.822+0000 7f54a3eef700 1 -- 172.21.15.60:0/3564575281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c10d8e0 msgr2=0x7f549c10dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.822+0000 7f54a3eef700 1 --2- 172.21.15.60:0/3564575281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c10d8e0 0x7f549c10dcc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5494009f90 tx=0x7f549400b330 comp rx=0 tx=0).stop 2023-10-05T15:30:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.823+0000 7f54a3eef700 1 -- 172.21.15.60:0/3564575281 shutdown_connections 2023-10-05T15:30:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.823+0000 7f54a3eef700 1 --2- 172.21.15.60:0/3564575281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c108870 0x7f549c114730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.823+0000 7f54a3eef700 1 --2- 172.21.15.60:0/3564575281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c10d8e0 0x7f549c10dcc0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5494009f90 tx=0x7f549400b330 comp rx=0 tx=0).stop 2023-10-05T15:30:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.823+0000 7f54a3eef700 1 --2- 172.21.15.60:0/3564575281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f549c107eb0 0x7f549c108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.823+0000 7f54a3eef700 1 -- 172.21.15.60:0/3564575281 >> 172.21.15.60:0/3564575281 conn(0x7f549c06d3e0 msgr2=0x7f549c06d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.829+0000 7f54a3eef700 1 -- 172.21.15.60:0/3564575281 shutdown_connections 2023-10-05T15:30:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.834+0000 7f54a3eef700 1 -- 172.21.15.60:0/3564575281 wait complete. 2023-10-05T15:30:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.835+0000 7f54a3eef700 1 Processor -- start 2023-10-05T15:30:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.835+0000 7f54a3eef700 1 -- start start 2023-10-05T15:30:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.836+0000 7f54a3eef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 0x7f549c11db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.836+0000 7f54a3eef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c108870 0x7f549c11e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.836+0000 7f54a3eef700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f549c1189a0 0x7f549c118e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.836+0000 7f54a3eef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1193c0 con 0x7f549c107eb0 2023-10-05T15:30:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.836+0000 7f54a3eef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c119530 con 0x7f549c108870 2023-10-05T15:30:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.836+0000 7f54a3eef700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1196f0 con 0x7f549c1189a0 2023-10-05T15:30:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.839+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 0x7f549c11db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.839+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 0x7f549c11db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42210/0 (socket says 172.21.15.60:42210) 2023-10-05T15:30:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.839+0000 7f54a1c8b700 1 -- 172.21.15.60:0/761017246 learned_addr learned my addr 172.21.15.60:0/761017246 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a1c8b700 1 -- 172.21.15.60:0/761017246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f549c1189a0 msgr2=0x7f549c118e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f549c1189a0 0x7f549c118e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a1c8b700 1 -- 172.21.15.60:0/761017246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c108870 msgr2=0x7f549c11e070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:30:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c108870 0x7f549c11e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a1c8b700 1 -- 172.21.15.60:0/761017246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009c40 con 0x7f549c107eb0 2023-10-05T15:30:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 0x7f549c11db10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5494009040 tx=0x7f5494004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f5492ffd700 1 -- 172.21.15.60:0/761017246 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400e040 con 0x7f549c107eb0 2023-10-05T15:30:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f5492ffd700 1 -- 172.21.15.60:0/761017246 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5494007910 con 0x7f549c107eb0 2023-10-05T15:30:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f5492ffd700 1 -- 172.21.15.60:0/761017246 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549401b6c0 con 0x7f549c107eb0 2023-10-05T15:30:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.840+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c1bb760 con 0x7f549c107eb0 2023-10-05T15:30:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.841+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c1bbb90 con 0x7f549c107eb0 2023-10-05T15:30:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.848+0000 7f5492ffd700 1 -- 172.21.15.60:0/761017246 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f549401d470 con 0x7f549c107eb0 2023-10-05T15:30:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.849+0000 7f5492ffd700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f54880a1780 0x7f54880a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.849+0000 7f5492ffd700 1 -- 172.21.15.60:0/761017246 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f54940ce840 con 0x7f549c107eb0 2023-10-05T15:30:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.851+0000 7f54a148a700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f54880a1780 0x7f54880a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.852+0000 7f54a148a700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f54880a1780 0x7f54880a3c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5498005e50 tx=0x7f5498005de0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.874+0000 7f54b00d9b80 1 Processor -- start 2023-10-05T15:30:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.874+0000 7f54b00d9b80 1 -- start start 2023-10-05T15:30:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74d2520 0x5614f74dce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74df7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f743b400 con 0x5614f74d1c00 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f742cbc0 con 0x5614f74d2520 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f742a4e0 con 0x5614f74dd3d0 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74d1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42216/0 (socket says 172.21.15.60:42216) 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a1c8b700 1 -- 172.21.15.60:0/1371820933 learned_addr learned my addr 172.21.15.60:0/1371820933 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a248c700 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74df7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a248c700 1 -- 172.21.15.60:0/1371820933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74d2520 msgr2=0x5614f74dce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a248c700 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74d2520 0x5614f74dce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a248c700 1 -- 172.21.15.60:0/1371820933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 msgr2=0x5614f74d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a248c700 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74d1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.875+0000 7f54a248c700 1 -- 172.21.15.60:0/1371820933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614f7250d80 con 0x5614f74dd3d0 2023-10-05T15:30:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.876+0000 7f54a248c700 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74df7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f548c00b9b0 tx=0x7f548c00bcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1862c9ed99e341d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.877+0000 7f5487fff700 1 -- 172.21.15.60:0/1371820933 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c004220 con 0x5614f74dd3d0 2023-10-05T15:30:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.877+0000 7f5487fff700 1 -- 172.21.15.60:0/1371820933 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f548c00be50 con 0x5614f74dd3d0 2023-10-05T15:30:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.877+0000 7f5487fff700 1 -- 172.21.15.60:0/1371820933 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00dce0 con 0x5614f74dd3d0 2023-10-05T15:30:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.878+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1371820933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 msgr2=0x5614f74df7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.878+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74df7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f548c00b9b0 tx=0x7f548c00bcc0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.884+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1371820933 shutdown_connections 2023-10-05T15:30:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.884+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74df7c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.884+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74d1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.884+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1371820933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74d2520 0x5614f74dce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.884+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1371820933 >> 172.21.15.60:0/1371820933 conn(0x5614f7447200 msgr2=0x5614f74ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.890+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1371820933 shutdown_connections 2023-10-05T15:30:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.894+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1371820933 wait complete. 2023-10-05T15:30:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.895+0000 7f54b00d9b80 1 -- start start 2023-10-05T15:30:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.895+0000 7f54b00d9b80 1 Processor -- start 2023-10-05T15:30:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dd3d0 0x5614f74da7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dad20 0x5614f74e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f7425dd0 con 0x5614f74d1c00 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f73c26b0 con 0x5614f74dd3d0 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f73c2350 con 0x5614f74dad20 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54b00d9b80 10 client.0 _ll_register_callbacks cb 0x5614f721f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74da2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74da2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42220/0 (socket says 172.21.15.60:42220) 2023-10-05T15:30:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.896+0000 7f54a1c8b700 1 -- 172.21.15.60:0/1110899450 learned_addr learned my addr 172.21.15.60:0/1110899450 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54a1c8b700 1 -- 172.21.15.60:0/1110899450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dad20 msgr2=0x5614f74e8fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dad20 0x5614f74e8fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54a1c8b700 1 -- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dd3d0 msgr2=0x5614f74da7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dd3d0 0x5614f74da7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54a1c8b700 1 -- 172.21.15.60:0/1110899450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c00b610 con 0x5614f74d1c00 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74da2a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f549409b1a0 tx=0x7f549400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261c0915dcc14b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54857fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54857fa700 1 -- 172.21.15.60:0/1110899450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54940a37a0 con 0x5614f74d1c00 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54857fa700 1 -- 172.21.15.60:0/1110899450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f549409a990 con 0x5614f74d1c00 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.897+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614f74c5d50 con 0x5614f74d1c00 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54857fa700 1 -- 172.21.15.60:0/1110899450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f549409ab50 con 0x5614f74d1c00 2023-10-05T15:30:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 10 client.17064 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5614f7239c00 con 0x5614f74d1c00 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54857fa700 1 -- 172.21.15.60:0/1110899450 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5614f74c5d50 con 0x5614f74d1c00 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54857fa700 1 -- 172.21.15.60:0/1110899450 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f54940ce3e0 con 0x5614f74d1c00 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 10 client.17064 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 10 client.17064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 20 client.17064 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f74ed380 0x5614f74ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 4 client.17064 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:30:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.898+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614f741edb0 con 0x5614f74ed380 2023-10-05T15:30:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.906+0000 7f54a148a700 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f74ed380 0x5614f74ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.906+0000 7f54a148a700 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f74ed380 0x5614f74ef840 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e1bd5a6b276c67 server_cookie=994177db4d4460b2 in_seq=0 out_seq=0 2023-10-05T15:30:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.906+0000 7f54857fa700 10 client.17064 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.913+0000 7f54857fa700 1 -- 172.21.15.60:0/1110899450 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5614f741edb0 con 0x5614f74ed380 2023-10-05T15:30:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.913+0000 7f54857fa700 10 client.17064 handle_command_reply: tid=0 2023-10-05T15:30:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.913+0000 7f54b00d9b80 1 client.17064 shutdown 2023-10-05T15:30:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 msgr2=0x5614f74da2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74da2a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f549409b1a0 tx=0x7f549400b330 comp rx=0 tx=0).stop 2023-10-05T15:30:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 shutdown_connections 2023-10-05T15:30:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f74ed380 0x5614f74ef840 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dad20 0x5614f74e8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74da2a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/1110899450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dd3d0 0x5614f74da7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.918+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 >> 172.21.15.60:0/1110899450 conn(0x5614f7447200 msgr2=0x5614f74cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.927+0000 7f54857fa700 0 client.17064 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:18.932 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.931+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 shutdown_connections 2023-10-05T15:30:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.935+0000 7f54b00d9b80 1 -- 172.21.15.60:0/1110899450 wait complete. 2023-10-05T15:30:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.942+0000 7f54b00d9b80 20 client.17064 trim_cache size 0 max 16384 2023-10-05T15:30:18.969 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 Processor -- start 2023-10-05T15:30:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 -- start start 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74d5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f72a68c0 con 0x5614f74d1c00 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f74d3450 con 0x5614f74dad20 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f74ca1d0 con 0x5614f74dd3d0 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54a148a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74d5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54a148a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74d5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55650/0 (socket says 172.21.15.60:55650) 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.968+0000 7f54a148a700 1 -- 172.21.15.60:0/2336311635 learned_addr learned my addr 172.21.15.60:0/2336311635 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.970+0000 7f54a148a700 1 -- 172.21.15.60:0/2336311635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 msgr2=0x5614f74d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.970+0000 7f54a148a700 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.970+0000 7f54a148a700 1 -- 172.21.15.60:0/2336311635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 msgr2=0x5614f74e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.970+0000 7f54a148a700 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.970+0000 7f54a148a700 1 -- 172.21.15.60:0/2336311635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614f74d9e10 con 0x5614f74dad20 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.971+0000 7f54a148a700 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74d5530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5614f74ceb90 tx=0x7f5498010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c93f7347a5d07b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.973+0000 7f5490ff9700 1 -- 172.21.15.60:0/2336311635 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498022330 con 0x5614f74dad20 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.973+0000 7f5490ff9700 1 -- 172.21.15.60:0/2336311635 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5498022490 con 0x5614f74dad20 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.973+0000 7f5490ff9700 1 -- 172.21.15.60:0/2336311635 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549801e6c0 con 0x5614f74dad20 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.974+0000 7f54b00d9b80 1 -- 172.21.15.60:0/2336311635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 msgr2=0x5614f74d5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.974+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74d5530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5614f74ceb90 tx=0x7f5498010000 comp rx=0 tx=0).stop 2023-10-05T15:30:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.976+0000 7f54b00d9b80 1 -- 172.21.15.60:0/2336311635 shutdown_connections 2023-10-05T15:30:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.976+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74dd3d0 0x5614f74d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.976+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74d1c00 0x5614f74e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.976+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/2336311635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74d5530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.976+0000 7f54b00d9b80 1 -- 172.21.15.60:0/2336311635 >> 172.21.15.60:0/2336311635 conn(0x5614f7447200 msgr2=0x5614f74da260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.983+0000 7f54b00d9b80 1 -- 172.21.15.60:0/2336311635 shutdown_connections 2023-10-05T15:30:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.983+0000 7f54b00d9b80 1 -- 172.21.15.60:0/2336311635 wait complete. 2023-10-05T15:30:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 -- start start 2023-10-05T15:30:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 Processor -- start 2023-10-05T15:30:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74d1c00 0x5614f74e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74dd3d0 0x5614f753a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f753a810 con 0x5614f74dd3d0 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f753a980 con 0x5614f74dad20 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614f753ab40 con 0x5614f74d1c00 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.984+0000 7f54b00d9b80 10 client.0 _ll_register_callbacks cb 0x5614f721f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a1c8b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74d1c00 0x5614f74e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a148a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a148a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74e2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55656/0 (socket says 172.21.15.60:55656) 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a148a700 1 -- 172.21.15.60:0/3103895350 learned_addr learned my addr 172.21.15.60:0/3103895350 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a248c700 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74dd3d0 0x5614f753a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a1c8b700 1 -- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 msgr2=0x5614f74e2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.985+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74e2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54a1c8b700 1 -- 172.21.15.60:0/3103895350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74dd3d0 msgr2=0x5614f753a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74dd3d0 0x5614f753a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54a1c8b700 1 -- 172.21.15.60:0/3103895350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498022b40 con 0x5614f74d1c00 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54a1c8b700 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74d1c00 0x5614f74e1c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54940979a0 tx=0x7f54940cbc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da836efdebcd800d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54857fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54857fa700 1 -- 172.21.15.60:0/3103895350 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54940a3510 con 0x5614f74d1c00 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54857fa700 1 -- 172.21.15.60:0/3103895350 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f549401da20 con 0x5614f74d1c00 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.986+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f548c00be50 con 0x5614f74d1c00 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.987+0000 7f54857fa700 1 -- 172.21.15.60:0/3103895350 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54940a37a0 con 0x5614f74d1c00 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.991+0000 7f54b00d9b80 10 client.26533 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.991+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5614f72771f0 con 0x5614f74d1c00 2023-10-05T15:30:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54857fa700 1 -- 172.21.15.60:0/3103895350 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f548c00be50 con 0x5614f74d1c00 2023-10-05T15:30:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54857fa700 1 -- 172.21.15.60:0/3103895350 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f54940a13a0 con 0x5614f74d1c00 2023-10-05T15:30:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54b00d9b80 10 client.26533 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54b00d9b80 10 client.26533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54b00d9b80 20 client.26533 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f7563f10 0x5614f7566300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54b00d9b80 4 client.26533 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:30:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.993+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5614f741ead0 con 0x5614f7563f10 2023-10-05T15:30:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:18.994+0000 7f54a148a700 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f7563f10 0x5614f7566300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.013+0000 7f54a148a700 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f7563f10 0x5614f7566300 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28404f750b408368 server_cookie=693e7478e1a94a2d in_seq=0 out_seq=0 2023-10-05T15:30:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.013+0000 7f54857fa700 10 client.26533 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.177+0000 7f54857fa700 1 -- 172.21.15.60:0/3103895350 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5614f741ead0 con 0x5614f7563f10 2023-10-05T15:30:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.177+0000 7f54857fa700 10 client.26533 handle_command_reply: tid=0 2023-10-05T15:30:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.177+0000 7f54b00d9b80 1 client.26533 shutdown 2023-10-05T15:30:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.183+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74d1c00 msgr2=0x5614f74e1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.183+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74d1c00 0x5614f74e1c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54940979a0 tx=0x7f54940cbc70 comp rx=0 tx=0).stop 2023-10-05T15:30:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 shutdown_connections 2023-10-05T15:30:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5614f7563f10 0x5614f7566300 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5614f74dd3d0 0x5614f753a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614f74d1c00 0x5614f74e1c40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 --2- 172.21.15.60:0/3103895350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5614f74dad20 0x5614f74e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 >> 172.21.15.60:0/3103895350 conn(0x5614f7447200 msgr2=0x5614f74da1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54857fa700 0 client.26533 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 shutdown_connections 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 1 -- 172.21.15.60:0/3103895350 wait complete. 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.184+0000 7f54b00d9b80 20 client.26533 trim_cache size 0 max 16384 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:30:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:30:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.190+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f54880a1780 msgr2=0x7f54880a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.190+0000 7f54a3eef700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f54880a1780 0x7f54880a3c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5498005e50 tx=0x7f5498005de0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.190+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 msgr2=0x7f549c11db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.190+0000 7f54a3eef700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 0x7f549c11db10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5494009040 tx=0x7f5494004d30 comp rx=0 tx=0).stop 2023-10-05T15:30:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.195+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 shutdown_connections 2023-10-05T15:30:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.195+0000 7f54a3eef700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f549c1189a0 0x7f549c118e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.195+0000 7f54a3eef700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c107eb0 0x7f549c11db10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.195+0000 7f54a3eef700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f54880a1780 0x7f54880a3c40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.195+0000 7f54a3eef700 1 --2- 172.21.15.60:0/761017246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f549c108870 0x7f549c11e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.195+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 >> 172.21.15.60:0/761017246 conn(0x7f549c06d3e0 msgr2=0x7f549c071710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.200+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 shutdown_connections 2023-10-05T15:30:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:19.205+0000 7f54a3eef700 1 -- 172.21.15.60:0/761017246 wait complete. 2023-10-05T15:30:19.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:19 smithi135 ceph-mon[103360]: pgmap v428: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 997 KiB/s wr, 90 op/s 2023-10-05T15:30:19.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:19 smithi060 ceph-mon[99238]: pgmap v428: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 997 KiB/s wr, 90 op/s 2023-10-05T15:30:19.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:19 smithi092 ceph-mon[102944]: pgmap v428: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 997 KiB/s wr, 90 op/s 2023-10-05T15:30:21.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:21 smithi135 ceph-mon[103360]: pgmap v429: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 89 op/s 2023-10-05T15:30:21.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:21 smithi092 ceph-mon[102944]: pgmap v429: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 89 op/s 2023-10-05T15:30:21.941 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:21 smithi060 ceph-mon[99238]: pgmap v429: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 89 op/s 2023-10-05T15:30:23.085 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:22 smithi135 ceph-mon[103360]: pgmap v430: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 83 op/s 2023-10-05T15:30:23.174 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:22 smithi060 ceph-mon[99238]: pgmap v430: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 83 op/s 2023-10-05T15:30:23.182 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:22 smithi092 ceph-mon[102944]: pgmap v430: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 83 op/s 2023-10-05T15:30:25.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:25 smithi135 ceph-mon[103360]: pgmap v431: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-05T15:30:25.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:25 smithi092 ceph-mon[102944]: pgmap v431: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-05T15:30:25.947 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:25 smithi060 ceph-mon[99238]: pgmap v431: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-05T15:30:27.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:27 smithi092 ceph-mon[102944]: pgmap v432: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 92 op/s 2023-10-05T15:30:27.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:27 smithi092 ceph-mon[102944]: osdmap e113: 12 total, 12 up, 12 in 2023-10-05T15:30:27.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:27 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:27 smithi135 ceph-mon[103360]: pgmap v432: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 92 op/s 2023-10-05T15:30:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:27 smithi135 ceph-mon[103360]: osdmap e113: 12 total, 12 up, 12 in 2023-10-05T15:30:27.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:27 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:27.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:27 smithi060 ceph-mon[99238]: pgmap v432: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 92 op/s 2023-10-05T15:30:27.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:27 smithi060 ceph-mon[99238]: osdmap e113: 12 total, 12 up, 12 in 2023-10-05T15:30:27.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:27 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:29.340 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:29 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.340 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:29 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.341 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:29 smithi135 ceph-mon[103360]: pgmap v434: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-05T15:30:29.341 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:29 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.341 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:29 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.426 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:29 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.426 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:29 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.426 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:29 smithi060 ceph-mon[99238]: pgmap v434: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-05T15:30:29.426 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:29 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.426 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:29 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:29 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:29 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:29 smithi092 ceph-mon[102944]: pgmap v434: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-05T15:30:29.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:29 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:29.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:29 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:30.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:30 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:30.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:30 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:30.417 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:30 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:30 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:30.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:30 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:30.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:30 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:30.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:30 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:30.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:30 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:30.584 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:30 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:30:31.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:31 smithi060 ceph-mon[99238]: pgmap v435: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 908 KiB/s wr, 93 op/s 2023-10-05T15:30:31.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:31 smithi092 ceph-mon[102944]: pgmap v435: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 908 KiB/s wr, 93 op/s 2023-10-05T15:30:31.582 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:31 smithi135 ceph-mon[103360]: pgmap v435: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 908 KiB/s wr, 93 op/s 2023-10-05T15:30:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.056+0000 7f0b92cd8700 1 -- 172.21.15.60:0/1350606459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 msgr2=0x7f0b8c10d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.056+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/1350606459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c10d980 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009920 tx=0x7f0b7c009c30 comp rx=0 tx=0).stop 2023-10-05T15:30:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.064+0000 7f0b92cd8700 1 -- 172.21.15.60:0/1350606459 shutdown_connections 2023-10-05T15:30:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.064+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/1350606459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 0x7f0b8c114360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.064+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/1350606459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c10d980 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.064+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/1350606459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b8c1074e0 0x7f0b8c107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.064+0000 7f0b92cd8700 1 -- 172.21.15.60:0/1350606459 >> 172.21.15.60:0/1350606459 conn(0x7f0b8c076cd0 msgr2=0x7f0b8c105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.065+0000 7f0b92cd8700 1 -- 172.21.15.60:0/1350606459 shutdown_connections 2023-10-05T15:30:33.071 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.069+0000 7f0b92cd8700 1 -- 172.21.15.60:0/1350606459 wait complete. 2023-10-05T15:30:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 Processor -- start 2023-10-05T15:30:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 -- start start 2023-10-05T15:30:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b8c1074e0 0x7f0b8c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.072 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 0x7f0b8c06af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c06b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1b2380 con 0x7f0b8c10d5a0 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1b24c0 con 0x7f0b8c1074e0 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b92cd8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1b2680 con 0x7f0b8c107ea0 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b91275700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b91275700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c06b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42246/0 (socket says 172.21.15.60:42246) 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.070+0000 7f0b91275700 1 -- 172.21.15.60:0/643663965 learned_addr learned my addr 172.21.15.60:0/643663965 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.071+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 0x7f0b8c06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.072+0000 7f0b8bfff700 1 -- 172.21.15.60:0/643663965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b8c1074e0 msgr2=0x7f0b8c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.072+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b8c1074e0 0x7f0b8c06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.072+0000 7f0b8bfff700 1 -- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 msgr2=0x7f0b8c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.072+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c06b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.072+0000 7f0b8bfff700 1 -- 172.21.15.60:0/643663965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009520 con 0x7f0b8c107ea0 2023-10-05T15:30:33.075 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.072+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 0x7f0b8c06af00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400ef10 tx=0x7f0b8400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:33.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:32 smithi135 ceph-mon[103360]: pgmap v436: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 911 KiB/s wr, 93 op/s 2023-10-05T15:30:33.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.078+0000 7f0b89ffb700 1 -- 172.21.15.60:0/643663965 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400ca70 con 0x7f0b8c107ea0 2023-10-05T15:30:33.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.078+0000 7f0b89ffb700 1 -- 172.21.15.60:0/643663965 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b8400f040 con 0x7f0b8c107ea0 2023-10-05T15:30:33.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.078+0000 7f0b89ffb700 1 -- 172.21.15.60:0/643663965 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840146e0 con 0x7f0b8c107ea0 2023-10-05T15:30:33.083 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.079+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c1b2900 con 0x7f0b8c107ea0 2023-10-05T15:30:33.084 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.080+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c1b2d90 con 0x7f0b8c107ea0 2023-10-05T15:30:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.089+0000 7f0b89ffb700 1 -- 172.21.15.60:0/643663965 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0b84004ad0 con 0x7f0b8c107ea0 2023-10-05T15:30:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.090+0000 7f0b89ffb700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0b740a16f0 0x7f0b740a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.090+0000 7f0b89ffb700 1 -- 172.21.15.60:0/643663965 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f0b840cd080 con 0x7f0b8c107ea0 2023-10-05T15:30:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 Processor -- start 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 -- start start 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6ceefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cef520 0x5562b6cf9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cfc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6c58400 con 0x5562b6cfa3d0 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6c49bc0 con 0x5562b6ceec00 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6c474e0 con 0x5562b6cef520 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b91275700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cfc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b91275700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cfc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42254/0 (socket says 172.21.15.60:42254) 2023-10-05T15:30:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b91275700 1 -- 172.21.15.60:0/3286482118 learned_addr learned my addr 172.21.15.60:0/3286482118 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.091+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cef520 0x5562b6cf9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.092+0000 7f0b8bfff700 1 -- 172.21.15.60:0/3286482118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 msgr2=0x5562b6ceefe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:30:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.092+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6ceefe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.092+0000 7f0b8bfff700 1 -- 172.21.15.60:0/3286482118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 msgr2=0x5562b6cfc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.092+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cfc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.092+0000 7f0b8bfff700 1 -- 172.21.15.60:0/3286482118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562b6a6dd80 con 0x5562b6cef520 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.092+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cef520 0x5562b6cf9e90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ca360 tx=0x7f0b840997c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb70795f9ca2b7be server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.093+0000 7f0b72ffd700 1 -- 172.21.15.60:0/3286482118 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840094e0 con 0x5562b6cef520 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.093+0000 7f0b72ffd700 1 -- 172.21.15.60:0/3286482118 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b8409a380 con 0x5562b6cef520 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.093+0000 7f0b72ffd700 1 -- 172.21.15.60:0/3286482118 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840993d0 con 0x5562b6cef520 2023-10-05T15:30:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.094+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/3286482118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cef520 msgr2=0x5562b6cf9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.094+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cef520 0x5562b6cf9e90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ca360 tx=0x7f0b840997c0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.096+0000 7f0b90a74700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0b740a16f0 0x7f0b740a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.100+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/3286482118 shutdown_connections 2023-10-05T15:30:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.100+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cfc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.100+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6ceefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.100+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/3286482118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cef520 0x5562b6cf9e90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.100+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/3286482118 >> 172.21.15.60:0/3286482118 conn(0x5562b6c64200 msgr2=0x5562b6ceb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.104+0000 7f0b90a74700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0b740a16f0 0x7f0b740a3bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c010 tx=0x7f0b7c009f80 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.110+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/3286482118 shutdown_connections 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.110+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/3286482118 wait complete. 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.110+0000 7f0b9eec2b80 1 -- start start 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 Processor -- start 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6cf9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6cf7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6c42dd0 con 0x5562b6cfa3d0 2023-10-05T15:30:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6bdf6b0 con 0x5562b6cef520 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6bdf350 con 0x5562b6ceec00 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b9eec2b80 10 client.0 _ll_register_callbacks cb 0x5562b6a3c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b90a74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6cf9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b90a74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6cf9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55788/0 (socket says 172.21.15.60:55788) 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.111+0000 7f0b90a74700 1 -- 172.21.15.60:0/2990992130 learned_addr learned my addr 172.21.15.60:0/2990992130 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.112+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6cf7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.112+0000 7f0b90a74700 1 -- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 msgr2=0x5562b6cf7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.112+0000 7f0b90a74700 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6cf7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.112+0000 7f0b90a74700 1 -- 172.21.15.60:0/2990992130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 msgr2=0x5562b6cf7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.112+0000 7f0b90a74700 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.112+0000 7f0b90a74700 1 -- 172.21.15.60:0/2990992130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c1b2d90 con 0x5562b6ceec00 2023-10-05T15:30:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.118+0000 7f0b90a74700 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6cf9e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00b7b0 tx=0x7f0b7c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc7cc926d704ef66 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.118+0000 7f0b6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-10-05T15:30:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.118+0000 7f0b6bfff700 1 -- 172.21.15.60:0/2990992130 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c027070 con 0x5562b6ceec00 2023-10-05T15:30:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.118+0000 7f0b6bfff700 1 -- 172.21.15.60:0/2990992130 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f0b7c005250 con 0x5562b6ceec00 2023-10-05T15:30:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.122+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562b6ce2d50 con 0x5562b6ceec00 2023-10-05T15:30:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.126+0000 7f0b6bfff700 1 -- 172.21.15.60:0/2990992130 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b7c01c070 con 0x5562b6ceec00 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.129+0000 7f0b9eec2b80 10 client.26542 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.129+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5562b6a56c00 con 0x5562b6ceec00 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.129+0000 7f0b6bfff700 1 -- 172.21.15.60:0/2990992130 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562b6ce2d50 con 0x5562b6ceec00 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b6bfff700 1 -- 172.21.15.60:0/2990992130 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f0b7c033070 con 0x5562b6ceec00 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b9eec2b80 10 client.26542 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b9eec2b80 10 client.26542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b9eec2b80 20 client.26542 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6cffeb0 0x5562b6d022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b9eec2b80 4 client.26542 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:30:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562b6c3bdb0 con 0x5562b6cffeb0 2023-10-05T15:30:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.132+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6cffeb0 0x5562b6d022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.139+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6cffeb0 0x5562b6d022d0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cfff6641d13686c server_cookie=90021371308ed0ec in_seq=0 out_seq=0 2023-10-05T15:30:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.139+0000 7f0b6bfff700 10 client.26542 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.146+0000 7f0b6bfff700 1 -- 172.21.15.60:0/2990992130 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5562b6c3bdb0 con 0x5562b6cffeb0 2023-10-05T15:30:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.146+0000 7f0b6bfff700 10 client.26542 handle_command_reply: tid=0 2023-10-05T15:30:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.147+0000 7f0b9eec2b80 1 client.26542 shutdown 2023-10-05T15:30:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.147+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 msgr2=0x5562b6cf9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.147+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6cf9e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00b7b0 tx=0x7f0b7c009260 comp rx=0 tx=0).stop 2023-10-05T15:30:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 shutdown_connections 2023-10-05T15:30:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6cffeb0 0x5562b6d022d0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6cf9e40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/2990992130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6cf7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 >> 172.21.15.60:0/2990992130 conn(0x5562b6c64200 msgr2=0x5562b6ceac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.155+0000 7f0b6bfff700 0 client.26542 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.163+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 shutdown_connections 2023-10-05T15:30:33.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:32 smithi060 ceph-mon[99238]: pgmap v436: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 911 KiB/s wr, 93 op/s 2023-10-05T15:30:33.169 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.167+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/2990992130 wait complete. 2023-10-05T15:30:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.169+0000 7f0b9eec2b80 20 client.26542 trim_cache size 0 max 16384 2023-10-05T15:30:33.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:32 smithi092 ceph-mon[102944]: pgmap v436: 129 pgs: 21 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 911 KiB/s wr, 93 op/s 2023-10-05T15:30:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.197+0000 7f0b9eec2b80 1 Processor -- start 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.197+0000 7f0b9eec2b80 1 -- start start 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.197+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6d16970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cef520 0x5562b6cf9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6ac38c0 con 0x5562b6cef520 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6cf2f10 con 0x5562b6ceec00 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6cf2bf0 con 0x5562b6cfa3d0 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b90a74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6d16970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b90a74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6d16970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55688/0 (socket says 172.21.15.60:55688) 2023-10-05T15:30:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b90a74700 1 -- 172.21.15.60:0/1679807784 learned_addr learned my addr 172.21.15.60:0/1679807784 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.198+0000 7f0b91275700 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.199+0000 7f0b91275700 1 -- 172.21.15.60:0/1679807784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 msgr2=0x5562b6d16970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.199+0000 7f0b91275700 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6d16970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.199+0000 7f0b91275700 1 -- 172.21.15.60:0/1679807784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cef520 msgr2=0x5562b6cf9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.199+0000 7f0b91275700 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cef520 0x5562b6cf9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.199+0000 7f0b91275700 1 -- 172.21.15.60:0/1679807784 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562b6a941f0 con 0x5562b6cfa3d0 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.199+0000 7f0b91275700 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf42c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009980 tx=0x7f0b80009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab3839d543e638a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.205+0000 7f0b737fe700 1 -- 172.21.15.60:0/1679807784 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800118d0 con 0x5562b6cfa3d0 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.205+0000 7f0b737fe700 1 -- 172.21.15.60:0/1679807784 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b80015460 con 0x5562b6cfa3d0 2023-10-05T15:30:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.205+0000 7f0b737fe700 1 -- 172.21.15.60:0/1679807784 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80014640 con 0x5562b6cfa3d0 2023-10-05T15:30:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1679807784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cfa3d0 msgr2=0x5562b6cf42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf42c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009980 tx=0x7f0b80009c90 comp rx=0 tx=0).stop 2023-10-05T15:30:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1679807784 shutdown_connections 2023-10-05T15:30:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6cfa3d0 0x5562b6cf42c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6ceec00 0x5562b6d16970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1679807784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cef520 0x5562b6cf9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.208+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1679807784 >> 172.21.15.60:0/1679807784 conn(0x5562b6c64200 msgr2=0x5562b6d16260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.209+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1679807784 shutdown_connections 2023-10-05T15:30:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.209+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1679807784 wait complete. 2023-10-05T15:30:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.209+0000 7f0b9eec2b80 1 -- start start 2023-10-05T15:30:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 Processor -- start 2023-10-05T15:30:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6d0e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6d0e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6d0eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6d800f0 con 0x5562b6cfa3d0 2023-10-05T15:30:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6d80230 con 0x5562b6cef520 2023-10-05T15:30:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b6d80370 con 0x5562b6ceec00 2023-10-05T15:30:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.210+0000 7f0b9eec2b80 10 client.0 _ll_register_callbacks cb 0x5562b6a3c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6d0e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6d0e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55694/0 (socket says 172.21.15.60:55694) 2023-10-05T15:30:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 -- 172.21.15.60:0/1215062424 learned_addr learned my addr 172.21.15.60:0/1215062424 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b90a74700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6d0e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b91275700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6d0eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 -- 172.21.15.60:0/1215062424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 msgr2=0x5562b6d0e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6d0e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 -- 172.21.15.60:0/1215062424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 msgr2=0x5562b6d0eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6d0eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 -- 172.21.15.60:0/1215062424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b80009630 con 0x5562b6cef520 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b90a74700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6d0e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.211+0000 7f0b8bfff700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6d0e660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b84099980 tx=0x7f0b8400cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd87306e96dfeec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b6bfff700 1 -- 172.21.15.60:0/1215062424 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840a1ff0 con 0x5562b6cef520 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b6bfff700 1 -- 172.21.15.60:0/1215062424 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f0b84099c80 con 0x5562b6cef520 2023-10-05T15:30:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b8409a380 con 0x5562b6cef520 2023-10-05T15:30:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b6bfff700 1 -- 172.21.15.60:0/1215062424 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b8409ddd0 con 0x5562b6cef520 2023-10-05T15:30:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b9eec2b80 10 client.26741 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.212+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5562b6a6c250 con 0x5562b6cef520 2023-10-05T15:30:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.216+0000 7f0b6bfff700 1 -- 172.21.15.60:0/1215062424 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b8409a380 con 0x5562b6cef520 2023-10-05T15:30:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.217+0000 7f0b6bfff700 1 -- 172.21.15.60:0/1215062424 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f0b840a1af0 con 0x5562b6cef520 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b9eec2b80 10 client.26741 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b9eec2b80 10 client.26741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b9eec2b80 20 client.26741 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6d81790 0x5562b6d83bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b9eec2b80 4 client.26741 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5562b6c3bad0 con 0x5562b6d81790 2023-10-05T15:30:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b90a74700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6d81790 0x5562b6d83bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b6bfff700 10 client.26741 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.218+0000 7f0b90a74700 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6d81790 0x5562b6d83bb0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1120e12dc6bbf485 server_cookie=fbec77bfd3a5b20c in_seq=0 out_seq=0 2023-10-05T15:30:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.299+0000 7f0b6bfff700 1 -- 172.21.15.60:0/1215062424 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5562b6c3bad0 con 0x5562b6d81790 2023-10-05T15:30:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.299+0000 7f0b6bfff700 10 client.26741 handle_command_reply: tid=0 2023-10-05T15:30:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.299+0000 7f0b9eec2b80 1 client.26741 shutdown 2023-10-05T15:30:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.300+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 msgr2=0x5562b6d0e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.300+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6d0e660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b84099980 tx=0x7f0b8400cbd0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.301+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 shutdown_connections 2023-10-05T15:30:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.301+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x5562b6d81790 0x5562b6d83bb0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.301+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5562b6cfa3d0 0x5562b6d0eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.301+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562b6ceec00 0x5562b6d0e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.301+0000 7f0b9eec2b80 1 --2- 172.21.15.60:0/1215062424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5562b6cef520 0x5562b6d0e660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.301+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 >> 172.21.15.60:0/1215062424 conn(0x5562b6c64200 msgr2=0x5562b6cf0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.306+0000 7f0b6bfff700 0 client.26741 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.306+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 shutdown_connections 2023-10-05T15:30:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.314+0000 7f0b9eec2b80 1 -- 172.21.15.60:0/1215062424 wait complete. 2023-10-05T15:30:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.324+0000 7f0b9eec2b80 20 client.26741 trim_cache size 0 max 16384 2023-10-05T15:30:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:30:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:30:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:30:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:30:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.330+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0b740a16f0 msgr2=0x7f0b740a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.331+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0b740a16f0 0x7f0b740a3bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c010 tx=0x7f0b7c009f80 comp rx=0 tx=0).stop 2023-10-05T15:30:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.331+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 msgr2=0x7f0b8c06af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.331+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 0x7f0b8c06af00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400ef10 tx=0x7f0b8400c3a0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.338+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 shutdown_connections 2023-10-05T15:30:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.338+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b8c10d5a0 0x7f0b8c06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.338+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0b740a16f0 0x7f0b740a3bb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.338+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b8c1074e0 0x7f0b8c06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.338+0000 7f0b92cd8700 1 --2- 172.21.15.60:0/643663965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c107ea0 0x7f0b8c06af00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.338+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 >> 172.21.15.60:0/643663965 conn(0x7f0b8c076cd0 msgr2=0x7f0b8c077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.350+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 shutdown_connections 2023-10-05T15:30:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:33.357+0000 7f0b92cd8700 1 -- 172.21.15.60:0/643663965 wait complete. 2023-10-05T15:30:35.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:35 smithi135 ceph-mon[103360]: pgmap v437: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-05T15:30:35.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:35 smithi060 ceph-mon[99238]: pgmap v437: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-05T15:30:35.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:35 smithi092 ceph-mon[102944]: pgmap v437: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-05T15:30:37.836 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:37 smithi135 ceph-mon[103360]: pgmap v438: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2023-10-05T15:30:37.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:37 smithi060 ceph-mon[99238]: pgmap v438: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2023-10-05T15:30:37.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:37 smithi092 ceph-mon[102944]: pgmap v438: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2023-10-05T15:30:39.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:39 smithi135 ceph-mon[103360]: pgmap v439: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 102 op/s 2023-10-05T15:30:39.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:39 smithi060 ceph-mon[99238]: pgmap v439: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 102 op/s 2023-10-05T15:30:39.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:39 smithi092 ceph-mon[102944]: pgmap v439: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 102 op/s 2023-10-05T15:30:41.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:41 smithi060 ceph-mon[99238]: pgmap v440: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 881 KiB/s wr, 86 op/s 2023-10-05T15:30:41.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:41 smithi092 ceph-mon[102944]: pgmap v440: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 881 KiB/s wr, 86 op/s 2023-10-05T15:30:42.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:41 smithi135 ceph-mon[103360]: pgmap v440: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 881 KiB/s wr, 86 op/s 2023-10-05T15:30:43.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:42 smithi135 ceph-mon[103360]: pgmap v441: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 875 KiB/s wr, 94 op/s 2023-10-05T15:30:43.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:42 smithi060 ceph-mon[99238]: pgmap v441: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 875 KiB/s wr, 94 op/s 2023-10-05T15:30:43.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:42 smithi092 ceph-mon[102944]: pgmap v441: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 875 KiB/s wr, 94 op/s 2023-10-05T15:30:45.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:45 smithi135 ceph-mon[103360]: pgmap v442: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 927 KiB/s wr, 115 op/s 2023-10-05T15:30:45.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:45 smithi060 ceph-mon[99238]: pgmap v442: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 927 KiB/s wr, 115 op/s 2023-10-05T15:30:45.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:45 smithi092 ceph-mon[102944]: pgmap v442: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 927 KiB/s wr, 115 op/s 2023-10-05T15:30:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.616+0000 7f7d0b342700 1 -- 172.21.15.60:0/3654838146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d041050f0 msgr2=0x7f7d0410cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.616+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3654838146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d041050f0 0x7f7d0410cc70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc01c0d0 tx=0x7f7cfc01c3e0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.625+0000 7f7d0b342700 1 -- 172.21.15.60:0/3654838146 shutdown_connections 2023-10-05T15:30:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.625+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3654838146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d041050f0 0x7f7d0410cc70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.625+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3654838146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040fffd0 0x7f7d041003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.625+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3654838146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d04100980 0x7f7d041049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.625+0000 7f7d0b342700 1 -- 172.21.15.60:0/3654838146 >> 172.21.15.60:0/3654838146 conn(0x7f7d04076ea0 msgr2=0x7f7d040772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.631+0000 7f7d0b342700 1 -- 172.21.15.60:0/3654838146 shutdown_connections 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.634+0000 7f7d0b342700 1 -- 172.21.15.60:0/3654838146 wait complete. 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.634+0000 7f7d0b342700 1 Processor -- start 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 -- start start 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d040fffd0 0x7f7d04107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d041050f0 0x7f7d04107870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 0x7f7d041ba930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041baf30 con 0x7f7d041b8470 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041bb0a0 con 0x7f7d040fffd0 2023-10-05T15:30:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d0b342700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041bb260 con 0x7f7d041050f0 2023-10-05T15:30:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d098df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 0x7f7d041ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d098df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 0x7f7d041ba930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42284/0 (socket says 172.21.15.60:42284) 2023-10-05T15:30:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.635+0000 7f7d098df700 1 -- 172.21.15.60:0/3365900046 learned_addr learned my addr 172.21.15.60:0/3365900046 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d040fffd0 0x7f7d04107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 -- 172.21.15.60:0/3365900046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d041050f0 msgr2=0x7f7d04107870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:30:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d041050f0 0x7f7d04107870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 -- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 msgr2=0x7f7d041ba930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 0x7f7d041ba930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 -- 172.21.15.60:0/3365900046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc01ad10 con 0x7f7d040fffd0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.640+0000 7f7d090de700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d040fffd0 0x7f7d04107330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000b450 tx=0x7f7d0000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.641+0000 7f7cfa7fc700 1 -- 172.21.15.60:0/3365900046 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00011830 con 0x7f7d040fffd0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.641+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d041bb540 con 0x7f7d040fffd0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.641+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d041bbaa0 con 0x7f7d040fffd0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.641+0000 7f7cfa7fc700 1 -- 172.21.15.60:0/3365900046 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d00011e50 con 0x7f7d040fffd0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.641+0000 7f7cfa7fc700 1 -- 172.21.15.60:0/3365900046 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000f2e0 con 0x7f7d040fffd0 2023-10-05T15:30:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.643+0000 7f7d098df700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 0x7f7d041ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:30:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.645+0000 7f7cfa7fc700 1 -- 172.21.15.60:0/3365900046 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7d00011990 con 0x7f7d040fffd0 2023-10-05T15:30:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.645+0000 7f7cfa7fc700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7cf00a16b0 0x7f7cf00a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.645+0000 7f7cfa7fc700 1 -- 172.21.15.60:0/3365900046 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f7d000cce10 con 0x7f7d040fffd0 2023-10-05T15:30:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.650+0000 7f7d088dd700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7cf00a16b0 0x7f7cf00a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 Processor -- start 2023-10-05T15:30:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 -- start start 2023-10-05T15:30:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae24bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24c520 0x55d2ae256e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae1b5400 con 0x55d2ae24c520 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae1a6bc0 con 0x55d2ae2573d0 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.660+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae1a44e0 con 0x55d2ae24bc00 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d098df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d098df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55714/0 (socket says 172.21.15.60:55714) 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d098df700 1 -- 172.21.15.60:0/934214347 learned_addr learned my addr 172.21.15.60:0/934214347 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d088dd700 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24c520 0x55d2ae256e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d088dd700 1 -- 172.21.15.60:0/934214347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 msgr2=0x55d2ae24bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d088dd700 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae24bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d088dd700 1 -- 172.21.15.60:0/934214347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 msgr2=0x55d2ae2597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d088dd700 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.662+0000 7f7d088dd700 1 -- 172.21.15.60:0/934214347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2adfcad80 con 0x55d2ae24c520 2023-10-05T15:30:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.663+0000 7f7d088dd700 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24c520 0x55d2ae256e90 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7d0410d180 tx=0x7f7cf40124f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef3c57dd08743e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.665+0000 7f7cef7fe700 1 -- 172.21.15.60:0/934214347 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf401b070 con 0x55d2ae24c520 2023-10-05T15:30:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.665+0000 7f7cef7fe700 1 -- 172.21.15.60:0/934214347 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cf4012e20 con 0x55d2ae24c520 2023-10-05T15:30:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.665+0000 7f7cef7fe700 1 -- 172.21.15.60:0/934214347 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4015890 con 0x55d2ae24c520 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 -- 172.21.15.60:0/934214347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24c520 msgr2=0x55d2ae256e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24c520 0x55d2ae256e90 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7d0410d180 tx=0x7f7cf40124f0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 -- 172.21.15.60:0/934214347 shutdown_connections 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae24bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/934214347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24c520 0x55d2ae256e90 secure :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7d0410d180 tx=0x7f7cf40124f0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.666+0000 7f7d1752cb80 1 -- 172.21.15.60:0/934214347 >> 172.21.15.60:0/934214347 conn(0x55d2ae1c1200 msgr2=0x55d2ae248080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:46.671 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.669+0000 7f7d1752cb80 1 -- 172.21.15.60:0/934214347 shutdown_connections 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.669+0000 7f7d1752cb80 1 -- 172.21.15.60:0/934214347 wait complete. 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.669+0000 7f7d088dd700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7cf00a16b0 0x7f7cf00a3b70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7cf401a000 tx=0x7f7cf4017000 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.669+0000 7f7d1752cb80 1 -- start start 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 Processor -- start 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae254340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae2573d0 0x55d2ae254880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae254dc0 0x55d2ae263030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae19fdd0 con 0x55d2ae24bc00 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae13c6b0 con 0x55d2ae254dc0 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae13c350 con 0x55d2ae2573d0 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.670+0000 7f7d1752cb80 10 client.0 _ll_register_callbacks cb 0x55d2adf997a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d090de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae254340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d090de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae254340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42300/0 (socket says 172.21.15.60:42300) 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d090de700 1 -- 172.21.15.60:0/2427785331 learned_addr learned my addr 172.21.15.60:0/2427785331 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d088dd700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae2573d0 0x55d2ae254880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae254dc0 0x55d2ae263030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 -- 172.21.15.60:0/2427785331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae2573d0 msgr2=0x55d2ae254880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae2573d0 0x55d2ae254880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 -- 172.21.15.60:0/2427785331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 msgr2=0x55d2ae254340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae254340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 -- 172.21.15.60:0/2427785331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf4009b00 con 0x55d2ae254dc0 2023-10-05T15:30:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.671+0000 7f7d098df700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae254dc0 0x55d2ae263030 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc01c800 tx=0x7f7cfc003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ede91e430fe2ce8a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7cecff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7cecff9700 1 -- 172.21.15.60:0/2427785331 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc01f070 con 0x55d2ae254dc0 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7cecff9700 1 -- 172.21.15.60:0/2427785331 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f7cfc0054f0 con 0x55d2ae254dc0 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2ae23fd50 con 0x55d2ae254dc0 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7cecff9700 1 -- 172.21.15.60:0/2427785331 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cfc0056b0 con 0x55d2ae254dc0 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7d1752cb80 10 client.26753 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.672+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d2adfb3c00 con 0x55d2ae254dc0 2023-10-05T15:30:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.674+0000 7f7cecff9700 1 -- 172.21.15.60:0/2427785331 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d2ae23fd50 con 0x55d2ae254dc0 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.674+0000 7f7cecff9700 1 -- 172.21.15.60:0/2427785331 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7cfc02a080 con 0x55d2ae254dc0 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.683+0000 7f7d1752cb80 10 client.26753 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.683+0000 7f7d1752cb80 10 client.26753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.683+0000 7f7d1752cb80 20 client.26753 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.683+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae267670 0x55d2ae269a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.683+0000 7f7d1752cb80 4 client.26753 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:30:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.683+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2ae198db0 con 0x55d2ae267670 2023-10-05T15:30:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.687+0000 7f7d090de700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae267670 0x55d2ae269a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.692+0000 7f7d090de700 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae267670 0x55d2ae269a90 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f971534b1880b8 server_cookie=5873928035617bf9 in_seq=0 out_seq=0 2023-10-05T15:30:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.697+0000 7f7cecff9700 10 client.26753 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.697+0000 7f7cecff9700 1 -- 172.21.15.60:0/2427785331 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d2ae198db0 con 0x55d2ae267670 2023-10-05T15:30:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.697+0000 7f7cecff9700 10 client.26753 handle_command_reply: tid=0 2023-10-05T15:30:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.697+0000 7f7d1752cb80 1 client.26753 shutdown 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae254dc0 msgr2=0x55d2ae263030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae254dc0 0x55d2ae263030 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc01c800 tx=0x7f7cfc003d70 comp rx=0 tx=0).stop 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 shutdown_connections 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae267670 0x55d2ae269a90 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae254dc0 0x55d2ae263030 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae254340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2427785331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae2573d0 0x55d2ae254880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.706+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 >> 172.21.15.60:0/2427785331 conn(0x55d2ae1c1200 msgr2=0x55d2ae247c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.709+0000 7f7cecff9700 0 client.26753 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.713+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 shutdown_connections 2023-10-05T15:30:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.719+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2427785331 wait complete. 2023-10-05T15:30:46.730 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.727+0000 7f7d1752cb80 20 client.26753 trim_cache size 0 max 16384 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.763+0000 7f7d1752cb80 1 Processor -- start 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.763+0000 7f7d1752cb80 1 -- start start 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.763+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae25df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae254dc0 0x55d2ae2626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae262c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae0208c0 con 0x55d2ae24bc00 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae2571f0 con 0x55d2ae2573d0 2023-10-05T15:30:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae24d3f0 con 0x55d2ae254dc0 2023-10-05T15:30:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d088dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae254dc0 0x55d2ae2626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d088dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae254dc0 0x55d2ae2626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55836/0 (socket says 172.21.15.60:55836) 2023-10-05T15:30:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d088dd700 1 -- 172.21.15.60:0/2064576045 learned_addr learned my addr 172.21.15.60:0/2064576045 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d090de700 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae25df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d090de700 1 -- 172.21.15.60:0/2064576045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae254dc0 msgr2=0x55d2ae2626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d090de700 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae254dc0 0x55d2ae2626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d090de700 1 -- 172.21.15.60:0/2064576045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 msgr2=0x55d2ae262c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d090de700 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae262c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.764+0000 7f7d090de700 1 -- 172.21.15.60:0/2064576045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2ae259a90 con 0x55d2ae24bc00 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.765+0000 7f7d090de700 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae25df80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009fd0 tx=0x7f7d000b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5de950c589ef0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.765+0000 7f7ceffff700 1 -- 172.21.15.60:0/2064576045 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b1070 con 0x55d2ae24bc00 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.765+0000 7f7ceffff700 1 -- 172.21.15.60:0/2064576045 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d000a1e20 con 0x55d2ae24bc00 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.765+0000 7f7ceffff700 1 -- 172.21.15.60:0/2064576045 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00099cf0 con 0x55d2ae24bc00 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2064576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 msgr2=0x55d2ae25df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae25df80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009fd0 tx=0x7f7d000b9040 comp rx=0 tx=0).stop 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2064576045 shutdown_connections 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae262c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae24bc00 0x55d2ae25df80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/2064576045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae254dc0 0x55d2ae2626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.766+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2064576045 >> 172.21.15.60:0/2064576045 conn(0x55d2ae1c1200 msgr2=0x55d2ae24f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.774+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2064576045 shutdown_connections 2023-10-05T15:30:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.783+0000 7f7d1752cb80 1 -- 172.21.15.60:0/2064576045 wait complete. 2023-10-05T15:30:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.784+0000 7f7d1752cb80 1 -- start start 2023-10-05T15:30:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.784+0000 7f7d1752cb80 1 Processor -- start 2023-10-05T15:30:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae2b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 0x55d2ae25d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae25dd20 con 0x55d2ae25d360 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae25de60 con 0x55d2ae2573d0 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ae25e020 con 0x55d2ae24bc00 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.785+0000 7f7d1752cb80 10 client.0 _ll_register_callbacks cb 0x7f7cfc01af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.786+0000 7f7d098df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 0x55d2ae25d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.786+0000 7f7d098df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 0x55d2ae25d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42312/0 (socket says 172.21.15.60:42312) 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.786+0000 7f7d098df700 1 -- 172.21.15.60:0/3423776117 learned_addr learned my addr 172.21.15.60:0/3423776117 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d088dd700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d090de700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae2b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d098df700 1 -- 172.21.15.60:0/3423776117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 msgr2=0x55d2ae2b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d098df700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae2b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d098df700 1 -- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 msgr2=0x55d2ae2b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d098df700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d098df700 1 -- 172.21.15.60:0/3423776117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d041bbaa0 con 0x55d2ae25d360 2023-10-05T15:30:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.787+0000 7f7d098df700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 0x55d2ae25d7e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0050b0 tx=0x7f7cfc01a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b421d4db62850f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.788+0000 7f7cecff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-05T15:30:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.788+0000 7f7cecff9700 1 -- 172.21.15.60:0/3423776117 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc01f040 con 0x55d2ae25d360 2023-10-05T15:30:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.788+0000 7f7cecff9700 1 -- 172.21.15.60:0/3423776117 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f7cfc007d50 con 0x55d2ae25d360 2023-10-05T15:30:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.789+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7cf4012e20 con 0x55d2ae25d360 2023-10-05T15:30:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.789+0000 7f7cecff9700 1 -- 172.21.15.60:0/3423776117 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cfc0052f0 con 0x55d2ae25d360 2023-10-05T15:30:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.789+0000 7f7d1752cb80 10 client.17094 fetch_fsmap learned FSMap version 43 2023-10-05T15:30:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.789+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d2adff11f0 con 0x55d2ae25d360 2023-10-05T15:30:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.789+0000 7f7cecff9700 1 -- 172.21.15.60:0/3423776117 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cf4012e20 con 0x55d2ae25d360 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7cecff9700 1 -- 172.21.15.60:0/3423776117 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7cfc005450 con 0x55d2ae25d360 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7d1752cb80 10 client.17094 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7d1752cb80 10 client.17094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7d1752cb80 20 client.17094 populate_metadata read hostname 'smithi060' 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae2bc010 0x55d2ae2be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7d1752cb80 4 client.17094 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:30:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.791+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 --> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d2ae198ad0 con 0x55d2ae2bc010 2023-10-05T15:30:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.792+0000 7f7d090de700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae2bc010 0x55d2ae2be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.792+0000 7f7cecff9700 10 client.17094 ms_handle_connect on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.792+0000 7f7d090de700 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae2bc010 0x55d2ae2be430 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31980e9125691f15 server_cookie=8e85f929413c5e96 in_seq=0 out_seq=0 2023-10-05T15:30:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.986+0000 7f7cecff9700 1 -- 172.21.15.60:0/3423776117 <== mds.0 v2:172.21.15.92:6838/3541269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d2ae198ad0 con 0x55d2ae2bc010 2023-10-05T15:30:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.986+0000 7f7cecff9700 10 client.17094 handle_command_reply: tid=0 2023-10-05T15:30:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.986+0000 7f7d1752cb80 1 client.17094 shutdown 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.989+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 msgr2=0x55d2ae25d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.989+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 0x55d2ae25d7e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0050b0 tx=0x7f7cfc01a550 comp rx=0 tx=0).stop 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 shutdown_connections 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:6838/3541269,v1:172.21.15.92:6839/3541269] conn(0x55d2ae2bc010 0x55d2ae2be430 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d2ae25d360 0x55d2ae25d7e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d2ae24bc00 0x55d2ae2b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7d1752cb80 1 --2- 172.21.15.60:0/3423776117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2ae2573d0 0x55d2ae2b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 >> 172.21.15.60:0/3423776117 conn(0x55d2ae1c1200 msgr2=0x55d2ae2626d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.991+0000 7f7cecff9700 0 client.17094 ms_handle_reset on v2:172.21.15.92:6838/3541269 2023-10-05T15:30:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:46.992+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 shutdown_connections 2023-10-05T15:30:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.001+0000 7f7d1752cb80 1 -- 172.21.15.60:0/3423776117 wait complete. 2023-10-05T15:30:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:{ 2023-10-05T15:30:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "message": "", 2023-10-05T15:30:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout: "return_code": 0 2023-10-05T15:30:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stdout:} 2023-10-05T15:30:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.002+0000 7f7d1752cb80 20 client.17094 trim_cache size 0 max 16384 2023-10-05T15:30:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.009+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7cf00a16b0 msgr2=0x7f7cf00a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.009+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7cf00a16b0 0x7f7cf00a3b70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7cf401a000 tx=0x7f7cf4017000 comp rx=0 tx=0).stop 2023-10-05T15:30:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.009+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d040fffd0 msgr2=0x7f7d04107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.009+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d040fffd0 0x7f7d04107330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000b450 tx=0x7f7d0000b810 comp rx=0 tx=0).stop 2023-10-05T15:30:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.016+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 shutdown_connections 2023-10-05T15:30:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.016+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d041b8470 0x7f7d041ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.016+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f7cf00a16b0 0x7f7cf00a3b70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.016+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d040fffd0 0x7f7d04107330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.016+0000 7f7d0b342700 1 --2- 172.21.15.60:0/3365900046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d041050f0 0x7f7d04107870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.016+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 >> 172.21.15.60:0/3365900046 conn(0x7f7d04076ea0 msgr2=0x7f7d041039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.026+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 shutdown_connections 2023-10-05T15:30:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi060.front.sepia.ceph.com.smithi060.stderr:2023-10-05T15:30:47.033+0000 7f7d0b342700 1 -- 172.21.15.60:0/3365900046 wait complete. 2023-10-05T15:30:47.521 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2023-10-05T15:30:47.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-05T15:30:47.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:47 smithi135 ceph-mon[103360]: pgmap v443: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 746 KiB/s wr, 109 op/s 2023-10-05T15:30:47.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:47 smithi060 ceph-mon[99238]: pgmap v443: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 746 KiB/s wr, 109 op/s 2023-10-05T15:30:47.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:47 smithi092 ceph-mon[102944]: pgmap v443: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 746 KiB/s wr, 109 op/s 2023-10-05T15:30:48.169 DEBUG:teuthology.parallel:result is None 2023-10-05T15:30:48.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T15:30:48.298 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T15:30:48.298 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-05T15:30:48.308 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:30:48.326 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-05T15:30:48.359 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-05T15:30:48.360 INFO:teuthology.task.exec:Executing custom commands... 2023-10-05T15:30:48.360 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:30:48.360 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-05T15:30:48.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-05T15:30:48.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-05T15:30:48.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.884+0000 7f1577acc700 1 -- 172.21.15.60:0/3426443507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157010fa90 msgr2=0x7f15701083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:48.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.884+0000 7f1577acc700 1 --2- 172.21.15.60:0/3426443507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157010fa90 0x7f15701083f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f156801c0d0 tx=0x7f156801c3e0 comp rx=0 tx=0).stop 2023-10-05T15:30:48.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.886+0000 7f1577acc700 1 -- 172.21.15.60:0/3426443507 shutdown_connections 2023-10-05T15:30:48.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.886+0000 7f1577acc700 1 --2- 172.21.15.60:0/3426443507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157011a690 0x7f157011ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:48.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.886+0000 7f1577acc700 1 --2- 172.21.15.60:0/3426443507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f157010f620 0x7f1570107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:48.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.886+0000 7f1577acc700 1 --2- 172.21.15.60:0/3426443507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157010fa90 0x7f15701083f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:48.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.886+0000 7f1577acc700 1 -- 172.21.15.60:0/3426443507 >> 172.21.15.60:0/3426443507 conn(0x7f157006cfa0 msgr2=0x7f157006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:48.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.893+0000 7f1577acc700 1 -- 172.21.15.60:0/3426443507 shutdown_connections 2023-10-05T15:30:48.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.893+0000 7f1577acc700 1 -- 172.21.15.60:0/3426443507 wait complete. 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.894+0000 7f1577acc700 1 Processor -- start 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.898+0000 7f1577acc700 1 -- start start 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.899+0000 7f1577acc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f157010f620 0x7f1570119900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.899+0000 7f1577acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157010fa90 0x7f1570119e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.899+0000 7f1577acc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 0x7f15701157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.899+0000 7f1577acc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1570115f50 con 0x7f157010f620 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.899+0000 7f1577acc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15701160c0 con 0x7f157011a690 2023-10-05T15:30:48.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.899+0000 7f1577acc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1570116280 con 0x7f157010fa90 2023-10-05T15:30:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.900+0000 7f1576069700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 0x7f15701157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.900+0000 7f1576069700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 0x7f15701157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55750/0 (socket says 172.21.15.60:55750) 2023-10-05T15:30:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.900+0000 7f1576069700 1 -- 172.21.15.60:0/96576665 learned_addr learned my addr 172.21.15.60:0/96576665 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.905+0000 7f1576069700 1 -- 172.21.15.60:0/96576665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157010fa90 msgr2=0x7f1570119e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.905+0000 7f1576069700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157010fa90 0x7f1570119e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.905+0000 7f1576069700 1 -- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f157010f620 msgr2=0x7f1570119900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.905+0000 7f1576069700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f157010f620 0x7f1570119900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.905+0000 7f1576069700 1 -- 172.21.15.60:0/96576665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156801ad10 con 0x7f157011a690 2023-10-05T15:30:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.909+0000 7f1576069700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 0x7f15701157c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c970 tx=0x7f156c00cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:48.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.917+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c007b00 con 0x7f157011a690 2023-10-05T15:30:48.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.917+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f156c00ce50 con 0x7f157011a690 2023-10-05T15:30:48.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.917+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1570116560 con 0x7f157011a690 2023-10-05T15:30:48.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.917+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15701aa650 con 0x7f157011a690 2023-10-05T15:30:48.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.918+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c005580 con 0x7f157011a690 2023-10-05T15:30:48.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.921+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f156c00f450 con 0x7f157011a690 2023-10-05T15:30:48.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.922+0000 7f1566ffd700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f155c0a1800 0x7f155c0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:48.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.922+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f156c0cdf40 con 0x7f157011a690 2023-10-05T15:30:48.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.923+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15540052f0 con 0x7f157011a690 2023-10-05T15:30:48.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.927+0000 7f1575868700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f155c0a1800 0x7f155c0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:48.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.928+0000 7f1575868700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f155c0a1800 0x7f155c0a3cc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1560005950 tx=0x7f15600058e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:48.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:48.928+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f156c01d080 con 0x7f157011a690 2023-10-05T15:30:49.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.354+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 --> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f1554000bc0 con 0x7f155c0a1800 2023-10-05T15:30:49.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.414+0000 7f1566ffd700 1 -- 172.21.15.60:0/96576665 <== mgr.15663 v2:172.21.15.60:6800/139103647 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f1554000bc0 con 0x7f155c0a1800 2023-10-05T15:30:49.422 INFO:teuthology.orchestra.run.smithi060.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-05T00:00:00", "created": "2023-10-05T15:16:50", "first": "2023-10-05T15:17:00", "last": "2023-10-05T15:30:00", "last_pruned": "2023-10-05T15:30:02", "created_count": 14, "pruned_count": 8, "active": true} 2023-10-05T15:30:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.423+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f155c0a1800 msgr2=0x7f155c0a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.423+0000 7f1577acc700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f155c0a1800 0x7f155c0a3cc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1560005950 tx=0x7f15600058e0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.423+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 msgr2=0x7f15701157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.423+0000 7f1577acc700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 0x7f15701157c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c970 tx=0x7f156c00cd30 comp rx=0 tx=0).stop 2023-10-05T15:30:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.431+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 shutdown_connections 2023-10-05T15:30:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.431+0000 7f1577acc700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f155c0a1800 0x7f155c0a3cc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.431+0000 7f1577acc700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f157011a690 0x7f15701157c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.431+0000 7f1577acc700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f157010f620 0x7f1570119900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.431+0000 7f1577acc700 1 --2- 172.21.15.60:0/96576665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157010fa90 0x7f1570119e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.431+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 >> 172.21.15.60:0/96576665 conn(0x7f157006cfa0 msgr2=0x7f157011bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.436+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 shutdown_connections 2023-10-05T15:30:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.441+0000 7f1577acc700 1 -- 172.21.15.60:0/96576665 wait complete. 2023-10-05T15:30:49.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-05T15:30:49.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 -- 172.21.15.60:0/1120360075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c100a60 msgr2=0x7f680c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 --2- 172.21.15.60:0/1120360075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c100a60 0x7f680c100e40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6800009990 tx=0x7f6800009ca0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 -- 172.21.15.60:0/1120360075 shutdown_connections 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 --2- 172.21.15.60:0/1120360075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c105150 0x7f680c10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 --2- 172.21.15.60:0/1120360075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c100a60 0x7f680c100e40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 --2- 172.21.15.60:0/1120360075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c101410 0x7f680c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 -- 172.21.15.60:0/1120360075 >> 172.21.15.60:0/1120360075 conn(0x7f680c0762e0 msgr2=0x7f680c0766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 -- 172.21.15.60:0/1120360075 shutdown_connections 2023-10-05T15:30:49.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.769+0000 7f6812c85700 1 -- 172.21.15.60:0/1120360075 wait complete. 2023-10-05T15:30:49.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.770+0000 7f6812c85700 1 Processor -- start 2023-10-05T15:30:49.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.770+0000 7f6812c85700 1 -- start start 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.770+0000 7f6812c85700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c100a60 0x7f680c1a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.770+0000 7f6812c85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c105150 0x7f680c1a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.770+0000 7f6812c85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c10daf0 0x7f680c10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6812c85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c10e5f0 con 0x7f680c10daf0 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6812c85700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c10e760 con 0x7f680c105150 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6812c85700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c10e920 con 0x7f680c100a60 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6810a21700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c100a60 0x7f680c1a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6810a21700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c100a60 0x7f680c1a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55870/0 (socket says 172.21.15.60:55870) 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6810a21700 1 -- 172.21.15.60:0/1480091410 learned_addr learned my addr 172.21.15.60:0/1480091410 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6811222700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c10daf0 0x7f680c10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f680bfff700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c105150 0x7f680c1a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6811222700 1 -- 172.21.15.60:0/1480091410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c100a60 msgr2=0x7f680c1a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6811222700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c100a60 0x7f680c1a36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6811222700 1 -- 172.21.15.60:0/1480091410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c105150 msgr2=0x7f680c1a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.771+0000 7f6811222700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c105150 0x7f680c1a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.772+0000 7f6811222700 1 -- 172.21.15.60:0/1480091410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000095f0 con 0x7f680c10daf0 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.772+0000 7f6811222700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c10daf0 0x7f680c10dfa0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f680400be20 tx=0x7f6804009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.772+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400cb90 con 0x7f680c10daf0 2023-10-05T15:30:49.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.772+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f680400ccf0 con 0x7f680c10daf0 2023-10-05T15:30:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.772+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6804012670 con 0x7f680c10daf0 2023-10-05T15:30:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.774+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c06a990 con 0x7f680c10daf0 2023-10-05T15:30:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.774+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c06ae20 con 0x7f680c10daf0 2023-10-05T15:30:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.775+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c076e00 con 0x7f680c10daf0 2023-10-05T15:30:49.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.778+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6804014440 con 0x7f680c10daf0 2023-10-05T15:30:49.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.779+0000 7f6809ffb700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67fc0a1780 0x7f67fc0a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:49.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.779+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f6804006e40 con 0x7f680c10daf0 2023-10-05T15:30:49.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.779+0000 7f6810a21700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67fc0a1780 0x7f67fc0a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:49.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.780+0000 7f6810a21700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67fc0a1780 0x7f67fc0a3c40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f680000b790 tx=0x7f680000b260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:49.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:49.785+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6804096170 con 0x7f680c10daf0 2023-10-05T15:30:49.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:49 smithi135 ceph-mon[103360]: pgmap v444: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 507 KiB/s wr, 121 op/s 2023-10-05T15:30:49.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:49 smithi060 ceph-mon[99238]: pgmap v444: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 507 KiB/s wr, 121 op/s 2023-10-05T15:30:49.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:49 smithi092 ceph-mon[102944]: pgmap v444: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 507 KiB/s wr, 121 op/s 2023-10-05T15:30:50.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.219+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 --> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f680c101520 con 0x7f67fc0a1780 2023-10-05T15:30:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.342+0000 7f6809ffb700 1 -- 172.21.15.60:0/1480091410 <== mgr.15663 v2:172.21.15.60:6800/139103647 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f680c101520 con 0x7f67fc0a1780 2023-10-05T15:30:50.346 INFO:teuthology.orchestra.run.smithi060.stdout:/ 1m 6m3h 2023-10-05T15:30:50.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.358+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67fc0a1780 msgr2=0x7f67fc0a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:50.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.358+0000 7f6812c85700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67fc0a1780 0x7f67fc0a3c40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f680000b790 tx=0x7f680000b260 comp rx=0 tx=0).stop 2023-10-05T15:30:50.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.358+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c10daf0 msgr2=0x7f680c10dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:50.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.358+0000 7f6812c85700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c10daf0 0x7f680c10dfa0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f680400be20 tx=0x7f6804009ed0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.362+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 shutdown_connections 2023-10-05T15:30:50.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.362+0000 7f6812c85700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f680c10daf0 0x7f680c10dfa0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.362+0000 7f6812c85700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f680c100a60 0x7f680c1a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.362+0000 7f6812c85700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f67fc0a1780 0x7f67fc0a3c40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.363+0000 7f6812c85700 1 --2- 172.21.15.60:0/1480091410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680c105150 0x7f680c1a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.363+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 >> 172.21.15.60:0/1480091410 conn(0x7f680c0762e0 msgr2=0x7f680c0fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:50.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.371+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 shutdown_connections 2023-10-05T15:30:50.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.377+0000 7f6812c85700 1 -- 172.21.15.60:0/1480091410 wait complete. 2023-10-05T15:30:50.416 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-05T15:30:50.428 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-05T15:30:50.428 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-05T15:30:50.429 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-05T15:30:50.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:30:50.575 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:30:50 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:30:50.270+0000 7f27d023a700 -1 calc_pg_upmaps abort due to max <= 0 2023-10-05T15:30:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.835+0000 7f916a10e700 1 -- 172.21.15.60:0/216565049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91641075d0 msgr2=0x7f9164107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.835+0000 7f916a10e700 1 --2- 172.21.15.60:0/216565049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91641075d0 0x7f9164107a30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b0d0 tx=0x7f915c00b3e0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.844+0000 7f916a10e700 1 -- 172.21.15.60:0/216565049 shutdown_connections 2023-10-05T15:30:50.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.844+0000 7f916a10e700 1 --2- 172.21.15.60:0/216565049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9164107f70 0x7f9164114380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.844+0000 7f916a10e700 1 --2- 172.21.15.60:0/216565049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f916410d600 0x7f916410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.844+0000 7f916a10e700 1 --2- 172.21.15.60:0/216565049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91641075d0 0x7f9164107a30 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.844+0000 7f916a10e700 1 -- 172.21.15.60:0/216565049 >> 172.21.15.60:0/216565049 conn(0x7f9164076d50 msgr2=0x7f9164105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:50.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.854+0000 7f916a10e700 1 -- 172.21.15.60:0/216565049 shutdown_connections 2023-10-05T15:30:50.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.855+0000 7f916a10e700 1 -- 172.21.15.60:0/216565049 wait complete. 2023-10-05T15:30:50.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.856+0000 7f916a10e700 1 Processor -- start 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 -- start start 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 0x7f916406b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9164107f70 0x7f916406b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916410d600 0x7f91641a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91641a1080 con 0x7f916410d600 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91641a11f0 con 0x7f91641075d0 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f916a10e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91641a13b0 con 0x7f9164107f70 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f91637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 0x7f916406b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f91637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 0x7f916406b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55776/0 (socket says 172.21.15.60:55776) 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f91637fe700 1 -- 172.21.15.60:0/246139239 learned_addr learned my addr 172.21.15.60:0/246139239 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.857+0000 7f9162ffd700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9164107f70 0x7f916406b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.858+0000 7f91637fe700 1 -- 172.21.15.60:0/246139239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9164107f70 msgr2=0x7f916406b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:50.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.858+0000 7f91637fe700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9164107f70 0x7f916406b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.858+0000 7f91637fe700 1 -- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916410d600 msgr2=0x7f91641a0b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:30:50.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.858+0000 7f91637fe700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916410d600 0x7f91641a0b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:50.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.858+0000 7f91637fe700 1 -- 172.21.15.60:0/246139239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009d00 con 0x7f91641075d0 2023-10-05T15:30:50.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.858+0000 7f91637fe700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 0x7f916406b350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f915800b550 tx=0x7f915800b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:50.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.863+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158011830 con 0x7f91641075d0 2023-10-05T15:30:50.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.863+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9158011e50 con 0x7f91641075d0 2023-10-05T15:30:50.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.863+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800f2e0 con 0x7f91641075d0 2023-10-05T15:30:50.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.864+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91641a1630 con 0x7f91641075d0 2023-10-05T15:30:50.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.864+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91641a1ac0 con 0x7f91641075d0 2023-10-05T15:30:50.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.869+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9164068120 con 0x7f91641075d0 2023-10-05T15:30:50.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.873+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9158011990 con 0x7f91641075d0 2023-10-05T15:30:50.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.874+0000 7f9160ff9700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f914c0a1800 0x7f914c0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:50.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.875+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f91580ccfd0 con 0x7f91641075d0 2023-10-05T15:30:50.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.877+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9158096010 con 0x7f91641075d0 2023-10-05T15:30:50.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.878+0000 7f9162ffd700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f914c0a1800 0x7f914c0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:50.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:50.884+0000 7f9162ffd700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f914c0a1800 0x7f914c0a3cc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f916406c910 tx=0x7f915c00b040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:50.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:50 smithi060 ceph-mon[99238]: from='client.26762 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:50.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:50 smithi092 ceph-mon[102944]: from='client.26762 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:51.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:50 smithi135 ceph-mon[103360]: from='client.26762 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:51.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.246+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f916406c650 con 0x7f91641075d0 2023-10-05T15:30:51.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.254+0000 7f9160ff9700 1 -- 172.21.15.60:0/246139239 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+25210 (secure 0 0 0) 0x7f9158015070 con 0x7f91641075d0 2023-10-05T15:30:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:30:51.265 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":113,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:30:26.677081+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/3221256091":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/3008673646":"2023-10-06T15:16:49.530067+0000","172.21.15.60:6801/3043189857":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/3001974532":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/303168486":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6800/3043189857":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":7,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:30:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.265+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f914c0a1800 msgr2=0x7f914c0a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.265+0000 7f916a10e700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f914c0a1800 0x7f914c0a3cc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f916406c910 tx=0x7f915c00b040 comp rx=0 tx=0).stop 2023-10-05T15:30:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.265+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 msgr2=0x7f916406b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.265+0000 7f916a10e700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 0x7f916406b350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f915800b550 tx=0x7f915800b860 comp rx=0 tx=0).stop 2023-10-05T15:30:51.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.268+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 shutdown_connections 2023-10-05T15:30:51.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.268+0000 7f916a10e700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916410d600 0x7f91641a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.268+0000 7f916a10e700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f914c0a1800 0x7f914c0a3cc0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f916406c910 tx=0x7f915c00b040 comp rx=0 tx=0).stop 2023-10-05T15:30:51.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.268+0000 7f916a10e700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91641075d0 0x7f916406b350 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f915800b550 tx=0x7f915800b860 comp rx=0 tx=0).stop 2023-10-05T15:30:51.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.268+0000 7f916a10e700 1 --2- 172.21.15.60:0/246139239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9164107f70 0x7f916406b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.268+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 >> 172.21.15.60:0/246139239 conn(0x7f9164076d50 msgr2=0x7f916410e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:51.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.280+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 shutdown_connections 2023-10-05T15:30:51.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.288+0000 7f916a10e700 1 -- 172.21.15.60:0/246139239 wait complete. 2023-10-05T15:30:51.318 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:30:51.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:30:51.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:51 smithi060 ceph-mon[99238]: from='client.17103 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:51.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:51 smithi060 ceph-mon[99238]: pgmap v445: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 503 KiB/s wr, 103 op/s 2023-10-05T15:30:51.615 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:51 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/246139239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:30:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.611+0000 7f03377e4700 1 -- 172.21.15.60:0/1867483582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033010f640 msgr2=0x7f0330107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.611+0000 7f03377e4700 1 --2- 172.21.15.60:0/1867483582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033010f640 0x7f0330107eb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f032c009990 tx=0x7f032c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.620+0000 7f03377e4700 1 -- 172.21.15.60:0/1867483582 shutdown_connections 2023-10-05T15:30:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.620+0000 7f03377e4700 1 --2- 172.21.15.60:0/1867483582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033011a690 0x7f033011ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.620+0000 7f03377e4700 1 --2- 172.21.15.60:0/1867483582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033010f640 0x7f0330107eb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.620+0000 7f03377e4700 1 --2- 172.21.15.60:0/1867483582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03301083f0 0x7f0330108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.620+0000 7f03377e4700 1 -- 172.21.15.60:0/1867483582 >> 172.21.15.60:0/1867483582 conn(0x7f033006d1a0 msgr2=0x7f033006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.629+0000 7f03377e4700 1 -- 172.21.15.60:0/1867483582 shutdown_connections 2023-10-05T15:30:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.633+0000 7f03377e4700 1 -- 172.21.15.60:0/1867483582 wait complete. 2023-10-05T15:30:51.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.634+0000 7f03377e4700 1 Processor -- start 2023-10-05T15:30:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 -- start start 2023-10-05T15:30:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03301083f0 0x7f0330113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033010f640 0x7f0330113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f033011a690 0x7f03301184a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:51.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330118af0 con 0x7f03301083f0 2023-10-05T15:30:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330118c60 con 0x7f033011a690 2023-10-05T15:30:51.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f03377e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330118e20 con 0x7f033010f640 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f0334d7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033010f640 0x7f0330113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f0334d7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033010f640 0x7f0330113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55900/0 (socket says 172.21.15.60:55900) 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f0334d7f700 1 -- 172.21.15.60:0/2967409008 learned_addr learned my addr 172.21.15.60:0/2967409008 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f0335d81700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f033011a690 0x7f03301184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.640+0000 7f0335580700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03301083f0 0x7f0330113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335580700 1 -- 172.21.15.60:0/2967409008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033010f640 msgr2=0x7f0330113fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335580700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033010f640 0x7f0330113fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335580700 1 -- 172.21.15.60:0/2967409008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f033011a690 msgr2=0x7f03301184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335580700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f033011a690 0x7f03301184a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335580700 1 -- 172.21.15.60:0/2967409008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0095f0 con 0x7f03301083f0 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335d81700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f033011a690 0x7f03301184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.641+0000 7f0335580700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03301083f0 0x7f0330113a90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f032c006010 tx=0x7f032c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.642+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c01d070 con 0x7f03301083f0 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.642+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03301190a0 con 0x7f03301083f0 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.642+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f032c021410 con 0x7f03301083f0 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.642+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c017650 con 0x7f03301083f0 2023-10-05T15:30:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.642+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03301bb4c0 con 0x7f03301083f0 2023-10-05T15:30:51.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.644+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0330067c60 con 0x7f03301083f0 2023-10-05T15:30:51.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.645+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f032c0177b0 con 0x7f03301083f0 2023-10-05T15:30:51.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.646+0000 7f03267fc700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f031c0a1670 0x7f031c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:51.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.646+0000 7f0334d7f700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f031c0a1670 0x7f031c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:51.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.646+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f032c0ce860 con 0x7f03301083f0 2023-10-05T15:30:51.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.646+0000 7f0334d7f700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f031c0a1670 0x7f031c0a3b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03301150a0 tx=0x7f0320009260 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:51.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:51.660+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f032c098740 con 0x7f03301083f0 2023-10-05T15:30:51.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:51 smithi092 ceph-mon[102944]: from='client.17103 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:51.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:51 smithi092 ceph-mon[102944]: pgmap v445: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 503 KiB/s wr, 103 op/s 2023-10-05T15:30:51.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:51 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/246139239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:30:52.027 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:30:52.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.025+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03301105e0 con 0x7f03301083f0 2023-10-05T15:30:52.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.025+0000 7f03267fc700 1 -- 172.21.15.60:0/2967409008 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f032c0260a0 con 0x7f03301083f0 2023-10-05T15:30:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.033+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f031c0a1670 msgr2=0x7f031c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.033+0000 7f03377e4700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f031c0a1670 0x7f031c0a3b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03301150a0 tx=0x7f0320009260 comp rx=0 tx=0).stop 2023-10-05T15:30:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.033+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03301083f0 msgr2=0x7f0330113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.033+0000 7f03377e4700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03301083f0 0x7f0330113a90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f032c006010 tx=0x7f032c005740 comp rx=0 tx=0).stop 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 shutdown_connections 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f031c0a1670 0x7f031c0a3b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f033011a690 0x7f03301184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03301083f0 0x7f0330113a90 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 --2- 172.21.15.60:0/2967409008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f033010f640 0x7f0330113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 >> 172.21.15.60:0/2967409008 conn(0x7f033006d1a0 msgr2=0x7f033011aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 shutdown_connections 2023-10-05T15:30:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.034+0000 7f03377e4700 1 -- 172.21.15.60:0/2967409008 wait complete. 2023-10-05T15:30:52.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:51 smithi135 ceph-mon[103360]: from='client.17103 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:52.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:51 smithi135 ceph-mon[103360]: pgmap v445: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 503 KiB/s wr, 103 op/s 2023-10-05T15:30:52.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:51 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/246139239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:30:52.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:30:52.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.393+0000 7f783e254700 1 -- 172.21.15.60:0/1481367124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78380ffeb0 msgr2=0x7f783810c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:52.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.393+0000 7f783e254700 1 --2- 172.21.15.60:0/1481367124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78380ffeb0 0x7f783810c370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f783000b140 tx=0x7f783000b450 comp rx=0 tx=0).stop 2023-10-05T15:30:52.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 -- 172.21.15.60:0/1481367124 shutdown_connections 2023-10-05T15:30:52.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 --2- 172.21.15.60:0/1481367124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78380ffeb0 0x7f783810c370 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 --2- 172.21.15.60:0/1481367124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78381055b0 0x7f7838105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 --2- 172.21.15.60:0/1481367124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78380ff4f0 0x7f78380ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 -- 172.21.15.60:0/1481367124 >> 172.21.15.60:0/1481367124 conn(0x7f7838077330 msgr2=0x7f78380fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:52.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 -- 172.21.15.60:0/1481367124 shutdown_connections 2023-10-05T15:30:52.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.394+0000 7f783e254700 1 -- 172.21.15.60:0/1481367124 wait complete. 2023-10-05T15:30:52.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.395+0000 7f783e254700 1 Processor -- start 2023-10-05T15:30:52.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.395+0000 7f783e254700 1 -- start start 2023-10-05T15:30:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f783e254700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78380ff4f0 0x7f783806c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f783e254700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78380ffeb0 0x7f783806c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f783e254700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78381055b0 0x7f7838070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f783e254700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380713b0 con 0x7f78380ffeb0 2023-10-05T15:30:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f783e254700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380714f0 con 0x7f78381055b0 2023-10-05T15:30:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f783e254700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380716b0 con 0x7f78380ff4f0 2023-10-05T15:30:52.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f7837fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78381055b0 0x7f7838070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:52.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f78377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78380ff4f0 0x7f783806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:52.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f7837fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78381055b0 0x7f7838070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55800/0 (socket says 172.21.15.60:55800) 2023-10-05T15:30:52.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f7837fff700 1 -- 172.21.15.60:0/389029230 learned_addr learned my addr 172.21.15.60:0/389029230 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f78377fe700 1 -- 172.21.15.60:0/389029230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78381055b0 msgr2=0x7f7838070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f78377fe700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78381055b0 0x7f7838070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f78377fe700 1 -- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78380ffeb0 msgr2=0x7f783806c980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f78377fe700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78380ffeb0 0x7f783806c980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.396+0000 7f78377fe700 1 -- 172.21.15.60:0/389029230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783000ad20 con 0x7f78380ff4f0 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.397+0000 7f78377fe700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78380ff4f0 0x7f783806c440 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f782800bb20 tx=0x7f782800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.397+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280098d0 con 0x7f78380ff4f0 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.397+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f782800d400 con 0x7f78380ff4f0 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.397+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828016db0 con 0x7f78380ff4f0 2023-10-05T15:30:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.398+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7838071990 con 0x7f78380ff4f0 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.398+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838071c40 con 0x7f78380ff4f0 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.399+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78380673d0 con 0x7f78380ff4f0 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.402+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7828014070 con 0x7f78380ff4f0 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.404+0000 7f7834ff9700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f78200a1800 0x7f78200a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.404+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f78280ccdc0 con 0x7f78380ff4f0 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.406+0000 7f7836ffd700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f78200a1800 0x7f78200a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.407+0000 7f7836ffd700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f78200a1800 0x7f78200a3cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7838071e50 tx=0x7f782c006c60 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.408+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7828095cf0 con 0x7f78380ff4f0 2023-10-05T15:30:52.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.807+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7838073070 con 0x7f78380ff4f0 2023-10-05T15:30:52.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.818+0000 7f7834ff9700 1 -- 172.21.15.60:0/389029230 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7828024020 con 0x7f78380ff4f0 2023-10-05T15:30:52.824 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.829+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f78200a1800 msgr2=0x7f78200a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.829+0000 7f783e254700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f78200a1800 0x7f78200a3cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7838071e50 tx=0x7f782c006c60 comp rx=0 tx=0).stop 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78380ff4f0 msgr2=0x7f783806c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78380ff4f0 0x7f783806c440 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f782800bb20 tx=0x7f782800be30 comp rx=0 tx=0).stop 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 shutdown_connections 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f78200a1800 0x7f78200a3cc0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7838071e50 tx=0x7f782c006c60 comp rx=0 tx=0).stop 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78381055b0 0x7f7838070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78380ff4f0 0x7f783806c440 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f782800bb20 tx=0x7f782800be30 comp rx=0 tx=0).stop 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 --2- 172.21.15.60:0/389029230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78380ffeb0 0x7f783806c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.830+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 >> 172.21.15.60:0/389029230 conn(0x7f7838077330 msgr2=0x7f78380fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.837+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 shutdown_connections 2023-10-05T15:30:52.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:52.839+0000 7f783e254700 1 -- 172.21.15.60:0/389029230 wait complete. 2023-10-05T15:30:52.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:30:52.997 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:52 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/2967409008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:30:52.998 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:52 smithi060 ceph-mon[99238]: pgmap v446: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 505 KiB/s wr, 103 op/s 2023-10-05T15:30:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:52 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/2967409008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:30:53.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:52 smithi135 ceph-mon[103360]: pgmap v446: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 505 KiB/s wr, 103 op/s 2023-10-05T15:30:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:52 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/2967409008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:30:53.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:52 smithi092 ceph-mon[102944]: pgmap v446: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 505 KiB/s wr, 103 op/s 2023-10-05T15:30:53.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.185+0000 7f0cd6a11700 1 -- 172.21.15.60:0/2774003285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 msgr2=0x7f0cd00ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:53.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.185+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/2774003285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd00ff970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001af80 tx=0x7f0cc001d440 comp rx=0 tx=0).stop 2023-10-05T15:30:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.191+0000 7f0cd6a11700 1 -- 172.21.15.60:0/2774003285 shutdown_connections 2023-10-05T15:30:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.191+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/2774003285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cd00ffeb0 0x7f0cd010c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.191+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/2774003285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd01055b0 0x7f0cd0105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.191+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/2774003285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd00ff970 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.191+0000 7f0cd6a11700 1 -- 172.21.15.60:0/2774003285 >> 172.21.15.60:0/2774003285 conn(0x7f0cd0077330 msgr2=0x7f0cd00fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.202+0000 7f0cd6a11700 1 -- 172.21.15.60:0/2774003285 shutdown_connections 2023-10-05T15:30:53.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.207+0000 7f0cd6a11700 1 -- 172.21.15.60:0/2774003285 wait complete. 2023-10-05T15:30:53.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.208+0000 7f0cd6a11700 1 Processor -- start 2023-10-05T15:30:53.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.208+0000 7f0cd6a11700 1 -- start start 2023-10-05T15:30:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0cd6a11700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd010c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0cd6a11700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd00ffeb0 0x7f0cd006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0cd6a11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cd01055b0 0x7f0cd006c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0cd6a11700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd006c760 con 0x7f0cd01055b0 2023-10-05T15:30:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0cd6a11700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd006c8d0 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0cd6a11700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0194bf0 con 0x7f0cd00ffeb0 2023-10-05T15:30:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0ccf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd00ffeb0 0x7f0cd006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd010c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0ccf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd00ffeb0 0x7f0cd006bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:55920/0 (socket says 172.21.15.60:55920) 2023-10-05T15:30:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.209+0000 7f0ccf7fe700 1 -- 172.21.15.60:0/1429557567 learned_addr learned my addr 172.21.15.60:0/1429557567 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0cd4fae700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cd01055b0 0x7f0cd006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0ccffff700 1 -- 172.21.15.60:0/1429557567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd00ffeb0 msgr2=0x7f0cd006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0ccffff700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd00ffeb0 0x7f0cd006bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0ccffff700 1 -- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cd01055b0 msgr2=0x7f0cd006c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0ccffff700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cd01055b0 0x7f0cd006c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0ccffff700 1 -- 172.21.15.60:0/1429557567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc001e040 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.210+0000 7f0ccffff700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd010c230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800d950 tx=0x7f0cb800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:53.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.212+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8009b40 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.213+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cb800be10 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.213+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800f620 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.213+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd0194ed0 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.213+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd0195390 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.215+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb00052f0 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.241+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0cb8009ca0 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.241+0000 7f0ccd7fa700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0cbc0a17c0 0x7f0cbc0a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:53.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.242+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7f0cb80cd950 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.242+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0cb80fa1a0 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.244+0000 7f0ccf7fe700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0cbc0a17c0 0x7f0cbc0a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:53.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.244+0000 7f0ccf7fe700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0cbc0a17c0 0x7f0cbc0a3c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001d880 tx=0x7f0cc001c040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.628+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cb0005b20 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.633+0000 7f0ccd7fa700 1 -- 172.21.15.60:0/1429557567 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cb8017020 con 0x7f0cd00ff4f0 2023-10-05T15:30:53.644 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:30:53.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.645+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0cbc0a17c0 msgr2=0x7f0cbc0a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:53.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.645+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0cbc0a17c0 0x7f0cbc0a3c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001d880 tx=0x7f0cc001c040 comp rx=0 tx=0).stop 2023-10-05T15:30:53.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.645+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 msgr2=0x7f0cd010c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:53.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.645+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd010c230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800d950 tx=0x7f0cb800dd10 comp rx=0 tx=0).stop 2023-10-05T15:30:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.653+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 shutdown_connections 2023-10-05T15:30:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.653+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cd01055b0 0x7f0cd006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.653+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f0cbc0a17c0 0x7f0cbc0a3c80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.653+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cd00ff4f0 0x7f0cd010c230 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.653+0000 7f0cd6a11700 1 --2- 172.21.15.60:0/1429557567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd00ffeb0 0x7f0cd006bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.653+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 >> 172.21.15.60:0/1429557567 conn(0x7f0cd0077330 msgr2=0x7f0cd00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:53.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.663+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 shutdown_connections 2023-10-05T15:30:53.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:53.664+0000 7f0cd6a11700 1 -- 172.21.15.60:0/1429557567 wait complete. 2023-10-05T15:30:53.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 -- 172.21.15.60:0/3629563259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8111be0 msgr2=0x7fdbb8114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/3629563259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8111be0 0x7fdbb8114030 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009990 tx=0x7fdbac009ca0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 -- 172.21.15.60:0/3629563259 shutdown_connections 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/3629563259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8111be0 0x7fdbb8114030 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/3629563259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb80ff930 0x7fdbb80ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/3629563259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb8100250 0x7fdbb8111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.010+0000 7fdbbdff0700 1 -- 172.21.15.60:0/3629563259 >> 172.21.15.60:0/3629563259 conn(0x7fdbb80761d0 msgr2=0x7fdbb80765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:54.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.019+0000 7fdbbdff0700 1 -- 172.21.15.60:0/3629563259 shutdown_connections 2023-10-05T15:30:54.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.027+0000 7fdbbdff0700 1 -- 172.21.15.60:0/3629563259 wait complete. 2023-10-05T15:30:54.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.027+0000 7fdbbdff0700 1 Processor -- start 2023-10-05T15:30:54.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 -- start start 2023-10-05T15:30:54.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80ff930 0x7fdbb8072710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8100250 0x7fdbb806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 0x7fdbb806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb806e180 con 0x7fdbb80ff930 2023-10-05T15:30:54.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb806e2f0 con 0x7fdbb8111be0 2023-10-05T15:30:54.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbbdff0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb806e4b0 con 0x7fdbb8100250 2023-10-05T15:30:54.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 0x7fdbb806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:54.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 0x7fdbb806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55824/0 (socket says 172.21.15.60:55824) 2023-10-05T15:30:54.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.029+0000 7fdbb7fff700 1 -- 172.21.15.60:0/403504903 learned_addr learned my addr 172.21.15.60:0/403504903 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb7fff700 1 -- 172.21.15.60:0/403504903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8100250 msgr2=0x7fdbb806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb7fff700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8100250 0x7fdbb806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb7fff700 1 -- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80ff930 msgr2=0x7fdbb8072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb7fff700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80ff930 0x7fdbb8072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb7fff700 1 -- 172.21.15.60:0/403504903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0095f0 con 0x7fdbb8111be0 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb7fff700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 0x7fdbb806dc40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00f690 tx=0x7fdbac00f770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac01d070 con 0x7fdbb8111be0 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbac021410 con 0x7fdbb8111be0 2023-10-05T15:30:54.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.030+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac017650 con 0x7fdbb8111be0 2023-10-05T15:30:54.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.031+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb810de50 con 0x7fdbb8111be0 2023-10-05T15:30:54.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.031+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb810e330 con 0x7fdbb8111be0 2023-10-05T15:30:54.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.035+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdbac00fad0 con 0x7fdbb8111be0 2023-10-05T15:30:54.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.036+0000 7fdbb4ff9700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdba00a1730 0x7fdba00a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.036+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7fdbac0ce2d0 con 0x7fdbb8111be0 2023-10-05T15:30:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.038+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb80680b0 con 0x7fdbb8111be0 2023-10-05T15:30:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.041+0000 7fdbb77fe700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdba00a1730 0x7fdba00a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.041+0000 7fdbb77fe700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdba00a1730 0x7fdba00a3bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000ab90 tx=0x7fdbb0009250 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.046+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdbac097210 con 0x7fdbb8111be0 2023-10-05T15:30:54.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:53 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/389029230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:30:54.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:53 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1429557567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:30:54.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/389029230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:30:54.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:53 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1429557567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:30:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:53 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/389029230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:30:54.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:53 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1429557567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:30:54.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.414+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdbb806ec30 con 0x7fdbb8111be0 2023-10-05T15:30:54.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.431+0000 7fdbb4ff9700 1 -- 172.21.15.60:0/403504903 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v113) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdbac026070 con 0x7fdbb8111be0 2023-10-05T15:30:54.441 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:30:54.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.452+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdba00a1730 msgr2=0x7fdba00a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.452+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdba00a1730 0x7fdba00a3bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000ab90 tx=0x7fdbb0009250 comp rx=0 tx=0).stop 2023-10-05T15:30:54.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.452+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 msgr2=0x7fdbb806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.452+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 0x7fdbb806dc40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00f690 tx=0x7fdbac00f770 comp rx=0 tx=0).stop 2023-10-05T15:30:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.461+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 shutdown_connections 2023-10-05T15:30:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.461+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fdba00a1730 0x7fdba00a3bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.461+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbb8111be0 0x7fdbb806dc40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.461+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80ff930 0x7fdbb8072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.461+0000 7fdbbdff0700 1 --2- 172.21.15.60:0/403504903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb8100250 0x7fdbb806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.461+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 >> 172.21.15.60:0/403504903 conn(0x7fdbb80761d0 msgr2=0x7fdbb80fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:54.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.473+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 shutdown_connections 2023-10-05T15:30:54.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.474+0000 7fdbbdff0700 1 -- 172.21.15.60:0/403504903 wait complete. 2023-10-05T15:30:54.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-05T15:30:54.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.830+0000 7fef6e94d700 1 -- 172.21.15.60:0/2944789411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6810f640 msgr2=0x7fef68107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.831+0000 7fef6e94d700 1 --2- 172.21.15.60:0/2944789411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6810f640 0x7fef68107eb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fef580098f0 tx=0x7fef58009c00 comp rx=0 tx=0).stop 2023-10-05T15:30:54.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.831+0000 7fef6e94d700 1 -- 172.21.15.60:0/2944789411 shutdown_connections 2023-10-05T15:30:54.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.831+0000 7fef6e94d700 1 --2- 172.21.15.60:0/2944789411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef6811a690 0x7fef6811ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.831+0000 7fef6e94d700 1 --2- 172.21.15.60:0/2944789411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6810f640 0x7fef68107eb0 secure :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fef580098f0 tx=0x7fef58009c00 comp rx=0 tx=0).stop 2023-10-05T15:30:54.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.831+0000 7fef6e94d700 1 --2- 172.21.15.60:0/2944789411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef681083f0 0x7fef68108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.831+0000 7fef6e94d700 1 -- 172.21.15.60:0/2944789411 >> 172.21.15.60:0/2944789411 conn(0x7fef6806bf20 msgr2=0x7fef6806c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:54.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.834+0000 7fef6e94d700 1 -- 172.21.15.60:0/2944789411 shutdown_connections 2023-10-05T15:30:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.839+0000 7fef6e94d700 1 -- 172.21.15.60:0/2944789411 wait complete. 2023-10-05T15:30:54.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.839+0000 7fef6e94d700 1 Processor -- start 2023-10-05T15:30:54.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 -- start start 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef681083f0 0x7fef68115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 0x7fef68116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681a2390 0x7fef681a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681a2ea0 con 0x7fef6811a690 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681a3010 con 0x7fef681a2390 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef6e94d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681a31d0 con 0x7fef681083f0 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 0x7fef68116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 0x7fef68116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42418/0 (socket says 172.21.15.60:42418) 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.840+0000 7fef677fe700 1 -- 172.21.15.60:0/1348433464 learned_addr learned my addr 172.21.15.60:0/1348433464 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:30:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef677fe700 1 -- 172.21.15.60:0/1348433464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef681083f0 msgr2=0x7fef68115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef677fe700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef681083f0 0x7fef68115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef677fe700 1 -- 172.21.15.60:0/1348433464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681a2390 msgr2=0x7fef681a2840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef677fe700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681a2390 0x7fef681a2840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef677fe700 1 -- 172.21.15.60:0/1348433464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58009520 con 0x7fef6811a690 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef677fe700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 0x7fef68116330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b560 tx=0x7fef5c00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c011830 con 0x7fef6811a690 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef5c011e50 con 0x7fef6811a690 2023-10-05T15:30:54.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.841+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00f2e0 con 0x7fef6811a690 2023-10-05T15:30:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.851+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef681aa6f0 con 0x7fef6811a690 2023-10-05T15:30:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.851+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef681aab80 con 0x7fef6811a690 2023-10-05T15:30:54.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.865+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fef5c0105f0 con 0x7fef6811a690 2023-10-05T15:30:54.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.866+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef68067cd0 con 0x7fef6811a690 2023-10-05T15:30:54.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.866+0000 7fef657fa700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fef500a16f0 0x7fef500a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:54.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.866+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9559+0+0 (secure 0 0 0) 0x7fef5c0cce80 con 0x7fef6811a690 2023-10-05T15:30:54.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.874+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fef5c095ea0 con 0x7fef6811a690 2023-10-05T15:30:54.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.884+0000 7fef67fff700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fef500a16f0 0x7fef500a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:54.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:54.884+0000 7fef67fff700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fef500a16f0 0x7fef500a3bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef58009fd0 tx=0x7fef580058e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:54 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/403504903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:30:55.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:54 smithi135 ceph-mon[103360]: pgmap v447: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 505 KiB/s wr, 111 op/s 2023-10-05T15:30:55.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:54 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/403504903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:30:55.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:54 smithi060 ceph-mon[99238]: pgmap v447: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 505 KiB/s wr, 111 op/s 2023-10-05T15:30:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:54 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/403504903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:30:55.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:54 smithi092 ceph-mon[102944]: pgmap v447: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 505 KiB/s wr, 111 op/s 2023-10-05T15:30:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.353+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fef68112540 con 0x7fef6811a690 2023-10-05T15:30:55.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.367+0000 7fef657fa700 1 -- 172.21.15.60:0/1348433464 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) v1 ==== 81+0+734406 (secure 0 0 0) 0x7fef5c015090 con 0x7fef6811a690 2023-10-05T15:30:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:30:55.382 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:30:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 26, 2023-10-05T15:30:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "active_gid": 15663, 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "active_name": "x", 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "active_addrs": { 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 139103647 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 139103647 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "active_addr": "172.21.15.60:6801/139103647", 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "active_change": "2023-10-05T15:16:49.530297+0000", 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "active_mgr_features": 4540138322906710015, 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "available": true, 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "standbys": [ 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "gid": 15654, 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "z", 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_features": 4540138322906710015, 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2023-10-05T15:30:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2023-10-05T15:30:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-05T15:30:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2023-10-05T15:30:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2023-10-05T15:30:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2023-10-05T15:30:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2023-10-05T15:30:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2023-10-05T15:30:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap" 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2023-10-05T15:30:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2023-10-05T15:30:55.436 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2023-10-05T15:30:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2023-10-05T15:30:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2023-10-05T15:30:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2023-10-05T15:30:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2023-10-05T15:30:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2023-10-05T15:30:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2023-10-05T15:30:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2023-10-05T15:30:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2023-10-05T15:30:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2023-10-05T15:30:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-05T15:30:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-05T15:30:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-05T15:30:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-05T15:30:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2023-10-05T15:30:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-05T15:30:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-05T15:30:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-05T15:30:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.540 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.541 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.542 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.543 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-05T15:30:55.544 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.545 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.546 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.547 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-05T15:30:55.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.549 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.550 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "UNSAFE_TLS_v1_2": { 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.551 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.552 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-05T15:30:55.553 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-05T15:30:55.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.554 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.554 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.554 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.554 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.554 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.555 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.555 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.555 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.555 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.555 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.556 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.557 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.557 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.557 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2023-10-05T15:30:55.557 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2023-10-05T15:30:55.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.558 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.558 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.558 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.558 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.559 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.559 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.559 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.559 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.559 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.559 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.560 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2023-10-05T15:30:55.560 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2023-10-05T15:30:55.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.560 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.560 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2023-10-05T15:30:55.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.564 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.565 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.566 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.567 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.570 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.572 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.573 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.574 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.575 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2023-10-05T15:30:55.576 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2023-10-05T15:30:55.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.576 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.576 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.576 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.577 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.578 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2023-10-05T15:30:55.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2023-10-05T15:30:55.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.578 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2023-10-05T15:30:55.579 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.593 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.594 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2023-10-05T15:30:55.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.596 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.597 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-05T15:30:55.598 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.599 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.602 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.603 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.604 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.605 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.606 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.607 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.608 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2023-10-05T15:30:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.610 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2023-10-05T15:30:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.614 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2023-10-05T15:30:55.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2023-10-05T15:30:55.616 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.617 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.618 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.619 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.619 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.619 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.619 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.620 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.620 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.620 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.620 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.620 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.620 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.621 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.621 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.621 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.621 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.621 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.621 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.622 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.623 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.623 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.623 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.623 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.623 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.624 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.625 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.625 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.625 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.625 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.625 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.626 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.627 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.629 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2023-10-05T15:30:55.630 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.632 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2023-10-05T15:30:55.633 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.634 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.636 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.637 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.638 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.639 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.640 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2023-10-05T15:30:55.641 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.642 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.643 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.645 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.649 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.655 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.656 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.658 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.660 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.661 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2023-10-05T15:30:55.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.664 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.665 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.666 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.667 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.669 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.670 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.671 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.672 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.675 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.676 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.733 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.735 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2023-10-05T15:30:55.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:55.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2023-10-05T15:30:55.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.740 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.741 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.742 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.743 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.744 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-05T15:30:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2023-10-05T15:30:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2023-10-05T15:30:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2023-10-05T15:30:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.762 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.764 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.765 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.766 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2023-10-05T15:30:55.767 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.768 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.769 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.772 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.774 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.775 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.776 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.777 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "drive_group_interval": { 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "drive_group_interval", 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.793 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300.0", 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.794 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.795 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.796 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.797 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2023-10-05T15:30:55.801 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.802 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.804 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.805 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.806 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.807 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.808 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.809 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.810 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.811 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.812 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2023-10-05T15:30:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.815 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.816 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.817 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.818 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.820 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.822 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.824 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.825 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.826 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.827 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2023-10-05T15:30:55.828 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.831 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.833 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.835 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.836 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.837 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.838 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.840 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.841 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.842 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.843 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.846 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.849 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.850 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.852 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.853 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2023-10-05T15:30:55.854 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.856 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.858 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.859 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.860 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.861 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2023-10-05T15:30:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2023-10-05T15:30:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2023-10-05T15:30:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2023-10-05T15:30:55.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.878 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.879 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.881 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.883 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.884 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.886 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.887 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.890 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.891 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.895 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.896 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.900 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.901 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.903 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.904 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.906 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.907 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-05T15:30:55.909 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2023-10-05T15:30:55.910 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.912 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.913 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.916 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.917 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.918 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.923 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2023-10-05T15:30:55.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.926 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.927 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "gid": 25424, 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "y", 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_features": 4540138322906710015, 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.929 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2023-10-05T15:30:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.931 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.935 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to", 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2023-10-05T15:30:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2023-10-05T15:30:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2023-10-05T15:30:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2023-10-05T15:30:55.951 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.952 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.953 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-05T15:30:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2023-10-05T15:30:55.955 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2023-10-05T15:30:55.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.957 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.958 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.959 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.961 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.963 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.965 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.966 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2023-10-05T15:30:55.967 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.968 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.969 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap" 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.971 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:55.972 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.973 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.974 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.975 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2023-10-05T15:30:55.976 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.977 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.978 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-05T15:30:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2023-10-05T15:30:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.984 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2023-10-05T15:30:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-05T15:30:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2023-10-05T15:30:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2023-10-05T15:30:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.997 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:55.998 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2023-10-05T15:30:55.999 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.000 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.001 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2023-10-05T15:30:56.004 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.005 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.006 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:56.008 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.009 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2023-10-05T15:30:56.010 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2023-10-05T15:30:56.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.012 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.012 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-05T15:30:56.012 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.012 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.012 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.013 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.014 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-05T15:30:56.015 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2023-10-05T15:30:56.016 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2023-10-05T15:30:56.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.021 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2023-10-05T15:30:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2023-10-05T15:30:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.027 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.028 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.029 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.030 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.031 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.033 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.034 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.035 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-05T15:30:56.036 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.037 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.038 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2023-10-05T15:30:56.040 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2023-10-05T15:30:56.041 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.042 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-05T15:30:56.043 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.044 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.045 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.047 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.048 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2023-10-05T15:30:56.049 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-05T15:30:56.050 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.051 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.052 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-05T15:30:56.054 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.055 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2023-10-05T15:30:56.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.058 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.059 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.062 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.063 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.065 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.066 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.067 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.068 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.072 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.074 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.075 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.077 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.078 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-05T15:30:56.079 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.081 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.082 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-05T15:30:56.083 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.084 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.085 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.086 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.088 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.089 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.090 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.092 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.093 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2023-10-05T15:30:56.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.095 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.096 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.099 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.104 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.105 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.106 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.107 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.108 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.110 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-05T15:30:56.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.114 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-05T15:30:56.115 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-05T15:30:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2023-10-05T15:30:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-05T15:30:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-05T15:30:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "UNSAFE_TLS_v1_2": { 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.127 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.129 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2023-10-05T15:30:56.131 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.132 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.133 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.134 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2023-10-05T15:30:56.135 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.137 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.138 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.139 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.140 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.141 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.142 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.144 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.145 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2023-10-05T15:30:56.146 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.147 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.148 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.149 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.150 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.151 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.152 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.153 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.154 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2023-10-05T15:30:56.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2023-10-05T15:30:56.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.157 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2023-10-05T15:30:56.158 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.160 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.161 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.163 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.164 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.165 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.167 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2023-10-05T15:30:56.170 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.171 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2023-10-05T15:30:56.173 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.174 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.175 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2023-10-05T15:30:56.176 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.177 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.179 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.180 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.182 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.184 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.185 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.185 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.185 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:55 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1348433464' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-05T15:30:56.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:55 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1348433464' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-05T15:30:56.190 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.190 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.190 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2023-10-05T15:30:56.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.193 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.194 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.196 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.197 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.198 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.199 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.202 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.203 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.205 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.206 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.207 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.208 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2023-10-05T15:30:56.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.210 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.211 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.212 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.214 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.215 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.216 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:30:56.217 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.218 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.219 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.220 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.221 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.222 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.223 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.224 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.225 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.226 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.227 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.229 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.230 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.231 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.232 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.234 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-05T15:30:56.236 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.238 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.241 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.242 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.243 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2023-10-05T15:30:56.244 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.245 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.246 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.247 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.248 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.249 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.250 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.251 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2023-10-05T15:30:56.253 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.254 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2023-10-05T15:30:56.255 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.256 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.257 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.258 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.261 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.263 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.265 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.266 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.268 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.269 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.273 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.276 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.278 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.279 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.280 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.281 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.282 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.283 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.284 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.286 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.288 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.290 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.291 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.292 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.293 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.294 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.295 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.297 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.300 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.302 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.303 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.304 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.305 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.306 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.307 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.308 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2023-10-05T15:30:56.310 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.311 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.312 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.313 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.314 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.315 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.316 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.317 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.318 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.319 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2023-10-05T15:30:56.320 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.321 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.322 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2023-10-05T15:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2023-10-05T15:30:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-05T15:30:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.337 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.338 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.340 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.341 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.345 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2023-10-05T15:30:56.346 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.347 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.348 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2023-10-05T15:30:56.350 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.351 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.352 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2023-10-05T15:30:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2023-10-05T15:30:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.368 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.369 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.370 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.372 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.373 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.374 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.375 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.376 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:56.377 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.380 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.382 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.383 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "drive_group_interval": { 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "drive_group_interval", 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300.0", 2023-10-05T15:30:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.389 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.392 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.393 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.394 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.395 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2023-10-05T15:30:56.396 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.398 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.399 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.401 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.402 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.404 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.405 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.406 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.408 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.409 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.410 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.411 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.413 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.414 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:56.415 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.416 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2023-10-05T15:30:56.417 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.418 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.419 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2023-10-05T15:30:56.420 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.421 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.422 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.424 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.428 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.431 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.433 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.434 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.435 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.436 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.437 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.438 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.439 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.440 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.441 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.443 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.444 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.445 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2023-10-05T15:30:56.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.449 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.451 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.452 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.453 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.454 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.455 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.456 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.458 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.459 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2023-10-05T15:30:56.461 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.462 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.463 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.464 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2023-10-05T15:30:56.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.466 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.467 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.468 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2023-10-05T15:30:56.469 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.470 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2023-10-05T15:30:56.471 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.472 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.474 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.475 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.476 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.477 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.478 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.481 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.481 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.481 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.481 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.481 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.481 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.482 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.483 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.484 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2023-10-05T15:30:56.485 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.486 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.487 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.488 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.491 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.492 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.494 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.495 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.496 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.498 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.500 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.502 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.504 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.505 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.506 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2023-10-05T15:30:56.507 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:56.508 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:56.510 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.512 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.513 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.515 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.516 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.518 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.519 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.520 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.521 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.522 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2023-10-05T15:30:56.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.524 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.525 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.526 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "modules": [ 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "dashboard", 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "iostat", 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nfs", 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "restful", 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_schedule" 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2023-10-05T15:30:56.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.528 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.530 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.531 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.532 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.533 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.534 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.535 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2023-10-05T15:30:56.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.538 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.539 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.540 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.542 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.543 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.544 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-05T15:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.546 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.548 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2023-10-05T15:30:56.549 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:30:56.550 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2023-10-05T15:30:56.551 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.552 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.553 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-05T15:30:56.554 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2023-10-05T15:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2023-10-05T15:30:56.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.557 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2023-10-05T15:30:56.558 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.559 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.560 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.561 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.565 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.566 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2023-10-05T15:30:56.567 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2023-10-05T15:30:56.568 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap" 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2023-10-05T15:30:56.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.570 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.571 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.573 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.574 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.575 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-05T15:30:56.576 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2023-10-05T15:30:56.577 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2023-10-05T15:30:56.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.579 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.580 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.581 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.582 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-05T15:30:56.583 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.584 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.585 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.586 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.587 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.588 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.589 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.590 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2023-10-05T15:30:56.591 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.592 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.593 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.594 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2023-10-05T15:30:56.595 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.596 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-05T15:30:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2023-10-05T15:30:56.598 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.599 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.600 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.603 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.604 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2023-10-05T15:30:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2023-10-05T15:30:56.606 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.607 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2023-10-05T15:30:56.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.611 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2023-10-05T15:30:56.612 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.613 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.614 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.615 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2023-10-05T15:30:56.616 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.617 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.618 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.619 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.620 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.621 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.622 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.623 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.624 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.627 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.628 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.629 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.630 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.631 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-05T15:30:56.632 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.633 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2023-10-05T15:30:56.634 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.635 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.636 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.637 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.638 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2023-10-05T15:30:56.639 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.640 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.642 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.643 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2023-10-05T15:30:56.644 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.645 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.646 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.647 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.648 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.649 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.650 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2023-10-05T15:30:56.651 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.654 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.656 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.657 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.659 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.661 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.662 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.664 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.665 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2023-10-05T15:30:56.666 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2023-10-05T15:30:56.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-05T15:30:56.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.670 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.671 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.672 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2023-10-05T15:30:56.673 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.674 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.675 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-05T15:30:56.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.677 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.678 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.679 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.681 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.682 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.683 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.684 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.684 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.684 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.684 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.684 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.686 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.687 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.688 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.689 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.690 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.691 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.692 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.693 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-05T15:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.696 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.697 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.698 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.700 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.701 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.702 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.703 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.707 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-05T15:30:56.708 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.709 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-05T15:30:56.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.711 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.712 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.713 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.714 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.715 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.716 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.717 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.719 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2023-10-05T15:30:56.720 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.721 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "UNSAFE_TLS_v1_2": { 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2023-10-05T15:30:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2023-10-05T15:30:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2023-10-05T15:30:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2023-10-05T15:30:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2023-10-05T15:30:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2023-10-05T15:30:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2023-10-05T15:30:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2023-10-05T15:30:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-05T15:30:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2023-10-05T15:30:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2023-10-05T15:30:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2023-10-05T15:30:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2023-10-05T15:30:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-05T15:30:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2023-10-05T15:30:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2023-10-05T15:30:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2023-10-05T15:30:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2023-10-05T15:30:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2023-10-05T15:30:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2023-10-05T15:30:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.910 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.911 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.912 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.913 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.915 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.916 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.917 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2023-10-05T15:30:56.918 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.920 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2023-10-05T15:30:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.922 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.923 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.924 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.928 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-05T15:30:56.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.930 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.933 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2023-10-05T15:30:56.934 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.935 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.942 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.943 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.944 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2023-10-05T15:30:56.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.946 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.947 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2023-10-05T15:30:56.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.950 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.951 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.954 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2023-10-05T15:30:56.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.957 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.958 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.960 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.963 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.964 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2023-10-05T15:30:56.965 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "drive_group_interval": { 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "drive_group_interval", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300.0", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.967 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.969 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.971 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2023-10-05T15:30:56.973 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.976 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.977 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.978 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.979 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.980 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.982 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.983 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2023-10-05T15:30:56.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.986 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.988 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.989 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.990 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2023-10-05T15:30:56.991 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2023-10-05T15:30:56.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:56.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.000 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.001 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.002 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.003 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.004 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.005 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.007 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.008 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.012 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.013 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.014 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.015 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.016 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.017 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.018 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.019 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.020 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.021 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.026 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.027 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2023-10-05T15:30:57.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2023-10-05T15:30:57.029 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.030 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.031 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.035 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.036 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.037 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.038 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2023-10-05T15:30:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.040 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.041 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.042 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.045 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.046 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.048 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.050 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.051 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.052 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.053 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.054 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.055 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.056 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.057 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.059 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.060 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.061 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2023-10-05T15:30:57.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.063 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.064 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2023-10-05T15:30:57.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.067 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2023-10-05T15:30:57.068 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2023-10-05T15:30:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2023-10-05T15:30:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2023-10-05T15:30:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-05T15:30:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.075 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2023-10-05T15:30:57.076 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2023-10-05T15:30:57.078 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "services": { 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "dashboard": "https://172.21.15.60:8443/" 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "always_on_modules": { 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus": [ 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2023-10-05T15:30:57.079 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific": [ 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2023-10-05T15:30:57.080 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy": [ 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2023-10-05T15:30:57.081 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "reef": [ 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2023-10-05T15:30:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "last_failure_osd_epoch": 91, 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "active_clients": [ 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2023-10-05T15:30:57.083 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1662602863 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "libcephsqlite", 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3310736891 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2023-10-05T15:30:57.085 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 131050714 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107164013 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.086 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1307209994 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.087 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3056705965 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-05T15:30:57.088 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.403+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fef500a16f0 msgr2=0x7fef500a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.403+0000 7fef6e94d700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fef500a16f0 0x7fef500a3bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef58009fd0 tx=0x7fef580058e0 comp rx=0 tx=0).stop 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.403+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 msgr2=0x7fef68116330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.403+0000 7fef6e94d700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 0x7fef68116330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b560 tx=0x7fef5c00b920 comp rx=0 tx=0).stop 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.406+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 shutdown_connections 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.406+0000 7fef6e94d700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fef500a16f0 0x7fef500a3bb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.406+0000 7fef6e94d700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef681a2390 0x7fef681a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.406+0000 7fef6e94d700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef681083f0 0x7fef68115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.406+0000 7fef6e94d700 1 --2- 172.21.15.60:0/1348433464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef6811a690 0x7fef68116330 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.406+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 >> 172.21.15.60:0/1348433464 conn(0x7fef6806bf20 msgr2=0x7fef6811bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.416+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 shutdown_connections 2023-10-05T15:30:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:30:55.418+0000 7fef6e94d700 1 -- 172.21.15.60:0/1348433464 wait complete. 2023-10-05T15:30:57.098 DEBUG:tasks.check_counter:Getting stats from a 2023-10-05T15:30:57.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-05T15:30:57.099 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:55 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1348433464' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-05T15:30:57.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:56 smithi060 ceph-mon[99238]: pgmap v448: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 460 KiB/s wr, 97 op/s 2023-10-05T15:30:57.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:56 smithi092 ceph-mon[102944]: pgmap v448: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 460 KiB/s wr, 97 op/s 2023-10-05T15:30:57.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:56 smithi135 ceph-mon[103360]: pgmap v448: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 460 KiB/s wr, 97 op/s 2023-10-05T15:30:58.052 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:30:59.519 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:30:59 smithi060 ceph-mon[99238]: pgmap v449: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 345 KiB/s wr, 101 op/s 2023-10-05T15:30:59.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:30:59 smithi135 ceph-mon[103360]: pgmap v449: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 345 KiB/s wr, 101 op/s 2023-10-05T15:30:59.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:30:59 smithi092 ceph-mon[102944]: pgmap v449: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 345 KiB/s wr, 101 op/s 2023-10-05T15:31:00.592 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:31:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1879, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1852, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 30223467, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 647791, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.228339197, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.058087558, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.097993564, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.068609906, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1851, 2023-10-05T15:31:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.675386304, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000364876 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1719536, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 162320 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 812, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1010, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 100884564, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 756186, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 8, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 6, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.175566283, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.030750214, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.099316038, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.036245807, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1007, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.428562217, 2023-10-05T15:31:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000425583 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 504208 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 896, 2023-10-05T15:31:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 896, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 101076463, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 277861, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.141968349, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.022526169, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.082873000, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.029421512, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 895, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.338049206, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000377708 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3024, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 448 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5179, 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.181476295, 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000035040 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2023-10-05T15:31:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 48661, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 4494, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 42382, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 1785, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 42241, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 1511, 2023-10-05T15:31:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 1, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2023-10-05T15:31:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:31:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2023-10-05T15:31:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:31:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 62563, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2023-10-05T15:31:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 92, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 7, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 233554107, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 233545192, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 62563 2023-10-05T15:31:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 17984, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 57414, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 39430, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 527, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 1555, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 1028, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 48661, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 91475, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 42814, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2023-10-05T15:31:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 154608, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 207152 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 2, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 1, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 3, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 3019, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-05T15:31:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:00.625 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 854720, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 18358, 2023-10-05T15:31:00.626 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 9656, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 191, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-05T15:31:00.627 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 75746377, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 728754, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3263, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2023-10-05T15:31:00.628 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3263, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3263, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 27.449749592, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.008412427 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3263, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3264 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3263, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 3263, 2023-10-05T15:31:00.629 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 1946, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1315, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2023-10-05T15:31:00.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2023-10-05T15:31:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2023-10-05T15:31:00.632 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 113, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 25, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 10, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 10, 2023-10-05T15:31:00.633 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2023-10-05T15:31:00.634 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:00.635 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 3583, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 231842867, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 3583, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3583, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 231842867, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.636 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3263, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 229554810, 2023-10-05T15:31:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3263, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 229554810, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2023-10-05T15:31:00.638 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3263, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3263, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3263, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3263, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-05T15:31:00.640 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x55bfbbd94960": { 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:00.641 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:00.642 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:01.085 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:01.086 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2023-10-05T15:31:01.086 DEBUG:tasks.check_counter:Getting stats from d 2023-10-05T15:31:01.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-05T15:31:01.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:01 smithi135 ceph-mon[103360]: pgmap v450: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 239 KiB/s wr, 78 op/s 2023-10-05T15:31:01.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:01 smithi060 ceph-mon[99238]: pgmap v450: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 239 KiB/s wr, 78 op/s 2023-10-05T15:31:01.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:01 smithi092 ceph-mon[102944]: pgmap v450: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 239 KiB/s wr, 78 op/s 2023-10-05T15:31:02.013 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:31:02.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:02 smithi060 ceph-mon[99238]: pgmap v451: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 KiB/s wr, 79 op/s 2023-10-05T15:31:03.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:02 smithi135 ceph-mon[103360]: pgmap v451: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 KiB/s wr, 79 op/s 2023-10-05T15:31:03.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:02 smithi092 ceph-mon[102944]: pgmap v451: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 KiB/s wr, 79 op/s 2023-10-05T15:31:04.167 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 282, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 269, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1579680, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 160960, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.053350132, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.016332388, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.037711895, 2023-10-05T15:31:04.168 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.007719147, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 269, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.095993873, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000356854 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1579680, 2023-10-05T15:31:04.169 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 160960 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 204, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 320, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 189136, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.015994891, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.011364456, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002260759, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:31:04.170 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 201, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.071307557, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000354763 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 189136 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.171 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.000518216, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000435758, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:04.172 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-05T15:31:04.173 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:04.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:04.175 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:04.176 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148977, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 30, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 928, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-05T15:31:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 280, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1537402, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 280, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 280, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1537402, 2023-10-05T15:31:04.179 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:04.180 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:04.180 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:04.180 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:04.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:04.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:04.180 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:31:05.526 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:05 smithi060 ceph-mon[99238]: pgmap v452: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 44 KiB/s wr, 86 op/s 2023-10-05T15:31:05.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:05 smithi135 ceph-mon[103360]: pgmap v452: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 44 KiB/s wr, 86 op/s 2023-10-05T15:31:05.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:05 smithi092 ceph-mon[102944]: pgmap v452: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 44 KiB/s wr, 86 op/s 2023-10-05T15:31:07.438 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-05T15:31:07.438 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-05T15:31:07.438 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-05T15:31:07.438 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-05T15:31:07.439 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-05T15:31:07.439 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-05T15:31:07.439 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-05T15:31:07.439 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-10-05T15:31:07.439 DEBUG:tasks.check_counter:Getting stats from g 2023-10-05T15:31:07.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-05T15:31:07.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:07 smithi135 ceph-mon[103360]: pgmap v453: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 68 op/s 2023-10-05T15:31:07.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:07 smithi060 ceph-mon[99238]: pgmap v453: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 68 op/s 2023-10-05T15:31:07.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:07 smithi092 ceph-mon[102944]: pgmap v453: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 68 op/s 2023-10-05T15:31:08.467 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:31:09.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:09 smithi135 ceph-mon[103360]: pgmap v454: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 55 op/s 2023-10-05T15:31:09.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:09 smithi135 ceph-mon[103360]: osdmap e114: 12 total, 12 up, 12 in 2023-10-05T15:31:09.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:09 smithi060 ceph-mon[99238]: pgmap v454: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 55 op/s 2023-10-05T15:31:09.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:09 smithi060 ceph-mon[99238]: osdmap e114: 12 total, 12 up, 12 in 2023-10-05T15:31:09.930 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:09 smithi092 ceph-mon[102944]: pgmap v454: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 55 op/s 2023-10-05T15:31:09.931 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:09 smithi092 ceph-mon[102944]: osdmap e114: 12 total, 12 up, 12 in 2023-10-05T15:31:11.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:11 smithi060 ceph-mon[99238]: pgmap v456: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 56 KiB/s wr, 39 op/s 2023-10-05T15:31:11.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:11 smithi092 ceph-mon[102944]: pgmap v456: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 56 KiB/s wr, 39 op/s 2023-10-05T15:31:12.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:11 smithi135 ceph-mon[103360]: pgmap v456: 129 pgs: 18 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 53 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 56 KiB/s wr, 39 op/s 2023-10-05T15:31:12.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:12 smithi060 ceph-mon[99238]: pgmap v457: 129 pgs: 22 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 42 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 42 KiB/s wr, 31 op/s 2023-10-05T15:31:13.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:12 smithi135 ceph-mon[103360]: pgmap v457: 129 pgs: 22 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 42 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 42 KiB/s wr, 31 op/s 2023-10-05T15:31:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:12 smithi092 ceph-mon[102944]: pgmap v457: 129 pgs: 22 active+clean+snaptrim, 65 active+clean+snaptrim_wait, 42 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 42 KiB/s wr, 31 op/s 2023-10-05T15:31:15.414 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:31:15.414 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:15.414 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1795, 2023-10-05T15:31:15.414 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1766, 2023-10-05T15:31:15.414 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 48316440, 2023-10-05T15:31:15.414 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 622294, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.239272681, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.068773088, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.100783126, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.066958891, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1766, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.535518604, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000303238 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.415 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1725920, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 166368 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 854, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1055, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 75727418, 2023-10-05T15:31:15.416 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 774517, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 8, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 6, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.149840106, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.029005189, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.083208820, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.028989466, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1052, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.353460337, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000335988 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 509488 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 713, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 715, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 100130460, 2023-10-05T15:31:15.418 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 221755, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.150705987, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.020318488, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.093928524, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.030156996, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 713, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.284398838, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000398876 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:15.419 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-05T15:31:15.420 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 4999, 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.149153799, 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000029836 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2023-10-05T15:31:15.422 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 24587, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 1228, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 22837, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 522, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 22832, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 164, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2023-10-05T15:31:15.423 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 1, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2023-10-05T15:31:15.424 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:15.425 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2023-10-05T15:31:15.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:15.427 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 64935, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 94, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 7, 2023-10-05T15:31:15.429 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 225761913, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 225755095, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 64935 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.430 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 9013, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 37429, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 28416, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 345, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 982, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 637, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 24587, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 60499, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 35912, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2023-10-05T15:31:15.431 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 109952, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 207152 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.433 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.435 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.436 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.437 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.439 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.440 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.442 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.443 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2023-10-05T15:31:15.444 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 2, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 3, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 5212, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:15.445 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:15.446 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:15.447 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 544042, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 9272, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:15.448 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 201, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 38162689, 2023-10-05T15:31:15.449 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 367914, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3031, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2023-10-05T15:31:15.450 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3031, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3031, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 69.183370947, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.022825262 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3031, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3032 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3031, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 3031, 2023-10-05T15:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 1790, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1239, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2023-10-05T15:31:15.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2023-10-05T15:31:15.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2023-10-05T15:31:15.454 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 114, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 26, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 10, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 10, 2023-10-05T15:31:15.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.456 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:15.457 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 3358, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 223852593, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 3358, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3358, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 223852593, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.458 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:15.459 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3031, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 221603346, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3031, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 221603346, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:15.460 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3031, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3031, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3031, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3031, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.461 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:15.462 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x5613561a4960": { 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-05T15:31:15.463 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:15.464 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:15.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:15.465 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:31:15.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:15 smithi135 ceph-mon[103360]: pgmap v458: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 16 KiB/s wr, 12 op/s 2023-10-05T15:31:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:15 smithi060 ceph-mon[99238]: pgmap v458: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 16 KiB/s wr, 12 op/s 2023-10-05T15:31:15.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:15 smithi092 ceph-mon[102944]: pgmap v458: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 16 KiB/s wr, 12 op/s 2023-10-05T15:31:15.990 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-05T15:31:15.991 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-05T15:31:15.991 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-05T15:31:15.991 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-05T15:31:15.991 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-10-05T15:31:15.991 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:15.991 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:15.992 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2023-10-05T15:31:15.992 DEBUG:tasks.check_counter:Getting stats from j 2023-10-05T15:31:15.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-05T15:31:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:31:17.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:17 smithi060 ceph-mon[99238]: pgmap v459: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-05T15:31:18.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:17 smithi135 ceph-mon[103360]: pgmap v459: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-05T15:31:18.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:17 smithi092 ceph-mon[102944]: pgmap v459: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-05T15:31:19.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:18 smithi135 ceph-mon[103360]: pgmap v460: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 204 B/s wr, 9 op/s 2023-10-05T15:31:19.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:18 smithi060 ceph-mon[99238]: pgmap v460: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 204 B/s wr, 9 op/s 2023-10-05T15:31:19.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:18 smithi092 ceph-mon[102944]: pgmap v460: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 204 B/s wr, 9 op/s 2023-10-05T15:31:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-05T15:31:20.673 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:20.673 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2023-10-05T15:31:20.673 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2023-10-05T15:31:20.674 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2023-10-05T15:31:20.674 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2023-10-05T15:31:20.674 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2023-10-05T15:31:20.674 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2023-10-05T15:31:20.674 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.001705263, 2023-10-05T15:31:20.674 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000211182, 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.675 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:20.677 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:20.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.677 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:20.677 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2, 2023-10-05T15:31:20.677 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 207, 2023-10-05T15:31:20.677 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 320, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 189664, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.015853495, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.010951836, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002450826, 2023-10-05T15:31:20.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 204, 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.053938913, 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000264406 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:20.679 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:31:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 189664 2023-10-05T15:31:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 287, 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 274, 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1581040, 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 164080, 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2023-10-05T15:31:20.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2023-10-05T15:31:20.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.053067659, 2023-10-05T15:31:20.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.016676240, 2023-10-05T15:31:20.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.037289127, 2023-10-05T15:31:20.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.007940360, 2023-10-05T15:31:20.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:20.685 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 274, 2023-10-05T15:31:20.685 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.113411003, 2023-10-05T15:31:20.685 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000413908 2023-10-05T15:31:20.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.686 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:20.686 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:20.686 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:20.686 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:20.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.686 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1581040, 2023-10-05T15:31:20.687 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 164080 2023-10-05T15:31:20.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.687 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-05T15:31:20.687 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2023-10-05T15:31:20.687 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-05T15:31:20.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-05T15:31:20.688 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:20.688 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:20.688 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-05T15:31:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148977, 2023-10-05T15:31:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 30, 2023-10-05T15:31:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-05T15:31:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-05T15:31:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2023-10-05T15:31:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2023-10-05T15:31:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-05T15:31:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 928, 2023-10-05T15:31:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2023-10-05T15:31:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-05T15:31:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-05T15:31:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-05T15:31:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-05T15:31:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-05T15:31:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-05T15:31:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 285, 2023-10-05T15:31:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1538052, 2023-10-05T15:31:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 285, 2023-10-05T15:31:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-05T15:31:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-05T15:31:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 285, 2023-10-05T15:31:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1538052, 2023-10-05T15:31:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-05T15:31:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-05T15:31:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-05T15:31:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-05T15:31:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:20.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-05T15:31:20.702 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-05T15:31:21.834 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:21 smithi135 ceph-mon[103360]: pgmap v461: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 172 B/s wr, 8 op/s 2023-10-05T15:31:21.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:21 smithi060 ceph-mon[99238]: pgmap v461: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 172 B/s wr, 8 op/s 2023-10-05T15:31:21.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:21 smithi092 ceph-mon[102944]: pgmap v461: 129 pgs: 21 active+clean+snaptrim, 63 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 172 B/s wr, 8 op/s 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-05T15:31:21.928 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-05T15:31:21.929 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-10-05T15:31:21.929 DEBUG:tasks.check_counter:Getting stats from b 2023-10-05T15:31:21.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-05T15:31:22.859 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:31:23.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:22 smithi135 ceph-mon[103360]: pgmap v462: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-05T15:31:23.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:22 smithi060 ceph-mon[99238]: pgmap v462: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-05T15:31:23.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:22 smithi092 ceph-mon[102944]: pgmap v462: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 191999, 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 271953, 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 65070208, 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 190185315, 2023-10-05T15:31:25.060 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 15, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 8.236526855, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 3.739678673, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 16.264479644, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.783076438, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 271951, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 105.194156791, 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000386812 2023-10-05T15:31:25.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 157149, 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.047149023, 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000300 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1810240, 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 624672 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.062 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 54746, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 51654, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 25742588, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 118788028, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 15, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 3.361564268, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.121210950, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.315103601, 2023-10-05T15:31:25.063 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 1.082305114, 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 51653, 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 74.580570832, 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001443876 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 39711, 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.006723497, 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000169 2023-10-05T15:31:25.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 501552, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 270576 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 56622, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 57112, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 33116904, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 128540689, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 158, 2023-10-05T15:31:25.065 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 8, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 3.450493692, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.139437699, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.783946087, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.825468187, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 57110, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 59.867260935, 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001048279 2023-10-05T15:31:25.066 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 62109, 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.014945325, 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000240 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 42528, 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 1360 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-05T15:31:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8227, 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 54.433716334, 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006616472 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 25322, 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 4.776303815, 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000188622 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 96316, 2023-10-05T15:31:25.069 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 90359, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 90359, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2011.142525247, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.022257246 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 5954, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 204, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 1, 2023-10-05T15:31:25.070 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 3873, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 62, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 11006, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 7601, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 3345, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 60, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 145, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 45984, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 2, 2023-10-05T15:31:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 2, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 6, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 168295, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 136028, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 5848, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 1081, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 94, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 525, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 19, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-05T15:31:25.072 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 338, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 32069, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 300, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 22541, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 147, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 4, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 246, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 6, 2023-10-05T15:31:25.073 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 147, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 36, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 4, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 32, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 111, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 79, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 9502, 2023-10-05T15:31:25.074 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 28270, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 5, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 36, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 26806, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 17106, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 463, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 33582 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-05T15:31:25.075 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 2476, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 7543, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 4616, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 5975, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 4569, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 55, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 13441, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 13386, 2023-10-05T15:31:25.076 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 4, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 338, 2023-10-05T15:31:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 62, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 2, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 69246, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 69140, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 69140, 2023-10-05T15:31:25.078 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 106, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 43, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 143, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 141, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 141, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 2, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 1, 2023-10-05T15:31:25.079 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 1, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 209478974, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 209894736, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2969, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 166.421593514, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.056053079 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.080 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 3932, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 42738, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 38806, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 436, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 3872, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 3436, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 11006, 2023-10-05T15:31:25.081 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 74721, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 63715, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 2, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 25391, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 25389, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 147564, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 207152 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 106388, 2023-10-05T15:31:25.082 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 2592, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 96316, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 305, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 5101, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 12275, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 51.242756108, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004174562 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-05T15:31:25.083 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2601, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 41.193370454, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.015837512 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.084 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 48080, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1657.944161611, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.034483031 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15, 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.092664875, 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006177658 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 88, 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.781693967, 2023-10-05T15:31:25.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.031610158 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15, 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 5.490778055, 2023-10-05T15:31:25.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.366051870 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3302, 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 23.109701974, 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006998698 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 617, 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 4.166359896, 2023-10-05T15:31:25.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006752609 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 11887, 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 177.735538970, 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.014952093 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 60, 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 10.375891166, 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.172931519 2023-10-05T15:31:25.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 9, 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 15.704178124, 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 1.744908680 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 7, 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.031583015, 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004511859 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.094 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.095 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 7, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.020026699, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002860957 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.002584947, 2023-10-05T15:31:25.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000861649 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 11393, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 21.251235386, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001865288 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.097 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 6, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 4, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-05T15:31:25.098 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 566, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 283, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 876, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:25.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:25.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:25.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 927781, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 4131, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:25.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 201, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 18042518, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 191197, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:25.104 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 77763, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 261147844, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 31, 2023-10-05T15:31:25.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 77763, 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 77763, 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 32737.065093962, 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.420985109 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 77763, 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 148563 2023-10-05T15:31:25.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 77763, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 1320, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 76443, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 3264, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 41019, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 444, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 3412, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 465, 2023-10-05T15:31:25.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 62, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 27373, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 162, 2023-10-05T15:31:25.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 62072, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 5, 2023-10-05T15:31:25.109 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-05T15:31:25.110 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 114, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 31, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2023-10-05T15:31:25.111 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 7532, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 930, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 1823 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-05T15:31:25.112 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 4 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 5, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 13386, 2023-10-05T15:31:25.113 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 303363, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 99048096, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:25.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 303363, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 303363, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 99048096, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:25.115 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 77763, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 262934073, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 77763, 2023-10-05T15:31:25.116 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 262934073, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:25.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 77763, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 77763, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 77763, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 77763, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.118 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 13386, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1807154, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 13386, 2023-10-05T15:31:25.119 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 443, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1807154, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55d841f8c6e0": { 2023-10-05T15:31:25.120 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 69246, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 205700432, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 69246, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2969, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 205700432, 2023-10-05T15:31:25.121 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:25.122 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:25.122 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:25.122 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:25.122 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.122 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:25.122 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-05T15:31:25.830 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:25 smithi092 ceph-mon[102944]: pgmap v463: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-05T15:31:25.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:25 smithi135 ceph-mon[103360]: pgmap v463: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-05T15:31:25.916 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:25 smithi060 ceph-mon[99238]: pgmap v463: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds.exported=338 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds.imported=300 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2476 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=7543 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=15 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=9 2023-10-05T15:31:27.602 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=62 2023-10-05T15:31:27.602 DEBUG:tasks.check_counter:Getting stats from e 2023-10-05T15:31:27.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-05T15:31:27.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:27 smithi060 ceph-mon[99238]: pgmap v464: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-05T15:31:27.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:27 smithi092 ceph-mon[102944]: pgmap v464: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-05T15:31:28.091 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:27 smithi135 ceph-mon[103360]: pgmap v464: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-05T15:31:28.431 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:31:29.906 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:29 smithi092 ceph-mon[102944]: pgmap v465: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:31:29.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:29 smithi060 ceph-mon[99238]: pgmap v465: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:31:30.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:29 smithi135 ceph-mon[103360]: pgmap v465: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:31:30.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:30 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:30.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:30 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:31.085 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:30 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:31.753 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-05T15:31:31.753 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:31.753 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 170936, 2023-10-05T15:31:31.753 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 215266, 2023-10-05T15:31:31.753 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 70308666, 2023-10-05T15:31:31.753 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 160303599, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 12, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 6.410943913, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.937636030, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 229.303637467, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.185818469, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 215264, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 59.554343889, 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000276657 2023-10-05T15:31:31.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 151362, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.041776083, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000276 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 34433, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 28624, 2023-10-05T15:31:31.755 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 21472038, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 61014941, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 14, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 2.095870140, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.884582781, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.428782628, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.250300496, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 28628, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 4.586876424, 2023-10-05T15:31:31.756 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000160223 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 49869, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.009364951, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000187 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1735264, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 175808 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 6388, 2023-10-05T15:31:31.757 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 6605, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1948147, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 93898234, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 20, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 9, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.817332581, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.324582321, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.120473629, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.338037891, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 6598, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.233630386, 2023-10-05T15:31:31.758 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000186970 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 30, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000004070, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000135 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3056, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 521408 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-05T15:31:31.759 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 5228, 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 44.374794388, 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.008487910 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 11275, 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.624001679, 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000144035 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 52466, 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 49181, 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 49181, 2023-10-05T15:31:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1008.248790412, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.020500778 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 3285, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 56, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 585, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 64, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 16330, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 265, 2023-10-05T15:31:31.762 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 5554, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 10511, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 15948, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 41073, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 1, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 1, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 5, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 92947, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 79799, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 2970, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 1022, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 27, 2023-10-05T15:31:31.763 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 824, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 367, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 31968, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 437, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 25381, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 1513, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 1126970, 2023-10-05T15:31:31.764 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 2, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 209, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 10031, 2023-10-05T15:31:31.765 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 18956, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 4, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 35014, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 15375, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 341, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 23410 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-05T15:31:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 1873, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 9049, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 5718, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 7084, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 3985, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 47, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 5692, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 5645, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-05T15:31:31.767 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 367, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 64, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.768 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 2, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 64935, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 64935, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 94, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 94, 2023-10-05T15:31:31.769 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 7, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 225761913, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2770, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 213.964300442, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.077243429 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.770 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 8467, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 38310, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 29843, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 375, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 3959, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 3584, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 16330, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 64172, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 47842, 2023-10-05T15:31:31.771 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 1, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 23185, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 23184, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 162108, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 198960 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 56957, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 3753, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 52466, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 512, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 5695, 2023-10-05T15:31:31.772 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 12097, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 38.977707661, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003222097 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 174, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 5.470186772, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.031437855 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.773 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 17355, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 691.764056591, 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.039859640 2023-10-05T15:31:31.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000126748, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000126748 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-05T15:31:31.775 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 62, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 5.475150022, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.088308871 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3323, 2023-10-05T15:31:31.778 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 12.898362991, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003881541 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 231, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.753369150, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003261338 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 12068, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 229.579493307, 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.019023822 2023-10-05T15:31:31.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-05T15:31:31.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 47, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 15.195058505, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.323299117 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.781 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3823, 2023-10-05T15:31:31.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 8.135278665, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002127982 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-05T15:31:31.785 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 3, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 2, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 904, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 904, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 874, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:31.786 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:31.787 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:31.788 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:31.789 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 989517, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 8278, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:31.790 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 201, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 31656591, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 330969, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.791 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 15856, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 234015785, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 27, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 15856, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15856, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 607.365186981, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.038305069 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15856, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 16759 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 15856, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 450, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 15406, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 0, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 10, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 321, 2023-10-05T15:31:31.793 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 3091, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 192, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 62, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 11356, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 0, 2023-10-05T15:31:31.794 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 20, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-05T15:31:31.795 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-05T15:31:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 114, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 26, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 1368, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 185, 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 154 2023-10-05T15:31:31.797 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 3 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:31.798 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 5, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 5645, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 211753, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 76622267, 2023-10-05T15:31:31.799 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 211753, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 211753, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 76622267, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.800 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 15856, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 234797551, 2023-10-05T15:31:31.801 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 15856, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 234797551, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:31.802 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 15856, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 15856, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 15856, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 15856, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 5645, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 785185, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 5645, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 321, 2023-10-05T15:31:31.804 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 785185, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55c56b9d26e0": { 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 64935, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 221567609, 2023-10-05T15:31:31.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 64935, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2770, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 221567609, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:31.806 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-05T15:31:31.923 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:31 smithi060 ceph-mon[99238]: pgmap v466: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-05T15:31:31.923 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:31 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:31.923 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:31 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:31.923 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:31 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:31:31.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:31 smithi092 ceph-mon[102944]: pgmap v466: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-05T15:31:31.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:31 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:31.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:31 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:31.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:31 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:31:32.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:31 smithi135 ceph-mon[103360]: pgmap v466: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-05T15:31:32.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:31 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:32.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:31 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:32.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:31 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' 2023-10-05T15:31:32.658 INFO:tasks.check_counter:Daemon mds.e mds.exported=367 2023-10-05T15:31:32.658 INFO:tasks.check_counter:Daemon mds.e mds.imported=437 2023-10-05T15:31:32.658 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=1873 2023-10-05T15:31:32.658 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=9049 2023-10-05T15:31:32.658 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=2 2023-10-05T15:31:32.659 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:32.659 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:32.659 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=64 2023-10-05T15:31:32.659 DEBUG:tasks.check_counter:Getting stats from h 2023-10-05T15:31:32.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-05T15:31:32.930 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:32 smithi092 ceph-mon[102944]: pgmap v467: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:33.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:32 smithi135 ceph-mon[103360]: pgmap v467: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:33.168 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:32 smithi060 ceph-mon[99238]: pgmap v467: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:33.521 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:31:35.832 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:35 smithi135 ceph-mon[103360]: pgmap v468: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-05T15:31:35.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:35 smithi060 ceph-mon[99238]: pgmap v468: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-05T15:31:35.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:35 smithi092 ceph-mon[102944]: pgmap v468: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-05T15:31:35.981 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-05T15:31:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 36727, 2023-10-05T15:31:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 42607, 2023-10-05T15:31:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 17841988, 2023-10-05T15:31:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 74422180, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 2.880727837, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.150089663, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.400822880, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.550462627, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 42605, 2023-10-05T15:31:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 11.431583730, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000268315 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 57010, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.009959541, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000174 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 31599, 2023-10-05T15:31:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 30982, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 19102092, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 115493281, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 15, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 2.597920182, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.825225617, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.131880304, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.815959049, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 30980, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 7.550590793, 2023-10-05T15:31:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000243724 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 36548, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.007093602, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000194 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 4256, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 521696 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 164298, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 211126, 2023-10-05T15:31:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 65887365, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 133926587, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 20, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 6.197754063, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.770818003, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 14.426247571, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.368849448, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 211125, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 75.064108606, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000355543 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 109256, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.040890327, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000374 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1744480, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 175280 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-05T15:31:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 6241, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 35.173488290, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.005635873 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 20748, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.550384170, 2023-10-05T15:31:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000122921 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 72866, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 67699, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 67699, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2764.999023517, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.040842538 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 5160, 2023-10-05T15:31:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 77, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 276, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 30, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 21113, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 2, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 8, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 21103, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 21106, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 35950, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2023-10-05T15:31:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 4, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 136179, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 99187, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 4901, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 934, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 12, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 1379, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-05T15:31:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 376, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 28922, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 246, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 34367, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 1513, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 1126970, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 2, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 341, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 6926, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 17040, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 2, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 21992, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 8265, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 363, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 22126 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 3157, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 7751, 2023-10-05T15:31:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 4675, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 5822, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 3841, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 51, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 10807, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 10756, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 380, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 30, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-05T15:31:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 2, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 58495, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 58495, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 85, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2023-10-05T15:31:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 85, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 6, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 222771266, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3013, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 219.373743888, 2023-10-05T15:31:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.072809075 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 11179, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 44533, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 33354, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 376, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 3904, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 3528, 2023-10-05T15:31:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 21113, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 68575, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 47462, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 23826, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 23826, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 172788, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 198960 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 80880, 2023-10-05T15:31:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 4157, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 72866, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 317, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 7716, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4125, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 15.058546069, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003650556 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-05T15:31:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 501, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 358.350747277, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.715270952 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 47631, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2015.982478627, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.042325008 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 6, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.041387465, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.173564577 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2015, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 15.339402352, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.007612606 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 426, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.996485395, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004686585 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4142, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 327.320571537, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.079024763 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 51, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 9.213855499, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.180663833 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8802, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 20.695549296, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002351232 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 3, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 2, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2023-10-05T15:31:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 9090, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 9090, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 901, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 1120658, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 10701, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 201, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 41181557, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 451002, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-05T15:31:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 26044, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 226213252, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 27, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 26044, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 26044, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1167.079449257, 2023-10-05T15:31:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.044811835 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 26044, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 26648 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 26044, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 506, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 25538, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 0, 2023-10-05T15:31:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 10, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 329, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 3346, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 181, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 30, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 21576, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 2, 2023-10-05T15:31:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 20, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-05T15:31:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-05T15:31:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 114, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 26, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 767, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 254, 2023-10-05T15:31:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 133 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 51 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 5, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 10756, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 232620, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 84189765, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 232620, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 232620, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 84189765, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 26044, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 227788506, 2023-10-05T15:31:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 26044, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 227788506, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 26044, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 26044, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 26044, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 26044, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 10756, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1579900, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 10756, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 332, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1579900, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x560fdb8ec6e0": { 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 58495, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 218576962, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 58495, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3013, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 218576962, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:36.034 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-05T15:31:37.381 INFO:tasks.check_counter:Daemon mds.h mds.exported=376 2023-10-05T15:31:37.381 INFO:tasks.check_counter:Daemon mds.h mds.imported=246 2023-10-05T15:31:37.382 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=3157 2023-10-05T15:31:37.382 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=7751 2023-10-05T15:31:37.382 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=2 2023-10-05T15:31:37.382 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:37.382 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:37.382 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=30 2023-10-05T15:31:37.382 DEBUG:tasks.check_counter:Getting stats from k 2023-10-05T15:31:37.382 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-05T15:31:38.085 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:37 smithi135 ceph-mon[103360]: pgmap v469: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:38.164 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:37 smithi060 ceph-mon[99238]: pgmap v469: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:38.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:37 smithi092 ceph-mon[102944]: pgmap v469: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:31:38.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:38 smithi092 ceph-mon[102944]: pgmap v470: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-05T15:31:39.086 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:38 smithi135 ceph-mon[103360]: pgmap v470: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-05T15:31:39.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:38 smithi060 ceph-mon[99238]: pgmap v470: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 2239, 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2241, 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 185246062, 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 696336, 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 8, 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2023-10-05T15:31:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.273220122, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.052448518, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.140303154, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.064975528, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2239, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.284537152, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000127082 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:40.400 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 630, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 840, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 134335621, 2023-10-05T15:31:40.401 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 714362, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 8, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.124003848, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.020204521, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.079101554, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.018579677, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 837, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.146528745, 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000175064 2023-10-05T15:31:40.402 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 518992 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1325, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1295, 2023-10-05T15:31:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 199162600, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 479256, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.228511267, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.031887043, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.164255040, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.036223190, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1295, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.187450851, 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000144749 2023-10-05T15:31:40.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1735344, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 173232 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-05T15:31:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 6140, 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.174447627, 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000028411 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-05T15:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.407 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 84497, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 4841, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 79573, 2023-10-05T15:31:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 83, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 77581, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 1498, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 1, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2023-10-05T15:31:40.409 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2023-10-05T15:31:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:31:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2023-10-05T15:31:40.412 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-05T15:31:40.413 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2023-10-05T15:31:40.414 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 143321, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 132, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 13, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 130294325, 2023-10-05T15:31:40.415 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 519983997, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 519970513, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 143321 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 33252, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 86841, 2023-10-05T15:31:40.416 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 53589, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 1014, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 2253, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 1239, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 84497, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 146384, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 61887, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 211632, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 207152 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-05T15:31:40.419 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.421 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.422 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.423 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.424 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.428 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.429 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.430 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2023-10-05T15:31:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 4, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 2, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 3, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 3038, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:40.432 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:40.433 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 1382867, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 33963, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 201, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-05T15:31:40.436 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 136215879, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 1312542, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 3851, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2023-10-05T15:31:40.437 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 3851, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3851, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 41.711536853, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.010831352 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3851, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3852 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 3851, 2023-10-05T15:31:40.438 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 3851, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 2307, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 1542, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-05T15:31:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-05T15:31:40.440 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-05T15:31:40.441 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 114, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-05T15:31:40.442 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 26, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 10, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 10, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-05T15:31:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.444 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 4190, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 518347063, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 4190, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 4190, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 518347063, 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:40.446 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3851, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 515946865, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3851, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 515946865, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3851, 2023-10-05T15:31:40.448 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 3851, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3851, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3851, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:40.449 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.450 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x560510456960": { 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:40.451 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-05T15:31:40.452 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-05T15:31:40.794 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-05T15:31:40.794 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-05T15:31:40.794 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-10-05T15:31:40.794 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-10-05T15:31:40.794 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-10-05T15:31:40.794 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:40.795 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:40.795 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2023-10-05T15:31:40.795 DEBUG:tasks.check_counter:Getting stats from c 2023-10-05T15:31:40.795 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-05T15:31:41.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:40 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:41.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:40 smithi060 ceph-mon[99238]: pgmap v471: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-05T15:31:41.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:40 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:41.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:40 smithi092 ceph-mon[102944]: pgmap v471: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-05T15:31:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:40 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:41.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:40 smithi135 ceph-mon[103360]: pgmap v471: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-05T15:31:41.859 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:31:43.078 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:42 smithi135 ceph-mon[103360]: pgmap v472: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:43.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:42 smithi060 ceph-mon[99238]: pgmap v472: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:43.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:42 smithi092 ceph-mon[102944]: pgmap v472: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-05T15:31:44.215 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-10-05T15:31:44.215 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:44.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 22983, 2023-10-05T15:31:44.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 23503, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 18542166, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 85353405, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 19, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 1.619139505, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.594529583, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.011860051, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.386939990, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 23501, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.935153087, 2023-10-05T15:31:44.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000167446 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 26362, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.004298932, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000163 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 401088 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 31710, 2023-10-05T15:31:44.217 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 34007, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 29457950, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 107664330, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 13, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 2.376226918, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.935318354, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.137525887, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.521344952, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 34004, 2023-10-05T15:31:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 4.711277767, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000138550 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 38392, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.006034255, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000157 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 4672, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 137312 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 183488, 2023-10-05T15:31:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 262377, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 72533276, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 169199860, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 13, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 7.161449003, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 3.267617202, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 10.977515040, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.368968686, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 262377, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 81.187596631, 2023-10-05T15:31:44.220 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000309431 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 156195, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.046589314, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000298 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1749248, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 177136 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-10-05T15:31:44.221 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4772, 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 38.412475015, 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.008049554 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:31:44.222 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 23961, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 4.570783061, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000190759 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 74345, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 69010, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 69010, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1357.077080735, 2023-10-05T15:31:44.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.019664933 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 5329, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 123, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 442, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 48, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 28911, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 2, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 8, 2023-10-05T15:31:44.224 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 28901, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 28904, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 49708, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 1, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 1, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 4, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 132083, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 104101, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 5042, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 1016, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 27, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:44.225 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 714, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 259, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 38228, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 233, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 50965, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1513, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 1126970, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 2, 2023-10-05T15:31:44.226 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 111, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 7114, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 20550, 2023-10-05T15:31:44.227 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 21083, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 12278, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 263, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 26875 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 2999, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 8406, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 5241, 2023-10-05T15:31:44.228 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 6641, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 3754, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 75, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 12776, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 12701, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:44.229 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 260, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 48, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 4, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 62563, 2023-10-05T15:31:44.230 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 62563, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 92, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 92, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 7, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-10-05T15:31:44.231 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 233554107, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2158, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 125.559362468, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.058183207 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 15613, 2023-10-05T15:31:44.232 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 58838, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 43225, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 540, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 4324, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 3784, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 28911, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 95000, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 66089, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 1, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 30801, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 30800, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 200044, 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 198960 2023-10-05T15:31:44.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 80236, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 2467, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 74345, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 315, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 4020, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6922, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 39.800171069, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005749808 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.234 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 80, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2.519886985, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.031498587 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 40533, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1144.926011000, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.028246762 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:44.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 28, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.655140996, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.023397892 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.239 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2887, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6.363970451, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002204354 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 501, 2023-10-05T15:31:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.724438906, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.003441993 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6915, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 114.534234190, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.016563157 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 75, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 25.846210134, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.344616135 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 11069, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 20.707017004, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001870721 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.246 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 3, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 1843, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 921, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 850, 2023-10-05T15:31:44.247 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:44.248 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:44.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:44.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 1428911, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 14851, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 176, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 2, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:44.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 201, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 57168543, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 597665, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-10-05T15:31:44.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 29625, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 240361644, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 33, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 29625, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 29625, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 717.245486385, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.024210818 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.253 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 29625, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 30450 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 29625, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 777, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 28848, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2023-10-05T15:31:44.254 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 390, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 2549, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 216, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 48, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 25468, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2023-10-05T15:31:44.255 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-10-05T15:31:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-10-05T15:31:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 114, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 26, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 1091, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 510, 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 147 2023-10-05T15:31:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 2 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 5, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 12701, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 238177, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 101425500, 2023-10-05T15:31:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 238177, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 238177, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 101425500, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 29625, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 242141411, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 29625, 2023-10-05T15:31:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 242141411, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 29625, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 29625, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 29625, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 29625, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 12701, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1790745, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 12701, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 390, 2023-10-05T15:31:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1790745, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55c6d5bfe6e0": { 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 62563, 2023-10-05T15:31:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 229359803, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 62563, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2158, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 229359803, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:44.268 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-10-05T15:31:44.686 INFO:tasks.check_counter:Daemon mds.c mds.exported=259 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds.imported=233 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=2999 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=8406 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=2 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:44.687 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=48 2023-10-05T15:31:44.687 DEBUG:tasks.check_counter:Getting stats from f 2023-10-05T15:31:44.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-05T15:31:45.547 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:31:45.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:45 smithi135 ceph-mon[103360]: pgmap v473: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:31:45.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:45 smithi060 ceph-mon[99238]: pgmap v473: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:31:45.927 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:45 smithi092 ceph-mon[102944]: pgmap v473: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:31:47.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:47 smithi135 ceph-mon[103360]: pgmap v474: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:31:47.628 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:47 smithi135 ceph-mon[103360]: osdmap e115: 12 total, 12 up, 12 in 2023-10-05T15:31:47.826 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-10-05T15:31:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1496, 2023-10-05T15:31:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1498, 2023-10-05T15:31:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 84345094, 2023-10-05T15:31:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 465266, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.164999396, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.031422839, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.076683153, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.045582659, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1496, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.293833474, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000196412 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 734, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 895, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 69816902, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 596641, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2023-10-05T15:31:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.096013185, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.023388919, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.047090988, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.020132583, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 894, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.214360981, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000239777 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3184, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 369856 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 921, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 908, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 42626494, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 340951, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-10-05T15:31:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.106904918, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.026595601, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.046543650, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.028724063, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 907, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.209654628, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000231151 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 323456, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 133824 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4830, 2023-10-05T15:31:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.603763560, 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000125002 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-10-05T15:31:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2023-10-05T15:31:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 29599, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 20599, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 8980, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 20, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 171, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 4771, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 2, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2023-10-05T15:31:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:31:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 246, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:31:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-10-05T15:31:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2023-10-05T15:31:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 65439, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 52, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 209478974, 2023-10-05T15:31:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 209894736, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 209894600, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 65439 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 8503, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 39314, 2023-10-05T15:31:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 30811, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 393, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1145, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 752, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 29599, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 67234, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 37635, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 111996, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207152 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-10-05T15:31:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 4, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 0, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 3857, 2023-10-05T15:31:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 526752, 2023-10-05T15:31:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 8754, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 9888, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 201, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 40975867, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 435646, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2891, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 26, 2023-10-05T15:31:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 4, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2891, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2891, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 22.230519275, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.007689560 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2891, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2892 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2891, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2891, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1620, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1268, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-10-05T15:31:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 2, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-10-05T15:31:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-10-05T15:31:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 115, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 21, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 10, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 10, 2023-10-05T15:31:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 3147, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 196489298, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 3147, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3147, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 196489298, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2891, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 195651002, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2891, 2023-10-05T15:31:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 195651002, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2891, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2891, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2891, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2891, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55857cd808c0": { 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:47.875 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-10-05T15:31:47.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:47 smithi060 ceph-mon[99238]: pgmap v474: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:31:47.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:47 smithi060 ceph-mon[99238]: osdmap e115: 12 total, 12 up, 12 in 2023-10-05T15:31:47.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:47 smithi092 ceph-mon[102944]: pgmap v474: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:31:47.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:47 smithi092 ceph-mon[102944]: osdmap e115: 12 total, 12 up, 12 in 2023-10-05T15:31:48.274 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-10-05T15:31:48.274 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-10-05T15:31:48.274 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-10-05T15:31:48.274 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-10-05T15:31:48.274 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2023-10-05T15:31:48.274 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:48.275 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:48.275 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-10-05T15:31:48.275 DEBUG:tasks.check_counter:Getting stats from i 2023-10-05T15:31:48.275 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-05T15:31:49.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:48 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:49.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:48 smithi135 ceph-mon[103360]: pgmap v476: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-05T15:31:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:48 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:49.165 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:48 smithi060 ceph-mon[99238]: pgmap v476: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-05T15:31:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:48 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:49.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:48 smithi092 ceph-mon[102944]: pgmap v476: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-05T15:31:49.233 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:31:51.746 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:51 smithi135 ceph-mon[103360]: pgmap v477: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-05T15:31:51.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:51 smithi060 ceph-mon[99238]: pgmap v477: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-05T15:31:51.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:51 smithi092 ceph-mon[102944]: pgmap v477: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-05T15:31:52.833 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:52 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:52.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:52 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:52.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:52 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:53.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:53 smithi135 ceph-mon[103360]: pgmap v478: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-05T15:31:53.831 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:53 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:53.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:53 smithi060 ceph-mon[99238]: pgmap v478: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-05T15:31:53.915 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:53 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:53.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:53 smithi092 ceph-mon[102944]: pgmap v478: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-05T15:31:53.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:53 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:55.840 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:55 smithi135 ceph-mon[103360]: pgmap v479: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-05T15:31:55.917 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:55 smithi060 ceph-mon[99238]: pgmap v479: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-05T15:31:55.926 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:55 smithi092 ceph-mon[102944]: pgmap v479: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-05T15:31:58.085 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:57 smithi135 ceph-mon[103360]: pgmap v480: 129 pgs: 15 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 71 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-10-05T15:31:58.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:57 smithi060 ceph-mon[99238]: pgmap v480: 129 pgs: 15 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 71 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-10-05T15:31:58.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:57 smithi092 ceph-mon[102944]: pgmap v480: 129 pgs: 15 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 71 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-10-05T15:31:58.452 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 35689, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 33677, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 24654990, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 252563668, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 14, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 3.209443711, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 1.220983721, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.042051910, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.034171498, 2023-10-05T15:31:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 33674, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 10.971004692, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000325800 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 37806, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.006228584, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000164 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 6128, 2023-10-05T15:31:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 412496 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 67965, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 79229, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 44999590, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 170206135, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 16, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 4.251340822, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 1.487535635, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 2.293134034, 2023-10-05T15:31:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.878666164, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 79231, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 32.371617755, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000408572 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 106812, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.017736746, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000166 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-05T15:31:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 118960 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 232476, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 385605, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 73816887, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 349597419, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 18, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 8, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 11.684311099, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 5.309925314, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 18.648491758, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.364371708, 2023-10-05T15:31:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 385601, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 119.747169359, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000310546 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 224641, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.068958611, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000306 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1777312, 2023-10-05T15:31:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 585888 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7288, 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 101.125492387, 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.013875616 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 37977, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6.253247032, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000164658 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 143254, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 129301, 2023-10-05T15:31:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 129301, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2250.968375573, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.017408746 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 13949, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 192, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 1056, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 112, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 57643, 2023-10-05T15:31:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 1454, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 39093, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 17096, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 55562, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 69853, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 1, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 1, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 6, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 225633, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 189834, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 13830, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 861, 2023-10-05T15:31:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 49, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 510, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 239, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 53423, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 363, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 51356, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 1649, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1513, 2023-10-05T15:31:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 1126970, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 2, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 1649, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 13, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 13, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 1636, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 231, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 14850, 2023-10-05T15:31:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 49869, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 1, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 45, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 51089, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 29150, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 537, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 53465 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 3820, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 4024, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 2198, 2023-10-05T15:31:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 3310, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 13299, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 142, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 20189, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 20047, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:31:58.466 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 241, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 113, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 2, 2023-10-05T15:31:58.467 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 143321, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 52313, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 49161, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 94160, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 3152, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 196, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 68, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 64, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 132, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 8, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 4, 2023-10-05T15:31:58.468 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 130294325, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 519983997, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3814, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 343.971333985, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.090186506 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 31676, 2023-10-05T15:31:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 88044, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 56368, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1049, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 4320, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 3271, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 57643, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 152069, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 94426, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 1, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 48352, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 48351, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 245704, 2023-10-05T15:31:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 198960 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 150537, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 3007, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 143254, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 343, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 5417, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 27112, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 146.076053707, 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005387874 2023-10-05T15:31:58.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1843, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 69.553255596, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.037739151 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-10-05T15:31:58.472 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 47171, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1589.639704782, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.033699512 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000199657, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000199657 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-10-05T15:31:58.474 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.475 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 198, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.167678803, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.015998377 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-10-05T15:31:58.476 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7105, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 69.476351445, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.009778515 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 896, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 4.288991523, 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004786820 2023-10-05T15:31:58.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 27126, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 302.105153679, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.011137106 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.478 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 143, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 27.556146347, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.192700324 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.479 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.563681683, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.563681683 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.480 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 17705, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 38.541158351, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002176851 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 4, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 9222, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 4611, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 900, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-10-05T15:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:31:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 2536124, 2023-10-05T15:31:58.487 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 30847, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 176, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 2, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 9752, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 197, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:31:58.488 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 114960133, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 1226575, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-10-05T15:31:58.489 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 49250, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 540615972, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 28, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 49250, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 49250, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1847.406207430, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.037510785 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-10-05T15:31:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 49250, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 51780 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 49250, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2592, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 46658, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 41, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 561, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 473, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 4291, 2023-10-05T15:31:58.491 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 241, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 111, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 40258, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1653, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 854, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:31:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 1, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-10-05T15:31:58.493 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-10-05T15:31:58.494 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 115, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 27, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 2359, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 662, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 275 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.495 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 3 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-10-05T15:31:58.496 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 5, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 20047, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 336126, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 116592781, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 336126, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:58.497 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 336126, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 116592781, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:31:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 49250, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 543578478, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 49250, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 543578478, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.499 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 49250, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 49250, 2023-10-05T15:31:58.500 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 49250, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 49250, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 20047, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 2975059, 2023-10-05T15:31:58.501 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 20047, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 476, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2975059, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x56142fe446e0": { 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 143321, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 515789693, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 143321, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3814, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 515789693, 2023-10-05T15:31:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:31:58.504 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:31:58.504 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:31:58.504 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:31:58.504 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.504 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:31:58.504 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-10-05T15:31:59.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:58 smithi135 ceph-mon[103360]: pgmap v481: 129 pgs: 15 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 71 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:31:59.084 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:31:58 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:59.139 INFO:tasks.check_counter:Daemon mds.i mds.exported=239 2023-10-05T15:31:59.139 INFO:tasks.check_counter:Daemon mds.i mds.imported=363 2023-10-05T15:31:59.140 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=3820 2023-10-05T15:31:59.140 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=4024 2023-10-05T15:31:59.140 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=2 2023-10-05T15:31:59.140 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:31:59.140 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:31:59.140 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=112 2023-10-05T15:31:59.140 DEBUG:tasks.check_counter:Getting stats from l 2023-10-05T15:31:59.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-05T15:31:59.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:58 smithi060 ceph-mon[99238]: pgmap v481: 129 pgs: 15 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 71 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:31:59.166 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:31:58 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:31:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:58 smithi092 ceph-mon[102944]: pgmap v481: 129 pgs: 15 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 71 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:31:59.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:31:58 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:00.211 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:32:01.835 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:01 smithi135 ceph-mon[103360]: pgmap v482: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-05T15:32:01.914 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:01 smithi060 ceph-mon[99238]: pgmap v482: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-05T15:32:01.928 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:01 smithi092 ceph-mon[102944]: pgmap v482: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 982, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 984, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 63662864, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 305466, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.115457845, 2023-10-05T15:32:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.021573196, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.056172123, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.029848883, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 982, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.209128228, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000212961 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1230, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1198, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 102671178, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 451011, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2023-10-05T15:32:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.167506669, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.034601557, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.102708361, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.034222129, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1197, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.164741743, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000137628 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1760432, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 176704 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1552, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1765, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 55006075, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1009046, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-10-05T15:32:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.185748171, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.042546543, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.071100071, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.057471733, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1763, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.363962022, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000206444 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3344, 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 528240 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:32:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5642, 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.158104983, 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000028022 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2023-10-05T15:32:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 33235, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 963, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 31474, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 798, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 31859, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 491, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2023-10-05T15:32:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2023-10-05T15:32:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:32:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:32:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-10-05T15:32:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:32:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-10-05T15:32:02.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 58495, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 85, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 6, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 222771266, 2023-10-05T15:32:02.592 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 222762351, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 58495 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 11342, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 43918, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 32576, 2023-10-05T15:32:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 363, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 998, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 635, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 33235, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 67090, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 33855, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 124784, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207152 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.594 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.595 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.596 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.598 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.599 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.601 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-10-05T15:32:02.604 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.605 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-10-05T15:32:02.606 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-10-05T15:32:02.607 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 3, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2023-10-05T15:32:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 3774, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:32:02.609 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:32:02.610 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-10-05T15:32:02.611 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 618404, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 11641, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-10-05T15:32:02.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 9752, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 197, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 49612895, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 464874, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-10-05T15:32:02.613 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 3410, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 3410, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3410, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 48.292953717, 2023-10-05T15:32:02.614 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.014162156 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3410, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3411 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 3410, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 3410, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-10-05T15:32:02.615 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 2016, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1392, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-10-05T15:32:02.616 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-10-05T15:32:02.617 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-10-05T15:32:02.618 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 115, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 27, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 9, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 9, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2023-10-05T15:32:02.619 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-10-05T15:32:02.620 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 3760, 2023-10-05T15:32:02.621 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 220981046, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 3760, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3760, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 220981046, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3410, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 218629117, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3410, 2023-10-05T15:32:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 218629117, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:32:02.624 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3410, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 3410, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3410, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3410, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-10-05T15:32:02.626 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x56533feb2960": { 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-10-05T15:32:02.627 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-10-05T15:32:02.628 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-10-05T15:32:02.990 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:02 smithi135 ceph-mon[103360]: pgmap v483: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-05T15:32:03.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:02 smithi060 ceph-mon[99238]: pgmap v483: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-05T15:32:03.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:02 smithi092 ceph-mon[102944]: pgmap v483: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-05T15:32:04.672 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-05T15:32:04.672 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-05T15:32:04.672 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-10-05T15:32:04.672 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-10-05T15:32:04.672 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2023-10-05T15:32:04.672 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-10-05T15:32:04.673 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-10-05T15:32:04.673 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2023-10-05T15:32:04.673 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-05T15:32:04.683 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-05T15:32:04.684 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:32:04.684 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:32:04.754 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:32:04.755 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:32:04.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:32:05.170 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:04 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:05.170 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:04 smithi060 ceph-mon[99238]: pgmap v484: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 22 op/s 2023-10-05T15:32:05.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:04 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:05.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:04 smithi092 ceph-mon[102944]: pgmap v484: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 22 op/s 2023-10-05T15:32:05.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.243+0000 7f1972b82700 1 -- 172.21.15.60:0/4076872363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c1010b0 msgr2=0x7f196c101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:05.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.243+0000 7f1972b82700 1 --2- 172.21.15.60:0/4076872363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c1010b0 0x7f196c101490 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f195c009990 tx=0x7f195c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 -- 172.21.15.60:0/4076872363 shutdown_connections 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 --2- 172.21.15.60:0/4076872363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1061d0 0x7f196c10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 --2- 172.21.15.60:0/4076872363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c1010b0 0x7f196c101490 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 --2- 172.21.15.60:0/4076872363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c101a60 0x7f196c105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 -- 172.21.15.60:0/4076872363 >> 172.21.15.60:0/4076872363 conn(0x7f196c0fc8d0 msgr2=0x7f196c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 -- 172.21.15.60:0/4076872363 shutdown_connections 2023-10-05T15:32:05.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.250+0000 7f1972b82700 1 -- 172.21.15.60:0/4076872363 wait complete. 2023-10-05T15:32:05.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.251+0000 7f1972b82700 1 Processor -- start 2023-10-05T15:32:05.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 -- start start 2023-10-05T15:32:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1010b0 0x7f196c114f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 0x7f196c1154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c10ffe0 0x7f196c110490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c110ba0 con 0x7f196c10ffe0 2023-10-05T15:32:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c110d10 con 0x7f196c1061d0 2023-10-05T15:32:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.256+0000 7f1972b82700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c11acc0 con 0x7f196c1010b0 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.257+0000 7f196bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 0x7f196c1154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.257+0000 7f196bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 0x7f196c1154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:55876/0 (socket says 172.21.15.60:55876) 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.257+0000 7f196bfff700 1 -- 172.21.15.60:0/173909500 learned_addr learned my addr 172.21.15.60:0/173909500 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.258+0000 7f196bfff700 1 -- 172.21.15.60:0/173909500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1010b0 msgr2=0x7f196c114f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.258+0000 7f196bfff700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1010b0 0x7f196c114f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.258+0000 7f196bfff700 1 -- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c10ffe0 msgr2=0x7f196c110490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.258+0000 7f196bfff700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c10ffe0 0x7f196c110490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.258+0000 7f196bfff700 1 -- 172.21.15.60:0/173909500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0095f0 con 0x7f196c1061d0 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.258+0000 7f196bfff700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 0x7f196c1154a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1960009fd0 tx=0x7f196000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.260+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960022640 con 0x7f196c1061d0 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.261+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1960022c60 con 0x7f196c1061d0 2023-10-05T15:32:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.261+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960021d50 con 0x7f196c1061d0 2023-10-05T15:32:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.261+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c11af40 con 0x7f196c1061d0 2023-10-05T15:32:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.261+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c11b400 con 0x7f196c1061d0 2023-10-05T15:32:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.262+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c067440 con 0x7f196c1061d0 2023-10-05T15:32:05.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.267+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f19600227a0 con 0x7f196c1061d0 2023-10-05T15:32:05.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.267+0000 7f1969ffb700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19540a1730 0x7f19540a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:05.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.268+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 9607+0+0 (secure 0 0 0) 0x7f19600ddd80 con 0x7f196c1061d0 2023-10-05T15:32:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.271+0000 7f197091e700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19540a1730 0x7f19540a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:05.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.272+0000 7f197091e700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19540a1730 0x7f19540a3bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c005fb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:05.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.275+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f19600a6d10 con 0x7f196c1061d0 2023-10-05T15:32:05.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:04 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:05.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:04 smithi135 ceph-mon[103360]: pgmap v484: 129 pgs: 14 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 72 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 22 op/s 2023-10-05T15:32:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.654+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f196c111510 con 0x7f196c1061d0 2023-10-05T15:32:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:32:05.666 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":115,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:31:46.734190+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":114,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":114,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/3221256091":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/3008673646":"2023-10-06T15:16:49.530067+0000","172.21.15.60:6801/3043189857":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/3001974532":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/303168486":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6800/3043189857":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:32:05.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.660+0000 7f1969ffb700 1 -- 172.21.15.60:0/173909500 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+25283 (secure 0 0 0) 0x7f19600aa330 con 0x7f196c1061d0 2023-10-05T15:32:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.667+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19540a1730 msgr2=0x7f19540a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.667+0000 7f1972b82700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19540a1730 0x7f19540a3bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.667+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 msgr2=0x7f196c1154a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.667+0000 7f1972b82700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 0x7f196c1154a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1960009fd0 tx=0x7f196000b8b0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.676+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 shutdown_connections 2023-10-05T15:32:05.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.676+0000 7f1972b82700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196c10ffe0 0x7f196c110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.676+0000 7f1972b82700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f196c1010b0 0x7f196c114f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.676+0000 7f1972b82700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f19540a1730 0x7f19540a3bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.676+0000 7f1972b82700 1 --2- 172.21.15.60:0/173909500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c1061d0 0x7f196c1154a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:05.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.676+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 >> 172.21.15.60:0/173909500 conn(0x7f196c0fc8d0 msgr2=0x7f196c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.692+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 shutdown_connections 2023-10-05T15:32:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:05.695+0000 7f1972b82700 1 -- 172.21.15.60:0/173909500 wait complete. 2023-10-05T15:32:05.743 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:10:55.610302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:14:46.019473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:14:46.977332+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 114, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:14:50.647849+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 114, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:32:05.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.058+0000 7fcf2265a700 1 -- 172.21.15.60:0/474355111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 msgr2=0x7fcf1c108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.058+0000 7fcf2265a700 1 --2- 172.21.15.60:0/474355111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c108870 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009990 tx=0x7fcf10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.065+0000 7fcf2265a700 1 -- 172.21.15.60:0/474355111 shutdown_connections 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.065+0000 7fcf2265a700 1 --2- 172.21.15.60:0/474355111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf1c11a690 0x7fcf1c11ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.065+0000 7fcf2265a700 1 --2- 172.21.15.60:0/474355111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf1c10f640 0x7fcf1c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.065+0000 7fcf2265a700 1 --2- 172.21.15.60:0/474355111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c108870 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.065+0000 7fcf2265a700 1 -- 172.21.15.60:0/474355111 >> 172.21.15.60:0/474355111 conn(0x7fcf1c06d1a0 msgr2=0x7fcf1c06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.071+0000 7fcf2265a700 1 -- 172.21.15.60:0/474355111 shutdown_connections 2023-10-05T15:32:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.072+0000 7fcf2265a700 1 -- 172.21.15.60:0/474355111 wait complete. 2023-10-05T15:32:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.072+0000 7fcf2265a700 1 Processor -- start 2023-10-05T15:32:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 -- start start 2023-10-05T15:32:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c1a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf1c10f640 0x7fcf1c1a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf1c11a690 0x7fcf1c1aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1aae80 con 0x7fcf1c1083f0 2023-10-05T15:32:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1aaff0 con 0x7fcf1c11a690 2023-10-05T15:32:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.073+0000 7fcf2265a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1ab1b0 con 0x7fcf1c10f640 2023-10-05T15:32:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.074+0000 7fcf1bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c1a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.074+0000 7fcf1bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c1a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42468/0 (socket says 172.21.15.60:42468) 2023-10-05T15:32:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.074+0000 7fcf1bfff700 1 -- 172.21.15.60:0/1511805170 learned_addr learned my addr 172.21.15.60:0/1511805170 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.075+0000 7fcf1bfff700 1 -- 172.21.15.60:0/1511805170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf1c10f640 msgr2=0x7fcf1c1a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.075+0000 7fcf1bfff700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf1c10f640 0x7fcf1c1a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.075+0000 7fcf1bfff700 1 -- 172.21.15.60:0/1511805170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf1c11a690 msgr2=0x7fcf1c1aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.075+0000 7fcf1bfff700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf1c11a690 0x7fcf1c1aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.075+0000 7fcf1bfff700 1 -- 172.21.15.60:0/1511805170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100095f0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.075+0000 7fcf1bfff700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c1a5ea0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400ada0 tx=0x7fcf1400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.077+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400f070 con 0x7fcf1c1083f0 2023-10-05T15:32:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.077+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf1400ce40 con 0x7fcf1c1083f0 2023-10-05T15:32:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.077+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14005520 con 0x7fcf1c1083f0 2023-10-05T15:32:06.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.082+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c1ab490 con 0x7fcf1c1083f0 2023-10-05T15:32:06.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.082+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c110050 con 0x7fcf1c1083f0 2023-10-05T15:32:06.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.083+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c1ab6b0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.103+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcf14004ad0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.103+0000 7fcf197fa700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcf040a1730 0x7fcf040a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.103+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 9607+0+0 (secure 0 0 0) 0x7fcf140cd8d0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.104+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf140fa1a0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.115+0000 7fcf1b7fe700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcf040a1730 0x7fcf040a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:06.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.120+0000 7fcf1b7fe700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcf040a1730 0x7fcf040a3bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098e0 tx=0x7fcf1000b690 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:06.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:05 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/173909500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:32:06.178 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:05 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/173909500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:32:06.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:05 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/173909500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:32:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.480+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf1c1a72a0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.486+0000 7fcf197fa700 1 -- 172.21.15.60:0/1511805170 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf140967e0 con 0x7fcf1c1083f0 2023-10-05T15:32:06.492 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-05T15:32:06.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.496+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcf040a1730 msgr2=0x7fcf040a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.496+0000 7fcf2265a700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcf040a1730 0x7fcf040a3bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098e0 tx=0x7fcf1000b690 comp rx=0 tx=0).stop 2023-10-05T15:32:06.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.496+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 msgr2=0x7fcf1c1a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.496+0000 7fcf2265a700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c1a5ea0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400ada0 tx=0x7fcf1400c330 comp rx=0 tx=0).stop 2023-10-05T15:32:06.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.507+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 shutdown_connections 2023-10-05T15:32:06.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.507+0000 7fcf2265a700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fcf040a1730 0x7fcf040a3bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.507+0000 7fcf2265a700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf1c11a690 0x7fcf1c1aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.507+0000 7fcf2265a700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf1c1083f0 0x7fcf1c1a5ea0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.507+0000 7fcf2265a700 1 --2- 172.21.15.60:0/1511805170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf1c10f640 0x7fcf1c1a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.507+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 >> 172.21.15.60:0/1511805170 conn(0x7fcf1c06d1a0 msgr2=0x7fcf1c118680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:06.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.514+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 shutdown_connections 2023-10-05T15:32:06.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.517+0000 7fcf2265a700 1 -- 172.21.15.60:0/1511805170 wait complete. 2023-10-05T15:32:06.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:32:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.877+0000 7fa359207700 1 -- 172.21.15.60:0/1461386966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 msgr2=0x7fa354114250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.877+0000 7fa359207700 1 --2- 172.21.15.60:0/1461386966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa354114250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa34c01c0d0 tx=0x7fa34c01c3e0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.878+0000 7fa359207700 1 -- 172.21.15.60:0/1461386966 shutdown_connections 2023-10-05T15:32:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.878+0000 7fa359207700 1 --2- 172.21.15.60:0/1461386966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa354114250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.878+0000 7fa359207700 1 --2- 172.21.15.60:0/1461386966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354073250 0x7fa354073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.878+0000 7fa359207700 1 --2- 172.21.15.60:0/1461386966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354073b70 0x7fa354111920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.878+0000 7fa359207700 1 -- 172.21.15.60:0/1461386966 >> 172.21.15.60:0/1461386966 conn(0x7fa3540fc960 msgr2=0x7fa3540fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.884+0000 7fa359207700 1 -- 172.21.15.60:0/1461386966 shutdown_connections 2023-10-05T15:32:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.886+0000 7fa359207700 1 -- 172.21.15.60:0/1461386966 wait complete. 2023-10-05T15:32:06.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.887+0000 7fa359207700 1 Processor -- start 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.900+0000 7fa359207700 1 -- start start 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa359207700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354073250 0x7fa35410d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa359207700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa35410d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa359207700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354110cc0 0x7fa354111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa359207700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354111740 con 0x7fa354110cc0 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa359207700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541118b0 con 0x7fa354073250 2023-10-05T15:32:06.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa359207700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354111a70 con 0x7fa354111e60 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa35359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354110cc0 0x7fa354111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa35359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354110cc0 0x7fa354111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42474/0 (socket says 172.21.15.60:42474) 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa35359e700 1 -- 172.21.15.60:0/1540986077 learned_addr learned my addr 172.21.15.60:0/1540986077 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.901+0000 7fa35259c700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa35410d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.902+0000 7fa35259c700 1 -- 172.21.15.60:0/1540986077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354073250 msgr2=0x7fa35410d330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.902+0000 7fa35259c700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354073250 0x7fa35410d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.902+0000 7fa35259c700 1 -- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354110cc0 msgr2=0x7fa354111140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.902+0000 7fa35259c700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354110cc0 0x7fa354111140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.902+0000 7fa35259c700 1 -- 172.21.15.60:0/1540986077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c01ad10 con 0x7fa354111e60 2023-10-05T15:32:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.902+0000 7fa35259c700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa35410d870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa354074310 tx=0x7fa34800b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.906+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800be70 con 0x7fa354111e60 2023-10-05T15:32:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.906+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa348011af0 con 0x7fa354111e60 2023-10-05T15:32:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.906+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348010b10 con 0x7fa354111e60 2023-10-05T15:32:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.908+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3541c3cf0 con 0x7fa354111e60 2023-10-05T15:32:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.908+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3541c4180 con 0x7fa354111e60 2023-10-05T15:32:06.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.910+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa354104360 con 0x7fa354111e60 2023-10-05T15:32:06.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.916+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa348011c60 con 0x7fa354111e60 2023-10-05T15:32:06.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.917+0000 7fa343fff700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa33c0a16b0 0x7fa33c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:06.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.917+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 9607+0+0 (secure 0 0 0) 0x7fa3480cca60 con 0x7fa354111e60 2023-10-05T15:32:06.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.924+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa348095a50 con 0x7fa354111e60 2023-10-05T15:32:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.940+0000 7fa352d9d700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa33c0a16b0 0x7fa33c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:06.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:06.945+0000 7fa352d9d700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa33c0a16b0 0x7fa33c0a3b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa344009710 tx=0x7fa344006c60 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:07.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:06 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1511805170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:32:07.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:06 smithi092 ceph-mon[102944]: pgmap v485: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-05T15:32:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.300+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa354107890 con 0x7fa354111e60 2023-10-05T15:32:07.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.307+0000 7fa343fff700 1 -- 172.21.15.60:0/1540986077 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa348099070 con 0x7fa354111e60 2023-10-05T15:32:07.309 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:32:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.319+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa33c0a16b0 msgr2=0x7fa33c0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.319+0000 7fa359207700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa33c0a16b0 0x7fa33c0a3b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa344009710 tx=0x7fa344006c60 comp rx=0 tx=0).stop 2023-10-05T15:32:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.319+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 msgr2=0x7fa35410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.319+0000 7fa359207700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa35410d870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa354074310 tx=0x7fa34800b6c0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.325+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 shutdown_connections 2023-10-05T15:32:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.325+0000 7fa359207700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa354110cc0 0x7fa354111140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.325+0000 7fa359207700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa33c0a16b0 0x7fa33c0a3b70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.325+0000 7fa359207700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354073250 0x7fa35410d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.325+0000 7fa359207700 1 --2- 172.21.15.60:0/1540986077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa354111e60 0x7fa35410d870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.325+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 >> 172.21.15.60:0/1540986077 conn(0x7fa3540fc960 msgr2=0x7fa3540fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:07.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:06 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1511805170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:32:07.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:06 smithi135 ceph-mon[103360]: pgmap v485: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-05T15:32:07.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.330+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 shutdown_connections 2023-10-05T15:32:07.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.332+0000 7fa359207700 1 -- 172.21.15.60:0/1540986077 wait complete. 2023-10-05T15:32:07.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:32:07.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:06 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1511805170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:32:07.378 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:06 smithi060 ceph-mon[99238]: pgmap v485: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-05T15:32:07.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.661+0000 7f71eeb84700 1 -- 172.21.15.60:0/2173691695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 msgr2=0x7f71e8108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:07.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.661+0000 7f71eeb84700 1 --2- 172.21.15.60:0/2173691695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 0x7f71e8108870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0098f0 tx=0x7f71dc009c00 comp rx=0 tx=0).stop 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.669+0000 7f71eeb84700 1 -- 172.21.15.60:0/2173691695 shutdown_connections 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.669+0000 7f71eeb84700 1 --2- 172.21.15.60:0/2173691695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e811a690 0x7f71e811ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.669+0000 7f71eeb84700 1 --2- 172.21.15.60:0/2173691695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e8107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.669+0000 7f71eeb84700 1 --2- 172.21.15.60:0/2173691695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 0x7f71e8108870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.669+0000 7f71eeb84700 1 -- 172.21.15.60:0/2173691695 >> 172.21.15.60:0/2173691695 conn(0x7f71e806d1a0 msgr2=0x7f71e806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.670+0000 7f71eeb84700 1 -- 172.21.15.60:0/2173691695 shutdown_connections 2023-10-05T15:32:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.670+0000 7f71eeb84700 1 -- 172.21.15.60:0/2173691695 wait complete. 2023-10-05T15:32:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 Processor -- start 2023-10-05T15:32:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 -- start start 2023-10-05T15:32:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 0x7f71e81a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e81a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e811a690 0x7f71e81aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e81aaf30 con 0x7f71e810f640 2023-10-05T15:32:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e81ab0a0 con 0x7f71e81083f0 2023-10-05T15:32:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71eeb84700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e81ab260 con 0x7f71e811a690 2023-10-05T15:32:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e81a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e81a6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42488/0 (socket says 172.21.15.60:42488) 2023-10-05T15:32:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.671+0000 7f71e7fff700 1 -- 172.21.15.60:0/614882400 learned_addr learned my addr 172.21.15.60:0/614882400 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:07.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.672+0000 7f71e7fff700 1 -- 172.21.15.60:0/614882400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e811a690 msgr2=0x7f71e81aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:07.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.672+0000 7f71e7fff700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e811a690 0x7f71e81aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.672+0000 7f71e7fff700 1 -- 172.21.15.60:0/614882400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 msgr2=0x7f71e81a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:07.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.672+0000 7f71e7fff700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 0x7f71e81a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:07.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.672+0000 7f71e7fff700 1 -- 172.21.15.60:0/614882400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc009520 con 0x7f71e810f640 2023-10-05T15:32:07.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.672+0000 7f71e7fff700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e81a6490 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009810 tx=0x7f71dc00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:07.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.676+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc01c070 con 0x7f71e810f640 2023-10-05T15:32:07.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.676+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71dc005500 con 0x7f71e810f640 2023-10-05T15:32:07.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.676+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc004b90 con 0x7f71e810f640 2023-10-05T15:32:07.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.678+0000 7f71eeb84700 1 -- 172.21.15.60:0/614882400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e81ab4e0 con 0x7f71e810f640 2023-10-05T15:32:07.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.679+0000 7f71eeb84700 1 -- 172.21.15.60:0/614882400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e81ab730 con 0x7f71e810f640 2023-10-05T15:32:07.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.680+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c80052f0 con 0x7f71e810f640 2023-10-05T15:32:07.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.682+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f71dc020070 con 0x7f71e810f640 2023-10-05T15:32:07.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.683+0000 7f71e5ffb700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f71d00a1800 0x7f71d00a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:07.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.683+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 9607+0+0 (secure 0 0 0) 0x7f71dc0ce970 con 0x7f71e810f640 2023-10-05T15:32:07.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.687+0000 7f71ec920700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f71d00a1800 0x7f71d00a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:07.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.694+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71dc097900 con 0x7f71e810f640 2023-10-05T15:32:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:07.696+0000 7f71ec920700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f71d00a1800 0x7f71d00a3cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005950 tx=0x7f71d80058e0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:08.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.072+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71c8005b20 con 0x7f71e810f640 2023-10-05T15:32:08.084 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-05T15:32:08.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.078+0000 7f71e5ffb700 1 -- 172.21.15.60:0/614882400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71dc0270a0 con 0x7f71e810f640 2023-10-05T15:32:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.088+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f71d00a1800 msgr2=0x7f71d00a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.088+0000 7f71cf7fe700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f71d00a1800 0x7f71d00a3cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005950 tx=0x7f71d80058e0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.088+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 msgr2=0x7f71e81a6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.088+0000 7f71cf7fe700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e81a6490 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009810 tx=0x7f71dc00b610 comp rx=0 tx=0).stop 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 shutdown_connections 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e811a690 0x7f71e81aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f71d00a1800 0x7f71d00a3cc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e81083f0 0x7f71e81a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 --2- 172.21.15.60:0/614882400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e810f640 0x7f71e81a6490 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 >> 172.21.15.60:0/614882400 conn(0x7f71e806d1a0 msgr2=0x7f71e8118680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 shutdown_connections 2023-10-05T15:32:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.089+0000 7f71cf7fe700 1 -- 172.21.15.60:0/614882400 wait complete. 2023-10-05T15:32:08.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:32:08.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:07 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1540986077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:32:08.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 -- 172.21.15.60:0/1086654240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0554100940 msgr2=0x7f0554104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 --2- 172.21.15.60:0/1086654240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0554100940 0x7f0554104980 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0550009990 tx=0x7f0550009ca0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 -- 172.21.15.60:0/1086654240 shutdown_connections 2023-10-05T15:32:08.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 --2- 172.21.15.60:0/1086654240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05541050b0 0x7f055410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 --2- 172.21.15.60:0/1086654240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05540fff90 0x7f0554100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 --2- 172.21.15.60:0/1086654240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0554100940 0x7f0554104980 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 -- 172.21.15.60:0/1086654240 >> 172.21.15.60:0/1086654240 conn(0x7f05540fb830 msgr2=0x7f05540fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 -- 172.21.15.60:0/1086654240 shutdown_connections 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.365+0000 7f055bb90700 1 -- 172.21.15.60:0/1086654240 wait complete. 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 Processor -- start 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 -- start start 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 0x7f055406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05541050b0 0x7f055406b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0554197380 0x7f0554199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0554199d80 con 0x7f05540fff90 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0554199ef0 con 0x7f0554197380 2023-10-05T15:32:08.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.366+0000 7f055bb90700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055419a0b0 con 0x7f05541050b0 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 0x7f055406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 0x7f055406b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42502/0 (socket says 172.21.15.60:42502) 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 -- 172.21.15.60:0/3952576172 learned_addr learned my addr 172.21.15.60:0/3952576172 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 -- 172.21.15.60:0/3952576172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05541050b0 msgr2=0x7f055406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05541050b0 0x7f055406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 -- 172.21.15.60:0/3952576172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0554197380 msgr2=0x7f0554199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0554197380 0x7f0554199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 -- 172.21.15.60:0/3952576172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500095f0 con 0x7f05540fff90 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.367+0000 7f055992c700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 0x7f055406b3c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f054400c9b0 tx=0x7f054400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.368+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544007b00 con 0x7f05540fff90 2023-10-05T15:32:08.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.368+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0544007c60 con 0x7f05540fff90 2023-10-05T15:32:08.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.368+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544018660 con 0x7f05540fff90 2023-10-05T15:32:08.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.368+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055419a330 con 0x7f05540fff90 2023-10-05T15:32:08.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.368+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055419a840 con 0x7f05540fff90 2023-10-05T15:32:08.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.370+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0554067c60 con 0x7f05540fff90 2023-10-05T15:32:08.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.375+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f054400f450 con 0x7f05540fff90 2023-10-05T15:32:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.376+0000 7f054affd700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f05400a16b0 0x7f05400a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.376+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 9731+0+0 (secure 0 0 0) 0x7f05440cd880 con 0x7f05540fff90 2023-10-05T15:32:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.376+0000 7f055912b700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f05400a16b0 0x7f05400a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.377+0000 7f055912b700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f05400a16b0 0x7f05400a3b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0550006010 tx=0x7f0550009530 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.378+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05440967f0 con 0x7f05540fff90 2023-10-05T15:32:08.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:07 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1540986077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:32:08.430 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:07 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1540986077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:32:08.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.740+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0554100b30 con 0x7f05540fff90 2023-10-05T15:32:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.745+0000 7f054affd700 1 -- 172.21.15.60:0/3952576172 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0544099e10 con 0x7f05540fff90 2023-10-05T15:32:08.758 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-05T15:32:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.758+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f05400a16b0 msgr2=0x7f05400a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.758+0000 7f055bb90700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f05400a16b0 0x7f05400a3b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0550006010 tx=0x7f0550009530 comp rx=0 tx=0).stop 2023-10-05T15:32:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.758+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 msgr2=0x7f055406b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.758+0000 7f055bb90700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 0x7f055406b3c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f054400c9b0 tx=0x7f054400cd70 comp rx=0 tx=0).stop 2023-10-05T15:32:08.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.761+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 shutdown_connections 2023-10-05T15:32:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.761+0000 7f055bb90700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f05400a16b0 0x7f05400a3b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.761+0000 7f055bb90700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0554197380 0x7f0554199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.761+0000 7f055bb90700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540fff90 0x7f055406b3c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.761+0000 7f055bb90700 1 --2- 172.21.15.60:0/3952576172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05541050b0 0x7f055406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.761+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 >> 172.21.15.60:0/3952576172 conn(0x7f05540fb830 msgr2=0x7f05540fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.764+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 shutdown_connections 2023-10-05T15:32:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:08.764+0000 7f055bb90700 1 -- 172.21.15.60:0/3952576172 wait complete. 2023-10-05T15:32:08.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:32:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.101+0000 7fa6c602c700 1 -- 172.21.15.60:0/978457255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c0100940 msgr2=0x7fa6c0104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.102+0000 7fa6c602c700 1 --2- 172.21.15.60:0/978457255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c0100940 0x7fa6c0104980 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009990 tx=0x7fa6a8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.104+0000 7fa6c602c700 1 -- 172.21.15.60:0/978457255 shutdown_connections 2023-10-05T15:32:09.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.104+0000 7fa6c602c700 1 --2- 172.21.15.60:0/978457255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 0x7fa6c010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.104+0000 7fa6c602c700 1 --2- 172.21.15.60:0/978457255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c00fff90 0x7fa6c0100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.104+0000 7fa6c602c700 1 --2- 172.21.15.60:0/978457255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c0100940 0x7fa6c0104980 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.104+0000 7fa6c602c700 1 -- 172.21.15.60:0/978457255 >> 172.21.15.60:0/978457255 conn(0x7fa6c00fb830 msgr2=0x7fa6c00fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.114+0000 7fa6c602c700 1 -- 172.21.15.60:0/978457255 shutdown_connections 2023-10-05T15:32:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.117+0000 7fa6c602c700 1 -- 172.21.15.60:0/978457255 wait complete. 2023-10-05T15:32:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.117+0000 7fa6c602c700 1 Processor -- start 2023-10-05T15:32:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 -- start start 2023-10-05T15:32:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c00fff90 0x7fa6c0194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 0x7fa6c01953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c01987e0 0x7fa6c0198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0199260 con 0x7fa6c01987e0 2023-10-05T15:32:09.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c01993a0 con 0x7fa6c00fff90 2023-10-05T15:32:09.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.118+0000 7fa6c602c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0199560 con 0x7fa6c01050b0 2023-10-05T15:32:09.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.127+0000 7fa6beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 0x7fa6c01953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:09.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.127+0000 7fa6beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 0x7fa6c01953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:56046/0 (socket says 172.21.15.60:56046) 2023-10-05T15:32:09.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.127+0000 7fa6beffd700 1 -- 172.21.15.60:0/1278769820 learned_addr learned my addr 172.21.15.60:0/1278769820 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:09.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.127+0000 7fa6bffff700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c01987e0 0x7fa6c0198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:09.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.128+0000 7fa6bffff700 1 -- 172.21.15.60:0/1278769820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 msgr2=0x7fa6c01953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:09.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.128+0000 7fa6bffff700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 0x7fa6c01953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.128+0000 7fa6bffff700 1 -- 172.21.15.60:0/1278769820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c00fff90 msgr2=0x7fa6c0194e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:32:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.128+0000 7fa6bffff700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c00fff90 0x7fa6c0194e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.128+0000 7fa6bffff700 1 -- 172.21.15.60:0/1278769820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80095f0 con 0x7fa6c01987e0 2023-10-05T15:32:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.128+0000 7fa6bffff700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c01987e0 0x7fa6c0198c90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8007f10 tx=0x7fa6b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:09.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.133+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800ddd0 con 0x7fa6c01987e0 2023-10-05T15:32:09.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.133+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6b800f040 con 0x7fa6c01987e0 2023-10-05T15:32:09.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.133+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8015400 con 0x7fa6c01987e0 2023-10-05T15:32:09.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.133+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c0199870 con 0x7fa6c01987e0 2023-10-05T15:32:09.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.133+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c0199d30 con 0x7fa6c01987e0 2023-10-05T15:32:09.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.138+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a0005320 con 0x7fa6c01987e0 2023-10-05T15:32:09.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.144+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa6b8004ad0 con 0x7fa6c01987e0 2023-10-05T15:32:09.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.145+0000 7fa6bcff9700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa6ac0a17f0 0x7fa6ac0a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:09.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.145+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 9731+0+0 (secure 0 0 0) 0x7fa6b80cd580 con 0x7fa6c01987e0 2023-10-05T15:32:09.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.149+0000 7fa6bf7fe700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa6ac0a17f0 0x7fa6ac0a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:09.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.150+0000 7fa6bf7fe700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa6ac0a17f0 0x7fa6ac0a3cb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009710 tx=0x7fa6b0006c60 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:09.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.151+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa6b8096400 con 0x7fa6c01987e0 2023-10-05T15:32:09.170 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:09 smithi060 ceph-mon[99238]: osdmap e116: 12 total, 12 up, 12 in 2023-10-05T15:32:09.171 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:09 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/614882400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:32:09.171 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:09 smithi060 ceph-mon[99238]: pgmap v487: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-05T15:32:09.171 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:09 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3952576172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:32:09.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:09 smithi135 ceph-mon[103360]: osdmap e116: 12 total, 12 up, 12 in 2023-10-05T15:32:09.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:09 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/614882400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:32:09.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:09 smithi135 ceph-mon[103360]: pgmap v487: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-05T15:32:09.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:09 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3952576172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:32:09.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:09 smithi092 ceph-mon[102944]: osdmap e116: 12 total, 12 up, 12 in 2023-10-05T15:32:09.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:09 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/614882400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:32:09.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:09 smithi092 ceph-mon[102944]: pgmap v487: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-05T15:32:09.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:09 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3952576172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:32:09.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.569+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6a0005190 con 0x7fa6c01987e0 2023-10-05T15:32:09.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.573+0000 7fa6bcff9700 1 -- 172.21.15.60:0/1278769820 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v116) v1 ==== 81+0+943 (secure 0 0 0) 0x7fa6b8023030 con 0x7fa6c01987e0 2023-10-05T15:32:09.575 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3221256091 2023-10-06T15:16:49.530067+0000 2023-10-05T15:32:09.575 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3008673646 2023-10-06T15:16:49.530067+0000 2023-10-05T15:32:09.575 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/3043189857 2023-10-06T15:16:49.530067+0000 2023-10-05T15:32:09.575 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3001974532 2023-10-06T15:16:49.530067+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/303168486 2023-10-06T15:16:49.530067+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1216724188 2023-10-06T15:08:45.079337+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/2843655042 2023-10-06T15:08:45.079337+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/2843655042 2023-10-06T15:08:45.079337+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4045235795 2023-10-06T15:08:18.717027+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4067501312 2023-10-06T15:08:18.717027+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4045235795 2023-10-06T15:08:18.717027+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4231976701 2023-10-06T15:08:45.079337+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2162692982 2023-10-06T15:08:18.717027+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/3043189857 2023-10-06T15:16:49.530067+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/649476863 2023-10-06T15:08:18.717027+0000 2023-10-05T15:32:09.576 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/364014604 2023-10-06T15:08:45.079337+0000 2023-10-05T15:32:09.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.576+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa6ac0a17f0 msgr2=0x7fa6ac0a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:09.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.576+0000 7fa6c602c700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa6ac0a17f0 0x7fa6ac0a3cb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009710 tx=0x7fa6b0006c60 comp rx=0 tx=0).stop 2023-10-05T15:32:09.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.576+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c01987e0 msgr2=0x7fa6c0198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:09.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.576+0000 7fa6c602c700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c01987e0 0x7fa6c0198c90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8007f10 tx=0x7fa6b800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.577+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 shutdown_connections 2023-10-05T15:32:09.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.577+0000 7fa6c602c700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6c01987e0 0x7fa6c0198c90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.577+0000 7fa6c602c700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fa6ac0a17f0 0x7fa6ac0a3cb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.577+0000 7fa6c602c700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c00fff90 0x7fa6c0194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.577+0000 7fa6c602c700 1 --2- 172.21.15.60:0/1278769820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c01050b0 0x7fa6c01953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:09.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.577+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 >> 172.21.15.60:0/1278769820 conn(0x7fa6c00fb830 msgr2=0x7fa6c00fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:09.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.581+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 shutdown_connections 2023-10-05T15:32:09.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:09.583+0000 7fa6c602c700 1 -- 172.21.15.60:0/1278769820 wait complete. 2023-10-05T15:32:09.601 INFO:teuthology.orchestra.run.smithi060.stderr:listed 16 entries 2023-10-05T15:32:09.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-05T15:32:09.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:09.626 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-05T15:32:10.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:32:10.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:10.164 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-05T15:32:10.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:10.298 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-05T15:32:10.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:10 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1278769820' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:32:10.425 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:10 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1278769820' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:32:10.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:10 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1278769820' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:32:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-05T15:32:10.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:10.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-05T15:32:10.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:10.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-05T15:32:10.875 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-05T15:32:10.876 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-05T15:32:10.876 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:32:10.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1832 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/a3567ba73698be9d5bd4ff8f7457aa29910f9e075755e49cc77c771a6313f2a2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/a3567ba73698be9d5bd4ff8f7457aa29910f9e075755e49cc77c771a6313f2a2/diff,workdir=/var/lib/containers/storage/overlay/a3567ba73698be9d5bd4ff8f7457aa29910f9e075755e49cc77c771a6313f2a2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f6074f2f444060461ada69f1eb0c0116b4fca51d7ad55bb70b463411ad2ab1a8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/f6074f2f444060461ada69f1eb0c0116b4fca51d7ad55bb70b463411ad2ab1a8/diff,workdir=/var/lib/containers/storage/overlay/f6074f2f444060461ada69f1eb0c0116b4fca51d7ad55bb70b463411ad2ab1a8/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/08ffc18a4f613c923e2e103a58fb69560c18a24496ee0afcc3b3d4078d1ad062/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/08ffc18a4f613c923e2e103a58fb69560c18a24496ee0afcc3b3d4078d1ad062/diff,workdir=/var/lib/containers/storage/overlay/08ffc18a4f613c923e2e103a58fb69560c18a24496ee0afcc3b3d4078d1ad062/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e6a70e94f58e35d081a793dbb6525ab8cba8abf78735fb52515d060bf0439f59/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/e6a70e94f58e35d081a793dbb6525ab8cba8abf78735fb52515d060bf0439f59/diff,workdir=/var/lib/containers/storage/overlay/e6a70e94f58e35d081a793dbb6525ab8cba8abf78735fb52515d060bf0439f59/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/962c2103d26acf697ed49645084394eefedb308beb0f3d5ef1aba1b1eedc12ae/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/962c2103d26acf697ed49645084394eefedb308beb0f3d5ef1aba1b1eedc12ae/diff,workdir=/var/lib/containers/storage/overlay/962c2103d26acf697ed49645084394eefedb308beb0f3d5ef1aba1b1eedc12ae/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/98b16ee777535fe2d26f03b6df0f8756356d207f1a4e72e379d94bad1c633e9f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/98b16ee777535fe2d26f03b6df0f8756356d207f1a4e72e379d94bad1c633e9f/diff,workdir=/var/lib/containers/storage/overlay/98b16ee777535fe2d26f03b6df0f8756356d207f1a4e72e379d94bad1c633e9f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2bcf59923e36b3d3ceba135a4dd596fefed6bbf6360c28bb4ab0b9792a412a4e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/2bcf59923e36b3d3ceba135a4dd596fefed6bbf6360c28bb4ab0b9792a412a4e/diff,workdir=/var/lib/containers/storage/overlay/2bcf59923e36b3d3ceba135a4dd596fefed6bbf6360c28bb4ab0b9792a412a4e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/be1090f2978af41197824bf16111cbbd1051d71d10c2e82ada08e3fd3711fd76/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/be1090f2978af41197824bf16111cbbd1051d71d10c2e82ada08e3fd3711fd76/diff,workdir=/var/lib/containers/storage/overlay/be1090f2978af41197824bf16111cbbd1051d71d10c2e82ada08e3fd3711fd76/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/4523ace40912bed7e267d1f4ff0507a68cc559ca995df9cce2119317dc02f49b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/4523ace40912bed7e267d1f4ff0507a68cc559ca995df9cce2119317dc02f49b/diff,workdir=/var/lib/containers/storage/overlay/4523ace40912bed7e267d1f4ff0507a68cc559ca995df9cce2119317dc02f49b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/34e4696f7caba1ad03bb6cf08c85246cc16ae3eb3eecdeda23f12516b5c86b70/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4QSMPIAY3VJJ34NZUCPMQCKB3P:/var/lib/containers/storage/overlay/l/75J675YAH7PCGMIKXKRNR236EF,upperdir=/var/lib/containers/storage/overlay/34e4696f7caba1ad03bb6cf08c85246cc16ae3eb3eecdeda23f12516b5c86b70/diff,workdir=/var/lib/containers/storage/overlay/34e4696f7caba1ad03bb6cf08c85246cc16ae3eb3eecdeda23f12516b5c86b70/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-05T15:32:10.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:10.972 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-05T15:32:11.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:32:11.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-05T15:32:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-05T15:32:11.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:32:11.270 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-05T15:32:11.281 INFO:tasks.cephadm:Teardown begin 2023-10-05T15:32:11.282 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-05T15:32:11.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:32:11.283 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:11 smithi060 ceph-mon[99238]: pgmap v488: 129 pgs: 15 active+clean+snaptrim, 44 active+clean+snaptrim_wait, 70 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-05T15:32:11.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:11 smithi092 ceph-mon[102944]: pgmap v488: 129 pgs: 15 active+clean+snaptrim, 44 active+clean+snaptrim_wait, 70 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-05T15:32:11.581 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:11 smithi135 ceph-mon[103360]: pgmap v488: 129 pgs: 15 active+clean+snaptrim, 44 active+clean+snaptrim_wait, 70 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-05T15:32:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.602+0000 7f75891c5700 1 -- 172.21.15.60:0/2694710258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f758410f640 msgr2=0x7f7584107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.602+0000 7f75891c5700 1 --2- 172.21.15.60:0/2694710258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f758410f640 0x7f7584107eb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7574009990 tx=0x7f7574009ca0 comp rx=0 tx=0).stop 2023-10-05T15:32:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.606+0000 7f75891c5700 1 -- 172.21.15.60:0/2694710258 shutdown_connections 2023-10-05T15:32:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.606+0000 7f75891c5700 1 --2- 172.21.15.60:0/2694710258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f758411a690 0x7f758411ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.606+0000 7f75891c5700 1 --2- 172.21.15.60:0/2694710258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f758410f640 0x7f7584107eb0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.606+0000 7f75891c5700 1 --2- 172.21.15.60:0/2694710258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75841083f0 0x7f7584108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.606+0000 7f75891c5700 1 -- 172.21.15.60:0/2694710258 >> 172.21.15.60:0/2694710258 conn(0x7f758406bf20 msgr2=0x7f758406c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:11.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.630+0000 7f75891c5700 1 -- 172.21.15.60:0/2694710258 shutdown_connections 2023-10-05T15:32:11.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.630+0000 7f75891c5700 1 -- 172.21.15.60:0/2694710258 wait complete. 2023-10-05T15:32:11.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.631+0000 7f75891c5700 1 Processor -- start 2023-10-05T15:32:11.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.631+0000 7f75891c5700 1 -- start start 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.631+0000 7f75891c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758410f640 0x7f75841a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.631+0000 7f75891c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f758411a690 0x7f75841a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.632+0000 7f75891c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 0x7f75841aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.632+0000 7f75891c5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75841ab510 con 0x7f75841aaa90 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.632+0000 7f75891c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75841ab650 con 0x7f758410f640 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.632+0000 7f75891c5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75841ab7c0 con 0x7f758411a690 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.633+0000 7f758359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 0x7f75841aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.633+0000 7f758359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 0x7f75841aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42524/0 (socket says 172.21.15.60:42524) 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.633+0000 7f758359e700 1 -- 172.21.15.60:0/825216301 learned_addr learned my addr 172.21.15.60:0/825216301 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:11.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.635+0000 7f7582d9d700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758410f640 0x7f75841a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f758359e700 1 -- 172.21.15.60:0/825216301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f758411a690 msgr2=0x7f75841a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f758359e700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f758411a690 0x7f75841a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f758359e700 1 -- 172.21.15.60:0/825216301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758410f640 msgr2=0x7f75841a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f758359e700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758410f640 0x7f75841a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f758359e700 1 -- 172.21.15.60:0/825216301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740095f0 con 0x7f75841aaa90 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f7582d9d700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758410f640 0x7f75841a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:32:11.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.637+0000 7f758359e700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 0x7f75841aaf10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f757800b450 tx=0x7f757800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:11.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.640+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578011830 con 0x7f75841aaa90 2023-10-05T15:32:11.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.640+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7578011e50 con 0x7f75841aaa90 2023-10-05T15:32:11.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.640+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758410fe70 con 0x7f75841aaa90 2023-10-05T15:32:11.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.640+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757800f2e0 con 0x7f75841aaa90 2023-10-05T15:32:11.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.640+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7584110380 con 0x7f75841aaa90 2023-10-05T15:32:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.644+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f757800f440 con 0x7f75841aaa90 2023-10-05T15:32:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.645+0000 7f756bfff700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f756c0a1850 0x7f756c0a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.645+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 9731+0+0 (secure 0 0 0) 0x7f75780cdef0 con 0x7f75841aaa90 2023-10-05T15:32:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.646+0000 7f7582d9d700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f756c0a1850 0x7f756c0a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.647+0000 7f7582d9d700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f756c0a1850 0x7f756c0a3d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7574003800 tx=0x7f7574005fb0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.649+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7570005320 con 0x7f75841aaa90 2023-10-05T15:32:11.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:11.667+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7578096e00 con 0x7f75841aaa90 2023-10-05T15:32:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.133+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7570005190 con 0x7f75841aaa90 2023-10-05T15:32:12.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.139+0000 7f756bfff700 1 -- 172.21.15.60:0/825216301 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+11381 (secure 0 0 0) 0x7f7578015030 con 0x7f75841aaa90 2023-10-05T15:32:12.148 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:32:12.149 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:32:02.833598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":58,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[1,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25822":{"gid":25822,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/2042143293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2042143293},{"type":"v1","addr":"172.21.15.135:6835","nonce":2042143293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.153+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f756c0a1850 msgr2=0x7f756c0a3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.153+0000 7f75891c5700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f756c0a1850 0x7f756c0a3d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7574003800 tx=0x7f7574005fb0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.153+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 msgr2=0x7f75841aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.153+0000 7f75891c5700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 0x7f75841aaf10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f757800b450 tx=0x7f757800b810 comp rx=0 tx=0).stop 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.154+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 shutdown_connections 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.154+0000 7f75891c5700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75841aaa90 0x7f75841aaf10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.154+0000 7f75891c5700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f756c0a1850 0x7f756c0a3d10 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7574003800 tx=0x7f7574005fb0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.154+0000 7f75891c5700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758410f640 0x7f75841a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.154+0000 7f75891c5700 1 --2- 172.21.15.60:0/825216301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f758411a690 0x7f75841a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.154+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 >> 172.21.15.60:0/825216301 conn(0x7f758406bf20 msgr2=0x7f7584118680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:12.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.165+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 shutdown_connections 2023-10-05T15:32:12.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.172+0000 7f75891c5700 1 -- 172.21.15.60:0/825216301 wait complete. 2023-10-05T15:32:12.192 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 49 2023-10-05T15:32:12.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:32:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 -- 172.21.15.60:0/2743431134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 msgr2=0x7fb8780ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 --2- 172.21.15.60:0/2743431134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 0x7fb8780ff2d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb87401a9a0 tx=0x7fb87401acb0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 -- 172.21.15.60:0/2743431134 shutdown_connections 2023-10-05T15:32:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 --2- 172.21.15.60:0/2743431134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878111b40 0x7fb878113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 --2- 172.21.15.60:0/2743431134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 0x7fb8780ff2d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 --2- 172.21.15.60:0/2743431134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8780ff810 0x7fb8780ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.491+0000 7fb87f99a700 1 -- 172.21.15.60:0/2743431134 >> 172.21.15.60:0/2743431134 conn(0x7fb878074bb0 msgr2=0x7fb878074fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:12.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.498+0000 7fb87f99a700 1 -- 172.21.15.60:0/2743431134 shutdown_connections 2023-10-05T15:32:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.503+0000 7fb87f99a700 1 -- 172.21.15.60:0/2743431134 wait complete. 2023-10-05T15:32:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.504+0000 7fb87f99a700 1 Processor -- start 2023-10-05T15:32:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 -- start start 2023-10-05T15:32:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 0x7fb87810ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 0x7fb87810d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878111b40 0x7fb8781c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781c3140 con 0x7fb878106e10 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781c3280 con 0x7fb878111b40 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87f99a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781c3440 con 0x7fb8780ff810 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87d736700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 0x7fb87810ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87d736700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 0x7fb87810ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:56068/0 (socket says 172.21.15.60:56068) 2023-10-05T15:32:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.512+0000 7fb87d736700 1 -- 172.21.15.60:0/3562974761 learned_addr learned my addr 172.21.15.60:0/3562974761 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.514+0000 7fb87d736700 1 -- 172.21.15.60:0/3562974761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878111b40 msgr2=0x7fb8781c2b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:32:12.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.514+0000 7fb87d736700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878111b40 0x7fb8781c2b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.514+0000 7fb87d736700 1 -- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 msgr2=0x7fb87810d350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.514+0000 7fb87d736700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 0x7fb87810d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.514+0000 7fb87d736700 1 -- 172.21.15.60:0/3562974761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87401a600 con 0x7fb8780ff810 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.514+0000 7fb87d736700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 0x7fb87810ce10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb874003890 tx=0x7fb874005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.519+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8740040a0 con 0x7fb8780ff810 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.519+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb874004200 con 0x7fb8780ff810 2023-10-05T15:32:12.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.519+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87401f6e0 con 0x7fb8780ff810 2023-10-05T15:32:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.524+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8781c36c0 con 0x7fb8780ff810 2023-10-05T15:32:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.524+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8781c3af0 con 0x7fb8780ff810 2023-10-05T15:32:12.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.527+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb87400f480 con 0x7fb8780ff810 2023-10-05T15:32:12.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.528+0000 7fb86e7fc700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8640a17d0 0x7fb8640a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:12.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.529+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 9731+0+0 (secure 0 0 0) 0x7fb8740ced10 con 0x7fb8780ff810 2023-10-05T15:32:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.530+0000 7fb87cf35700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8640a17d0 0x7fb8640a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.531+0000 7fb87cf35700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8640a17d0 0x7fb8640a3c90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb878111a80 tx=0x7fb868006c60 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.531+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb878068120 con 0x7fb8780ff810 2023-10-05T15:32:12.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.542+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb874097c90 con 0x7fb8780ff810 2023-10-05T15:32:12.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.995+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb878109a20 con 0x7fb8780ff810 2023-10-05T15:32:13.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:12.998+0000 7fb86e7fc700 1 -- 172.21.15.60:0/3562974761 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+11380 (secure 0 0 0) 0x7fb874013090 con 0x7fb8780ff810 2023-10-05T15:32:13.000 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:32:13.000 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2448218707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2448218707},{"type":"v1","addr":"172.21.15.60:6835","nonce":2448218707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/416878759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":416878759},{"type":"v1","addr":"172.21.15.60:6837","nonce":416878759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:14:47.613338+0000","modified":"2023-10-05T15:32:12.045328+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24496,"mds_2":24488,"mds_3":24472,"mds_4":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1500527837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1500527837},{"type":"v1","addr":"172.21.15.60:6839","nonce":1500527837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1110694579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1110694579},{"type":"v1","addr":"172.21.15.60:6841","nonce":1110694579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3118655820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3118655820},{"type":"v1","addr":"172.21.15.135:6833","nonce":3118655820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/1259260250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1259260250},{"type":"v1","addr":"172.21.15.92:6833","nonce":1259260250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"e","rank":4,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.92:6835/2553924574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2553924574},{"type":"v1","addr":"172.21.15.92:6835","nonce":2553924574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24472":{"gid":24472,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.135:6837/2461370959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2461370959},{"type":"v1","addr":"172.21.15.135:6837","nonce":2461370959}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.92:6837/1596160002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1596160002},{"type":"v1","addr":"172.21.15.92:6837","nonce":1596160002}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":58,"addr":"172.21.15.135:6839/1073230370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1073230370},{"type":"v1","addr":"172.21.15.135:6839","nonce":1073230370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/3541269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3541269},{"type":"v1","addr":"172.21.15.92:6839","nonce":3541269}]},"join_fscid":-1,"export_targets":[1,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25822":{"gid":25822,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/2042143293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2042143293},{"type":"v1","addr":"172.21.15.135:6835","nonce":2042143293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:32:13.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.004+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8640a17d0 msgr2=0x7fb8640a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.004+0000 7fb87f99a700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8640a17d0 0x7fb8640a3c90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb878111a80 tx=0x7fb868006c60 comp rx=0 tx=0).stop 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.004+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 msgr2=0x7fb87810ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.004+0000 7fb87f99a700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 0x7fb87810ce10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb874003890 tx=0x7fb874005800 comp rx=0 tx=0).stop 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.005+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 shutdown_connections 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.005+0000 7fb87f99a700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fb8640a17d0 0x7fb8640a3c90 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb878111a80 tx=0x7fb868006c60 comp rx=0 tx=0).stop 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.005+0000 7fb87f99a700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878111b40 0x7fb8781c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.005+0000 7fb87f99a700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780ff810 0x7fb87810ce10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.005+0000 7fb87f99a700 1 --2- 172.21.15.60:0/3562974761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878106e10 0x7fb87810d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.005+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 >> 172.21.15.60:0/3562974761 conn(0x7fb878074bb0 msgr2=0x7fb8780fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.011+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 shutdown_connections 2023-10-05T15:32:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.016+0000 7fb87f99a700 1 -- 172.21.15.60:0/3562974761 wait complete. 2023-10-05T15:32:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 50 2023-10-05T15:32:13.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:32:13.083 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:12 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/825216301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:32:13.145 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:12 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/825216301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:32:13.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:12 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/825216301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:32:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.327+0000 7f9321981700 1 -- 172.21.15.60:0/7881893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 msgr2=0x7f931c11ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.327+0000 7f9321981700 1 --2- 172.21.15.60:0/7881893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 0x7f931c11ca80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f930c01a9a0 tx=0x7f930c01acb0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 -- 172.21.15.60:0/7881893 shutdown_connections 2023-10-05T15:32:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 --2- 172.21.15.60:0/7881893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 0x7f931c11ca80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 --2- 172.21.15.60:0/7881893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 0x7f931c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 --2- 172.21.15.60:0/7881893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 -- 172.21.15.60:0/7881893 >> 172.21.15.60:0/7881893 conn(0x7f931c06bf20 msgr2=0x7f931c06c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 -- 172.21.15.60:0/7881893 shutdown_connections 2023-10-05T15:32:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.328+0000 7f9321981700 1 -- 172.21.15.60:0/7881893 wait complete. 2023-10-05T15:32:13.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.329+0000 7f9321981700 1 Processor -- start 2023-10-05T15:32:13.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.329+0000 7f9321981700 1 -- start start 2023-10-05T15:32:13.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f9321981700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:13.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f9321981700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 0x7f931c115e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f9321981700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 0x7f931c1a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f9321981700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1a9910 con 0x7f931c1083f0 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f9321981700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1a9a50 con 0x7f931c11a690 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f9321981700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1a9bc0 con 0x7f931c10f640 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f931affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f931affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42548/0 (socket says 172.21.15.60:42548) 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f931affd700 1 -- 172.21.15.60:0/1072289867 learned_addr learned my addr 172.21.15.60:0/1072289867 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f931a7fc700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 0x7f931c115e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.330+0000 7f931b7fe700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 0x7f931c1a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f931affd700 1 -- 172.21.15.60:0/1072289867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 msgr2=0x7f931c115e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f931affd700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 0x7f931c115e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f931affd700 1 -- 172.21.15.60:0/1072289867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 msgr2=0x7f931c1a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f931affd700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 0x7f931c1a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f931affd700 1 -- 172.21.15.60:0/1072289867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c01a600 con 0x7f931c1083f0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f931affd700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c115910 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f931400ef10 tx=0x7f931400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400c960 con 0x7f931c1083f0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f931400f040 con 0x7f931c1083f0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.331+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314014480 con 0x7f931c1083f0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.332+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c1a9e40 con 0x7f931c1083f0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.332+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c1aa270 con 0x7f931c1083f0 2023-10-05T15:32:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.335+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c067cd0 con 0x7f931c1083f0 2023-10-05T15:32:13.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.336+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9314007690 con 0x7f931c1083f0 2023-10-05T15:32:13.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.337+0000 7f932097f700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93040a1770 0x7f93040a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:13.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.337+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 9731+0+0 (secure 0 0 0) 0x7f93140cd2c0 con 0x7f931c1083f0 2023-10-05T15:32:13.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.340+0000 7f931a7fc700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 0x7f931c115e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:32:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.345+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9314096150 con 0x7f931c1083f0 2023-10-05T15:32:13.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.348+0000 7f931a7fc700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93040a1770 0x7f93040a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:13.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.369+0000 7f931a7fc700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93040a1770 0x7f93040a3c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f931c116fd0 tx=0x7f9310009190 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.717+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f931c116c60 con 0x7f931c1083f0 2023-10-05T15:32:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.725+0000 7f932097f700 1 -- 172.21.15.60:0/1072289867 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+25473 (secure 0 0 0) 0x7f9314099770 con 0x7f931c1083f0 2023-10-05T15:32:13.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-05T15:32:13.735 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"d07a9b62-6390-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:07:46.061674+0000","modified":"2023-10-05T15:32:07.920560+0000","last_up_change":"2023-10-05T15:14:05.944145+0000","last_in_change":"2023-10-05T15:13:48.455686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:10:55.610302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:14:46.019473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:14:46.977332+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:14:50.647849+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"347f2ced-67e4-4e5a-9259-3bbb7716df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6803","nonce":3848725098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6805","nonce":3848725098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6809","nonce":3848725098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3848725098},{"type":"v1","addr":"172.21.15.60:6807","nonce":3848725098}]},"public_addr":"172.21.15.60:6803/3848725098","cluster_addr":"172.21.15.60:6805/3848725098","heartbeat_back_addr":"172.21.15.60:6809/3848725098","heartbeat_front_addr":"172.21.15.60:6807/3848725098","state":["exists","up"]},{"osd":1,"uuid":"31b61e8d-4c45-43bd-ae04-807def1aa75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6801","nonce":502814453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6803","nonce":502814453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6807","nonce":502814453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":502814453},{"type":"v1","addr":"172.21.15.92:6805","nonce":502814453}]},"public_addr":"172.21.15.92:6801/502814453","cluster_addr":"172.21.15.92:6803/502814453","heartbeat_back_addr":"172.21.15.92:6807/502814453","heartbeat_front_addr":"172.21.15.92:6805/502814453","state":["exists","up"]},{"osd":2,"uuid":"d5814980-a6fb-4a86-86f0-d59539b4515a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6801","nonce":391606832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6803","nonce":391606832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6807","nonce":391606832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":391606832},{"type":"v1","addr":"172.21.15.135:6805","nonce":391606832}]},"public_addr":"172.21.15.135:6801/391606832","cluster_addr":"172.21.15.135:6803/391606832","heartbeat_back_addr":"172.21.15.135:6807/391606832","heartbeat_front_addr":"172.21.15.135:6805/391606832","state":["exists","up"]},{"osd":3,"uuid":"5847cb91-24d6-43e4-ad16-e1410664b98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6811","nonce":4586473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6813","nonce":4586473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6817","nonce":4586473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":4586473},{"type":"v1","addr":"172.21.15.60:6815","nonce":4586473}]},"public_addr":"172.21.15.60:6811/4586473","cluster_addr":"172.21.15.60:6813/4586473","heartbeat_back_addr":"172.21.15.60:6817/4586473","heartbeat_front_addr":"172.21.15.60:6815/4586473","state":["exists","up"]},{"osd":4,"uuid":"0d375042-3a53-4d3d-87c6-a23e1312fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6809","nonce":3732185580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6811","nonce":3732185580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6815","nonce":3732185580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3732185580},{"type":"v1","addr":"172.21.15.92:6813","nonce":3732185580}]},"public_addr":"172.21.15.92:6809/3732185580","cluster_addr":"172.21.15.92:6811/3732185580","heartbeat_back_addr":"172.21.15.92:6815/3732185580","heartbeat_front_addr":"172.21.15.92:6813/3732185580","state":["exists","up"]},{"osd":5,"uuid":"5967fc00-aa3b-4b43-ac63-4b5444cbf486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6809","nonce":3143637698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6811","nonce":3143637698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6815","nonce":3143637698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3143637698},{"type":"v1","addr":"172.21.15.135:6813","nonce":3143637698}]},"public_addr":"172.21.15.135:6809/3143637698","cluster_addr":"172.21.15.135:6811/3143637698","heartbeat_back_addr":"172.21.15.135:6815/3143637698","heartbeat_front_addr":"172.21.15.135:6813/3143637698","state":["exists","up"]},{"osd":6,"uuid":"acf54d89-6f62-4433-90cf-d1f90de08ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6819","nonce":2234761108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6821","nonce":2234761108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6825","nonce":2234761108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2234761108},{"type":"v1","addr":"172.21.15.60:6823","nonce":2234761108}]},"public_addr":"172.21.15.60:6819/2234761108","cluster_addr":"172.21.15.60:6821/2234761108","heartbeat_back_addr":"172.21.15.60:6825/2234761108","heartbeat_front_addr":"172.21.15.60:6823/2234761108","state":["exists","up"]},{"osd":7,"uuid":"575cac22-a90b-42aa-9b1f-c2cd5fbd82e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6817","nonce":784886390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6819","nonce":784886390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6823","nonce":784886390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":784886390},{"type":"v1","addr":"172.21.15.92:6821","nonce":784886390}]},"public_addr":"172.21.15.92:6817/784886390","cluster_addr":"172.21.15.92:6819/784886390","heartbeat_back_addr":"172.21.15.92:6823/784886390","heartbeat_front_addr":"172.21.15.92:6821/784886390","state":["exists","up"]},{"osd":8,"uuid":"30b375fe-d15e-48c7-8154-3c1aeeaf4b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6817","nonce":2545710917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6819","nonce":2545710917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6823","nonce":2545710917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2545710917},{"type":"v1","addr":"172.21.15.135:6821","nonce":2545710917}]},"public_addr":"172.21.15.135:6817/2545710917","cluster_addr":"172.21.15.135:6819/2545710917","heartbeat_back_addr":"172.21.15.135:6823/2545710917","heartbeat_front_addr":"172.21.15.135:6821/2545710917","state":["exists","up"]},{"osd":9,"uuid":"944c5503-34c9-4e9c-9429-fd03f0e9013b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6827","nonce":2673223699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6829","nonce":2673223699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6833","nonce":2673223699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2673223699},{"type":"v1","addr":"172.21.15.60:6831","nonce":2673223699}]},"public_addr":"172.21.15.60:6827/2673223699","cluster_addr":"172.21.15.60:6829/2673223699","heartbeat_back_addr":"172.21.15.60:6833/2673223699","heartbeat_front_addr":"172.21.15.60:6831/2673223699","state":["exists","up"]},{"osd":10,"uuid":"7809fa8d-bdd5-4fe7-8057-6ac9f82a8381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6825","nonce":2400346223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6827","nonce":2400346223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6831","nonce":2400346223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2400346223},{"type":"v1","addr":"172.21.15.92:6829","nonce":2400346223}]},"public_addr":"172.21.15.92:6825/2400346223","cluster_addr":"172.21.15.92:6827/2400346223","heartbeat_back_addr":"172.21.15.92:6831/2400346223","heartbeat_front_addr":"172.21.15.92:6829/2400346223","state":["exists","up"]},{"osd":11,"uuid":"b44347aa-119e-4c10-a5c7-56ae0b781fbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6825","nonce":2696703622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6827","nonce":2696703622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6831","nonce":2696703622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2696703622},{"type":"v1","addr":"172.21.15.135:6829","nonce":2696703622}]},"public_addr":"172.21.15.135:6825/2696703622","cluster_addr":"172.21.15.135:6827/2696703622","heartbeat_back_addr":"172.21.15.135:6831/2696703622","heartbeat_front_addr":"172.21.15.135:6829/2696703622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:09.386357+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:30.717533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:10:52.333635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:13.793814+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:35.037386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:11:56.099501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:17.999495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:12:39.276972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:00.330360+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:21.646728+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:13:43.209807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:14:04.290633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/3221256091":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/3008673646":"2023-10-06T15:16:49.530067+0000","172.21.15.60:6801/3043189857":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/3001974532":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/303168486":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/1216724188":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6801/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/2843655042":"2023-10-06T15:08:45.079337+0000","172.21.15.60:6800/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4067501312":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6801/4045235795":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/4231976701":"2023-10-06T15:08:45.079337+0000","172.21.15.60:0/2162692982":"2023-10-06T15:08:18.717027+0000","172.21.15.60:6800/3043189857":"2023-10-06T15:16:49.530067+0000","172.21.15.60:0/649476863":"2023-10-06T15:08:18.717027+0000","172.21.15.60:0/364014604":"2023-10-06T15:08:45.079337+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:32:13.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.734+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93040a1770 msgr2=0x7f93040a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.734+0000 7f9321981700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93040a1770 0x7f93040a3c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f931c116fd0 tx=0x7f9310009190 comp rx=0 tx=0).stop 2023-10-05T15:32:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.734+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 msgr2=0x7f931c115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.734+0000 7f9321981700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c115910 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f931400ef10 tx=0x7f931400c3a0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.741+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 shutdown_connections 2023-10-05T15:32:13.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.741+0000 7f9321981700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f93040a1770 0x7f93040a3c30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.741+0000 7f9321981700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c11a690 0x7f931c1a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.741+0000 7f9321981700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1083f0 0x7f931c115910 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.741+0000 7f9321981700 1 --2- 172.21.15.60:0/1072289867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f931c10f640 0x7f931c115e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.741+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 >> 172.21.15.60:0/1072289867 conn(0x7f931c06bf20 msgr2=0x7f931c11aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:13.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.756+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 shutdown_connections 2023-10-05T15:32:13.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:13.761+0000 7f9321981700 1 -- 172.21.15.60:0/1072289867 wait complete. 2023-10-05T15:32:13.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-05T15:32:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.076+0000 7f601b0fa700 1 -- 172.21.15.60:0/3955189948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60141086e0 msgr2=0x7f6014108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.076+0000 7f601b0fa700 1 --2- 172.21.15.60:0/3955189948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60141086e0 0x7f6014108b50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009990 tx=0x7f5ffc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:13 smithi135 ceph-mon[103360]: pgmap v489: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 41 KiB/s wr, 27 op/s 2023-10-05T15:32:14.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:13 smithi135 ceph-mon[103360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:14.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:13 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3562974761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:13 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/1072289867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.080+0000 7f601b0fa700 1 -- 172.21.15.60:0/3955189948 shutdown_connections 2023-10-05T15:32:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.080+0000 7f601b0fa700 1 --2- 172.21.15.60:0/3955189948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60141086e0 0x7f6014108b50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.080+0000 7f601b0fa700 1 --2- 172.21.15.60:0/3955189948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6014109850 0x7f6014109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.080+0000 7f601b0fa700 1 --2- 172.21.15.60:0/3955189948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601410a170 0x7f60141128c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.080+0000 7f601b0fa700 1 -- 172.21.15.60:0/3955189948 >> 172.21.15.60:0/3955189948 conn(0x7f601406d1a0 msgr2=0x7f601406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:14.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.088+0000 7f601b0fa700 1 -- 172.21.15.60:0/3955189948 shutdown_connections 2023-10-05T15:32:14.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.091+0000 7f601b0fa700 1 -- 172.21.15.60:0/3955189948 wait complete. 2023-10-05T15:32:14.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.092+0000 7f601b0fa700 1 Processor -- start 2023-10-05T15:32:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 -- start start 2023-10-05T15:32:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141086e0 0x7f60141122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6014109850 0x7f6014112810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 0x7f601410f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601410fbd0 con 0x7f601410a170 2023-10-05T15:32:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601410fd40 con 0x7f6014109850 2023-10-05T15:32:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.097+0000 7f601b0fa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601410ff00 con 0x7f60141086e0 2023-10-05T15:32:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 0x7f601410f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 0x7f601410f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42562/0 (socket says 172.21.15.60:42562) 2023-10-05T15:32:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 -- 172.21.15.60:0/377745863 learned_addr learned my addr 172.21.15.60:0/377745863 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 -- 172.21.15.60:0/377745863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141086e0 msgr2=0x7f60141122d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:32:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141086e0 0x7f60141122d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 -- 172.21.15.60:0/377745863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6014109850 msgr2=0x7f6014112810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:32:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6014109850 0x7f6014112810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.098+0000 7f6019697700 1 -- 172.21.15.60:0/377745863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc0095f0 con 0x7f601410a170 2023-10-05T15:32:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.099+0000 7f6019697700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 0x7f601410f400 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc004710 tx=0x7f5ffc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:14.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.108+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc01d070 con 0x7f601410a170 2023-10-05T15:32:14.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.108+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ffc004830 con 0x7f601410a170 2023-10-05T15:32:14.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.108+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0054e0 con 0x7f601410a170 2023-10-05T15:32:14.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.108+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60141a7e70 con 0x7f601410a170 2023-10-05T15:32:14.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.108+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60141a8330 con 0x7f601410a170 2023-10-05T15:32:14.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.110+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6014067c60 con 0x7f601410a170 2023-10-05T15:32:14.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.111+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5ffc022470 con 0x7f601410a170 2023-10-05T15:32:14.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.112+0000 7f6011ffb700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60000a17c0 0x7f60000a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:14.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.112+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 9731+0+0 (secure 0 0 0) 0x7f5ffc0ced70 con 0x7f601410a170 2023-10-05T15:32:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.118+0000 7f6018e96700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60000a17c0 0x7f60000a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.119+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ffc097be0 con 0x7f601410a170 2023-10-05T15:32:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.133+0000 7f6018e96700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60000a17c0 0x7f60000a3c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f600c00ba10 tx=0x7f600c00b3f0 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:14.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:13 smithi060 ceph-mon[99238]: pgmap v489: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 41 KiB/s wr, 27 op/s 2023-10-05T15:32:14.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:13 smithi060 ceph-mon[99238]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:14.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:13 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3562974761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:13 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/1072289867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:13 smithi092 ceph-mon[102944]: pgmap v489: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 41 KiB/s wr, 27 op/s 2023-10-05T15:32:14.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:13 smithi092 ceph-mon[102944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:32:14.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:13 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3562974761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:13 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/1072289867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.564+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f60141100c0 con 0x7f601410a170 2023-10-05T15:32:14.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.585+0000 7f6011ffb700 1 -- 172.21.15.60:0/377745863 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5ffc030070 con 0x7f601410a170 2023-10-05T15:32:14.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.598+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60000a17c0 msgr2=0x7f60000a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:14.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.598+0000 7f601b0fa700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60000a17c0 0x7f60000a3c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f600c00ba10 tx=0x7f600c00b3f0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.598+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 msgr2=0x7f601410f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:14.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.598+0000 7f601b0fa700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 0x7f601410f400 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc004710 tx=0x7f5ffc005e80 comp rx=0 tx=0).stop 2023-10-05T15:32:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.608+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 shutdown_connections 2023-10-05T15:32:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.608+0000 7f601b0fa700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f601410a170 0x7f601410f400 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.608+0000 7f601b0fa700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141086e0 0x7f60141122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.608+0000 7f601b0fa700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f60000a17c0 0x7f60000a3c80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.608+0000 7f601b0fa700 1 --2- 172.21.15.60:0/377745863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6014109850 0x7f6014112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.608+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 >> 172.21.15.60:0/377745863 conn(0x7f601406d1a0 msgr2=0x7f601406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:14.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.619+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 shutdown_connections 2023-10-05T15:32:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.620+0000 7f601b0fa700 1 -- 172.21.15.60:0/377745863 wait complete. 2023-10-05T15:32:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-05T15:32:14.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-05T15:32:14.857 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g[149932]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:14.857 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g[149932]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:14.857 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g[149932]: starting mds.g at 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a[150317]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a[150317]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a[150317]: starting mds.a at 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:32:14.568+0000 7fc4d32b3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: pgmap v490: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 16 KiB/s wr, 13 op/s 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/377745863' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-05T15:32:14.858 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-05T15:32:14.859 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-05T15:32:14.859 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-05T15:32:14.859 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/377745863' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-05T15:32:14.859 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: osdmap e117: 12 total, 12 up, 12 in 2023-10-05T15:32:14.859 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:14 smithi060 ceph-mon[99238]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-05T15:32:14.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.962+0000 7fafb5679700 1 -- 172.21.15.60:0/899031711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb01083f0 msgr2=0x7fafb0108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.962+0000 7fafb5679700 1 --2- 172.21.15.60:0/899031711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb01083f0 0x7fafb0108870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fafa001c0d0 tx=0x7fafa001c3e0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.129 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l[138628]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:15.129 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l[138628]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:15.130 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l[138628]: starting mds.l at 2023-10-05T15:32:15.130 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: pgmap v490: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 16 KiB/s wr, 13 op/s 2023-10-05T15:32:15.130 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/377745863' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-05T15:32:15.130 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-05T15:32:15.130 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-05T15:32:15.130 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-05T15:32:15.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/377745863' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-05T15:32:15.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: osdmap e117: 12 total, 12 up, 12 in 2023-10-05T15:32:15.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mon[103360]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-05T15:32:15.131 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c[139307]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:15.131 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c[139307]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:15.131 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c[139307]: starting mds.c at 2023-10-05T15:32:15.132 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[142924]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:15.132 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[142924]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:15.132 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-mds[142948]: -- 172.21.15.135:0/1079726854 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560a7ab7d1e0 con 0x560a7ab52800 2023-10-05T15:32:15.132 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[142924]: starting mds.f at 2023-10-05T15:32:15.132 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:15.133 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:15.133 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:32:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: starting mds.i at 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.972+0000 7fafb5679700 1 -- 172.21.15.60:0/899031711 shutdown_connections 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.972+0000 7fafb5679700 1 --2- 172.21.15.60:0/899031711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb011a690 0x7fafb011ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.972+0000 7fafb5679700 1 --2- 172.21.15.60:0/899031711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb010f640 0x7fafb0107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.972+0000 7fafb5679700 1 --2- 172.21.15.60:0/899031711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb01083f0 0x7fafb0108870 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.972+0000 7fafb5679700 1 -- 172.21.15.60:0/899031711 >> 172.21.15.60:0/899031711 conn(0x7fafb006d1a0 msgr2=0x7fafb006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.985+0000 7fafb5679700 1 -- 172.21.15.60:0/899031711 shutdown_connections 2023-10-05T15:32:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.991+0000 7fafb5679700 1 -- 172.21.15.60:0/899031711 wait complete. 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 Processor -- start 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 -- start start 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb01083f0 0x7fafb01159b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 0x7fafb0115ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb011a690 0x7fafb01cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01cb950 con 0x7fafb010f640 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01cbac0 con 0x7fafb01083f0 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.992+0000 7fafb5679700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01cbc80 con 0x7fafb011a690 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.997+0000 7fafae7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 0x7fafb0115ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.997+0000 7fafae7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 0x7fafb0115ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42598/0 (socket says 172.21.15.60:42598) 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.997+0000 7fafae7fc700 1 -- 172.21.15.60:0/3043207670 learned_addr learned my addr 172.21.15.60:0/3043207670 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.998+0000 7fafaeffd700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb01083f0 0x7fafb01159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.998+0000 7fafae7fc700 1 -- 172.21.15.60:0/3043207670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb011a690 msgr2=0x7fafb01cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.998+0000 7fafae7fc700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb011a690 0x7fafb01cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.998+0000 7fafae7fc700 1 -- 172.21.15.60:0/3043207670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb01083f0 msgr2=0x7fafb01159b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.998+0000 7fafae7fc700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb01083f0 0x7fafb01159b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:14.998+0000 7fafae7fc700 1 -- 172.21.15.60:0/3043207670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa001ad10 con 0x7fafb010f640 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.003+0000 7fafae7fc700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 0x7fafb0115ef0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fafa001cf50 tx=0x7fafa0004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.003+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa001f040 con 0x7fafb010f640 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.004+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafa000b070 con 0x7fafb010f640 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.004+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb01cbf00 con 0x7fafb010f640 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.004+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00127b0 con 0x7fafb010f640 2023-10-05T15:32:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.004+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb01cc320 con 0x7fafb010f640 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.007+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fafa00182a0 con 0x7fafb010f640 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.008+0000 7fafa7fff700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faf9c0a17c0 0x7faf9c0a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.008+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 10073+0+0 (secure 0 0 0) 0x7fafa000d070 con 0x7fafb010f640 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.014+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf90005320 con 0x7fafb010f640 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.017+0000 7fafaeffd700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faf9c0a17c0 0x7faf9c0a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.019+0000 7fafaeffd700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faf9c0a17c0 0x7faf9c0a3c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf9800a850 tx=0x7faf98008040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.032+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fafa00984b0 con 0x7fafb010f640 2023-10-05T15:32:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: pgmap v490: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 16 KiB/s wr, 13 op/s 2023-10-05T15:32:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/377745863' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-05T15:32:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-05T15:32:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-05T15:32:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-05T15:32:15.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/377745863' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-05T15:32:15.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: osdmap e117: 12 total, 12 up, 12 in 2023-10-05T15:32:15.177 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:14 smithi092 ceph-mon[102944]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-05T15:32:15.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.481+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf90005b50 con 0x7fafb010f640 2023-10-05T15:32:15.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.605+0000 7fafa7fff700 1 -- 172.21.15.60:0/3043207670 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafa009bad0 con 0x7fafb010f640 2023-10-05T15:32:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.610+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faf9c0a17c0 msgr2=0x7faf9c0a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.610+0000 7fafb5679700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faf9c0a17c0 0x7faf9c0a3c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf9800a850 tx=0x7faf98008040 comp rx=0 tx=0).stop 2023-10-05T15:32:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.610+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 msgr2=0x7fafb0115ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.610+0000 7fafb5679700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 0x7fafb0115ef0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fafa001cf50 tx=0x7fafa0004de0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 shutdown_connections 2023-10-05T15:32:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb011a690 0x7fafb01cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7faf9c0a17c0 0x7faf9c0a3c80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb01083f0 0x7fafb01159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 --2- 172.21.15.60:0/3043207670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafb010f640 0x7fafb0115ef0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 >> 172.21.15.60:0/3043207670 conn(0x7fafb006d1a0 msgr2=0x7fafb011aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 shutdown_connections 2023-10-05T15:32:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.611+0000 7fafb5679700 1 -- 172.21.15.60:0/3043207670 wait complete. 2023-10-05T15:32:15.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3043207670' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: Cluster is now healthy 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3043207670' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.60:6838/398176622,v1:172.21.15.60:6840/398176622] up:boot 2023-10-05T15:32:15.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.60:6839/2898877538,v1:172.21.15.60:6841/2898877538] up:boot 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6836/782043157,v1:172.21.15.135:6837/782043157] up:boot 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6838/1859007170,v1:172.21.15.135:6839/1859007170] up:boot 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6832/3840180650,v1:172.21.15.135:6833/3840180650] up:boot 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.135:6834/3226718566,v1:172.21.15.135:6835/3226718566] up:boot 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: fsmap 8 up:standby 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:32:15.919 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:15 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:32:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.935+0000 7fd42dda9700 1 -- 172.21.15.60:0/1931324239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42811a690 msgr2=0x7fd42811ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.935+0000 7fd42dda9700 1 --2- 172.21.15.60:0/1931324239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42811a690 0x7fd42811ca80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd41c01a9a0 tx=0x7fd41c01acb0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.943+0000 7fd42dda9700 1 -- 172.21.15.60:0/1931324239 shutdown_connections 2023-10-05T15:32:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.943+0000 7fd42dda9700 1 --2- 172.21.15.60:0/1931324239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42811a690 0x7fd42811ca80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.943+0000 7fd42dda9700 1 --2- 172.21.15.60:0/1931324239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42810f640 0x7fd428107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.943+0000 7fd42dda9700 1 --2- 172.21.15.60:0/1931324239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4281083f0 0x7fd428108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.943+0000 7fd42dda9700 1 -- 172.21.15.60:0/1931324239 >> 172.21.15.60:0/1931324239 conn(0x7fd42806d1a0 msgr2=0x7fd42806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.943+0000 7fd42dda9700 1 -- 172.21.15.60:0/1931324239 shutdown_connections 2023-10-05T15:32:15.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.945+0000 7fd42dda9700 1 -- 172.21.15.60:0/1931324239 wait complete. 2023-10-05T15:32:15.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.945+0000 7fd42dda9700 1 Processor -- start 2023-10-05T15:32:15.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 -- start start 2023-10-05T15:32:15.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4281083f0 0x7fd4281158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42810f640 0x7fd428115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 0x7fd4281a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281a9910 con 0x7fd42810f640 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281a9a50 con 0x7fd4281083f0 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd42dda9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281a9b90 con 0x7fd42811a690 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.948+0000 7fd427fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 0x7fd4281a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.949+0000 7fd427fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 0x7fd4281a93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:56144/0 (socket says 172.21.15.60:56144) 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.949+0000 7fd427fff700 1 -- 172.21.15.60:0/679934417 learned_addr learned my addr 172.21.15.60:0/679934417 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd426ffd700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42810f640 0x7fd428115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd427fff700 1 -- 172.21.15.60:0/679934417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4281083f0 msgr2=0x7fd4281158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd427fff700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4281083f0 0x7fd4281158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd427fff700 1 -- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42810f640 msgr2=0x7fd428115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd427fff700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42810f640 0x7fd428115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd427fff700 1 -- 172.21.15.60:0/679934417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c01a600 con 0x7fd42811a690 2023-10-05T15:32:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd426ffd700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42810f640 0x7fd428115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:32:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.951+0000 7fd427fff700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 0x7fd4281a93d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd41c006010 tx=0x7fd41c004e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:15.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.960+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c005250 con 0x7fd42811a690 2023-10-05T15:32:15.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.960+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd41c0283f0 con 0x7fd42811a690 2023-10-05T15:32:15.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.960+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4281a9de0 con 0x7fd42811a690 2023-10-05T15:32:15.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.960+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c01f650 con 0x7fd42811a690 2023-10-05T15:32:15.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.961+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4281aa260 con 0x7fd42811a690 2023-10-05T15:32:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.964+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd428067c60 con 0x7fd42811a690 2023-10-05T15:32:15.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.970+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd41c028560 con 0x7fd42811a690 2023-10-05T15:32:15.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.971+0000 7fd424ff9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4100a16b0 0x7fd4100a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:15.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.971+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 10073+0+0 (secure 0 0 0) 0x7fd41c0df710 con 0x7fd42811a690 2023-10-05T15:32:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.978+0000 7fd4277fe700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4100a16b0 0x7fd4100a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.979+0000 7fd4277fe700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4100a16b0 0x7fd4100a3b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd42000e2d0 tx=0x7fd42000d040 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:15.985+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd41c0a84b0 con 0x7fd42811a690 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3043207670' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: Cluster is now healthy 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3043207670' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.60:6838/398176622,v1:172.21.15.60:6840/398176622] up:boot 2023-10-05T15:32:16.179 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.60:6839/2898877538,v1:172.21.15.60:6841/2898877538] up:boot 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6836/782043157,v1:172.21.15.135:6837/782043157] up:boot 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6838/1859007170,v1:172.21.15.135:6839/1859007170] up:boot 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6832/3840180650,v1:172.21.15.135:6833/3840180650] up:boot 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.135:6834/3226718566,v1:172.21.15.135:6835/3226718566] up:boot 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: fsmap 8 up:standby 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:32:16.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:15 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:32:16.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3043207670' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:32:16.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: Cluster is now healthy 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3043207670' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.60:6838/398176622,v1:172.21.15.60:6840/398176622] up:boot 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.60:6839/2898877538,v1:172.21.15.60:6841/2898877538] up:boot 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6836/782043157,v1:172.21.15.135:6837/782043157] up:boot 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6838/1859007170,v1:172.21.15.135:6839/1859007170] up:boot 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6832/3840180650,v1:172.21.15.135:6833/3840180650] up:boot 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.135:6834/3226718566,v1:172.21.15.135:6835/3226718566] up:boot 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: fsmap 8 up:standby 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:32:16.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:32:16.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:32:16.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:32:16.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:32:16.334 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:15 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:32:16.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.338+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd428112590 con 0x7fd42811a690 2023-10-05T15:32:16.676 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k[138631]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:16.676 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k[138631]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:16.676 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k[138631]: starting mds.k at 2023-10-05T15:32:16.677 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:16.677 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:16.677 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: starting mds.b at 2023-10-05T15:32:16.677 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e[138973]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:16.677 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e[138973]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:16.677 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-mds[138997]: -- 172.21.15.92:0/253707137 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c586871e0 con 0x556c5865c800 2023-10-05T15:32:16.678 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e[138973]: starting mds.e at 2023-10-05T15:32:16.678 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h[139315]: ignoring --setuser ceph since I am not root 2023-10-05T15:32:16.678 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h[139315]: ignoring --setgroup ceph since I am not root 2023-10-05T15:32:16.678 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h[139315]: starting mds.h at 2023-10-05T15:32:16.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.790+0000 7fd424ff9700 1 -- 172.21.15.60:0/679934417 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v118) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd41c0abad0 con 0x7fd42811a690 2023-10-05T15:32:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.803+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4100a16b0 msgr2=0x7fd4100a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.803+0000 7fd42dda9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4100a16b0 0x7fd4100a3b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd42000e2d0 tx=0x7fd42000d040 comp rx=0 tx=0).stop 2023-10-05T15:32:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.803+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 msgr2=0x7fd4281a93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:16.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.803+0000 7fd42dda9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 0x7fd4281a93d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd41c006010 tx=0x7fd41c004e60 comp rx=0 tx=0).stop 2023-10-05T15:32:16.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.811+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 shutdown_connections 2023-10-05T15:32:16.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.811+0000 7fd42dda9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42811a690 0x7fd4281a93d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:16.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.811+0000 7fd42dda9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7fd4100a16b0 0x7fd4100a3b70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:16.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.811+0000 7fd42dda9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4281083f0 0x7fd4281158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:16.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.811+0000 7fd42dda9700 1 --2- 172.21.15.60:0/679934417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42810f640 0x7fd428115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:16.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.811+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 >> 172.21.15.60:0/679934417 conn(0x7fd42806d1a0 msgr2=0x7fd42811aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.819+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 shutdown_connections 2023-10-05T15:32:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:16.820+0000 7fd42dda9700 1 -- 172.21.15.60:0/679934417 wait complete. 2023-10-05T15:32:16.842 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-05T15:32:16.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-05T15:32:17.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.154+0000 7f438a042700 1 -- 172.21.15.60:0/3801759524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f438410f640 msgr2=0x7f4384107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:17.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.154+0000 7f438a042700 1 --2- 172.21.15.60:0/3801759524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f438410f640 0x7f4384107eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f437401a9a0 tx=0x7f437401acb0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.163+0000 7f438a042700 1 -- 172.21.15.60:0/3801759524 shutdown_connections 2023-10-05T15:32:17.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.163+0000 7f438a042700 1 --2- 172.21.15.60:0/3801759524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f438411a690 0x7f438411ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.163+0000 7f438a042700 1 --2- 172.21.15.60:0/3801759524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f438410f640 0x7f4384107eb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.163+0000 7f438a042700 1 --2- 172.21.15.60:0/3801759524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43841083f0 0x7f4384108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.163+0000 7f438a042700 1 -- 172.21.15.60:0/3801759524 >> 172.21.15.60:0/3801759524 conn(0x7f438406d1a0 msgr2=0x7f438406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:17.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:16 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/679934417' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:17.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:16 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:17.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:16 smithi060 ceph-mon[99238]: pgmap v492: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2023-10-05T15:32:17.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:16 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:17.169 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:16 smithi060 ceph-mon[99238]: osdmap e118: 12 total, 12 up, 12 in 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.170+0000 7f438a042700 1 -- 172.21.15.60:0/3801759524 shutdown_connections 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.170+0000 7f438a042700 1 -- 172.21.15.60:0/3801759524 wait complete. 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.170+0000 7f438a042700 1 Processor -- start 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 -- start start 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43841083f0 0x7f4384115a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f438410f640 0x7f4384115f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438411a690 0x7f43841cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43841cb9e0 con 0x7f438410f640 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43841cbb50 con 0x7f438411a690 2023-10-05T15:32:17.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.171+0000 7f438a042700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43841cbd10 con 0x7f43841083f0 2023-10-05T15:32:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f4383fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438411a690 0x7f43841cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f4383fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438411a690 0x7f43841cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.60:56052/0 (socket says 172.21.15.60:56052) 2023-10-05T15:32:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f4383fff700 1 -- 172.21.15.60:0/3813532601 learned_addr learned my addr 172.21.15.60:0/3813532601 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f43837fe700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43841083f0 0x7f4384115a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:17.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f4382ffd700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f438410f640 0x7f4384115f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/679934417' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-mon[102944]: pgmap v492: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2023-10-05T15:32:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:17.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:16 smithi092 ceph-mon[102944]: osdmap e118: 12 total, 12 up, 12 in 2023-10-05T15:32:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f43837fe700 1 -- 172.21.15.60:0/3813532601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438411a690 msgr2=0x7f43841cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f43837fe700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438411a690 0x7f43841cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f43837fe700 1 -- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f438410f640 msgr2=0x7f4384115f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f43837fe700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f438410f640 0x7f4384115f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.172+0000 7f43837fe700 1 -- 172.21.15.60:0/3813532601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437401a600 con 0x7f43841083f0 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.173+0000 7f43837fe700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43841083f0 0x7f4384115a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4374006010 tx=0x7f4374003710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.175+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374003f10 con 0x7f43841083f0 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.175+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4374004070 con 0x7f43841083f0 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.175+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43841cbf90 con 0x7f43841083f0 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.175+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400fea0 con 0x7f43841083f0 2023-10-05T15:32:17.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.175+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43841cc300 con 0x7f43841083f0 2023-10-05T15:32:17.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.180+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f43740041e0 con 0x7f43841083f0 2023-10-05T15:32:17.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.181+0000 7f4380ff9700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f436c0a17c0 0x7f436c0a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:17.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.181+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 9589+0+0 (secure 0 0 0) 0x7f43740cea40 con 0x7f43841083f0 2023-10-05T15:32:17.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.182+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4370005320 con 0x7f43841083f0 2023-10-05T15:32:17.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.182+0000 7f4382ffd700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f436c0a17c0 0x7f436c0a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:17.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.183+0000 7f4382ffd700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f436c0a17c0 0x7f436c0a3c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4384117050 tx=0x7f4378009190 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:17.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.192+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43740979f0 con 0x7f43841083f0 2023-10-05T15:32:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:16 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/679934417' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:16 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:16 smithi135 ceph-mon[103360]: pgmap v492: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2023-10-05T15:32:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:16 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:17.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:16 smithi135 ceph-mon[103360]: osdmap e118: 12 total, 12 up, 12 in 2023-10-05T15:32:17.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.564+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43700055d0 con 0x7f43841083f0 2023-10-05T15:32:17.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.910+0000 7f4380ff9700 1 -- 172.21.15.60:0/3813532601 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v119) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4374013020 con 0x7f43841083f0 2023-10-05T15:32:17.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.924+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f436c0a17c0 msgr2=0x7f436c0a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.924+0000 7f438a042700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f436c0a17c0 0x7f436c0a3c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4384117050 tx=0x7f4378009190 comp rx=0 tx=0).stop 2023-10-05T15:32:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.924+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43841083f0 msgr2=0x7f4384115a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.924+0000 7f438a042700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43841083f0 0x7f4384115a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4374006010 tx=0x7f4374003710 comp rx=0 tx=0).stop 2023-10-05T15:32:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.931+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 shutdown_connections 2023-10-05T15:32:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.931+0000 7f438a042700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f436c0a17c0 0x7f436c0a3c80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.931+0000 7f438a042700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438411a690 0x7f43841cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.931+0000 7f438a042700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43841083f0 0x7f4384115a40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.931+0000 7f438a042700 1 --2- 172.21.15.60:0/3813532601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f438410f640 0x7f4384115f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.931+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 >> 172.21.15.60:0/3813532601 conn(0x7f438406d1a0 msgr2=0x7f4384071880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.940+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 shutdown_connections 2023-10-05T15:32:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:17.945+0000 7f438a042700 1 -- 172.21.15.60:0/3813532601 wait complete. 2023-10-05T15:32:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-05T15:32:17.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-05T15:32:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 -- 172.21.15.60:0/2512087757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557011a690 msgr2=0x7f557011ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 --2- 172.21.15.60:0/2512087757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557011a690 0x7f557011ca80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f55640098f0 tx=0x7f5564009c00 comp rx=0 tx=0).stop 2023-10-05T15:32:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 -- 172.21.15.60:0/2512087757 shutdown_connections 2023-10-05T15:32:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 --2- 172.21.15.60:0/2512087757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557011a690 0x7f557011ca80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 --2- 172.21.15.60:0/2512087757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557010f640 0x7f5570107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 --2- 172.21.15.60:0/2512087757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55701083f0 0x7f5570108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 -- 172.21.15.60:0/2512087757 >> 172.21.15.60:0/2512087757 conn(0x7f557006d1a0 msgr2=0x7f557006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.274+0000 7f5575e48700 1 -- 172.21.15.60:0/2512087757 shutdown_connections 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.275+0000 7f5575e48700 1 -- 172.21.15.60:0/2512087757 wait complete. 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 Processor -- start 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 -- start start 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557010f640 0x7f5570115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557011a690 0x7f5570116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f557011e770 0x7f557011ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557011f160 con 0x7f557010f640 2023-10-05T15:32:18.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557011f2d0 con 0x7f557011a690 2023-10-05T15:32:18.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.276+0000 7f5575e48700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557011f490 con 0x7f557011e770 2023-10-05T15:32:18.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.278+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557010f640 0x7f5570115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:18.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.278+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557010f640 0x7f5570115ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42646/0 (socket says 172.21.15.60:42646) 2023-10-05T15:32:18.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.278+0000 7f556f7fe700 1 -- 172.21.15.60:0/3219019355 learned_addr learned my addr 172.21.15.60:0/3219019355 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-05T15:32:18.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.278+0000 7f556effd700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557011a690 0x7f5570116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:18.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.278+0000 7f556ffff700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f557011e770 0x7f557011ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:18.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.279+0000 7f556effd700 1 -- 172.21.15.60:0/3219019355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f557011e770 msgr2=0x7f557011ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:18.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.279+0000 7f556effd700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f557011e770 0x7f557011ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.279+0000 7f556effd700 1 -- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557010f640 msgr2=0x7f5570115ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:18.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.279+0000 7f556effd700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557010f640 0x7f5570115ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.279+0000 7f556effd700 1 -- 172.21.15.60:0/3219019355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564009520 con 0x7f557011a690 2023-10-05T15:32:18.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.285+0000 7f556effd700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557011a690 0x7f5570116020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f557006dd20 tx=0x7f556801c630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:18.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.286+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800c070 con 0x7f557011a690 2023-10-05T15:32:18.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.286+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f556801cd60 con 0x7f557011a690 2023-10-05T15:32:18.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.286+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568018b70 con 0x7f557011a690 2023-10-05T15:32:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.287+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5570125840 con 0x7f557011a690 2023-10-05T15:32:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.288+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5570125cd0 con 0x7f557011a690 2023-10-05T15:32:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.289+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5570067c60 con 0x7f557011a690 2023-10-05T15:32:18.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.298+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5568018cd0 con 0x7f557011a690 2023-10-05T15:32:18.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.298+0000 7f556cff9700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f55580a17a0 0x7f55580a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:18.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.299+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8973+0+0 (secure 0 0 0) 0x7f55680ccf00 con 0x7f557011a690 2023-10-05T15:32:18.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.299+0000 7f556f7fe700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f55580a17a0 0x7f55580a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.300+0000 7f556f7fe700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f55580a17a0 0x7f55580a3c60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5560009ad0 tx=0x7f5560009290 comp rx=0 tx=0).ready entity=mgr.15663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.305+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5568096080 con 0x7f557011a690 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6836/12519414,v1:172.21.15.92:6837/12519414] up:boot 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6834/384241080,v1:172.21.15.92:6835/384241080] up:boot 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6832/2056297058,v1:172.21.15.92:6833/2056297058] up:boot 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: mds.? [v2:172.21.15.92:6838/3092400549,v1:172.21.15.92:6839/3092400549] up:boot 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: fsmap 12 up:standby 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:32:18.332 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:32:18.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:32:18.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3813532601' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:18.333 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:17 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6836/12519414,v1:172.21.15.92:6837/12519414] up:boot 2023-10-05T15:32:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6834/384241080,v1:172.21.15.92:6835/384241080] up:boot 2023-10-05T15:32:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6832/2056297058,v1:172.21.15.92:6833/2056297058] up:boot 2023-10-05T15:32:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: mds.? [v2:172.21.15.92:6838/3092400549,v1:172.21.15.92:6839/3092400549] up:boot 2023-10-05T15:32:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: fsmap 12 up:standby 2023-10-05T15:32:18.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:32:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:32:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:32:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:32:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3813532601' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:18.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:17 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6836/12519414,v1:172.21.15.92:6837/12519414] up:boot 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6834/384241080,v1:172.21.15.92:6835/384241080] up:boot 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6832/2056297058,v1:172.21.15.92:6833/2056297058] up:boot 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: mds.? [v2:172.21.15.92:6838/3092400549,v1:172.21.15.92:6839/3092400549] up:boot 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: fsmap 12 up:standby 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:32:18.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:32:18.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: from='mgr.15663 172.21.15.60:0/3630081049' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:32:18.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3813532601' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:18.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:17 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.677+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5570112640 con 0x7f557011a690 2023-10-05T15:32:18.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.973+0000 7f556cff9700 1 -- 172.21.15.60:0/3219019355 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v120) v1 ==== 178+0+0 (secure 0 0 0) 0x7f55680996a0 con 0x7f557011a690 2023-10-05T15:32:18.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.982+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f55580a17a0 msgr2=0x7f55580a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:18.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.982+0000 7f5575e48700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f55580a17a0 0x7f55580a3c60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5560009ad0 tx=0x7f5560009290 comp rx=0 tx=0).stop 2023-10-05T15:32:18.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.982+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557011a690 msgr2=0x7f5570116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:18.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.982+0000 7f5575e48700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557011a690 0x7f5570116020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f557006dd20 tx=0x7f556801c630 comp rx=0 tx=0).stop 2023-10-05T15:32:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.992+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 shutdown_connections 2023-10-05T15:32:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.992+0000 7f5575e48700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f557011e770 0x7f557011ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.992+0000 7f5575e48700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557010f640 0x7f5570115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.992+0000 7f5575e48700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.60:6800/139103647,v1:172.21.15.60:6801/139103647] conn(0x7f55580a17a0 0x7f55580a3c60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.992+0000 7f5575e48700 1 --2- 172.21.15.60:0/3219019355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557011a690 0x7f5570116020 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:18.992+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 >> 172.21.15.60:0/3219019355 conn(0x7f557006d1a0 msgr2=0x7f557011aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:19.003+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 shutdown_connections 2023-10-05T15:32:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-05T15:32:19.005+0000 7f5575e48700 1 -- 172.21.15.60:0/3219019355 wait complete. 2023-10-05T15:32:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data_ec' removed 2023-10-05T15:32:19.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:32:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:18 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:18 smithi135 ceph-mon[103360]: osdmap e119: 12 total, 12 up, 12 in 2023-10-05T15:32:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:18 smithi135 ceph-mon[103360]: pgmap v495: 33 pgs: 19 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 1 active+clean; 579 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:32:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:18 smithi135 ceph-mon[103360]: from='client.? 172.21.15.60:0/3219019355' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:19.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:18 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:19.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:18 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:19.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:18 smithi060 ceph-mon[99238]: osdmap e119: 12 total, 12 up, 12 in 2023-10-05T15:32:19.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:18 smithi060 ceph-mon[99238]: pgmap v495: 33 pgs: 19 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 1 active+clean; 579 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:32:19.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:18 smithi060 ceph-mon[99238]: from='client.? 172.21.15.60:0/3219019355' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:19.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:18 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:19.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:32:19.413 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:18 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:19.413 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:18 smithi092 ceph-mon[102944]: osdmap e119: 12 total, 12 up, 12 in 2023-10-05T15:32:19.413 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:18 smithi092 ceph-mon[102944]: pgmap v495: 33 pgs: 19 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 1 active+clean; 579 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:32:19.413 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:18 smithi092 ceph-mon[102944]: from='client.? 172.21.15.60:0/3219019355' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:19.414 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:18 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-05T15:32:19.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:32:19.488 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-05T15:32:19.488 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:32:19.506 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:32:19.523 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:32:19.540 INFO:tasks.cephadm:Stopping all daemons... 2023-10-05T15:32:19.540 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-05T15:32:19.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a 2023-10-05T15:32:19.665 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:19 smithi060 systemd[1]: Stopping Ceph mon.a for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:20.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:19 smithi135 ceph-mon[103360]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:20.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:19 smithi135 ceph-mon[103360]: osdmap e120: 12 total, 12 up, 12 in 2023-10-05T15:32:20.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:19 smithi060 ceph-mon[99238]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:20.415 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:19 smithi060 ceph-mon[99238]: osdmap e120: 12 total, 12 up, 12 in 2023-10-05T15:32:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:19 smithi092 ceph-mon[102944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2023-10-05T15:32:20.426 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:19 smithi092 ceph-mon[102944]: osdmap e120: 12 total, 12 up, 12 in 2023-10-05T15:32:21.046 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:32:20.756+0000 7fc4d8abe700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:21.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a[99214]: 2023-10-05T15:32:20.756+0000 7fc4d8abe700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-05T15:32:22.167 INFO:journalctl@ceph.mon.a.smithi060.stdout:Oct 05 15:32:22 smithi060 bash[182315]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-a 2023-10-05T15:32:24.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-05T15:32:24.164 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:24.165 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-05T15:32:24.165 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-05T15:32:24.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.b 2023-10-05T15:32:24.667 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:24 smithi092 systemd[1]: Stopping Ceph mon.b for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:24.923 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-b[102920]: 2023-10-05T15:32:24.665+0000 7f9e003ca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:24.923 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-b[102920]: 2023-10-05T15:32:24.665+0000 7f9e003ca700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-05T15:32:25.176 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 05 15:32:24 smithi092 bash[146564]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-b 2023-10-05T15:32:25.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-05T15:32:25.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:25.393 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-05T15:32:25.393 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-05T15:32:25.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.c 2023-10-05T15:32:25.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:25 smithi135 systemd[1]: Stopping Ceph mon.c for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:26.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-c[103321]: 2023-10-05T15:32:25.795+0000 7fd971e1f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:26.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Oct 05 15:32:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mon-c[103321]: 2023-10-05T15:32:25.795+0000 7fd971e1f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-05T15:32:26.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-05T15:32:26.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:26.451 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-05T15:32:26.451 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-05T15:32:26.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x 2023-10-05T15:32:26.818 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:32:26 smithi060 systemd[1]: Stopping Ceph mgr.x for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:27.099 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:32:26 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x[99484]: 2023-10-05T15:32:26.815+0000 7f2834ca3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:27.355 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Oct 05 15:32:27 smithi060 bash[182467]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-x 2023-10-05T15:32:27.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-05T15:32:27.400 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:27.400 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-05T15:32:27.400 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-05T15:32:27.400 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.y 2023-10-05T15:32:27.866 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:32:27 smithi092 systemd[1]: Stopping Ceph mgr.y for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:28.162 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:32:28 smithi092 bash[146713]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mgr-y 2023-10-05T15:32:28.296 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 05 15:32:28 smithi092 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-05T15:32:28.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-05T15:32:28.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:28.336 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-05T15:32:28.336 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-05T15:32:28.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.z 2023-10-05T15:32:28.760 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Oct 05 15:32:28 smithi135 systemd[1]: Stopping Ceph mgr.z for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:29.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-05T15:32:29.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:29.285 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-05T15:32:29.285 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-05T15:32:29.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.0 2023-10-05T15:32:29.642 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:32:29 smithi060 systemd[1]: Stopping Ceph osd.0 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:29.914 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:32:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0[117854]: 2023-10-05T15:32:29.640+0000 7f1ea7e18700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:29.915 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:32:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0[117854]: 2023-10-05T15:32:29.640+0000 7f1ea7e18700 -1 osd.0 120 *** Got signal Terminated *** 2023-10-05T15:32:29.915 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:32:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0[117854]: 2023-10-05T15:32:29.640+0000 7f1ea7e18700 -1 osd.0 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:32:35.616 INFO:journalctl@ceph.osd.0.smithi060.stdout:Oct 05 15:32:35 smithi060 bash[182610]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-0 2023-10-05T15:32:36.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-05T15:32:37.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:37.032 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-05T15:32:37.032 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-05T15:32:37.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.1 2023-10-05T15:32:37.412 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:32:37 smithi092 systemd[1]: Stopping Ceph osd.1 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:37.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:32:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1[107988]: 2023-10-05T15:32:37.410+0000 7f82906f3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:37.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:32:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1[107988]: 2023-10-05T15:32:37.410+0000 7f82906f3700 -1 osd.1 120 *** Got signal Terminated *** 2023-10-05T15:32:37.676 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:32:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1[107988]: 2023-10-05T15:32:37.410+0000 7f82906f3700 -1 osd.1 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:32:43.426 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 05 15:32:43 smithi092 bash[146858]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-1 2023-10-05T15:32:45.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-05T15:32:45.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:45.086 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-05T15:32:45.086 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-05T15:32:45.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.2 2023-10-05T15:32:45.467 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:32:45 smithi135 systemd[1]: Stopping Ceph osd.2 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:45.831 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:32:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2[109190]: 2023-10-05T15:32:45.464+0000 7f93baab5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:45.831 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:32:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2[109190]: 2023-10-05T15:32:45.464+0000 7f93baab5700 -1 osd.2 120 *** Got signal Terminated *** 2023-10-05T15:32:45.831 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:32:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2[109190]: 2023-10-05T15:32:45.464+0000 7f93baab5700 -1 osd.2 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:32:51.581 INFO:journalctl@ceph.osd.2.smithi135.stdout:Oct 05 15:32:51 smithi135 bash[147220]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-2 2023-10-05T15:32:53.148 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-05T15:32:53.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:32:53.191 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-05T15:32:53.192 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-05T15:32:53.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.3 2023-10-05T15:32:53.573 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:32:53 smithi060 systemd[1]: Stopping Ceph osd.3 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:32:53.915 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:32:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:32:53.570+0000 7fec4e1dd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:32:53.915 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:32:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:32:53.570+0000 7fec4e1dd700 -1 osd.3 120 *** Got signal Terminated *** 2023-10-05T15:32:53.915 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:32:53 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:32:53.570+0000 7fec4e1dd700 -1 osd.3 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:32:57.915 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:32:57 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3[126504]: 2023-10-05T15:32:57.550+0000 7fec467cb700 -1 osd.3 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.148079+0000 front 2023-10-05T15:32:33.147987+0000 (oldest deadline 2023-10-05T15:32:57.248159+0000) 2023-10-05T15:32:58.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:32:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:32:57.639+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:32:58.662 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:32:58 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:32:58.227+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:32:58.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:32:58 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:32:58.660+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:32:59.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:32:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:32:58.631+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:32:59.363 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:32:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:32:59.081+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:32:59.495 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:32:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:32:59.205+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:32:59.651 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:32:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:32:59.360+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:32:59.915 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 05 15:32:59 smithi060 bash[182884]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-3 2023-10-05T15:32:59.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:32:59 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:32:59.678+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:00.061 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:32:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:32:59.649+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:00.331 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:00.060+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:00.414 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:00.238+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:00.653 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:00.383+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:00.911 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:00 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:00.699+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:00.918 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-05T15:33:00.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:00 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:00.569+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:00.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:00.960 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-05T15:33:00.960 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-05T15:33:00.960 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.4 2023-10-05T15:33:01.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:00.651+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:01.323 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:33:00 smithi092 systemd[1]: Stopping Ceph osd.4 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:01.391 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:01 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:01.100+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:01.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:01 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:01.259+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:01.676 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:33:01 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4[116680]: 2023-10-05T15:33:01.321+0000 7f3dc5621700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:01.676 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:33:01 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4[116680]: 2023-10-05T15:33:01.321+0000 7f3dc5621700 -1 osd.4 120 *** Got signal Terminated *** 2023-10-05T15:33:01.676 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:33:01 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4[116680]: 2023-10-05T15:33:01.321+0000 7f3dc5621700 -1 osd.4 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:01.676 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:01 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:01.565+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:01.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:01 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:01.389+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:01.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:01 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:01.613+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:02.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:01 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:01.740+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:02.437 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:02 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:02.095+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:02.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:02 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:02.309+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:02.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:02 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:02.581+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:02.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:02 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:02.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:02.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:02 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:02.534+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:03.164 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:02 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:02.706+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:03.477 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:03 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:03.119+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:03.664 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:03 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:03.333+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:03.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:03 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:03.619+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:03.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:03 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:03.475+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:03.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:03 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:03.551+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:04.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:03 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:03.752+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:04.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:03 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:03.752+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:04.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:04 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:04.071+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:04.458 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:04 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:04.111+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:04.664 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:04 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:04.331+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:04.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:04 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:04.570+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:04.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:04 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:04.456+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:04.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:04 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:04.527+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:05.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:04 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:04.732+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:05.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:04 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:04.732+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:05.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:05 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:05.115+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:05.483 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:05 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:05.115+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:05.664 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:05 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:05.309+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:05.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:05 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:05.591+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:05.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:05 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:05.482+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:05.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:05 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:05.482+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:05.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:05 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:05.573+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:06.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:05 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:05.759+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:06.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:05 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:05.759+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:06.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:06 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:06.087+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:06.499 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:06 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:06.129+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:06.499 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:06 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:06.129+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:06.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:06 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:06.298+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:06.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:06 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:06.298+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:06.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:06 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:06.582+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:06.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:06 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:06.497+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:06.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:06 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:06.497+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:06.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:06 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:06.571+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:07.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:06 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:06.721+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:07.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:06 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:06.721+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:07.426 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 05 15:33:07 smithi092 bash[147120]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-4 2023-10-05T15:33:07.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:07 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:07.124+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:07.475 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:07 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:07.095+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:07.475 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:07 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:07.095+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:07.664 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:07 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:07.321+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:07.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:07 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:07.321+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:07.805 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:07 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:07.551+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:07.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:07 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:07.550+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:07.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:07 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:07.474+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:07.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:07 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:07.474+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:08.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:07 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:07.673+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:08.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:07 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:07.673+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:08.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:08 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:08.106+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:08.436 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:08 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:08.100+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:08.436 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:08 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:08.100+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:08.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-05T15:33:08.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:08.533 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-05T15:33:08.533 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-05T15:33:08.534 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.5 2023-10-05T15:33:08.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:08 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:08.360+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:08.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:08 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:08.360+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:08.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:08 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:08.597+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:08.832 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:08 smithi135 systemd[1]: Stopping Ceph osd.5 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:08.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:08 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:08.434+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:08.833 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:08 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:08.434+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:08.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:08 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:08.595+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:08.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:08 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:08.595+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:09.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:08 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:08.698+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:09.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:08 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:08.698+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:09.331 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:09.075+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:09.331 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:09.075+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:09.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:09 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:09.135+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:09.664 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:09.370+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:09.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:09.370+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:09.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:09.589+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:09.831 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:09.385+0000 7f8732161700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:09.832 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:09.385+0000 7f8732161700 -1 osd.5 120 *** Got signal Terminated *** 2023-10-05T15:33:09.832 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:09.385+0000 7f8732161700 -1 osd.5 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:09.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:09.471+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:09.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:09 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:09.471+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:09.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:09 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:09.630+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:09.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:09 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:09.630+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:10.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:09.676+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:10.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:09.676+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:10.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:10 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:10.155+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:10.519 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:10 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:10.121+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:10.519 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:10 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:10.122+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:10.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:10.360+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:10.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:10.360+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:10.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:10 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:10.637+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:10.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:10 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:10.517+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:10.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:10 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:10.517+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:10.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:10 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:10.665+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:10.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:10 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:10.665+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:11.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:10.713+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:11.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:10 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:10.713+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:11.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:11 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:11.140+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:11.509 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:11 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:11.170+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:11.509 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:11 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:11.170+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:11.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:11.375+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:11.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:11.375+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:11.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:11 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:11.617+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:11.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:11 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:11.617+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:11.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:11 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:11.507+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:11.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:11 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:11.507+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:12.136 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:11 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:11.700+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:12.137 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:11 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:11.700+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:12.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:11.682+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:12.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:11.682+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:12.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:11 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:11.682+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:12.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:12 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:12.135+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:12.544 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:12.159+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:12.544 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:12.159+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:12.544 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:12.159+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:49.771459+0000 front 2023-10-05T15:32:49.771478+0000 (oldest deadline 2023-10-05T15:33:11.972259+0000) 2023-10-05T15:33:12.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:12.389+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:12.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:12.389+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:12.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:12.640+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:12.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:12.640+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:12.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:12.542+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:12.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:12.542+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:12.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:12 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:12.542+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:13.108 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:12 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:12.677+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:13.109 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:12 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:12.677+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:13.164 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:12.697+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:13.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:12.697+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:13.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:12 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:12.697+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:13.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:13 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:13.107+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:13.556 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:13.195+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:13.556 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:13.195+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:13.556 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:13.195+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:49.771459+0000 front 2023-10-05T15:32:49.771478+0000 (oldest deadline 2023-10-05T15:33:11.972259+0000) 2023-10-05T15:33:13.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:13.405+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:13.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:13.405+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:13.665 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:13.405+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:13.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:13.654+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:13.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:13.654+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:13.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:13.554+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:13.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:13.554+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:13.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:13 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:13.554+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:14.134 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:13 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:13.710+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:14.135 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:13 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:13.710+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:14.135 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:13 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:13.710+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:14.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:13.701+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:14.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:13.701+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:14.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:13 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:13.701+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:14.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:14 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:14.133+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:14.581 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:14.157+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:28.768034+0000 front 2023-10-05T15:32:28.768023+0000 (oldest deadline 2023-10-05T15:32:58.168408+0000) 2023-10-05T15:33:14.581 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:14.157+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:42.170636+0000 front 2023-10-05T15:32:42.170503+0000 (oldest deadline 2023-10-05T15:33:05.670479+0000) 2023-10-05T15:33:14.581 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5[117146]: 2023-10-05T15:33:14.157+0000 7f872cf54700 -1 osd.5 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:49.771459+0000 front 2023-10-05T15:32:49.771478+0000 (oldest deadline 2023-10-05T15:33:11.972259+0000) 2023-10-05T15:33:14.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:14.442+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:14.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:14.443+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:14.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:14.443+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:14.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:14.674+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:14.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:14.674+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:14.916 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:14.674+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:15.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:14.645+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:15.082 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:14.645+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:15.082 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:14.583+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:15.082 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:14.583+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:15.082 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:14 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:14.583+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:15.141 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:14 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:14.735+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:15.141 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:14 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:14.735+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:15.141 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:14 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:14.735+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:15.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:15 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:15.139+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:15.559 INFO:journalctl@ceph.osd.5.smithi135.stdout:Oct 05 15:33:15 smithi135 bash[147501]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-5 2023-10-05T15:33:15.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:15 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:15.689+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:15.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:15 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:15.689+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:15.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:15 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:15.556+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:15.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:15 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:15.556+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:15.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:15 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:15.556+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:15.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:15.451+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:15.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:15.451+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:15.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:15.451+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:15.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:15.655+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:15.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:15.655+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:15.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:15 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:15.655+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:16.107 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:15 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:15.738+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:16.108 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:15 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:15.738+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:16.108 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:15 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:15.738+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:16.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:16.106+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:16.693 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:16 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:16.563+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:16.693 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:16 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:16.563+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:16.693 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:16 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:16.563+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:16.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-05T15:33:16.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:16.764 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-05T15:33:16.764 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-05T15:33:16.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.6 2023-10-05T15:33:16.795 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:16.639+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:16.795 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:16.639+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:16.795 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:16.639+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:16.796 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:16.470+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:16.796 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:16.470+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:16.796 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:16 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:16.470+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:17.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:16 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:16.690+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:17.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:16 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:16.690+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:17.083 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:16.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:17.084 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:16.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:17.084 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:16 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:16.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:17.137 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:16 smithi060 systemd[1]: Stopping Ceph osd.6 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:17.415 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:17.133+0000 7feafb21b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:17.415 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:17.133+0000 7feafb21b700 -1 osd.6 120 *** Got signal Terminated *** 2023-10-05T15:33:17.415 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:17.133+0000 7feafb21b700 -1 osd.6 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:17.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:17 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:17.082+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:17.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:17 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:17.082+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:17.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:17 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:17.711+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:17.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:17 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:17.711+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:17.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:17 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:17.557+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:17.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:17 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:17.557+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:17.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:17 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:17.557+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:17.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:17.632+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:17.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:17.632+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:17.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:17.632+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:17.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:17.448+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:17.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:17.448+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:17.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:17 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:17.448+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:17.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:17 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:17.670+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:17.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:17 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:17.670+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:17.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:17 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:17.670+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:18.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:18 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:18.048+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:18.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:18 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:18.048+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:18.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:18 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:18.704+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:18.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:18 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:18.704+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:18.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:18 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:18.537+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:18.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:18 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:18.537+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:18.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:18 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:18.537+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:18.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:18.657+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:18.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:18.657+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:18.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:18.657+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:18.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:18.464+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:18.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:18.464+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:18.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:18 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:18.464+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:19.051 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:18 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:18.704+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:19.051 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:18 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:18.704+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:19.051 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:18 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:18.704+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:19.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:19.049+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:19.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:19.049+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:19.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:19 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:19.724+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:19.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:19 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:19.724+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:19.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:19 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:19.724+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:19.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:19 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:19.563+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:19.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:19 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:19.563+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:19.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:19 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:19.563+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:19.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:19.484+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:19.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:19.484+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:19.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:19.484+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:19.916 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:19.688+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:19.916 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:19.688+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:19.916 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:19.688+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:19.916 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:19 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:19.688+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:54.546190+0000 front 2023-10-05T15:32:54.546104+0000 (oldest deadline 2023-10-05T15:33:19.246177+0000) 2023-10-05T15:33:20.062 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:19.716+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:20.062 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:19.716+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:20.063 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:19.716+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:20.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:20 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:20.060+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:20.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:20 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:20.060+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:20.732 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:20.467+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:20.732 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:20.467+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:20.732 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:20.467+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:20.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:20.701+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:20.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:20.701+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:20.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:20.701+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:20.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:20.572+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:20.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:20.572+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:20.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:20 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:20.572+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:21.068 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:20 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:20.735+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:21.068 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:20 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:20.735+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:21.068 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:20 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:20.735+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:21.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:20.730+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:21.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:20.730+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:21.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:20.730+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:21.165 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:20 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:20.730+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:54.546190+0000 front 2023-10-05T15:32:54.546104+0000 (oldest deadline 2023-10-05T15:33:19.246177+0000) 2023-10-05T15:33:21.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:21 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:21.065+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:21.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:21 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:21.065+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:21.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:21 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:21.065+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:21.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:21.685+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:21.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:21.685+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:21.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:21.685+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:21.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:21.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:21.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:21.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:21.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:21 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:21.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:21.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:21.700+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.041378+0000 front 2023-10-05T15:32:33.041413+0000 (oldest deadline 2023-10-05T15:32:58.341477+0000) 2023-10-05T15:33:21.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:21.700+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.642895+0000 front 2023-10-05T15:32:40.642545+0000 (oldest deadline 2023-10-05T15:33:03.542555+0000) 2023-10-05T15:33:21.915 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:21.700+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.144664+0000 front 2023-10-05T15:32:48.144692+0000 (oldest deadline 2023-10-05T15:33:11.644868+0000) 2023-10-05T15:33:21.916 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6[134483]: 2023-10-05T15:33:21.700+0000 7feaf3809700 -1 osd.6 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:54.546190+0000 front 2023-10-05T15:32:54.546104+0000 (oldest deadline 2023-10-05T15:33:19.246177+0000) 2023-10-05T15:33:21.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:21.474+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:21.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:21.474+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:21.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:21.474+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:21.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:21 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:21.474+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:22.078 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:21 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:21.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:22.078 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:21 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:21.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:22.078 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:21 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:21.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:22.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:22 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:22.075+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:22.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:22 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:22.075+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:22.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:22 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:22.075+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:22.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:22.488+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:22.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:22.488+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:22.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:22.488+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:22.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:22 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:22.488+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:22.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:22.699+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:22.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:22.699+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:22.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:22.699+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:22.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:22.551+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:22.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:22.551+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:22.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:22 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:22.551+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:23.045 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:22 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:22.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:23.046 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:22 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:22.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:23.046 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:22 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:22.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:23.414 INFO:journalctl@ceph.osd.6.smithi060.stdout:Oct 05 15:33:23 smithi060 bash[183147]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-6 2023-10-05T15:33:23.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:23.043+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:23.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:23.043+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:23.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:23.043+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:23.790 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:23.533+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:23.790 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:23.533+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:23.790 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:23.533+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:23.790 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:23 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:23.533+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:23.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:23 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:23.717+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:23.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:23 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:23.717+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:23.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:23 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:23.717+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:23.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:23 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:23.533+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:23.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:23 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:23.533+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:23.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:23 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:23.533+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:24.040 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:23.722+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:24.040 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:23.722+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:24.040 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:23.722+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:24.040 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:23 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:23.722+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:24.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:24.038+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:24.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:24.038+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:24.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:24.038+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:24.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-05T15:33:24.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:24.671 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-05T15:33:24.671 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-05T15:33:24.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.7 2023-10-05T15:33:24.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:24 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:24.728+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:24.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:24 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:24.728+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:24.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:24 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:24.728+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:24.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:24 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:24.536+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:24.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:24 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:24.536+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:24.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:24 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:24.536+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:24.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:24 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:24.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:24.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:24 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:24.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:24.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:24 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:24.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:24.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:24 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:24.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:25.035 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:24 smithi092 systemd[1]: Stopping Ceph osd.7 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:25.035 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:25.031+0000 7f269f7c5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:25.035 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:24.734+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:25.035 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:24.734+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:25.035 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:24.734+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:25.036 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:24.734+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:25.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:25.031+0000 7f269f7c5700 -1 osd.7 120 *** Got signal Terminated *** 2023-10-05T15:33:25.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:25.031+0000 7f269f7c5700 -1 osd.7 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:25.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:25.073+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:25.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:25.073+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:25.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:25.073+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:25.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:25.698+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:25.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:25.698+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:25.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:25.698+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:25.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:25.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:25.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:25.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:25.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:25 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:25.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:25.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:25 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:25.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:25.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:25 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:25.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:25.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:25 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:25.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:25.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:25 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:25.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:26.070 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:25.726+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:26.071 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:25.726+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:26.071 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:25.726+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:26.071 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:25 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:25.726+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:26.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:26.068+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:26.427 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:26.068+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:26.427 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:26.068+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:26.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:26 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:26.720+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:26.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:26 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:26.720+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:26.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:26 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:26.720+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:26.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:26 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:26.482+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:26.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:26 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:26.482+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:26.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:26 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:26.482+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:26.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:26 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:26.568+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:26.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:26 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:26.568+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:26.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:26 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:26.568+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:26.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:26 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:26.568+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:27.094 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:26.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:27.094 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:26.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:27.094 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:26.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:27.094 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:26 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:26.709+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:27.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:27.091+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:27.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:27.091+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:27.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:27.091+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:27.723 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:27 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:27.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:27.723 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:27 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:27.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:27.723 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:27 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:27.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:27.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:27 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:27.601+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:27.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:27 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:27.601+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:27.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:27 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:27.601+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:27.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:27 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:27.601+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:27.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:27 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:27.601+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:28.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:27 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:27.721+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:28.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:27 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:27.721+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:28.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:27 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:27.721+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:28.088 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:27.744+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:28.088 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:27.744+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:28.088 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:27.744+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:28.088 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:27 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:27.744+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:28.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:28.086+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:28.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:28.086+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:28.426 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:28.086+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:28.770 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:28.406+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:28.771 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:28.406+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:28.771 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:28.406+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:28.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:28 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:28.610+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:28.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:28 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:28.610+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:28.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:28 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:28.611+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:28.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:28 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:28.611+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:28.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:28 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:28.611+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:29.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:28.768+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:29.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:28.768+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:29.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:28.768+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:29.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:28 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:28.768+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:29.176 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:29.039+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:41.655371+0000 front 2023-10-05T15:32:41.655435+0000 (oldest deadline 2023-10-05T15:33:03.856279+0000) 2023-10-05T15:33:29.176 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:29.039+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:46.157481+0000 front 2023-10-05T15:32:46.157579+0000 (oldest deadline 2023-10-05T15:33:16.158137+0000) 2023-10-05T15:33:29.176 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7[125249]: 2023-10-05T15:33:29.039+0000 7f26995b6700 -1 osd.7 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:56.158991+0000 front 2023-10-05T15:32:56.158844+0000 (oldest deadline 2023-10-05T15:33:20.858716+0000) 2023-10-05T15:33:29.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:28.791+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:29.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:28.791+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:29.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:28.791+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:29.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:28 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:28.791+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:29.787 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:29.432+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:29.787 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:29.432+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:29.787 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:29.432+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:29.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:29.620+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:29.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:29.620+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:29.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:29.620+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:29.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:29.620+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:29.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:29 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:29.620+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:30.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:29.785+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:30.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:29.785+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:30.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:29.785+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:30.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:29 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:29.785+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:30.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:29.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:30.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:29.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:30.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:29.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:30.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:29.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:30.819 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:30.464+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:30.819 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:30.464+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:30.819 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:30.464+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:30.819 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:30.464+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:30.914 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:30 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:30.602+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:30.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:30 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:30.602+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:30.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:30 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:30.602+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:30.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:30 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:30.602+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:30.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:30 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:30.602+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:31.010 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 05 15:33:30 smithi092 bash[147393]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-7 2023-10-05T15:33:31.010 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:30 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:30.785+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:31.010 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:30 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:30.785+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:31.010 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:30 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:30.785+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:31.010 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:30 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:30.785+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:31.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:30.816+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:31.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:30.816+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:31.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:30.816+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:31.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:30 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:30.816+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:31.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:31.497+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:31.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:31.497+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:31.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:31.497+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:31.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:31.497+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:31.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:31 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:31.619+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:31.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:31 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:31.619+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:31.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:31 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:31.619+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:31.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:31 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:31.619+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:31.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:31 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:31.619+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:31.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:31 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:31.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:31.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:31 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:31.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:31.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:31 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:31.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:31.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:31 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:31.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:31.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:31 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:31.778+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:32.331 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:31.832+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:32.331 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:31.832+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:32.331 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:31.832+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:32.331 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:31 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:31.832+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:32.365 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-05T15:33:32.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:32.406 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-05T15:33:32.406 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-05T15:33:32.407 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.8 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 systemd[1]: Stopping Ceph osd.8 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.765+0000 7f458b453700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.765+0000 7f458b453700 -1 osd.8 120 *** Got signal Terminated *** 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:32.522+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:32.522+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:32.522+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:32.769 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:32.522+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:32.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:32 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:32.612+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:32.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:32 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:32.612+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:32.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:32 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:32.612+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:32.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:32 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:32.612+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:32.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:32 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:32.612+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:33.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.765+0000 7f458b453700 -1 osd.8 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:33.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.840+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:33.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.840+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:33.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.840+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:33.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:32 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:32.840+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:33.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:32 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:32.816+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:33.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:32 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:32.816+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:33.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:32 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:32.816+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:33.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:32 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:32.816+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:33.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:32 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:32.816+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:33.808 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:33.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:33.808 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:33.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:33.808 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:33.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:33.808 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:33.525+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:33.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:33 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:33.565+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:33.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:33 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:33.565+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:33.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:33 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:33.565+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:33.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:33 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:33.565+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:33.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:33 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:33.565+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:34.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:33.806+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:34.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:33.806+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:34.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:33.806+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:34.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:33 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:33.806+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:34.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:33.813+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:34.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:33.813+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:34.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:33.813+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:34.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:33.813+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:34.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:33.813+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:34.761 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:34.498+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:34.761 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:34.498+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:34.761 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:34.498+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:34.761 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:34.498+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:34.914 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:34 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:34.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:34.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:34 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:34.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:34.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:34 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:34.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:34.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:34 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:34.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:34.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:34 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:34.543+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:35.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:34.759+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:35.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:34.759+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:35.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:34.759+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:35.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:34 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:34.759+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:35.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:34 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:34.828+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:35.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:34 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:34.828+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:35.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:34 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:34.828+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:35.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:34 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:34.828+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:35.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:34 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:34.828+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:35.799 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:35.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:35.799 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:35.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:35.799 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:35.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:35.799 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:35.540+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:35.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:35 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:35.552+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:35.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:35 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:35.552+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:35.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:35 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:35.552+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:35.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:35 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:35.552+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:35.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:35 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:35.552+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:36.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:35.796+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:36.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:35.796+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:36.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:35.796+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:36.081 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:35 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:35.796+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:36.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:35.811+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:36.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:35.811+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:36.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:35.811+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:36.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:35.811+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:36.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:35 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:35.811+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:36.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:36.526+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:36.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:36.526+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:36.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:36.526+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:36.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:36.526+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:36.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:36.761+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.274335+0000 front 2023-10-05T15:32:33.274284+0000 (oldest deadline 2023-10-05T15:32:56.774285+0000) 2023-10-05T15:33:36.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:36.761+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.177382+0000 front 2023-10-05T15:32:47.177279+0000 (oldest deadline 2023-10-05T15:33:11.277367+0000) 2023-10-05T15:33:36.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:36.761+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.079054+0000 front 2023-10-05T15:32:57.079023+0000 (oldest deadline 2023-10-05T15:33:19.379006+0000) 2023-10-05T15:33:36.832 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:36 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8[125074]: 2023-10-05T15:33:36.761+0000 7f4586246700 -1 osd.8 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.580531+0000 front 2023-10-05T15:33:04.580499+0000 (oldest deadline 2023-10-05T15:33:28.680569+0000) 2023-10-05T15:33:36.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:36.508+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:36.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:36.508+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:36.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:36.508+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:36.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:36.508+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:36.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:36.508+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:36.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:36 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:36.508+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:37.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:36 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:36.764+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:37.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:36 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:36.764+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:37.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:36 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:36.764+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:37.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:36 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:36.764+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:37.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:36 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:36.764+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:37.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:37 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:37.501+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:37.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:37 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:37.501+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:37.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:37 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:37.501+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:37.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:37 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:37.501+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:37.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:37.544+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:37.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:37.544+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:37.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:37.544+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:37.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:37.544+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:37.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:37.544+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:37.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:37 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:37.544+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:38.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:37.727+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:38.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:37.727+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:38.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:37.727+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:38.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:37.727+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:38.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:37.727+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:38.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:37 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:37.727+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:38.566 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:38 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:38.462+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:38.566 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:38 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:38.462+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:38.566 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:38 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:38.462+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:38.566 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:38 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:38.462+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:38.831 INFO:journalctl@ceph.osd.8.smithi135.stdout:Oct 05 15:33:38 smithi135 bash[147769]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-8 2023-10-05T15:33:38.914 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:38.562+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:38.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:38.562+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:38.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:38.562+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:38.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:38.562+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:38.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:38.562+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:38.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:38 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:38.562+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:39.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:38.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:39.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:38.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:39.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:38.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:39.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:38.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:39.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:38.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:39.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:38 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:38.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:39.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:39.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:39.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:39.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:39.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:39.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:39.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:39.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:39.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:39.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:39.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:39.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:39.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:39.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:39.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:39.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:39.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:39.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:39.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:39.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:39.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:39 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:39.532+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:40.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-05T15:33:40.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:40.048 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-05T15:33:40.048 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-05T15:33:40.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.9 2023-10-05T15:33:40.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:39.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:40.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:39.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:40.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:39.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:40.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:39.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:40.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:39.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:40.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:39 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:39.715+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:40.415 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 systemd[1]: Stopping Ceph osd.9 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:40.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:40 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:40.441+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:40.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:40 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:40.441+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:40.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:40 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:40.441+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:40.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:40 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:40.441+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:40.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:40 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:40.441+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.414+0000 7f7210b60700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.414+0000 7f7210b60700 -1 osd.9 120 *** Got signal Terminated *** 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.414+0000 7f7210b60700 -1 osd.9 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.564+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.564+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.564+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.564+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:40.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.564+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:40.916 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:40 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:40.564+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:41.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:40 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:40.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:41.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:40 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:40.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:41.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:40 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:40.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:41.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:40 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:40.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:41.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:40 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:40.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:41.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:40 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:40.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:41.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:41.465+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:41.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:41.465+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:41.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:41.465+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:41.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:41.465+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:41.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:41 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:41.465+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:41.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:41.519+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:41.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:41.519+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:41.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:41.519+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:41.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:41.519+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:41.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:41.519+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:41.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:41 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:41.519+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:42.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:41.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:42.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:41.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:42.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:41.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:42.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:41.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:42.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:41.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:42.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:41 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:41.751+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:42.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:42.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:42.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:42.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:42.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:42.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:42.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:42.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:42.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:42 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:42.435+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:42.914 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:42.505+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:42.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:42.505+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:42.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:42.505+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:42.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:42.505+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:42.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:42.505+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:42.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:42 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:42.505+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:43.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:42.765+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:43.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:42.765+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:43.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:42.765+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:43.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:42.765+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:43.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:42.765+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:43.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:42 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:42.765+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:43.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:43.387+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:43.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:43.387+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:43.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:43.387+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:43.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:43.387+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:43.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:43.387+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:43.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:43.504+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:43.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:43.504+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:43.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:43.504+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:43.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:43.504+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:43.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:43.504+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:43.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:43 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:43.504+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:44.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:43.736+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:44.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:43.736+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:44.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:43.736+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:44.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:43.736+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:44.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:43.736+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:44.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:43 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:43.736+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:44.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:44.424+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:44.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:44.424+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:44.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:44.424+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:44.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:44.424+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:44.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:44.424+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:44.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:44 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:44.424+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:44.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:44.503+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:33.218417+0000 front 2023-10-05T15:32:33.218536+0000 (oldest deadline 2023-10-05T15:32:57.818588+0000) 2023-10-05T15:33:44.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:44.503+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:39.519784+0000 front 2023-10-05T15:32:39.520113+0000 (oldest deadline 2023-10-05T15:33:05.419769+0000) 2023-10-05T15:33:44.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:44.503+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:47.720963+0000 front 2023-10-05T15:32:47.721040+0000 (oldest deadline 2023-10-05T15:33:12.420812+0000) 2023-10-05T15:33:44.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:44.503+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:58.222205+0000 front 2023-10-05T15:32:58.222110+0000 (oldest deadline 2023-10-05T15:33:21.122213+0000) 2023-10-05T15:33:44.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:44.503+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.023159+0000 front 2023-10-05T15:33:04.023303+0000 (oldest deadline 2023-10-05T15:33:27.523201+0000) 2023-10-05T15:33:44.915 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:44 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9[142485]: 2023-10-05T15:33:44.503+0000 7f720b953700 -1 osd.9 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.324803+0000 front 2023-10-05T15:33:13.324612+0000 (oldest deadline 2023-10-05T15:33:35.624639+0000) 2023-10-05T15:33:45.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:44.724+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:45.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:44.724+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:45.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:44.724+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:45.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:44.724+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:45.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:44.724+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:45.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:44 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:44.724+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:45.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:45.385+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:45.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:45.385+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:45.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:45.385+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:45.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:45.385+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:45.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:45.385+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:45.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:45 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:45.385+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:46.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:45.761+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:46.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:45.761+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:46.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:45.761+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:46.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:45.761+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:46.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:45.761+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:46.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:45 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:45.761+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:46.664 INFO:journalctl@ceph.osd.9.smithi060.stdout:Oct 05 15:33:46 smithi060 bash[183410]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-9 2023-10-05T15:33:46.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:46.379+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:46.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:46.379+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:46.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:46.379+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:46.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:46.379+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:46.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:46.379+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:46.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:46 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:46.379+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:47.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:46.721+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:47.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:46.721+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:47.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:46.721+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:47.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:46.721+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:47.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:46.721+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:47.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:46 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:46.721+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:47.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-05T15:33:47.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:47.808 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-05T15:33:47.808 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-05T15:33:47.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.10 2023-10-05T15:33:47.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:47.421+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:47.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:47.421+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:47.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:47.421+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:47.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:47.421+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:47.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:47.421+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:47.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:47.421+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:48.171 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:48.171 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:48.171 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:48.171 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:48.171 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:48.172 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:48.172 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:47.743+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:21.664280+0000 front 2023-10-05T15:33:21.664254+0000 (oldest deadline 2023-10-05T15:33:46.964204+0000) 2023-10-05T15:33:48.172 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:47 smithi092 systemd[1]: Stopping Ceph osd.10 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:48.172 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.168+0000 7f8b0185a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:48.172 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.168+0000 7f8b0185a700 -1 osd.10 120 *** Got signal Terminated *** 2023-10-05T15:33:48.172 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.168+0000 7f8b0185a700 -1 osd.10 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:48.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:48.381+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:48.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:48.381+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:48.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:48.381+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:48.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:48.381+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:48.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:48.381+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:48.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:48 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:48.381+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:49.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:49.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:49.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:49.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:49.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:49.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:49.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:48 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:48.699+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:21.664280+0000 front 2023-10-05T15:33:21.664254+0000 (oldest deadline 2023-10-05T15:33:46.964204+0000) 2023-10-05T15:33:49.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:49.340+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:49.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:49.340+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:49.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:49.340+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:49.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:49.340+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:49.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:49.340+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:49.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:49 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:49.340+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:50.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:50.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:50.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:50.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:50.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:50.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:50.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:49 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:49.688+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:21.664280+0000 front 2023-10-05T15:33:21.664254+0000 (oldest deadline 2023-10-05T15:33:46.964204+0000) 2023-10-05T15:33:50.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:50.350+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:50.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:50.350+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:50.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:50.350+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:50.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:50.350+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:50.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:50.350+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:50.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:50 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:50.350+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:50.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:50.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:50.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:50.927 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:50.927 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:50.927 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:50.927 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:50 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:50.640+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:21.664280+0000 front 2023-10-05T15:33:21.664254+0000 (oldest deadline 2023-10-05T15:33:46.964204+0000) 2023-10-05T15:33:51.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:51.318+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:51.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:51.318+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:51.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:51.318+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:51.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:51.318+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:51.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:51.318+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:51.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:51 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:51.318+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:51.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:51.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:51.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:51.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:51.926 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:51.927 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:51.927 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:51 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:51.668+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:21.664280+0000 front 2023-10-05T15:33:21.664254+0000 (oldest deadline 2023-10-05T15:33:46.964204+0000) 2023-10-05T15:33:52.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:52.272+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:52.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:52.272+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:52.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:52.272+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:52.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:52.272+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:52.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:52.272+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:52.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:52 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:52.272+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:53.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:34.257615+0000 front 2023-10-05T15:32:34.257710+0000 (oldest deadline 2023-10-05T15:33:00.157626+0000) 2023-10-05T15:33:53.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:40.158150+0000 front 2023-10-05T15:32:40.157975+0000 (oldest deadline 2023-10-05T15:33:08.259188+0000) 2023-10-05T15:33:53.176 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.259733+0000 front 2023-10-05T15:32:48.259807+0000 (oldest deadline 2023-10-05T15:33:12.959779+0000) 2023-10-05T15:33:53.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2023-10-05T15:32:57.661312+0000 front 2023-10-05T15:32:57.661243+0000 (oldest deadline 2023-10-05T15:33:22.961038+0000) 2023-10-05T15:33:53.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:05.762396+0000 front 2023-10-05T15:33:05.762422+0000 (oldest deadline 2023-10-05T15:33:31.062586+0000) 2023-10-05T15:33:53.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:11.063223+0000 front 2023-10-05T15:33:11.063165+0000 (oldest deadline 2023-10-05T15:33:36.963074+0000) 2023-10-05T15:33:53.177 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:52 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10[133243]: 2023-10-05T15:33:52.701+0000 7f8afa649700 -1 osd.10 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:21.664280+0000 front 2023-10-05T15:33:21.664254+0000 (oldest deadline 2023-10-05T15:33:46.964204+0000) 2023-10-05T15:33:53.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:53 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:53.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:53.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:53 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:53.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:53.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:53 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:53.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:53.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:53 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:53.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:53.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:53 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:53.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:53.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:53 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:53.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:54.426 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 05 15:33:54 smithi092 bash[147654]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-10 2023-10-05T15:33:54.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:54.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:54.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:54.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:54.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:54.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:54.582 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:54 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:54.317+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:33:55.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-05T15:33:55.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:33:55.480 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-05T15:33:55.480 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-05T15:33:55.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.11 2023-10-05T15:33:55.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:55.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:55.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:55.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:55.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:55.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:55.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.345+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:33:55.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 systemd[1]: Stopping Ceph osd.11 for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:56.325 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.847+0000 7f1312d51700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:33:56.325 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.847+0000 7f1312d51700 -1 osd.11 120 *** Got signal Terminated *** 2023-10-05T15:33:56.325 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:55 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:55.847+0000 7f1312d51700 -1 osd.11 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:33:56.326 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:56.326 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:56.326 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:56.326 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:56.326 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:56.326 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:56.327 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:56 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:56.323+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:57.581 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:57 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:57.285+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:58.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:58 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:58.333+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:33:59.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:33:59.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:33:59.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:33:59.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:33:59.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:33:59.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:33:59.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:33:59.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:33:59 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:33:59.367+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2023-10-05T15:33:33.787069+0000 front 2023-10-05T15:33:33.787017+0000 (oldest deadline 2023-10-05T15:33:59.087131+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2023-10-05T15:32:29.978250+0000 front 2023-10-05T15:32:29.978175+0000 (oldest deadline 2023-10-05T15:32:58.778694+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-05T15:32:38.779499+0000 front 2023-10-05T15:32:38.779351+0000 (oldest deadline 2023-10-05T15:33:04.679426+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-10-05T15:32:48.780476+0000 front 2023-10-05T15:32:48.780500+0000 (oldest deadline 2023-10-05T15:33:11.680605+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-05T15:33:04.384276+0000 front 2023-10-05T15:33:04.384313+0000 (oldest deadline 2023-10-05T15:33:30.284122+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-10-05T15:33:13.784979+0000 front 2023-10-05T15:33:13.785013+0000 (oldest deadline 2023-10-05T15:33:39.085086+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2023-10-05T15:33:19.085683+0000 front 2023-10-05T15:33:19.085622+0000 (oldest deadline 2023-10-05T15:33:44.385495+0000) 2023-10-05T15:34:00.831 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-05T15:33:29.686486+0000 front 2023-10-05T15:33:29.686541+0000 (oldest deadline 2023-10-05T15:33:53.786504+0000) 2023-10-05T15:34:00.832 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:00 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11[133234]: 2023-10-05T15:34:00.344+0000 7f130bb40700 -1 osd.11 120 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2023-10-05T15:33:33.787069+0000 front 2023-10-05T15:33:33.787017+0000 (oldest deadline 2023-10-05T15:33:59.087131+0000) 2023-10-05T15:34:01.715 INFO:journalctl@ceph.osd.11.smithi135.stdout:Oct 05 15:34:01 smithi135 bash[148030]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-osd-11 2023-10-05T15:34:03.078 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-05T15:34:03.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:03.118 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-05T15:34:03.119 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-05T15:34:03.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.a 2023-10-05T15:34:03.417 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:34:03 smithi060 systemd[1]: Stopping Ceph mds.a for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:03.914 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:34:03 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a[150317]: 2023-10-05T15:34:03.495+0000 7f34c8c29700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:03.915 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:34:03 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a[150317]: 2023-10-05T15:34:03.495+0000 7f34c8c29700 -1 mds.a *** got signal Terminated *** 2023-10-05T15:34:07.342 INFO:journalctl@ceph.mds.a.smithi060.stdout:Oct 05 15:34:07 smithi060 bash[183690]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-a 2023-10-05T15:34:07.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-05T15:34:07.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:07.388 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-05T15:34:07.388 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-05T15:34:07.388 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.d 2023-10-05T15:34:07.665 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:34:07 smithi060 systemd[1]: Stopping Ceph mds.d for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:08.164 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:34:07 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-d[149343]: 2023-10-05T15:34:07.769+0000 7fce11d45700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:08.165 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:34:07 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-d[149343]: 2023-10-05T15:34:07.769+0000 7fce11d45700 -1 mds.d *** got signal Terminated *** 2023-10-05T15:34:09.317 INFO:journalctl@ceph.mds.d.smithi060.stdout:Oct 05 15:34:09 smithi060 bash[183830]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-d 2023-10-05T15:34:09.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-05T15:34:09.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:09.357 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-05T15:34:09.357 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-05T15:34:09.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.g 2023-10-05T15:34:09.664 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:34:09 smithi060 systemd[1]: Stopping Ceph mds.g for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:10.165 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:34:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g[149932]: 2023-10-05T15:34:09.774+0000 7f3e17175700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:10.165 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:34:09 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g[149932]: 2023-10-05T15:34:09.774+0000 7f3e17175700 -1 mds.g *** got signal Terminated *** 2023-10-05T15:34:14.333 INFO:journalctl@ceph.mds.g.smithi060.stdout:Oct 05 15:34:13 smithi060 bash[183969]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-g 2023-10-05T15:34:14.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-05T15:34:14.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:14.521 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-05T15:34:14.521 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-05T15:34:14.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.j 2023-10-05T15:34:14.914 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:34:14 smithi060 systemd[1]: Stopping Ceph mds.j for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:15.414 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:34:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-j[148977]: 2023-10-05T15:34:14.917+0000 7fc84170a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:15.415 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:34:14 smithi060 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-j[148977]: 2023-10-05T15:34:14.917+0000 7fc84170a700 -1 mds.j *** got signal Terminated *** 2023-10-05T15:34:18.780 INFO:journalctl@ceph.mds.j.smithi060.stdout:Oct 05 15:34:18 smithi060 bash[184119]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-j 2023-10-05T15:34:18.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-05T15:34:19.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:19.025 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-05T15:34:19.025 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-05T15:34:19.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.b 2023-10-05T15:34:19.389 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:34:19 smithi092 systemd[1]: Stopping Ceph mds.b for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:19.676 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:34:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: 2023-10-05T15:34:19.387+0000 7f501e485700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:19.676 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:34:19 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b[139654]: 2023-10-05T15:34:19.387+0000 7f501e485700 -1 mds.b *** got signal Terminated *** 2023-10-05T15:34:23.918 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 05 15:34:23 smithi092 bash[147932]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-b 2023-10-05T15:34:23.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-05T15:34:23.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:23.962 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-05T15:34:23.962 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-05T15:34:23.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.e 2023-10-05T15:34:24.176 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:34:24 smithi092 systemd[1]: Stopping Ceph mds.e for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:24.676 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:34:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e[138973]: 2023-10-05T15:34:24.352+0000 7fe474325700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:24.676 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:34:24 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e[138973]: 2023-10-05T15:34:24.352+0000 7fe474325700 -1 mds.e *** got signal Terminated *** 2023-10-05T15:34:28.926 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 05 15:34:28 smithi092 bash[148077]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-e 2023-10-05T15:34:28.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-05T15:34:28.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:28.965 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-05T15:34:28.966 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-05T15:34:28.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.h 2023-10-05T15:34:29.354 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:34:29 smithi092 systemd[1]: Stopping Ceph mds.h for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:29.676 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:34:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h[139315]: 2023-10-05T15:34:29.352+0000 7f7c5411b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:29.676 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:34:29 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h[139315]: 2023-10-05T15:34:29.352+0000 7f7c5411b700 -1 mds.h *** got signal Terminated *** 2023-10-05T15:34:32.676 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 05 15:34:32 smithi092 bash[148223]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-h 2023-10-05T15:34:32.797 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-05T15:34:32.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:32.830 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-05T15:34:32.830 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-05T15:34:32.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.k 2023-10-05T15:34:33.176 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:34:32 smithi092 systemd[1]: Stopping Ceph mds.k for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:33.676 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:34:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k[138631]: 2023-10-05T15:34:33.218+0000 7f2e7a4d2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:33.676 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:34:33 smithi092 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k[138631]: 2023-10-05T15:34:33.218+0000 7f2e7a4d2700 -1 mds.k *** got signal Terminated *** 2023-10-05T15:34:36.673 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 05 15:34:36 smithi092 bash[148365]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-k 2023-10-05T15:34:36.869 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-05T15:34:36.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:36.903 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-05T15:34:36.904 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-05T15:34:36.904 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.c 2023-10-05T15:34:37.267 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:34:36 smithi135 systemd[1]: Stopping Ceph mds.c for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:37.581 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:34:37 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c[139307]: 2023-10-05T15:34:37.265+0000 7f52080b7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:37.581 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:34:37 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c[139307]: 2023-10-05T15:34:37.265+0000 7f52080b7700 -1 mds.c *** got signal Terminated *** 2023-10-05T15:34:39.328 INFO:journalctl@ceph.mds.c.smithi135.stdout:Oct 05 15:34:38 smithi135 bash[148301]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-c 2023-10-05T15:34:39.334 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-05T15:34:39.371 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:39.371 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-05T15:34:39.371 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-05T15:34:39.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f 2023-10-05T15:34:39.581 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:34:39 smithi135 systemd[1]: Stopping Ceph mds.f for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:40.081 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:34:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[142924]: 2023-10-05T15:34:39.765+0000 7fa4c49bd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:40.081 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:34:39 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f[142924]: 2023-10-05T15:34:39.765+0000 7fa4c49bd700 -1 mds.f *** got signal Terminated *** 2023-10-05T15:34:43.331 INFO:journalctl@ceph.mds.f.smithi135.stdout:Oct 05 15:34:42 smithi135 bash[148450]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-f 2023-10-05T15:34:43.403 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-05T15:34:43.436 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:43.437 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-05T15:34:43.437 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-05T15:34:43.437 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.i 2023-10-05T15:34:43.816 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:34:43 smithi135 systemd[1]: Stopping Ceph mds.i for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:44.081 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:34:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:34:43.813+0000 7f2077449700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:44.081 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:34:43 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i[139645]: 2023-10-05T15:34:43.813+0000 7f2077449700 -1 mds.i *** got signal Terminated *** 2023-10-05T15:34:47.081 INFO:journalctl@ceph.mds.i.smithi135.stdout:Oct 05 15:34:47 smithi135 bash[148602]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-i 2023-10-05T15:34:47.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-05T15:34:47.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:47.307 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-05T15:34:47.307 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-05T15:34:47.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.l 2023-10-05T15:34:47.581 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:34:47 smithi135 systemd[1]: Stopping Ceph mds.l for d07a9b62-6390-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:48.081 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:34:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l[138628]: 2023-10-05T15:34:47.712+0000 7f30d4004700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:34:48.081 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:34:47 smithi135 ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l[138628]: 2023-10-05T15:34:47.712+0000 7f30d4004700 -1 mds.l *** got signal Terminated *** 2023-10-05T15:34:51.124 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:34:51 smithi135 bash[148742]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7-mds-l 2023-10-05T15:34:51.354 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-05T15:34:51.377 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:34:51 smithi135 systemd[1]: ceph-d07a9b62-6390-11ee-8db5-212e2dc638e7@mds.l.service: Succeeded. 2023-10-05T15:34:51.377 INFO:journalctl@ceph.mds.l.smithi135.stdout:Oct 05 15:34:51 smithi135 systemd[1]: Stopped Ceph mds.l for d07a9b62-6390-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:51.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:34:51.387 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-05T15:34:51.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-05T15:34:51.709 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:34:53.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-05T15:34:53.806 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:34:55.413 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-05T15:34:55.800 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:34:57.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:34:57.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:34:57.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:34:57.562 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-05T15:34:57.564 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi060/crash 2023-10-05T15:34:57.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash -- . 2023-10-05T15:34:57.597 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-05T15:34:57.597 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2023-10-05T15:34:57.599 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi092/crash 2023-10-05T15:34:57.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash -- . 2023-10-05T15:34:57.730 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-05T15:34:57.730 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2023-10-05T15:34:57.732 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi135/crash 2023-10-05T15:34:57.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash -- . 2023-10-05T15:34:57.788 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-05T15:34:57.788 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2023-10-05T15:34:57.790 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-05T15:34:57.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-05T15:34:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:grep: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-05T15:34:57.855 INFO:tasks.cephadm:Compressing logs... 2023-10-05T15:34:57.855 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T15:34:57.857 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T15:34:57.859 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T15:34:57.909 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-05T15:34:57.909 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-05T15:34:57.910 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-05T15:34:57.911 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-05T15:34:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-05T15:34:57.920 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-05T15:34:57.920 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-05T15:34:57.920 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-05T15:34:57.920 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-05T15:34:57.924 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-05T15:34:57.924 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-05T15:34:57.924 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-05T15:34:57.924 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-05T15:34:57.924 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-05T15:34:57.924 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-05T15:34:57.925 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-05T15:34:57.925 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.5.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-05T15:34:57.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.i.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-05T15:34:57.928 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 92.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-05T15:34:57.929 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.b.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 92.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-05T15:34:58.013 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-05T15:34:58.013 INFO:teuthology.orchestra.run.smithi060.stderr:: No such file or directory 2023-10-05T15:34:58.020 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-10-05T15:34:58.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-05T15:34:58.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-05T15:34:58.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-05T15:34:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-05T15:34:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.g.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-05T15:34:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-05T15:34:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.6.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-05T15:34:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-05T15:34:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.d.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-10-05T15:34:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-05T15:34:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-05T15:34:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.9.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-05T15:34:58.026 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.j.log: /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.a.log: 94.3% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-05T15:34:58.027 INFO:teuthology.orchestra.run.smithi060.stderr: 94.3% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-05T15:34:58.076 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-05T15:34:58.204 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-05T15:34:58.217 INFO:teuthology.orchestra.run.smithi060.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-05T15:34:58.277 INFO:teuthology.orchestra.run.smithi135.stderr: 91.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-05T15:34:58.659 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-05T15:34:59.079 INFO:teuthology.orchestra.run.smithi060.stderr: 90.1% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-05T15:34:59.461 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-05T15:34:59.894 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-05T15:35:00.139 INFO:teuthology.orchestra.run.smithi060.stderr: 90.5% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-05T15:35:01.681 INFO:teuthology.orchestra.run.smithi135.stderr: 92.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-05T15:35:08.211 INFO:teuthology.orchestra.run.smithi060.stderr: 95.0% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-05T15:35:08.388 INFO:teuthology.orchestra.run.smithi060.stderr: 95.3% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-05T15:35:22.573 INFO:teuthology.orchestra.run.smithi135.stderr: 94.9% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-05T15:35:25.619 INFO:teuthology.orchestra.run.smithi135.stderr: 95.1% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi092.stderr: 95.5% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-05T15:36:14.633 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-05T15:36:21.074 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-05T15:36:23.212 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-05T15:36:29.217 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-05T15:36:29.219 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-05T15:36:29.219 INFO:teuthology.orchestra.run.smithi060.stderr:real 1m31.346s 2023-10-05T15:36:29.219 INFO:teuthology.orchestra.run.smithi060.stderr:user 4m13.263s 2023-10-05T15:36:29.219 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m8.185s 2023-10-05T15:36:47.854 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-05T15:37:24.067 INFO:teuthology.orchestra.run.smithi092.stderr: 91.4% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-05T15:37:26.449 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-05T15:37:39.814 INFO:teuthology.orchestra.run.smithi135.stderr: 91.4% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-05T15:37:51.779 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-05T15:37:52.603 INFO:teuthology.orchestra.run.smithi092.stderr: 91.3% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-05T15:38:09.692 INFO:teuthology.orchestra.run.smithi092.stderr: 93.9% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-05T15:38:12.673 INFO:teuthology.orchestra.run.smithi092.stderr: 91.5% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-05T15:38:15.946 INFO:teuthology.orchestra.run.smithi092.stderr: 93.6% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-05T15:38:25.857 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-05T15:38:26.385 INFO:teuthology.orchestra.run.smithi135.stderr: 93.7% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-05T15:38:49.207 INFO:teuthology.orchestra.run.smithi092.stderr: 93.7% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-05T15:38:49.210 INFO:teuthology.orchestra.run.smithi092.stderr: 2023-10-05T15:38:49.210 INFO:teuthology.orchestra.run.smithi092.stderr:real 3m51.333s 2023-10-05T15:38:49.210 INFO:teuthology.orchestra.run.smithi092.stderr:user 6m29.071s 2023-10-05T15:38:49.210 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m15.159s 2023-10-05T15:39:50.687 INFO:teuthology.orchestra.run.smithi135.stderr: 93.3% -- replaced with /var/log/ceph/d07a9b62-6390-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-05T15:39:50.690 INFO:teuthology.orchestra.run.smithi135.stderr: 2023-10-05T15:39:50.690 INFO:teuthology.orchestra.run.smithi135.stderr:real 4m52.814s 2023-10-05T15:39:50.690 INFO:teuthology.orchestra.run.smithi135.stderr:user 6m51.003s 2023-10-05T15:39:50.690 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m16.288s 2023-10-05T15:39:50.690 INFO:tasks.cephadm:Archiving logs... 2023-10-05T15:39:50.691 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi060/log 2023-10-05T15:39:50.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T15:40:31.062 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi092/log 2023-10-05T15:40:31.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T15:41:29.334 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi135/log 2023-10-05T15:41:29.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T15:42:33.688 INFO:tasks.cephadm:Removing cluster... 2023-10-05T15:42:33.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --force 2023-10-05T15:42:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:42:34.951 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --force 2023-10-05T15:42:35.715 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:42:36.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d07a9b62-6390-11ee-8db5-212e2dc638e7 --force 2023-10-05T15:42:37.107 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: d07a9b62-6390-11ee-8db5-212e2dc638e7 2023-10-05T15:42:38.098 INFO:tasks.cephadm:Removing cephadm ... 2023-10-05T15:42:38.098 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-05T15:42:38.120 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-05T15:42:38.146 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-05T15:42:38.178 INFO:tasks.cephadm:Teardown complete 2023-10-05T15:42:38.178 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-05T15:42:38.196 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-05T15:42:38.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T15:42:38.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T15:42:38.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T15:42:38.347 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-05T15:42:38.360 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-05T15:42:38.360 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:42:38.363 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:42:38.365 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:42:38.379 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-05T15:42:38.381 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-10-05T15:42:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-05T15:42:38.403 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:42:38.403 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-05T15:42:38.403 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 19 -459us[ -450us] +/- 89ms 2023-10-05T15:42:38.403 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 +310us[ +320us] +/- 63ms 2023-10-05T15:42:38.403 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +17us[ +17us] +/- 69ms 2023-10-05T15:42:38.404 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:42:38.409 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:42:38.410 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-05T15:42:38.410 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 -447us[ -447us] +/- 89ms 2023-10-05T15:42:38.410 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 +340us[ +357us] +/- 63ms 2023-10-05T15:42:38.410 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +29us[ +29us] +/- 69ms 2023-10-05T15:42:38.410 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:42:38.412 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:42:38.412 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-10-05T15:42:38.412 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 -498us[ -495us] +/- 89ms 2023-10-05T15:42:38.412 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 +309us[ +312us] +/- 63ms 2023-10-05T15:42:38.413 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +7998ns[ +11us] +/- 69ms 2023-10-05T15:42:38.413 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:42:38.413 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-05T15:42:38.426 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-05T15:42:38.426 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-05T15:42:38.454 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T15:42:38.609 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T15:42:38.767 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T15:42:38.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T15:42:39.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:42:39.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T15:42:39.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:42:39.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T15:42:39.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:42:39.081 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-05T15:42:39.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-05T15:42:39.104 INFO:teuthology.task.internal:Duration was 2914.750462 seconds 2023-10-05T15:42:39.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-05T15:42:39.115 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-05T15:42:39.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T15:42:39.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T15:42:39.120 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T15:42:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T15:42:39.203 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T15:42:39.222 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T15:42:39.463 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-05T15:42:39.463 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2023-10-05T15:42:39.463 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T15:42:39.490 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-10-05T15:42:39.490 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T15:42:39.520 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-10-05T15:42:39.520 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T15:42:39.565 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-05T15:42:39.566 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T15:42:39.568 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T15:42:39.571 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T15:42:39.674 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-05T15:42:39.674 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T15:42:39.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T15:42:39.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T15:42:39.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-05T15:42:39.851 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-05T15:42:39.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T15:42:39.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T15:42:39.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T15:42:39.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-05T15:42:40.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T15:42:40.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T15:42:40.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T15:42:40.041 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-10-05T15:42:40.064 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-10-05T15:42:40.075 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2023-10-05T15:42:40.093 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T15:42:40.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:42:40.109 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T15:42:40.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:42:40.128 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T15:42:40.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:42:40.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-05T15:42:40.156 INFO:teuthology.task.internal:Transferring archived files... 2023-10-05T15:42:40.157 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi060 2023-10-05T15:42:40.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T15:42:40.200 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi092 2023-10-05T15:42:40.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T15:42:40.245 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969/remote/smithi135 2023-10-05T15:42:40.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T15:42:40.286 INFO:teuthology.task.internal:Removing archive directory... 2023-10-05T15:42:40.287 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T15:42:40.289 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T15:42:40.291 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T15:42:40.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-05T15:42:40.351 INFO:teuthology.task.internal:Not uploading archives. 2023-10-05T15:42:40.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-05T15:42:40.363 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-05T15:42:40.363 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T15:42:40.365 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T15:42:40.367 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T15:42:40.380 INFO:teuthology.orchestra.run.smithi060.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 15:42 /home/ubuntu/cephtest 2023-10-05T15:42:40.383 INFO:teuthology.orchestra.run.smithi092.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 15:42 /home/ubuntu/cephtest 2023-10-05T15:42:40.394 INFO:teuthology.orchestra.run.smithi135.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 15:42 /home/ubuntu/cephtest 2023-10-05T15:42:40.395 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-05T15:42:40.407 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-05T15:42:40.433 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T15:42:40.460 DEBUG:teuthology.nuke:shortname: smithi060 2023-10-05T15:42:40.460 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T15:42:40.486 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-05T15:42:40.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T15:42:40.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:48:44.149463', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T15:42:40.508 DEBUG:teuthology.nuke:shortname: smithi135 2023-10-05T15:42:40.508 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T15:42:40.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:48:44.146424', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T15:42:40.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:48:44.148153', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T15:42:40.539 INFO:teuthology.orchestra.console.smithi060:Power off 2023-10-05T15:42:40.539 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T15:42:40.579 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-05T15:42:40.580 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T15:42:40.594 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-05T15:42:40.594 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T15:42:40.646 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-10-05T15:42:40.646 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:40.654 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-05T15:42:40.655 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:40.662 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-05T15:42:40.662 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:40.670 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-05T15:42:40.677 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-05T15:42:40.683 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-05T15:42:44.671 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:44.679 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:44.685 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:44.781 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-05T15:42:44.787 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-05T15:42:44.794 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-05T15:42:48.782 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:48.790 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:48.796 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:48.892 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-10-05T15:42:48.899 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-05T15:42:48.904 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-05T15:42:48.993 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-10-05T15:42:52.902 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:52.909 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T15:42:53.012 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-05T15:42:53.019 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-05T15:42:53.113 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-05T15:42:53.120 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-05T15:42:53.224 INFO:teuthology.run:Summary data: description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} duration: 2914.7504618167877 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2023-10-05T15:42:53.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T15:42:53.300 INFO:teuthology.run:FAIL